Experimental Physics and
Industrial Control System

On 4/27/20 9:04 AM, Ralph Lange wrote:
> On Mon, 27 Apr 2020 at 16:53, Michael Davidsaver <mdavidsaver at gmail.com <mailto:mdavidsaver at gmail.com>> wrote:
> 
>     Back in Feb. I added testImpreciseTiming() to epicsUnitTest.h, and used it
>     in some of the common (apparently) false positives failures.  Starting with
>     epicsEventTest (on 7.0) to mark these tests specific TODO on CI runs.
> 
>     https://github.com/epics-base/epics-base/commit/819b0de65b92d29d2ab26b0a2e36390ba0e17f71
> 
> 
> Sounds good, I will have a look.
> 
>     So having the appveyor tests run with EPICS_TEST_IMPRECISE_TIMING=YES is a
>     first step.
> 
> 
> All tests on all platforms? Just the critical tests, on all platforms? All test on the critical platform? Or just the failing one, just on the critical platform?
> Platform being MacOS on Travis-CI, btw.

The best I can give is a rule of thumb to set EPICS_TEST_IMPRECISE_TIMING=YES
when running tests on a system which is not otherwise idle.
This includes VMs on shared or oversubscribed hosts.

I started with travis and the most common spurious failures in
epicsEventTest + simmTest.  These are tests checking maximum
execution time (epicsEventTest), or having synchronization with
sleeps (simmTest), which are known to cause problems when the
test process doesn't have priority or sufficient idle cycles.

Attachment: signature.asc
Description: OpenPGP digital signature

References:

Base CI tests on MacOS failing Ralph Lange via Core-talk

Re: Base CI tests on MacOS failing Michael Davidsaver via Core-talk

Re: Base CI tests on MacOS failing Ralph Lange via Core-talk

Navigate by Date:

Prev: Build completed: epics-base base-use-ci-scripts-3.15-328 AppVeyor via Core-talk

Next: Re: IOC shell usage messages Johnson, Andrew N. via Core-talk

Index: 2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  <2020>  2021  2022  2023  2024 

Navigate by Thread:

Prev: Re: Base CI tests on MacOS failing Ralph Lange via Core-talk

Next: Build completed: epics-base base-use-ci-scripts-3.15-328 AppVeyor via Core-talk

Index: 2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  <2020>  2021  2022  2023  2024