Argonne National Laboratory

Experimental Physics and
Industrial Control System

1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  <20192020  Index 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  <20192020 
<== Date ==> <== Thread ==>

Subject: RE: Weird stream device behavior when using the IOC shell's exit function
From: Abdalla Ahmad via Tech-talk <tech-talk@aps.anl.gov>
To: Mark Rivers <rivers@cars.uchicago.edu>
Cc: "tech-talk@aps.anl.gov" <tech-talk@aps.anl.gov>
Date: Tue, 5 Feb 2019 11:53:55 +0000

Hi Mark

 

No command available which starts with asyn. I cloned the latest asyn from github with the same behavior.

For the gdb part, attached is the stack trace from gdb for all pending threads.

 

Best Regards,

Abdalla.

 

From: Mark Rivers [mailto:rivers@cars.uchicago.edu]
Sent: Monday, February 04, 2019 4:52 PM
To: Abdalla Ahmad <abdalla.ahmad@sesame.org.jo>
Cc: tech-talk@aps.anl.gov
Subject: RE: Weird stream device behavior when using the IOC shell's exit function

 

At the iocsh prompt when the IOC is still running type the command

 

help

 

It should show a complete list of commands that the iocsh understands.  See which ones start with “asyn”.

 

Mark

 

 

From: Abdalla Ahmad <abdalla.ahmad@sesame.org.jo>
Sent: Monday, February 4, 2019 8:44 AM
To: Mark Rivers <
rivers@cars.uchicago.edu>
Cc:
tech-talk@aps.anl.gov
Subject: Re: Weird stream device behavior when using the IOC shell's exit function

 

Hello Mark

I will apply the gdb tip and get back to you. For the asyn commands, I don't see any asyn command when I type exit.

 

On Mon, Feb 4, 2019 at 4:33 PM +0200, "Mark Rivers" <rivers@cars.uchicago.edu> wrote:

Hi Abdalla,
 
> asynError in write. Asyn driver says: device:port disconnected.
 
During IOC shutdown asyn does close all TCP ports.  However, record processing should have already been shut down, so I don't understand why you are getting that message from Stream.
 
Another problem we are facing with this new setup is that I can't find some asyn IOC shell function like asynTraceMask for example. The IOC is configured properly in RELEASE and src/Makefile. Is there anything we miss in the new setup?
 
> But eventually the IOC exits. For the gamma controllers we get something really strange. 
> There a point in the database where the IOC never exits, the exit command just freezes and Ctrl-C is the only way to shut down the IOC.
 
I don't think I have seen that with Stream on any version of Stream/asyn/base that I have used.  That includes base 3.14.12, 3.15.5, 7.0.2.
 
If you run the IOC with gdb then when you type exit and it hangs do the following:
 
- Type Ctrl-C
- Enter the gdb command
thread apply all bt
 
That will show you the current stack trace for all threads.  You can then see what is blocking the threads.
 
> Another problem we are facing with this new setup is that I can't find some asyn IOC shell function like asynTraceMask for example. 
> The IOC is configured properly in RELEASE and src/Makefile. Is there anything we miss in the new setup?
 
The command is not "asynTraceMask" it is "asynSetTraceMask" or "asynSetTraceIOMask".  
 
What asyn commands do you see if you type "help" at the iocsh prompt?
 
Mark
 
________________________________________
From: tech-talk-bounces@aps.anl.gov  on behalf of Abdalla Ahmad via Tech-talk 
Sent: Monday, February 4, 2019 1:41 AM
To: tech-talk@aps.anl.gov
Subject: Weird stream device behavior when using the IOC shell's exit function 
 
Hi
 
We are using the following setup to test control of the agilent XGS gauge controllers and Gamma ion pump controllers:
1.       EPICS Base 3.15.6
2.       Asyn R4-33
3.       Stream R2-7-7c
 
For agilent controllers we get the following error:
 
asynError in write. Asyn driver says: device:port disconnected.
 
But eventually the IOC exits. For the gamma controllers we get something really strange. There a point in the database where the IOC never exits, the exit command just freezes and Ctrl-C is the only way to shut down the IOC. For now I can see that this behavior occurs because more DB substitutions are configured which means more PVs and more controllers. But that was not the case when we had:
1.       EPICS Base 3.14.12.3
2.       Asyn R4-18
3.       Stream R2-5-1
 
Where the IOC exits with no errors or freezing. Should we upgrade our support modules or change the EPICS base?
 
Another problem we are facing with this new setup is that I can't find some asyn IOC shell function like asynTraceMask for example. The IOC is configured properly in RELEASE and src/Makefile. Is there anything we miss in the new setup?
 
Best Regards,
 
Abdalla Ahmad
Control Engineer
SESAME
Allan, Jordan.
Tel: (+962-5) 3511348 , ext. 265
Fax: (+962-5) 3511423
Mob: (+962-7)88183296
http://www.sesame.org.jo/
 
epics> exit
[Thread 0x7fffcfbfc700 (LWP 29193) exited]
[Thread 0x7fffed842700 (LWP 29174) exited]
[Thread 0x7fffed2be700 (LWP 29179) exited]
^C
Program received signal SIGINT, Interrupt.
0x00007ffff5d3351d in __lll_lock_wait () from /lib64/libpthread.so.0
(gdb) thread apply all bt

Thread 40 (Thread 0x7fffcf1f5700 (LWP 29201)):
#0  0x00007ffff6040a5b in recv () from /lib64/libc.so.6
#1  0x00007ffff70635ca in camsgtask (pParm=0x7fffe4000f48) at ../../../src/ioc/rsrv/camsgtask.c:72
#2  0x00007ffff6b6f7fc in start_routine (arg=0x7fffd8006880) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#3  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#4  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 39 (Thread 0x7fffcf2f6700 (LWP 29200)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x7fffd8006310) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff703cbbc in event_task (pParm=0x7fffd8004630) at ../../../src/ioc/db/dbEvent.c:1007
#4  0x00007ffff6b6f7fc in start_routine (arg=0x7fffd80064d0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 38 (Thread 0x7fffcf3f7700 (LWP 29198)):
#0  0x00007ffff6040ac3 in recvfrom () from /lib64/libc.so.6
#1  0x00007ffff6ddee9d in udpRecvThread::run (this=0x7fffe8021098) at ../udpiiu.cpp:380
#2  0x00007ffff6b69bf9 in epicsThreadCallEntryPoint (pPvt=0x7fffe80210b8) at ../../../src/libCom/osi/epicsThread.cpp:83
#3  0x00007ffff6b6f7fc in start_routine (arg=0x7fffe8021330) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 37 (Thread 0x7fffcf4f8700 (LWP 29197)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x7fffe8010110, timeout=0.026995762999999999) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff6b6aefc in epicsEvent::wait (this=this@entry=0x7fffe800fee0, timeOut=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:75
#3  0x00007ffff6b7a6ef in timerQueueActive::run (this=0x7fffe800fe20) at ../../../src/libCom/timer/timerQueueActive.cpp:95
#4  0x00007ffff6b69bf9 in epicsThreadCallEntryPoint (pPvt=0x7fffe800fef0) at ../../../src/libCom/osi/epicsThread.cpp:83
#5  0x00007ffff6b6f7fc in start_routine (arg=0x7fffe8010340) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#6  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#7  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 36 (Thread 0x7fffcf6f9700 (LWP 29196)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x7fffe800f860) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6aeac in epicsEvent::wait (this=this@entry=0x7fffe800f710) at ../../../src/libCom/osi/epicsEvent.cpp:66
#3  0x00007ffff6b67ca2 in (anonymous namespace)::ipAddrToAsciiGlobal::run (this=0x7fffe800f2d0) at ../../../src/libCom/misc/ipAddrToAsciiAsynchronous.cpp:304
#4  0x00007ffff6b69bf9 in epicsThreadCallEntryPoint (pPvt=0x7fffe800f720) at ../../../src/libCom/osi/epicsThread.cpp:83
#5  0x00007ffff6b6f7fc in start_routine (arg=0x7fffe800fa90) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#6  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#7  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 35 (Thread 0x7fffcf8fa700 (LWP 29195)):
#0  0x00007ffff6040a5b in recv () from /lib64/libc.so.6
#1  0x00007ffff70635ca in camsgtask (pParm=0x7fffe4001060) at ../../../src/ioc/rsrv/camsgtask.c:72
#2  0x00007ffff6b6f7fc in start_routine (arg=0x7fffd8005d00) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#3  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#4  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 34 (Thread 0x7fffcf9fb700 (LWP 29194)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x7fffd80057d0) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff703cbbc in event_task (pParm=0x7fffd8004eb0) at ../../../src/ioc/db/dbEvent.c:1007
#4  0x00007ffff6b6f7fc in start_routine (arg=0x7fffd8005990) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6
---Type <return> to continue, or q <return> to quit---

Thread 32 (Thread 0x7fffec0b4700 (LWP 29192)):
#0  0x00007ffff600656d in nanosleep () from /lib64/libc.so.6
#1  0x00007ffff6b70828 in epicsThreadSleep (seconds=seconds@entry=15) at ../../../src/libCom/osi/os/posix/osdThread.c:715
#2  0x00007ffff7068bab in rsrv_online_notify_task (pParm=<optimized out>) at ../../../src/ioc/rsrv/online_notify.c:99
#3  0x00007ffff6b6f7fc in start_routine (arg=0x740370) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 31 (Thread 0x7fffcfcfd700 (LWP 29191)):
#0  0x00007ffff6040ac3 in recvfrom () from /lib64/libc.so.6
#1  0x00007ffff7068776 in cast_server (pParm=<optimized out>) at ../../../src/ioc/rsrv/cast_server.c:167
#2  0x00007ffff6b6f7fc in start_routine (arg=0x740010) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#3  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#4  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 30 (Thread 0x7fffcfdfe700 (LWP 29190)):
#0  0x00007ffff604085d in accept () from /lib64/libc.so.6
#1  0x00007ffff6b6e0ab in epicsSocketAccept (sock=sock@entry=18, pAddr=pAddr@entry=0x7fffcfdfddf0, addrlen=addrlen@entry=0x7fffcfdfdde0)
    at ../../../src/libCom/osi/os/posix/osdSock.c:98
#2  0x00007ffff70633e2 in req_server (pParm=<optimized out>) at ../../../src/ioc/rsrv/caservertask.c:91
#3  0x00007ffff6b6f7fc in start_routine (arg=0x73fcb0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 29 (Thread 0x7fffcffff700 (LWP 29189)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x73e710, timeout=0.099927225999999994) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff7039aab in periodicTask (arg=0x73e640) at ../../../src/ioc/db/dbScan.c:759
#3  0x00007ffff6b6f7fc in start_routine (arg=0x737c60) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 28 (Thread 0x7fffec2b5700 (LWP 29188)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x73e5d0, timeout=0.199926571) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff7039aab in periodicTask (arg=0x743240) at ../../../src/ioc/db/dbScan.c:759
#3  0x00007ffff6b6f7fc in start_routine (arg=0x79a8d0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 27 (Thread 0x7fffec4b6700 (LWP 29187)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x7431d0, timeout=0.499901712) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff7039aab in periodicTask (arg=0x743100) at ../../../src/ioc/db/dbScan.c:759
#3  0x00007ffff6b6f7fc in start_routine (arg=0x79a570) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 26 (Thread 0x7fffec6b7700 (LWP 29186)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x743090, timeout=0.99980082400000003) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff7039aab in periodicTask (arg=0x742fc0) at ../../../src/ioc/db/dbScan.c:759
#3  0x00007ffff6b6f7fc in start_routine (arg=0x79a210) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 25 (Thread 0x7fffec8b8700 (LWP 29185)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x742f50, timeout=1.999908692) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
---Type <return> to continue, or q <return> to quit---
#2  0x00007ffff7039aab in periodicTask (arg=0x742e80) at ../../../src/ioc/db/dbScan.c:759
#3  0x00007ffff6b6f7fc in start_routine (arg=0x799e70) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 24 (Thread 0x7fffecab9700 (LWP 29184)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x7a4440, timeout=4.9996461959999996) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff7039aab in periodicTask (arg=0x7a4370) at ../../../src/ioc/db/dbScan.c:759
#3  0x00007ffff6b6f7fc in start_routine (arg=0x799b10) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 23 (Thread 0x7fffeccba700 (LWP 29183)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x7a4300, timeout=9.9999414059999996) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff7039aab in periodicTask (arg=0x7a4230) at ../../../src/ioc/db/dbScan.c:759
#3  0x00007ffff6b6f7fc in start_routine (arg=0x7997b0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 22 (Thread 0x7fffecebb700 (LWP 29182)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x73e7b0) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff7039980 in onceTask (arg=<optimized out>) at ../../../src/ioc/db/dbScan.c:661
#4  0x00007ffff6b6f7fc in start_routine (arg=0x73e820) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 21 (Thread 0x7fffecfbc700 (LWP 29181)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x735810, timeout=1.7976931348623157e+308) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff6b6aefc in epicsEvent::wait (this=this@entry=0x7355e0, timeOut=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:75
#3  0x00007ffff6b7a6ef in timerQueueActive::run (this=0x735520) at ../../../src/libCom/timer/timerQueueActive.cpp:95
#4  0x00007ffff6b69bf9 in epicsThreadCallEntryPoint (pPvt=0x7355f0) at ../../../src/libCom/osi/epicsThread.cpp:83
#5  0x00007ffff6b6f7fc in start_routine (arg=0x735a40) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#6  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#7  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 20 (Thread 0x7fffed0bd700 (LWP 29180)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x722f70, timeout=9.9806791550000007) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff6b6aefc in epicsEvent::wait (this=this@entry=0x722d40, timeOut=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:75
#3  0x00007ffff6b7a6ef in timerQueueActive::run (this=0x722c80) at ../../../src/libCom/timer/timerQueueActive.cpp:95
#4  0x00007ffff6b69bf9 in epicsThreadCallEntryPoint (pPvt=0x722d50) at ../../../src/libCom/osi/epicsThread.cpp:83
#5  0x00007ffff6b6f7fc in start_routine (arg=0x7231a0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#6  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#7  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 18 (Thread 0x7fffed4bf700 (LWP 29178)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x71e4a0) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff704365e in callbackTask (arg=<optimized out>) at ../../../src/ioc/db/callback.c:168
#4  0x00007ffff6b6f7fc in start_routine (arg=0x7223a0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 17 (Thread 0x7fffed6c0700 (LWP 29177)):
---Type <return> to continue, or q <return> to quit---
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x71a240) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff704365e in callbackTask (arg=<optimized out>) at ../../../src/ioc/db/callback.c:168
#4  0x00007ffff6b6f7fc in start_routine (arg=0x71e140) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 16 (Thread 0x7ffff54a8700 (LWP 29176)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x715b40) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff704365e in callbackTask (arg=<optimized out>) at ../../../src/ioc/db/callback.c:168
#4  0x00007ffff6b6f7fc in start_routine (arg=0x71a130) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 15 (Thread 0x7fffed7c1700 (LWP 29175)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x712090, timeout=1.7976931348623157e+308) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff6b6aefc in epicsEvent::wait (this=this@entry=0x7156f0, timeOut=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:75
#3  0x00007ffff6b7a6ef in timerQueueActive::run (this=0x715630) at ../../../src/libCom/timer/timerQueueActive.cpp:95
#4  0x00007ffff6b69bf9 in epicsThreadCallEntryPoint (pPvt=0x715700) at ../../../src/libCom/osi/epicsThread.cpp:83
#5  0x00007ffff6b6f7fc in start_routine (arg=0x715a20) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#6  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#7  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 13 (Thread 0x7fffed943700 (LWP 29173)):
#0  0x00007ffff6034f0d in poll () from /lib64/libc.so.6
#1  0x00007ffff7926c14 in readIt (drvPvt=0x70eb30, pasynUser=0x79e4a8, data=0x70fd40 ">", maxchars=2048, nbytesTransfered=0x7fffed942ba0, gotEom=0x7fffed942b90)
    at ../../asyn/drvAsynSerial/drvAsynIPPort.c:726
#2  0x00007ffff7930886 in readIt (drvPvt=0x70fbb0, pasynUser=0x79e4a8, data=0x70fd40 ">", maxchars=<optimized out>, nbytesTransfered=0x7fffed942ba0, eomReason=0x7fffed942b90)
    at ../../asyn/interfaces/asynOctetBase.c:233
#3  0x00007ffff793a563 in readIt (ppvt=0x70fcb0, pasynUser=0x79e4a8, data=0x79e3a8 ">", maxchars=63, nbytesTransfered=0x7fffed942ca0, eomReason=0x7fffed942c70)
    at ../../asyn/miscellaneous/asynInterposeEos.c:231
#4  0x00007ffff7bab5f5 in AsynDriverInterface::readHandler (this=this@entry=0x79e2e0) at ../AsynDriverInterface.cc:960
#5  0x00007ffff7bacd08 in handleRequest (pasynUser=<optimized out>) at ../AsynDriverInterface.cc:1503
#6  0x00007ffff791c9f3 in portThread (pport=0x70ece0) at ../../asyn/asynDriver/asynManager.c:902
#7  0x00007ffff6b6f7fc in start_routine (arg=0x70f290) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#8  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#9  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 12 (Thread 0x7fffeda44700 (LWP 29172)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x70d520) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff791c40c in portThread (pport=0x70d050) at ../../asyn/asynDriver/asynManager.c:788
#4  0x00007ffff6b6f7fc in start_routine (arg=0x70d590) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 11 (Thread 0x7fffedb45700 (LWP 29171)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x70b860) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff791c40c in portThread (pport=0x70b390) at ../../asyn/asynDriver/asynManager.c:788
#4  0x00007ffff6b6f7fc in start_routine (arg=0x70b8d0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

---Type <return> to continue, or q <return> to quit---
Thread 10 (Thread 0x7fffedc46700 (LWP 29170)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x709ba0) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff791c40c in portThread (pport=0x7096d0) at ../../asyn/asynDriver/asynManager.c:788
#4  0x00007ffff6b6f7fc in start_routine (arg=0x709c10) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 9 (Thread 0x7fffedd47700 (LWP 29169)):
#0  0x00007ffff6034f0d in poll () from /lib64/libc.so.6
#1  0x00007ffff7926c14 in readIt (drvPvt=0x707800, pasynUser=0x788f38, data=0x708910 "\002\201\070\064\062\060  0.0E+00", maxchars=2048, nbytesTransfered=0x7fffedd46ba0, 
    gotEom=0x7fffedd46b90) at ../../asyn/drvAsynSerial/drvAsynIPPort.c:726
#2  0x00007ffff7930886 in readIt (drvPvt=0x705af0, pasynUser=0x788f38, data=0x708910 "\002\201\070\064\062\060  0.0E+00", maxchars=<optimized out>, 
    nbytesTransfered=0x7fffedd46ba0, eomReason=0x7fffedd46b90) at ../../asyn/interfaces/asynOctetBase.c:233
#3  0x00007ffff793a563 in readIt (ppvt=0x708880, pasynUser=0x788f38, data=0x788e4a "", maxchars=63, nbytesTransfered=0x7fffedd46ca0, eomReason=0x7fffedd46c70)
    at ../../asyn/miscellaneous/asynInterposeEos.c:231
#4  0x00007ffff7bab5f5 in AsynDriverInterface::readHandler (this=this@entry=0x788d70) at ../AsynDriverInterface.cc:960
#5  0x00007ffff7bacd08 in handleRequest (pasynUser=<optimized out>) at ../AsynDriverInterface.cc:1503
#6  0x00007ffff791c9f3 in portThread (pport=0x707a10) at ../../asyn/asynDriver/asynManager.c:902
#7  0x00007ffff6b6f7fc in start_routine (arg=0x707f50) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#8  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#9  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 8 (Thread 0x7fffede48700 (LWP 29168)):
#0  0x00007ffff6034f0d in poll () from /lib64/libc.so.6
#1  0x00007ffff7926c14 in readIt (drvPvt=0x705b40, pasynUser=0x78aa68, data=0x706c50 "\002\201\070\062\062\060  4.4E-09", maxchars=2048, nbytesTransfered=0x7fffede47ba0, 
    gotEom=0x7fffede47b90) at ../../asyn/drvAsynSerial/drvAsynIPPort.c:726
#2  0x00007ffff7930886 in readIt (drvPvt=0x6c7360, pasynUser=0x78aa68, data=0x706c50 "\002\201\070\062\062\060  4.4E-09", maxchars=<optimized out>, 
    nbytesTransfered=0x7fffede47ba0, eomReason=0x7fffede47b90) at ../../asyn/interfaces/asynOctetBase.c:233
#3  0x00007ffff793a563 in readIt (ppvt=0x706bc0, pasynUser=0x78aa68, data=0x78a97a "", maxchars=63, nbytesTransfered=0x7fffede47ca0, eomReason=0x7fffede47c70)
    at ../../asyn/miscellaneous/asynInterposeEos.c:231
#4  0x00007ffff7bab5f5 in AsynDriverInterface::readHandler (this=this@entry=0x78a8a0) at ../AsynDriverInterface.cc:960
#5  0x00007ffff7bacd08 in handleRequest (pasynUser=<optimized out>) at ../AsynDriverInterface.cc:1503
#6  0x00007ffff791c9f3 in portThread (pport=0x705d50) at ../../asyn/asynDriver/asynManager.c:902
#7  0x00007ffff6b6f7fc in start_routine (arg=0x706290) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#8  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#9  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 7 (Thread 0x7fffedf49700 (LWP 29167)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x6c7a90) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
#3  0x00007ffff791c40c in portThread (pport=0x6c75c0) at ../../asyn/asynDriver/asynManager.c:788
#4  0x00007ffff6b6f7fc in start_routine (arg=0x6c7b00) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 6 (Thread 0x7ffff7ed7700 (LWP 29166)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x7fffe0000a10, timeout=timeout@entry=6) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff6b77cb4 in twdTask (arg=<optimized out>) at ../../../src/libCom/taskwd/taskwd.c:125
#3  0x00007ffff6b6f7fc in start_routine (arg=0x7fffe0000af0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#4  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#5  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 5 (Thread 0x7fffee67d700 (LWP 29165)):
#0  0x00007ffff5d30995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b71f3b in epicsEventWait (pevent=0x6c5270) at ../../../src/libCom/osi/os/posix/osdEvent.c:103
#2  0x00007ffff6b6b029 in epicsEventMustWait (id=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:125
---Type <return> to continue, or q <return> to quit---
#3  0x00007ffff791c40c in portThread (pport=0x6c4240) at ../../asyn/asynDriver/asynManager.c:788
#4  0x00007ffff6b6f7fc in start_routine (arg=0x6c52e0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#5  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#6  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 4 (Thread 0x7fffee77e700 (LWP 29164)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x6f2680, timeout=1.7976931348623157e+308) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff6b6aefc in epicsEvent::wait (this=this@entry=0x6f2450, timeOut=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:75
#3  0x00007ffff6b7a6ef in timerQueueActive::run (this=0x6f2390) at ../../../src/libCom/timer/timerQueueActive.cpp:95
#4  0x00007ffff6b69bf9 in epicsThreadCallEntryPoint (pPvt=0x6f2460) at ../../../src/libCom/osi/epicsThread.cpp:83
#5  0x00007ffff6b6f7fc in start_routine (arg=0x6c3ed0) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#6  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#7  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 3 (Thread 0x7ffff7fd8700 (LWP 29163)):
#0  0x00007ffff5d30d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007ffff6b720b9 in epicsEventWaitWithTimeout (pevent=0x6cedd0, timeout=1.9949870599999999) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
#2  0x00007ffff6b6aefc in epicsEvent::wait (this=this@entry=0x6ee300, timeOut=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:75
#3  0x00007ffff6b7a6ef in timerQueueActive::run (this=0x6ee240) at ../../../src/libCom/timer/timerQueueActive.cpp:95
#4  0x00007ffff6b69bf9 in epicsThreadCallEntryPoint (pPvt=0x6ee310) at ../../../src/libCom/osi/epicsThread.cpp:83
#5  0x00007ffff6b6f7fc in start_routine (arg=0x6f1f40) at ../../../src/libCom/osi/os/posix/osdThread.c:403
#6  0x00007ffff5d2ce25 in start_thread () from /lib64/libpthread.so.0
#7  0x00007ffff603fbad in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x7ffff7fda740 (LWP 29161)):
#0  0x00007ffff5d3351d in __lll_lock_wait () from /lib64/libpthread.so.0
#1  0x00007ffff5d2ee36 in _L_lock_870 () from /lib64/libpthread.so.0
#2  0x00007ffff5d2ed2f in pthread_mutex_lock () from /lib64/libpthread.so.0
#3  0x00007ffff6b71a76 in mutexLock (id=0x70ef60) at ../../../src/libCom/osi/os/posix/osdMutex.c:46
#4  epicsMutexOsdLock (pmutex=0x70ef60) at ../../../src/libCom/osi/os/posix/osdMutex.c:130
#5  0x00007ffff7917e9b in lockPort (pasynUser=0x710668) at ../../asyn/asynDriver/asynManager.c:1741
#6  0x00007ffff7925876 in cleanup (arg=0x70eb30) at ../../asyn/drvAsynSerial/drvAsynIPPort.c:246
#7  0x00007ffff6b65ce3 in epicsExitCallAtExitsPvt (pep=<optimized out>) at ../../../src/libCom/misc/epicsExit.c:95
#8  epicsExitCallAtExits () at ../../../src/libCom/misc/epicsExit.c:113
#9  0x00007ffff6b66088 in epicsExit (status=0) at ../../../src/libCom/misc/epicsExit.c:181
#10 0x000000000040544d in main (argc=<optimized out>, argv=<optimized out>) at ../iocMain.cpp:21
(gdb) 

Replies:
Re: Weird stream device behavior when using the IOC shell's exit function Ralph Lange via Tech-talk
Re: Weird stream device behavior when using the IOC shell's exit function Mark Rivers via Tech-talk
References:
Weird stream device behavior when using the IOC shell's exit function Abdalla Ahmad via Tech-talk
Re: Weird stream device behavior when using the IOC shell's exit function Mark Rivers via Tech-talk
Re: Weird stream device behavior when using the IOC shell's exit function Abdalla Ahmad via Tech-talk
RE: Weird stream device behavior when using the IOC shell's exit function Mark Rivers via Tech-talk

Navigate by Date:
Prev: RE: AsynDriver with delayed and async communication Joao Afonso via Tech-talk
Next: Re: Weird stream device behavior when using the IOC shell's exit function Ralph Lange via Tech-talk
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  <20192020 
Navigate by Thread:
Prev: RE: Weird stream device behavior when using the IOC shell's exit function Mark Rivers via Tech-talk
Next: Re: Weird stream device behavior when using the IOC shell's exit function Ralph Lange via Tech-talk
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  <20192020 
ANJ, 05 Feb 2019 Valid HTML 4.01! · Home · News · About · Base · Modules · Extensions · Distributions · Download ·
· Search · EPICS V4 · IRMIS · Talk · Bugs · Documents · Links · Licensing ·