Experimental Physics and
Industrial Control System

Mark Rivers via Tech-talk <tech-talk at aps.anl.gov> · Tue, 24 Nov 2020 23:18:55 +0000

Hi John,

It looks to me that the problem is that it is looking for a static version of libzmq, and there is only a dynamic version.

In the master branch these are the lines from that Makefile:

ifdef ZMQ_LIB
  zmq_DIR        += $(ZMQ_LIB)
  PROD_LIBS      += zmq
else
  PROD_SYS_LIBS  += zmq
endif

Did you define ZMQ_LIB?   If you don't then it will search for it as a PROD_SYS_LIB, which means it will be fine with only a dynamic library.  I suspect you defined ZMQ_LIB so it is looking for a static version, because you are building statically.

This is what I get when I link.  I am also building statically.  Note that -lzmq is after -Bdynamic, so it finds the shareable version.

/usr/bin/g++ -o eigerDetectorApp -Wl,-Bstatic -L/home/epics/devel/areaDetector-3-10/ADEiger/lib/linux-x86_64 -L/home/epics/devel/areaDetector-3-10/ADEiger/iocs/eigerIOC/lib/linux-x86_64 -L/home/epics/devel/areaDetector-3-10/ADCore/lib/linux-x86_64 -L/home/epics/devel/areaDetector-3-10/ADSupport/lib/linux-x86_64 -L/home/epics/devel/asyn-4-41/lib/linux-x86_64 -L/home/epics/devel/autosave-5-10/lib/linux-x86_64 -L/home/epics/devel/busy-1-7-2/lib/linux-x86_64 -L/home/epics/devel/calc-3-7-3/lib/linux-x86_64 -L/home/epics/devel/devIocStats-3-1-16/lib/linux-x86_64 -L/home/epics/devel/seq-2-2-5/lib/linux-x86_64 -L/home/epics/devel/sscan-2-11-3/lib/linux-x86_64 -L/usr/local/epics-devel/base-7.0.4/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/areaDetector-3-10/ADEiger/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/areaDetector-3-10/ADEiger/iocs/eigerIOC/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/areaDetector-3-10/ADCore/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/areaDetector-3-10/ADSupport/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/asyn-4-41/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/autosave-5-10/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/busy-1-7-2/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/calc-3-7-3/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/devIocStats-3-1-16/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/seq-2-2-5/lib/linux-x86_64 -Wl,-rpath,/home/epics/devel/sscan-2-11-3/lib/linux-x86_64 -Wl,-rpath,/usr/local/epics-devel/base-7.0.4/lib/linux-x86_64           -rdynamic -m64          eigerDetectorApp_registerRecordDeviceDriver.o eigerDetectorAppMain.o   -leigerDetector -lfrozen -lhdf5_hl -lNDPlugin -lADBase -lqsrv -lntndArrayConverter -lnt -lpvDatabase -lpvAccessIOC -lpvAccessCA -lpvAccess -lpvData -lnetCDF -lMagick++ -lcoders -lMagick -ljbig -ljp2 -lbzlib -lpng -lwebp -llcms -lttf -lwmf -lfilters -ltiff -lxml2 -lNeXus -lhdf5 -lhdf5_hl -lbitshuffle -lblosc -lszip -lzlib -ljpeg -lasyn -lautosave -lbusy -lcalc -ldevIocStats -lsscan -lseq -lpv -ldbRecStd -ldbCore -lca -lCom -Wl,-Bdynamic -lzmq -lboost_system -lX11 -lXext -lpthread   -lreadline -lm -lrt -ldl -lgcc

When I run ldd on the eigerDetectorApp executable this is where it is finding libzmq.so

corvette:eigerIOC/eigerApp/src>ldd ../../bin/linux-x86_64/eigerDetectorApp
        linux-vdso.so.1 =>  (0x00007ffe9a3d1000)
        libzmq.so.5 => /lib64/libzmq.so.5 (0x00007f05b31f2000)

What version of Linux are you using?  I am using Centos 7 and I just installed the zmq package.

Mark

________________________________
From: John Dobbins <john.dobbins at cornell.edu>
Sent: Tuesday, November 24, 2020 4:48 PM
To: Mark Rivers; Perez Juarez, Emilio (DLSLtd,RAL,LSCI)
Cc: tech-talk at aps.anl.gov
Subject: Re: ADEiger for EIGER2

New problem:

/usr/bin/g++ -o eigerDetectorApp -Wl,-Bstatic -L/nfs/chess/epics/det/support/areaDetector/ADEiger/lib/linux-x86_64 -L/nfs/chess/epics/det/support/areaDetector/ADEiger/iocs/eigerIOC/lib/linux-x86_64 -L/nfs/chess/epics/det/base-7.0.3/lib/linux-x86_64 -L/nfs/chess/epics/det/support/alive-R1-1-1/lib/linux-x86_64 -L/nfs/chess/epics/det/support/areaDetector/ADCore/lib/linux-x86_64 -L/nfs/chess/epics/det/support/areaDetector/ADSupport/lib/linux-x86_64 -L/nfs/chess/epics/det/support/asyn-R4-40-1/lib/linux-x86_64 -L/nfs/chess/epics/det/support/autosave-R5-10/lib/linux-x86_64 -L/nfs/chess/epics/det/support/busy-R1-7-2/lib/linux-x86_64 -L/nfs/chess/epics/det/support/calc-R3-7-3/lib/linux-x86_64 -L/nfs/chess/epics/det/support/iocStats-3-1-16/lib/linux-x86_64 -L/nfs/chess/epics/det/support/seq-2-2-6/lib/linux-x86_64 -L/nfs/chess/epics/det/support/sscan-R2-11-3/lib/linux-x86_64 -L/nfs/opt/zmq-4.3.1-23.3.x86_64/lib            -rdynamic -m64          eigerDetectorApp_registerRecordDeviceDriver.o eigerDetectorAppMain.o   -leigerDetector -lfrozen -lhdf5_hl -lzmq -lNDPlugin -lADBase -lnetCDF -lMagick++ -lcoders -lMagick -ljbig -ljp2 -lbzlib -lpng -lwebp -llcms -lttf -lwmf -lfilters -ltiff -lxml2 -lNeXus -lhdf5 -lhdf5_hl -lbitshuffle -lblosc -lszip -lzlib -ljpeg -lasyn -lalive -lautosave -lbusy -lcalc -ldevIocStats -lsscan -lseq -lpv -ldbRecStd -ldbCore -lca -lCom -Wl,-Bdynamic -lX11 -lXext -lpthread   -lreadline -lm -lrt -ldl -lgcc

/usr/bin/ld: cannot find -lzmq

but note the flag

-L/nfs/opt/zmq-4.3.1-23.3.x86_64/lib

and

jad22@chess62 $ ls -l /nfs/opt/zmq-4.3.1-23.3.x86_64/lib

lrwxrwxrwx 1 root root     21 Feb  8  2019 libpgm-5.2.so.0 -> libpgm-5.2.so.0.0.122
-rwxr-xr-x 1 root root 303296 Jan 28  2019 libpgm-5.2.so.0.0.122
lrwxrwxrwx 1 root root     21 Feb  8  2019 libpgm.so -> libpgm-5.2.so.0.0.122
lrwxrwxrwx 1 root root     19 Feb  8  2019 libsodium.so -> libsodium.so.18.1.1
lrwxrwxrwx 1 root root     19 Feb  8  2019 libsodium.so.18 -> libsodium.so.18.1.1
-rw-r--r-- 1 root root 421512 Jan  4  2019 libsodium.so.18.1.1
lrwxrwxrwx 1 root root     15 Feb  8  2019 libzmq.so -> libzmq.so.5.2.1
lrwxrwxrwx 1 root root     15 Feb  8  2019 libzmq.so.5 -> libzmq.so.5.2.1
-rwxr-xr-x 1 root root 663568 Jan 28  2019 libzmq.so.5.2.1
drwxr-xr-x 2 root root     22 Apr 24  2019 static

Is it uphappy with the libzmq version?

Does libsodium have to be executable?

Apologies for my ignorance.

John

________________________________
From: Mark Rivers <rivers at cars.uchicago.edu>
Sent: Tuesday, November 24, 2020 3:55 PM
To: John Dobbins <john.dobbins at cornell.edu>; Perez Juarez, Emilio (DLSLtd,RAL,LSCI) <emilio.perez-juarez at diamond.ac.uk>
Cc: tech-talk at aps.anl.gov <tech-talk at aps.anl.gov>
Subject: Re: ADEiger for EIGER2

Hi John,

lz4 and bitshuffle are both provided in ADSupport/supportApp/bitshuffleSrc.  I would strongly recommend using those, and not your system versions.

I don't know why that code for lz4 and bitshuffle was added to eigerApp/src/Makefile.  It should not be needed. I would try deleting it.

Mark

________________________________
From: John Dobbins <john.dobbins at cornell.edu>
Sent: Tuesday, November 24, 2020 1:29 PM
To: Perez Juarez, Emilio (DLSLtd,RAL,LSCI); Mark Rivers
Cc: tech-talk at aps.anl.gov
Subject: Re: ADEiger for EIGER2

Sorry, that got sent prematurely.

________________________________
From: John Dobbins <john.dobbins at cornell.edu>
Sent: Tuesday, November 24, 2020 2:27 PM
To: Perez Juarez, Emilio (DLSLtd,RAL,LSCI) <emilio.perez-juarez at diamond.ac.uk>; Mark Rivers <rivers at cars.uchicago.edu>
Cc: tech-talk at aps.anl.gov <tech-talk at aps.anl.gov>
Subject: Re: ADEiger for EIGER2

I get a build error related to the lz4 library (see below) I poked around and I am confused about where lz4 gets configured. I am using base-7.0.3 , areaDetector-master (is that a problem?)

On out SL7 systems

>locate lz4
/usr/lib/liblz4.so.1
/usr/lib/liblz4.so.1.7.5
/usr/lib64/liblz4.so.1
/usr/lib64/liblz4.so.1.7.5

but I also thought bitshhuffle from ADSupport provides LZ4.

Finally, I see that

areaDetector/ADEiger/eigerApp/src/Makefile contains a section

ifdef LZ4_LIB
  lz4_DIR  += $(LZ4_LIB)
  LIB_LIBS += lz4
  bitshuffle_DIR += $(LZ4_LIB)
  LIB_LIBS       += bitshuffle
else
  LIB_SYS_LIBS  += lz4
  LIB_SYS_LIBS  += bitshuffle
endif

not in other ADEiger installs I have.

John

/usr/bin/g++ -o libeigerDetector.so -shared -fPIC -Wl,-hlibeigerDetector.so -L/nfs/chess/epics/det/support/areaDetector/ADEiger/lib/linux-x86_64 -L/nfs/chess/epics/det/base-7.0.3/lib/linux-x86_64 -L/nfs/chess/epics/det/support/areaDetector/ADCore/lib/linux-x86_64 -L/nfs/chess/epics/det/support/areaDetector/ADSupport/lib/linux-x86_64 -L/nfs/chess/epics/det/support/asyn-R4-40-1/lib/linux-x86_64 -L/nfs/opt/zmq-4.3.1-23.3.x86_64/lib -Wl,-rpath,/nfs/chess/epics/det/support/areaDetector/ADEiger/lib/linux-x86_64 -Wl,-rpath,/nfs/chess/epics/det/base-7.0.3/lib/linux-x86_64 -Wl,-rpath,/nfs/chess/epics/det/support/areaDetector/ADCore/lib/linux-x86_64 -Wl,-rpath,/nfs/chess/epics/det/support/areaDetector/ADSupport/lib/linux-x86_64 -Wl,-rpath,/nfs/chess/epics/det/support/asyn-R4-40-1/lib/linux-x86_64 -Wl,-rpath,/nfs/opt/zmq-4.3.1-23.3.x86_64/lib           -rdynamic -m64          eigerDetector.o restApi.o streamApi.o eigerParam.o   -lzmq -lADBase -lasyn -lnetCDF -lMagick++ -lcoders -lMagick -ljbig -ljp2 -lbzlib -lpng -lwebp -llcms -lttf -lwmf -lfilters -ltiff -lxml2 -lNeXus -lhdf5 -lhdf5_hl -lbitshuffle -lblosc -lszip -lzlib -ljpeg -ldbRecStd -ldbCore -lca -lCom  -llz4 -lbitshuffle -lhdf5_hl -lX11 -lXext -lpthread   -lreadline -lm -lrt -ldl -lgcc
/usr/bin/ld: cannot find -llz4
collect2: error: ld returned 1 exit status

________________________________
From: Perez Juarez, Emilio (DLSLtd,RAL,LSCI) <emilio.perez-juarez at diamond.ac.uk>
Sent: Tuesday, November 24, 2020 11:47 AM
To: John Dobbins <john.dobbins at cornell.edu>; Mark Rivers <rivers at cars.uchicago.edu>
Cc: tech-talk at aps.anl.gov <tech-talk at aps.anl.gov>
Subject: Re: ADEiger for EIGER2

Hi, here's another approach:

$ git clone https://github.com/areaDetector/ADEiger

$ cd ADEiger/

$ git fetch origin pull/30/head:pr-branch

$ git checkout pr-branch

I think this way you get the result of merging to the target branch

Kind Regards,
Emilio
________________________________
From: Tech-talk <tech-talk-bounces at aps.anl.gov> on behalf of Mark Rivers via Tech-talk <tech-talk at aps.anl.gov>
Sent: 24 November 2020 16:33
To: John Dobbins <john.dobbins at cornell.edu>
Cc: tech-talk at aps.anl.gov <tech-talk at aps.anl.gov>
Subject: Re: ADEiger for EIGER2

Hi John,

You can clone the repository issuing that pull request and then checkout that branch:

git clone https://github.com/dls-controls/ADEiger/

cd ADEiger

git checkout 1.8

Mark

________________________________
From: Tech-talk <tech-talk-bounces at aps.anl.gov> on behalf of John Dobbins via Tech-talk <tech-talk at aps.anl.gov>
Sent: Tuesday, November 24, 2020 10:16 AM
To: tech-talk at aps.anl.gov
Subject: ADEiger for EIGER2

All,

I have a new EIGER 2 detector. I understand that this

https://github.com/areaDetector/ADEiger/pull/30

is the appropriate ADEiger for an EIGER 2.  True?

Can someone tell me how to clone this pull?

Thanks,

John Dobbins

Research Support Specialist
Cornell High Energy Synchrotron Source
Cornell University

www.chess.cornell.edu<http://www.chess.cornell.edu<http://www.chess.cornell.edu<http://www.chess.cornell.edu<http://www.chess.cornell.edu<http://www.chess.cornell.edu<http://www.chess.cornell.edu<http://www.chess.cornell.edu>>>

--

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

Experimental Physics and Industrial Control System

Experimental Physics and
Industrial Control System