EPICS Controls Argonne National Laboratory

Experimental Physics and
Industrial Control System

1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021  <20222023  2024  Index 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021  <20222023  2024 
<== Date ==> <== Thread ==>

Subject: RE: NDCodec Compression Factor
From: "Smith, William via Tech-talk" <tech-talk at aps.anl.gov>
To: Mark Rivers <rivers at cars.uchicago.edu>, "tech-talk at aps.anl.gov" <tech-talk at aps.anl.gov>
Date: Tue, 22 Mar 2022 13:13:30 +0000

Ah ha! The noise parameter in my sim was non-zero as you suggest and playing with it shows that the compression factor I can achieve is dependant on it. Attempts with real images bear similar results.

 

Thanks for clarifying this for me,

 

Will

 

From: Mark Rivers <rivers at cars.uchicago.edu>
Sent: Tuesday, March 22, 2022 2:11 PM
To: tech-talk at aps.anl.gov; Smith, William <william.smith at helmholtz-berlin.de>
Subject: Re: NDCodec Compression Factor

 

Hi Will,

 

Note that the current location of the documentation is here: https://areadetector.github.io/master/ADCore/NDPluginCodec.html

 

Please send screenshots of your simDetector configuration, e.g. simDetector.adl and simDetectorSetup.adl.  The performance you are seeing would be consistent with a non-zero value of the Noise parameter.

 

Mark

 

 

 


From: Tech-talk <tech-talk-bounces at aps.anl.gov> on behalf of Smith, William via Tech-talk <tech-talk at aps.anl.gov>
Sent: Tuesday, March 22, 2022 2:03 AM
To: tech-talk at aps.anl.gov <tech-talk at aps.anl.gov>
Subject: NDCodec Compression Factor

 

Hi,

 

I have been revisiting using the NDCodec plugin in areaDetector. I noticed that when I try to repeat the example shown here https://cars9.uchicago.edu/software/epics/NDPluginCodec.html under “Screen Shots” with the following parameters plugin

 

#NDCodecConfigure(const char *portName, int queueSize, int blockingCallbacks, const char *NDArrayPort, int NDArrayAddr, int maxBuffers, size_t maxMemory, int priority, int stackSize)

 

NDCodecConfigure("CODEC1", 20, 0, "SIM1", 0, 0, 0, 0, 0, 5)

 

With the same settings as is shows in the example:

 

Compressor: Blosc

Blosc Compressor: ZSTD

Blosc Comp. Level: 5

Blosc Shuffle: Bit

Blosc num threads: 6

 

I can only achieve compression of something like 1.3 not 151.35 as is shown in the example. What might I be doing wrong?

 

If I use JPEG compression I can achieve higher compression ratios, e.g with JPEG quality set to 10 I get compression factor of 81.5. With anything other than JPEG, for all combinations of settings I get roughly the same compression factor between 1 and 2.

 

The input image is coming from the sim detector. I am using a 1024x 1024 image of UInt8 which is a single peak centred about (500,500).

 

There is no codec error shown. I get no error in the ioc shell.

 

Many thanks,

 

Will

 

 



 



Helmholtz-Zentrum Berlin für Materialien und Energie GmbH

Mitglied der Hermann von Helmholtz-Gemeinschaft Deutscher Forschungszentren e.V.

Aufsichtsrat: Vorsitzender Dr. Volkmar Dietz, stv. Vorsitzende Dr. Jutta Koch-Unterseher
Geschäftsführung: Prof. Dr. Bernd Rech, Thomas Frederking

Sitz Berlin, AG Charlottenburg, 89 HRB 5583

Postadresse:
Hahn-Meitner-Platz 1
14109 Berlin
Deutschland




Helmholtz-Zentrum Berlin für Materialien und Energie GmbH

Mitglied der Hermann von Helmholtz-Gemeinschaft Deutscher Forschungszentren e.V.

Aufsichtsrat: Vorsitzender Dr. Volkmar Dietz, stv. Vorsitzende Dr. Jutta Koch-Unterseher
Geschäftsführung: Prof. Dr. Bernd Rech, Thomas Frederking

Sitz Berlin, AG Charlottenburg, 89 HRB 5583

Postadresse:
Hahn-Meitner-Platz 1
14109 Berlin
Deutschland

Replies:
Re: NDCodec Compression Factor Mark Rivers via Tech-talk
References:
NDCodec Compression Factor Smith, William via Tech-talk
Re: NDCodec Compression Factor Mark Rivers via Tech-talk

Navigate by Date:
Prev: Re: NDCodec Compression Factor Mark Rivers via Tech-talk
Next: Re: NDCodec Compression Factor Mark Rivers via Tech-talk
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021  <20222023  2024 
Navigate by Thread:
Prev: Re: NDCodec Compression Factor Mark Rivers via Tech-talk
Next: Re: NDCodec Compression Factor Mark Rivers via Tech-talk
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021  <20222023  2024 
ANJ, 14 Sep 2022 Valid HTML 4.01! · Home · News · About · Base · Modules · Extensions · Distributions · Download ·
· Search · EPICS V4 · IRMIS · Talk · Bugs · Documents · Links · Licensing ·