New 2.3.1 release of EPICS Archiver Appliance

[Sky Brewer via Tech-talk <tech-talk at aps.anl.gov>]

Hi all,

I’d like to announce the 2.3.1 release of the EPICS Archiver Appliance. I’ve set it as prerelease for now as more sites test it.

It includes a large new feature, support for parquet files.

Parquet files (https://parquet.apache.org/) are designed for large data sets with efficient storage and retrieval. The main highlights:

• Support for multiple different compression methods
• Support for ‘predicate push down’, i.e. filter the data at the file before reading it.

There is now an endpoint for updating the storage url of a PV, so you can transition existing PVs from pb files to parquet files one PV and one storage layer at a time. Also included is a command line tool for converting a single file, for testing and an even slower transition of data without needing to pause the pv. The documentation can be found at https://epicsarchiver.readthedocs.io/en/2.3.1/sysadmin/storage_plugins.html 

For those of you interested please test it and give us feedback at https://github.com/archiver-appliance/epicsarchiverap/issues , I am very excited to see how well this feature works.

Best regards,

Sky Brewer 

(ESS)