Experimental Physics and
Industrial Control System

Hi Steve,


> They would however like what I think is a list of separate 2D arrays with the attributes directly connected to each array they are relevant to.

I don't think you can do that via the XML layout file with the existing NDFileHDF5 plugin.  When collecting NumArrays arrays into a single HDF5 file the plugin creates an image array [NX, NY, [NZ, etc.], NumArrays],
and for each attribute a 1-D array [NumArrays].

I believe the NDPosPlugin allows you to fill in those arrays non-sequentially, for example to handle a bi-directional "snake scan", but the array structure is fixed.

The simplest solution would be a post-processing program in Python, etc. that re-structures the array into a new HDF5 file.  The plugin is already fairly complex, so it may not be trivial to add that feature.

Mark


________________________________
From: [email protected] <[email protected]> on behalf of [email protected] <[email protected]>
Sent: Thursday, February 8, 2018 3:15 AM
To: [email protected]
Subject: Data format using NDFileHDF5

I am using the NDFileHDF5 areaDetector plugin to write data and attributes collected from PCO cameras. I've been able to store data and attributes using XML files to define the attributes of interest and the following for the HDF5 layout:

<entry>
  <group name="Data" ndattr_default="true">
    <dataset name="Images" source="detector" det_default="true"></dataset>
  </group>
</entry>

My end user sees this as a 3D data array with separate attributes which seemed fine. They would however like what I think is a list of separate 2D arrays with the attributes directly connected to each array they are relevant to. I've spent some time trying to figure out how to do that via the XML layout file but not got there yet. I will continue but I am beginning to wonder whether I will have to modifiy the plugin source.

In the meantime I wondered whether anyone had an example XML layout file that might help me get the desired structure? Or advice on whether the plugin will need modifying?

Thanks

Steve

Replies:

RE: Data format using NDFileHDF5 ulrik.pedersen

References:

Data format using NDFileHDF5 steve.kinder

Navigate by Date:

Prev: Re: procServ under systemd service Ralph Lange

Next: RE: mca compilation fails on windows 7, keyword re-definition Mark Rivers

Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  <2018>  2019  2020  2021  2022  2023  2024 

Navigate by Thread:

Prev: Data format using NDFileHDF5 steve.kinder

Next: RE: Data format using NDFileHDF5 ulrik.pedersen

Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  <2018>  2019  2020  2021  2022  2023  2024