Experimental Physics and
Industrial Control System
| 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 <2021> 2022 2023 2024 | Index | 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 <2021> 2022 2023 2024 |
| <== Date ==> | <== Thread ==> |
|---|
| Subject: | Re: CS-Studio(Phoebus) Archive Viewer Matlab Export Issue |
| From: | bob dalesio via Tech-talk <tech-talk at aps.anl.gov> |
| To: | "Kasemir, Kay" <kasemirk at ornl.gov> |
| Cc: | "tech-talk at aps.anl.gov" <tech-talk at aps.anl.gov> |
| Date: | Fri, 29 Jan 2021 08:41:18 -0500 |
There is another approach for high rate data. It is based on Normative Types in pvAccess that represent ND Arrays, Tables or statistical samples. These are collected into an HDF5 file. A File Manager Service helps to add metadata to allow fast searches and provenance for post analysis data. This work is being done as Beam Synchronous DAQ - but it is basically snapshots. It can also be used for continuous collection where the "snapshot" is at a set frequency and period. It has been demonstrated for scalars at 120 Hz. We do not know the fastest rate this can accomplish with the new Normative Types.
Access libraries are used with machine learning analysis codes (not sure of the language: matlab? python?)
On Fri, Jan 29, 2021 at 8:32 AM Kasemir, Kay via Tech-talk <tech-talk at aps.anl.gov> wrote:
> spreadsheet data shows up just fine..
> matlab files seem to be exporting just a single index per record
Yes, the Matlab export code only handles scalars.In case of array data, you get the first element.
The code in question is this for the Matlab 'text file' *.m exportand this for the Matlab 'binary' *.mat export
In both places you'll see that it calls VTypeHelper.toDouble to try and turn the sample which might be double, enum, int, short, ... into a scalar for export.
You could try to update that code to check for VNumberArray and then export all array elements.
-Kay
- References:
- CS-Studio(Phoebus) Archive Viewer Matlab Export Issue Manoussakis, Adamandios via Tech-talk
- Re: CS-Studio(Phoebus) Archive Viewer Matlab Export Issue Kasemir, Kay via Tech-talk
- Navigate by Date:
- Prev: Re: Areadetector driver for AVT-Marlin Firewire Camera on Windows Malu, Sandeep Kumar (-, RAL, CLF) via Tech-talk
- Next: RE: Areadetector driver for AVT-Marlin Firewire Camera on Windows Mark Rivers via Tech-talk
- Index: 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 <2021> 2022 2023 2024
- Navigate by Thread:
- Prev: Re: CS-Studio(Phoebus) Archive Viewer Matlab Export Issue Kasemir, Kay via Tech-talk
- Next: RE: CS-Studio(Phoebus) Archive Viewer Matlab Export Issue Manoussakis, Adamandios via Tech-talk
- Index: 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 <2021> 2022 2023 2024
·
Home
·
News
·
About
·
Base
·
Modules
·
Extensions
·
Distributions
·
Download
·
· Search · EPICS V4 · IRMIS · Talk · Bugs · Documents · Links · Licensing ·