1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 <2022> 2023 2024 2025 | Index | 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 <2022> 2023 2024 2025 |
<== Date ==> | <== Thread ==> |
---|
Subject: | Epics Archiver Appliance and Network Storage slowdown |
From: | "Manoussakis, Adamandios via Tech-talk" <tech-talk at aps.anl.gov> |
To: | EPICS tech-talk <tech-talk at aps.anl.gov> |
Date: | Thu, 10 Feb 2022 23:11:55 +0000 |
Hello All, I am running into a strange slowdown when using our NAS (red drives) with the archiver for MTS STS LTS folders. We have softlinks for each of the folders in /arch to the NAS MTS STS LTS folders, writing data seems to work perfectly fine
but it is taking 2-3mins to pull a 40MB file from the archiver instead of <30seconds previously when it was local storage. Sometimes this is even causing our application that is pulling the data to timeout due to the long wait time to grab data. I switched
back to local and seems to run at less than 30 seconds a file for the 40MB of data JSON using the same front end application to do the request. We are using the getDataAtTime endpoint to get the JSON with the post including the list of records we want in
JSON. I checked with our IT to see if there was any reason why there would be slowdown over the network but didn’t get any reason why it should. I wrote my own python script just to see if it matched what our application request time was seeing and it matched
about 2min-2.5min per 40MB file. Just wondering if there might be something I am missing to speed this up or is this expected from using NAS with the archiver? Thanks, Adam |