Re: Epics Archiver Appliance and Network Storage slowdown

["Shankar, Murali via Tech-talk" <tech-talk at aps.anl.gov>]

>> I think for this experiment its only 6000 PVs

I think that should not take this long. Will look into this a bit here as well.

Regards,

Murali

---

From: Shankar, Murali
Sent: Saturday, February 12, 2022 8:03 AM
To: tech-talk at aps.anl.gov <tech-talk at aps.anl.gov>
Subject: Re: Epics Archiver Appliance and Network Storage slowdown

 

>> We are using the getDataAtTime endpoint

>> 40MB file from the archive

By this I'd guess that you are getting data for several 100,000's of PVs? The getDataAtTime API call has to look at all these 100,000 files ( with perhaps cache-misses for most of them ) and then do binary search to determine the data point. Your NAS needs to support quite a high rate of IOPS to for this to come back quickly. And this is a usecase where even the smallest latency tends to accumulate quickly. Perhaps you can consider breaking down your request into smaller chunks when using the NAS? 

Regards,

Murali