EPICS Home EPICS Controls Argonne National Laboratory

Experimental Physics and
Industrial Control System

Format page
for printing


Search Tech-talk
1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  <2020>  2021  2022  2023  2024  Index 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  <2020>  2021  2022  2023  2024 
<== Date ==> <== Thread ==>
Subject: Re: Adding a PV to archiver appl, missing something...
From: astrid morreale via Tech-talk <tech-talk at aps.anl.gov>
To: Abdalla Ahmad <Abdalla.Ahmad at sesame.org.jo>
Cc: tech-talk at aps.anl.gov
Date: Sun, 26 Jul 2020 16:15:24 -0600
Thanks a lot Abdalla, I added those ports you suggested and now I am seeing more output in the  logs.

1. the catalina error first warns me(then goes to error) about a memory leak...and threadlocal key?
something should have been cleaned up but I am not sure where these keys are.

2. The arch log file warne me about an access denied  "1818 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=STS&rootFolder=${ARCHAPPL_SHORT_TERM_FOLDER}&partitionGranularity=PARTITION_HOUR&consolidateOnShutdown=true
java.nio.file.AccessDeniedException: /home/arch/sts"

yet this directory should be readable

ls -lrt -h  /home/arch/sts
lrwxrwxrwx 1 tomcat tomcat 43 Jul 20 16:07 /home/arch/sts -> '/run/media/amorreal/Linux ext/archiver/shm/"

Could it be because the simlink points to an external drive?


the two log files are pasted below (from the first warning/error on)

thanks again in advance
Astrid

> more mgmt_catalina.err

Jul 26, 2020 3:58:44 PM org.apache.catalina.loader.WebappClassLoaderBase clearReferencesThreads
WARNING: The web application [mgmt] appears to have started a thread named [Event bus] but has failed to stop it. This is very likely to create a memory leak. Stac
k trace of thread:
 sun.misc.Unsafe.park(Native Method)
 java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
 java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
 java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 java.lang.Thread.run(Thread.java:748)
Jul 26, 2020 3:58:44 PM org.apache.catalina.loader.WebappClassLoaderBase checkThreadLocalMapForLeaks
SEVERE: The web application [mgmt] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@1da78c7c]) and a value of type [org
.python.core.ThreadState] (value [org.python.core.ThreadState@15402cf4]) but failed to remove it when the web application was stopped. Threads are going to be rene
wed over time to try and avoid a probable memory leak.
Jul 26, 2020 3:58:44 PM org.apache.catalina.loader.WebappClassLoaderBase checkThreadLocalMapForLeaks
SEVERE: The web application [mgmt] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@1da78c7c]) and a value of type [org
.python.core.ThreadState] (value [org.python.core.ThreadState@2cd2fdd8]) but failed to remove it when the web application was stopped. Threads are going to be rene
wed over time to try and avoid a probable memory leak.
Jul 26, 2020 3:58:44 PM org.apache.catalina.loader.WebappClassLoaderBase checkThreadLocalMapForLeaks
SEVERE: The web application [mgmt] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@1da78c7c]) and a value of type [org
.python.core.ThreadState] (value [org.python.core.ThreadState@7018c94]) but failed to remove it when the web application was stopped. Threads are going to be renew
ed over time to try and avoid a probable memory leak.
Jul 26, 2020 3:58:44 PM org.apache.coyote.AbstractProtocol stop
INFO: Stopping ProtocolHandler ["http-nio-17665"]
Jul 26, 2020 3:58:44 PM org.apache.coyote.AbstractProtocol destroy
INFO: Destroying ProtocolHandler ["http-nio-17665"]
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Server version name:   Apache Tomcat/9.0.36
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Server built:          Dec 12 1969 11:45:33 UTC
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Server version number: 9.0.36.0
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: OS Name:               Linux
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: OS Version:            5.7.8-200.fc32.x86_64
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Architecture:          amd64
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Java Home:             /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-1.fc32.x86_64/jre
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: JVM Version:           1.8.0_252-b09
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: JVM Vendor:            Oracle Corporation
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: CATALINA_BASE:         /opt/archappl-2020Jul20-1614-27MDT/mgmt
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: CATALINA_HOME:         /usr/share/tomcat
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -XX:MaxMetaspaceSize=256M
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -XX:+UseG1GC
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Xms512M
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Xmx512M
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -ea
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dcatalina.base=/opt/archappl/mgmt
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dcatalina.home=/usr/share/tomcat
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dcommons.daemon.process.id=73885
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dcommons.daemon.process.parent=73884
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dcommons.daemon.version=1.2.2
Jul 26, 2020 3:59:00 PM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: abort
Jul 26, 2020 3:59:00 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: Loaded Apache Tomcat Native library [1.2.23] using APR version [1.7.0].
Jul 26, 2020 3:59:00 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].
Jul 26, 2020 3:59:00 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
Jul 26, 2020 3:59:00 PM org.apache.catalina.core.AprLifecycleListener initializeSSL
INFO: OpenSSL successfully initialized [OpenSSL 1.1.1g FIPS  21 Apr 2020]
Jul 26, 2020 3:59:01 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["http-nio-17665"]
Jul 26, 2020 3:59:01 PM org.apache.catalina.startup.Catalina load
INFO: Server initialization in [1,140] milliseconds
Jul 26, 2020 3:59:01 PM org.apache.catalina.core.StandardService startInternal
--More--(99%)
====================================
>sudo more arch.log

0    [main] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Archiver Appliance Version 0.0.1_master_H649cc2a_B2020Jul15-2234-24MDT_T
5    [main] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  -
18   [main] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - My identity is appliance0 and my mgmt URL is http://10.0.0.78:17665/mgmt/bpl
24   [main] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Loading archappl.properties using the environment/JVM property from /opt/archap
pl/archappl.properties
32   [main] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Done loading installation specific properties file from /opt/archappl/archappl.
properties
177  [main] INFO  config.org.epics.archiverappliance.config.ConvertPVNameToKey  - The pv name components in this installation are separated by these characters [\:
\-] and the key names are terminated by :
10183 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Post startup for MGMT
10444 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Setting my cluster port base to 16670 and using interface 10.0.0.7
8
11698 [Startup executor] INFO  config.org.epics.archiverappliance.config.persistence.MySQLPersistence  - Looking up datasource called jdbc/archappl in the java:/co
mp/env namespace using JDNI
11698 [Startup executor] INFO  config.org.epics.archiverappliance.config.persistence.MySQLPersistence  - Found datasource called jdbc/archappl in the java:/comp/en
v namespace using JDNI
11698 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Loading PVTypeInfo from persistence
11818 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=STS&rootFolder=
${ARCHAPPL_SHORT_TERM_FOLDER}&partitionGranularity=PARTITION_HOUR&consolidateOnShutdown=true
java.nio.file.AccessDeniedException: /home/arch/sts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11820 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=MTS&rootFolder=${ARCHAPPL_MEDIUM_TERM_FOLDER}&par
titionGranularity=PARTITION_DAY&hold=2&gather=1
java.nio.file.AccessDeniedException: /home/arch/mts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11820 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=LTS&rootFolder=${ARCHAPPL_LONG_TERM_FOLDER}&parti
tionGranularity=PARTITION_YEAR
java.nio.file.AccessDeniedException: /home/arch/lts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11821 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=STS&rootFolder=${ARCHAPPL_SHORT_TERM_FOLDER}&part
itionGranularity=PARTITION_HOUR&consolidateOnShutdown=true
java.nio.file.AccessDeniedException: /home/arch/sts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11821 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=MTS&rootFolder=${ARCHAPPL_MEDIUM_TERM_FOLDER}&par
titionGranularity=PARTITION_DAY&hold=2&gather=1
java.nio.file.AccessDeniedException: /home/arch/mts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11822 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=LTS&rootFolder=${ARCHAPPL_LONG_TERM_FOLDER}&parti
tionGranularity=PARTITION_YEAR
java.nio.file.AccessDeniedException: /home/arch/lts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11822 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=STS&rootFolder=${ARCHAPPL_SHORT_TERM_FOLDER}&part
itionGranularity=PARTITION_HOUR&consolidateOnShutdown=true
java.nio.file.AccessDeniedException: /home/arch/sts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11823 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=MTS&rootFolder=${ARCHAPPL_MEDIUM_TERM_FOLDER}&par
titionGranularity=PARTITION_DAY&hold=2&gather=1
java.nio.file.AccessDeniedException: /home/arch/mts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11823 [Startup executor] ERROR org.epics.archiverappliance.config.DefaultConfigService  - Exception parsing storage metrics url pb://localhost?name=LTS&rootFolder=${ARCHAPPL_LONG_TERM_FOLDER}&parti
tionGranularity=PARTITION_YEAR
java.nio.file.AccessDeniedException: /home/arch/lts
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:308)
        at java.nio.file.Files.createDirectories(Files.java:746)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.setRootFolder(PlainPBStoragePlugin.java:497)
        at edu.stanford.slac.archiverappliance.PlainPB.PlainPBStoragePlugin.initialize(PlainPBStoragePlugin.java:385)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parsePlainPBStoragePlugin(StoragePluginURLParser.java:123)
        at org.epics.archiverappliance.config.StoragePluginURLParser.parseETLDest(StoragePluginURLParser.java:103)
        at org.epics.archiverappliance.config.ApplianceAggregateInfo.addInfoForPV(ApplianceAggregateInfo.java:46)
        at org.epics.archiverappliance.config.DefaultConfigService.loadTypeInfosFromPersistence(DefaultConfigService.java:1758)
        at org.epics.archiverappliance.config.DefaultConfigService.postStartup(DefaultConfigService.java:725)
        at org.epics.archiverappliance.mgmt.MgmtPostStartup.run(MgmtPostStartup.java:44)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
11823 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Done loading 3 PVs from persistence into cluster
11823 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Loading aliases from persistence
11824 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Done loading 0 aliases from persistence into cluster
11824 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Loading archive requests from persistence
11825 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Done loading 0 archive pv requests from persistence into cluster
11825 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Loading external servers from persistence
11825 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Done loading external servers from persistence
11831 [Startup executor] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Start complete for webapp MGMT
11831 [Startup executor] INFO  config.org.epics.archiverappliance.mgmt.MgmtPostStartup  - Finished post startup for the mgmt webapp
30432 [http-nio-17665-exec-4] INFO  config.org.epics.archiverappliance.mgmt.WebappReady  - Received webAppReady from RETRIEVAL
30509 [http-nio-17665-exec-5] INFO  config.org.epics.archiverappliance.mgmt.WebappReady  - Received webAppReady from ETL
30988 [http-nio-17665-exec-6] INFO  config.org.epics.archiverappliance.mgmt.WebappReady  - Received webAppReady from ENGINE
32133 [http-nio-17665-exec-6] INFO  config.org.epics.archiverappliance.mgmt.MgmtRuntimeState  - All components in this appliance have started up. We should be ready to start accepting UI request
32134 [http-nio-17665-exec-6] INFO  config.org.epics.archiverappliance.mgmt.MgmtRuntimeState  - Starting archive requests after an initial delay (in s) of 10
86192 [http-nio-17665-exec-5] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Obtained policies location from environment /opt/archappl/ess_policies.py





---current port listing


 >sudo firewall-cmd --direct --get-rules ipv4 filter INPUT
0 -s 10.0.0.0/8 -p udp --sport 5064 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --dport 5065 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --sport 5075 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --dport 5064 -j ACCEPT
0 -s 10.0.0.0/8 -p tcp --dport 5065 -j ACCEPT
0 -s 10.0.0.0/8 -p tcp --dport 5075 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --sport 16670 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --sport 17665 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --sport 17666 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --sport 17667 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --sport 17668 -j ACCEPT
0 -s 10.0.0.0/8 -p tcp --sport 16670 -j ACCEPT
0 -s 10.0.0.0/8 -p tcp --sport 17666 -j ACCEPT
0 -s 10.0.0.0/8 -p tcp --sport 17665 -j ACCEPT
0 -s 10.0.0.0/8 -p tcp --sport 17667 -j ACCEPT
0 -s 10.0.0.0/8 -p tcp --sport 17668 -j ACCEPT

Il giorno dom 26 lug 2020 alle ore 04:52 Abdalla Ahmad <Abdalla.Ahmad at sesame.org.jo> ha scritto:

Could it be a firewall issue? The iptables rules you are showing are for EPICS, the archiver is using few different ports. Try allowing the custom ports that the archiver is using: 16670, 17665, 17666, 17667 and 17668 in firewall-cmd or just flush the firewall rules :)

 

Best Regards,

Abdalla

 

From: Tech-talk <tech-talk-bounces at aps.anl.gov> On Behalf Of astrid morreale via Tech-talk
Sent: Saturday, July 25, 2020 2:26 AM
To: Hu, Yong <yhu at bnl.gov>
Cc: tech-talk at aps.anl.gov
Subject: Re: Adding a PV to archiver appl, missing something...

 

Thanks Yong, I took a look at the https://epics.anl.gov/tech-talk/2017/msg00705.php thread and checked the various hints, unfortunately I do think what is suggested in those threads is the problem (?).

 

My PV shows "Appliance assigned" in the archiver browser followed by a bunch of N/A despite the changing value of my PV. It's not seen/sampled/monitored at all  by the archiver.

 

the permissions 

in the s/l/m write directories seem ok

ie

ls -lrt -h  /home/arch/sts/
total 4.0K
drwxr-xr-x 2 tomcat tomcat 4.0K Jul 20 16:14 ArchiverStore
 

looking at the logs under

 

ls -lrt -h   /opt/archappl/retrieval/logs/

 

I do not see suspicious entries, I still think something is wrong in my setup

 

I checked the ports, I think these are ok

 

sudo firewall-cmd --direct --get-rules ipv4 filter INPUT
0 -s 10.0.0.0/8 -p udp --sport 5064 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --dport 5065 -j ACCEPT
0 -s 10.0.0.0/8 -p udp --sport 5075 -j ACCEPT

 

 

finally, I attach my  arch.log and my retrieval_catalina.err files

(tails pasted)

 

any input will be appreciated.

 

Thanks!

 

tail   /opt/archappl/retrieval/logs/arch.log
17   [main] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Done loading installation specific properties file from /opt/archappl/archappl.properties
19   [main] INFO  config.org.epics.archiverappliance.config.ConvertPVNameToKey  - The pv name components in this installation are separated by these characters [\:\-] and the key names are terminated by :
30128 [http-nio-17668-exec-1] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Post startup for RETRIEVAL
30447 [http-nio-17668-exec-1] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - client network config conn attempt limit: -1
30447 [http-nio-17668-exec-1] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - client network config conn attempt period: 3000
30447 [http-nio-17668-exec-1] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - client network config conn timeout: 5000
30462 [http-nio-17668-exec-1] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - client network config addresses: 10.0.0.78:16670
30462 [http-nio-17668-exec-1] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - client network config is redo: false
30463 [http-nio-17668-exec-1] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - client config properties: {hazelcast.logging.type=log4j}
31945 [http-nio-17668-exec-1] INFO  config.org.epics.archiverappliance.config.DefaultConfigService  - Start complete for webapp RETRIEVAL
[amorreal@localhost arch]$

 

tail   /opt/archappl/retrieval/logs/retrieval_catalina.err
Jul 24, 2020 5:11:26 PM org.epics.archiverappliance.retrieval.pva.PvaDataRetrievalServlet lambda$init$0
INFO: pool-1-thread-1
Jul 24, 2020 5:11:26 PM org.epics.archiverappliance.retrieval.pva.PvaDataRetrievalServlet init
INFO: 2020-07-24T17:11:26.878-06:00[America/Denver]pvaDataRetrievalService is operational.
Jul 24, 2020 5:11:26 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deployment of web application directory [/opt/archappl-2020Jul20-1614-27MDT/retrieval/webapps/retrieval] has finished in [6,405] ms
Jul 24, 2020 5:11:26 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["http-nio-17668"]
Jul 24, 2020 5:11:26 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in [6,501] milliseconds

 

 

 

Il giorno gio 23 lug 2020 alle ore 20:52 Hu, Yong <yhu at bnl.gov> ha scritto:

Hi Astrid,

 

It seems you have a similar issue as asked on tech-talk, EPICS Archiver Appliance does not transfer PVs to "Being archived"

https://epics.anl.gov/tech-talk/2017/msg00705.php

 

Good luck!

Yong

 

 

From: Tech-talk <tech-talk-bounces at aps.anl.gov> on behalf of "tech-talk at aps.anl.gov" <tech-talk at aps.anl.gov>
Reply-To: astrid morreale <astridmorreale at gmail.com>
Date: Thursday, July 23, 2020 at 7:21 PM
To: "tech-talk at aps.anl.gov" <tech-talk at aps.anl.gov>
Subject: Adding a PV to archiver appl, missing something...

 

Hello everyone,

 

I have yet another naive question as I am just starting (from zero) using EPICS and Archiver appl.

 

I have EPICS running and I am "ca monitoring" some PV's which are being populated---> all ok with ca monitoring I see that the PV's are changing value as I expected.

astrid@localhost epics-base]$camonitor myPV

myPV                           2020-07-23 16:44:41.905899 0

 

 

I open my archiver browser and I try to add my PV and I do not see anything happen (the PV is there but seems like a ghost).

I suspect I am missing some fundamental setting and archiver is just getting ready to connect to the PV.

 

"myPV

Appliance assigned

N/A

N/A

N/A

N/A

N/A

N/A

N/A"

 

some added info:

 

my env variable in bash is set to

EPICS_CA_ADDR_LIST=localhost

export EPICS_CA_ADDR_LIST

 

my epics base directory looks like this:

[astrid@localhost epics-base]$ ls

R3.15.5/ bin/ etc....

where my softIoc is under

epics-base/bin/linux-x86_64/softIoc

and R3.15.5 is the automatic epics installation done by archiver (following the slacmshankar/ archiver instructions online)

 

(I use Linux)

 

thanks a lot in advance.

Astrid

 

--

Astrid Morreale
Staff Scientist Subatomic Physics Group.  
Los Alamos National Laboratory.
astrid at lanl.gov



--

Astrid Morreale
Staff Scientist Subatomic Physics Group.  
Los Alamos National Laboratory.
astrid at lanl.gov



--
Astrid Morreale
Staff Scientist Subatomic Physics Group.  
Los Alamos National Laboratory.
astrid at lanl.gov
Replies:
Re: Adding a PV to archiver appl, missing something... Michael Davidsaver via Tech-talk
References:
Adding a PV to archiver appl, missing something... astrid morreale via Tech-talk
Re: Adding a PV to archiver appl, missing something... Hu, Yong via Tech-talk
Re: Adding a PV to archiver appl, missing something... astrid morreale via Tech-talk
Navigate by Date:
Prev: Re: How to check IOC connection Jong Woo Kim via Tech-talk
Next: Re: Adding a PV to archiver appl, missing something... Michael Davidsaver via Tech-talk
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  <2020>  2021  2022  2023  2024 
Navigate by Thread:
Prev: Re: Adding a PV to archiver appl, missing something... astrid morreale via Tech-talk
Next: Re: Adding a PV to archiver appl, missing something... Michael Davidsaver via Tech-talk
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  <2020>  2021  2022  2023  2024 
ANJ, 26 Jul 2020 Valid HTML 4.01! · Home · News · About · Base · Modules · Extensions · Distributions · Download ·
· Search · EPICS V4 · IRMIS · Talk · Bugs · Documents · Links · Licensing ·