Page History

...

 /tmp/nfs/slac/g/lcls/tools/archiver_appliance_automation/lclsResumePausedPVs/lclsResumePausedPVs.log

...

Sent to: controls-cd, ppascual, bhill

2020-

...

07-08 13:00:

...

06,

...

309 - Starting resumePausedPVs...
2020-

...

07-08 13:00:

...

06,

...

309 - 2020-07-08 13:00:06.309367
2020-07-08 13:00:06,309 - Logfile: /nfs/slac/g/lcls/tools/archiver_appliance_automation/lclsResumePausedPVs/lclsResumePausedPVs.log
2020-07-08 13:00:06,313 - Starting new HTTP connection (1): lcls-archapp:80
2020-07-08 13:00:56,262 - http://lcls-archapp:80 "GET /mgmt/bpl/getPausedPVsReport HTTP/1.1" 200 None
2020-07-08 13:00:56,487 - 89727 total PVs are paused
2020-07-08 13:00:56,643 - Processing file /mccfs2/u1/lcls/epics/ioc/data/ioc-bsy0-mp01/archive/MPS_LinkProcessor.archive modified within 60 days
2020-07-08 13:00:56,644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-feh1-pp01/archive/ioc-

...

feh1-pp01.archive

...

 that has not been modified within 60 days
2020-07-08 13:00:

...

56,

...

644 - Processing file /mccfs2/u1/lcls/epics/ioc/data/ioc-in20-ev01/archive/beam_code_rates.archive modified within 60 days
2020-07-08 13:00:56,644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-in20-mc01/archive/ioc-

...

in20-

...

mc01.archive that has not been modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-in20-pp01/archive/ioc-

...

in20-

...

pp01.archive that has not been modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-li21-mc01/archive/ioc-

...

li21-

...

mc01.archive that has not been modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

644 - Processing file /mccfs2/u1/lcls/epics/ioc/data/ioc-li24-mc01/archive/ioc-

...

li24-

...

mc01.archive modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-li29-mc01/archive/ioc-

...

li29-

...

mc01.archive that has not been modified within 60 days
2020-07-08 13:00:

...

56,

...

644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-li30-mc01/archive/ioc-

...

li30-

...

mc01.archive that has not been modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-ltuh-mc01/archive/ioc-

...

ltuh-

...

mc01.archive that has not been modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-ltuh-mc02/archive/ioc-

...

ltuh-

...

mc02.archive that has not been modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

644 - Ignoring file /mccfs2/u1/lcls/epics/ioc/data/ioc-ltuh-mc03/archive/ioc-

...

ltuh-

...

mc03.archive that has not been modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

644 - Processing file /mccfs2/u1/lcls/epics/ioc/data/ioc-ltuh-mg01/archive/ioc-

...

ltuh-

...

mg01.archive modified within 60 days
2020-

...

07-08 13:00:

...

56,

...

645 - Processing file /mccfs2/u1/lcls/epics/ioc/data/ioc-ltuh-mg02/archive/ioc-

...

ltuh-

...

...

Cronjob:

lcls-prod01 00 1 * * * /afs/slac/g/lcls/package/ArchiverAppliance/tools/script/lclsProcessArchiveFiles.sh

Log:

/tmp/lclsProcessArchiveFiles.log

...

mg02.archive modified within 60 days
[...]
2020-07-08 13:01:14,937 - 397 total PVs have been paused in the past 60 days:
IOC:SYS0:FB02:TODSUM
SIOC:GUNB:PM02:UPTIME
SIOC:LI26:BP01:TODSUM
ACSW:UNDH:NW01:6POWERSTATE
SIOC:LTUH:MG01:TODSUM
CRAT:UNDH:UC19:CHV5_V
VIOC:LI21:MG01:TODDIFF
VIOC:LI21:MG03:FD_FREE
SIOC:LTUH:MG01:HEARTBEATOK
CRAT:LI24:BC01:FANTRAY
SIOC:GUNB:TM02:START_CNT
IOC:SYS0:FB01:CA_CONN_CNT
IOC:SYS0:FB04:TODDIFF
IOC:LI21:MG02:UPTIME
SIOC:LTUH:WA01:TODDIFF
[...]
2020-07-08 13:01:35,018 - No live PVs in this batch.
2020-07-08 13:01:35,018 - Done.
2020-07-08 13:01:35,018 - Total run time: 88.71944975852966

Notes:

lclsProcessArchiveFiles

Cronjob:

lcls-prod01 00 1 * * * /afs/slac/g/lcls/package/ArchiverAppliance/tools/script/lclsProcessArchiveFiles.sh

Log:

/nfs/slac/g/lcls/tools/archiver_appliance_automation/lclsProcessArchiveFiles/lclsProcessArchiveFiles.log

Schedule: Every hour

Description:
This is one of the steps used in automation of archiver configuration.
This assumes the requests for the archiver are somehow stored in the IOC (perhaps in INFO fields) and then submitted as archive files.
Archive files are consolidated together into a IOC_DATA like folder and can be identified using a bash glob expression.
Archive files are space/tab separated text files with these rules
1) They can have blank lines
2) They can have comment lines beginning with a #
3) Space/tab separated lines are interpreted as PVName, sampling period (in secs), sampling method (one of scan/monitor).
4) The PVName is mandatory; the other two are optional in which case defaults (optional arguments to this script)  are applied.

Example report:

Sent to: controls-cd, ppascual, bhill

2020-07-08 13:00:06,230 - Starting processArchiveFiles...
2020-07-08 13:00:06,230 - 2020-07-08 13:00:06.230638
2020-07-08 13:00:06,230 - Logfile: /nfs/slac/g/lcls/tools/archiver_appliance_automation/lclsProcessArchiveFiles/lclsProcessArchiveFiles.log
2020-07-08 13:00:06,230 - Searching for archive files: 

Example report:

Sent to: controls-cd, ppascual, bhill

...

/mccfs2/u1/lcls/epics/ioc/data

...

*/archive/

...

*.archive
2020-

...

07-08 13:00:06,944 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

bsy0-

...

mp01/archive/

...

MPS_LinkProcessor.archive modified within 999 days
2020-

...

07-08 13:00:06,945 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

feh1-pp01/archive/

...

ioc-

...

feh1-pp01.archive modified within 999 days
2020-

...

07-08 13:00:06,945 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

in20-

...

ev01/archive/

...

beam_code_rates.archive modified within 999 days
2020-

...

07-08 13:00:06,945 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

in20-

...

mc01/archive/

...

ioc-in20-mc01.archive modified within 999 days
2020-

...

07-08 13:00:06,945 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

in20-

...

pp01/archive/

...

ioc-in20-pp01.archive modified within 999 days
2020-

...

07-08 13:00:06,945 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

li21-

...

mc01/archive/

...

ioc-

...

li21-

...

mc01.archive modified within 999 days
2020-

...

07-08 13:00:06,945 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

li24-

...

mc01/archive/

...

ioc-li24-mc01.archive modified within 999 days
2020-

...

07-08 13:00:06,945 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

li29-

...

mc01/archive/

...

ioc-li29-mc01.archive modified within 999 days
2020-

...

07-08 13:00:06,945 - Processing file /mccfs2/u1/lcls/epics/ioc/data/

...

ioc-

...

li30-

...

mc01/archive/

...

ioc-

...

li30-mc01.archive modified within 999 days
[...]
2020-07-08 13:03:18,451 - Processing archive file /mccfs2/u1/lcls/epics/ioc/data/sioc-gunb-va02/archive/sioc-gunb-va02.archive
2020-07-08 13:03:18,452 - All 8 PVs from sioc-gunb-va02/archive/sioc-gunb-va02.archive are in the archiver
2020-07-08 13:03:18,452 - Processing archive file /mccfs2/u1/lcls/epics/ioc/data/sioc-gunb-va03/archive/sioc-gunb-va03.archive
2020-07-08 13:03:18,455 - All 42 PVs from sioc-gunb-va03/archive/sioc-gunb-va03.archive are in the archiver
2020-07-08 13:03:18,456 - Processing archive file /mccfs2/u1/lcls/epics/ioc/data/sioc-in20-mg01/archive/sioc-in20-mg01.archive
2020-07-08 13:03:18,532 - Processing archive file /mccfs2/u1/lcls/epics/ioc/data/sioc-in20-mg02/archive/sioc-in20-mg02.archive
2020-07-08 13:03:18,621 - Checking for liveness of 1013 PVs
2020-07-08 13:03:23,717 - Submitting 2 new PVs to the archiver
2020-07-08 13:03:23,717 - Submitting these PVs to the archiver:
SIOC:GUNB:MC01:APP_DIR
SIOC:GUNB:MC01:ST_SCRIPT
2020-07-08 13:03:23,721 - Starting new HTTP connection (1): lcls-archapp:80
2020-07-08 13:03:23,831 - http://lcls-archapp:80 "POST /mgmt/bpl/archivePV HTTP/1.1" 200 None
2020-07-08 13:03:23,832 - archivePVs returned with status 200
[...]
2020-07-08 13:03:32,410 - Checking for liveness of 1335 PVs
2020-07-08 13:03:37,523 - Skipped 1335 potentially stale PVs:
PPS:SYSE:1:CLTS:HRTBT_OK_LTH_A
PPS:SYSE:1:CLTS:PAUSEHB_A
PLC:BSY0:PPxx:FAULTLED
PPS:SYSE:1:CLTS:HRTBT_OUTP_A
PPS:SYSE:1:CLTS:HRTBT_INP_B
PLC:BSY0:PPxx:IFAULTLED
PLC:BSY0:PPxx:PWLED
PLC:BSY0:PPxx:RUNLED
PLC:BSY0:PPxx:DIAGLED
PPS:SYSE:1:CLTS:HRTBT_OK_LTH_B
PLC:BSY0:PPxx:CHECKSUM
PPS:SYSE:1:CLTS:HRTBT_INP_A
PLC:BSY0:PPxx:OFAULTLED
PPS:SYSE:1:CLTS:HRTBT_OUTP_B
[...]
2020-07-08 13:04:40,949 - Total run time: 274.7326340675354
2020-07-08 13:04:40,950 - Done.

bp01.archive
2020-03-11 01:02:37,643 - _main_ - INFO - Submitting 1137 new PVs to the archiver
2020-03-11 01:02:37,643 - _main_ - INFO - Submitting these PVs to the archiver BPMS:BSYS:865:TMIT1H,BPMS:LTUS:150:CALBTDES,TPR:BSYS:BP01:0:TPRTRIG04,BPMS:LTUS:150:USCL,TPR:BSYS:BP01:0:RTMOUT2TWID,TPR:BSYS:BP01:0:RTMOUT1TWID,TPR:BSYS:BP01:0:CH02_CNT,BPMS:LTUS:150:YOFF,TPR:BSYS:BP01:0:TRG12_TDESTICKS,TPR:BSYS:BP01:0:TPRTRIG13,TPR:BSYS:BP01:0:CH04_RATE,BPMS:LTUS:150:XOFF.E,TPR:BSYS:BP01:0:CH11_RATE,TPR:BSYS:BP01:0:TRG06_SOURCE,TPR:BSYS:BP01:0:CH12_RATEMODE,TPR:BSYS:BP01:0:TRG09_SYS0_TCTL,TPR:BSYS:BP01:0:TRG01_SOURCE,TPR:BSYS:BP01:0:CH12_FIXEDRATE,TPR:BSYS:BP01:0:CH09_ACRATE,TPR:BSYS:BP01:0:TRG04_SOURCE,TPR:BSYS:BP01:0:RTMOUT0SOURCE,BPMS:LTUS:150:Y.AOFF,TPR:BSYS:BP01:0:CH12_TSMASK,TPR:BSYS:BP01:0:TPRTRIG10,TPR:BSYS:BP01:0:CH01_RATE,BPMS:LTUS:150:TDES,TPR:BSYS:BP01:0:CH07_TSMASK,TPR:BSYS:BP01:0:TPRTRIG00,BPMS:LTUS:150:GRN_SLOW,TPR:BSYS:BP01:0:TRG02_SYS0_TWID,TPR:BSYS:BP01:0:CH15_CNT,TPR:BSYS:BP01:0:CH12_CNT,TPR:BSYS:BP01:0:CH08_RATE,TPR:BSYS:BP01:0:CH05_CNT,BPMS:BSYS:865:YAOFF,TPR:BSYS:BP01:0:CH13_CNT,TPR:BSYS:BP01:0:TRG14_SYS0_TDES,TPR:BSYS:BP01:0:TRG05_TWIDTICKS,TPR:BSYS:BP01:0:TRG00_SOURCE,TPR:BSYS:BP01:0:TRG08_SYS2_TCTL,
...Notes:

...