Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Order of running jobs in trscrontab

 
Code Block
#write-offsitenodes.pl updates:
#/afs/slac.stanford.edu/www/comp/net/mon/offsite.nodes 
#a file of beacons: /afs/slac/g/www/www-iepm/pinger/beacons.txt, this is accessed via https://www-iepm.slac.stanford.edu/pinger/beacons.txt
#XML file for worldwide pingER monitoring sites: /afs/slac.stanford.edu/g/www/www-iepm/pinger/pinger.xml. This is accessed via the URL http://www-iepm.slac.stanford.edu/pinger/pinger.xml
#XML file for the local SLAC pinger2 monitoring: /afs/slac.stanford.edu/package/pinger/pinger2/share/pinger/pinger.xml
lnxcron 00 23 28 * * /afs/slac/package/pinger/write_offsitenodes.pl > /afs/slac/g/www/www-iepm/pinger/host-warnings.txt 2>&1 #takes ~15 

...

 minutes 7/31/2019
pinger;200 32 1 * * * /afs/slac/package/pinger/getdata.pl > /afs/slac/g/www/www-iepm/pinger/slaconly/getdata.err

...

 #Takes ~20 minutes 7/31/2019
lnxcron;120 55 2 * * * /afs/slac/package/pinger/analysis/analyze-all.pl --date 1days #Takes

...

 

...

55 mins 9/21/2011, 70 minutes 5/11/2018

...


pinger;300 30 4 * * * /afs/slac/package/pinger/analysis/wrap-analyze-daily.pl --basedir /nfs/slac/g/net/pinger --usemetric --dataset hep # Takes ~ 5 hours for whole month on pinger 11/10/2012

...


#analyze-monthly.pl
lnxcron 13 7 * * * /usr/local/bin/bsub -W 200 -o /dev/null -q xxl /afs/slac/package/pinger/analysis/wrap-analyze-monthly.pl --basedir /nfs/slac/g/net/pinger --usemetric --dataset hep --by by-site >/dev/null 2>&1 # Takes 3hrs 10 mins on pinger 11/11/2012.
lnxcron 14 7 * * * /usr/local/bin/bsub -W 200 -o /dev/null -q xxl /afs/slac/package/pinger/analysis/wrap-analyze-monthly.pl --basedir /nfs/slac/g/net/pinger --usemetric --dataset hep --size 1000  >/dev/null 2>&1
lnxcron 15 7 * * * /usr/local/bin/bsub -W 200 -o /dev/null -q xxl /afs/slac/package/pinger/analysis/wrap-analyze-monthly.pl --basedir /nfs/slac/g/net/pinger --usemetric --dataset hep --by by-site --size 1000  >/dev/null 2>&1
lnxcron 12 4 * * * /usr/local/bin/bsub -W 200 -o /dev/null -q xxl /afs/slac/package/pinger/analysis/wrap-analyze-monthly.pl --basedir /nfs/slac/g/net/pinger --usemetric --dataset hep > /dev/null #Takes about 55mins 9/19/2011, or 7 mins on rhel6 11/13/2011.
/afs/slac/package/pinger/sites-per-country.pl

/afs/slac/package/pinger/sites-per-country.pl

Checks:

  1. View pinger.xml at SLAC
  2. View analyzed hourly data
  3. View analyzed daily data
  4. View analyzed monthly data
  5. View sites per country

Data

Code Block
/nfs/slac/g/net/pinger/pinger_mon_data/ping-<YYYY>-<MM>.txt contains raw data from 2005-2010, just for SLAC.
/nfs/slac/g/net/pinger/pinger2/data/ping-<YYYY>-<MM>.txt contains raw data from 2009-present, just for SLAC
/nfs/slac/g/net/pinger/pingerdata/<data> contains data from 1997-2003 contains raw data
/nfs/slac/g/net/pinger/pingerdata/hep/data/<host>/ contains raw data 1997-2007200

Data volumes Sep 2014

The total PingER data volume is about 550Gbytes.

...