Versions Compared

Old Version 20

changes.mady.by.user Les Cottrell

Saved on

compared with

New Version 21

changes.mady.by.user Les Cottrell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

There is also data in the space below but I am unsure of its provenance

 

Code Block
/nfs/slac/g/net/pinger/pingerdata/hep/data.unite/<host>/ping-<YYYY>-<MM>-<DD>.txt.gz
with files of the form:
-rw-rw-r-- 1 cottrell sf 52464462 Jul 20 18:11 ping-2007-04.txt

 


There is a script pinger-tar.pl. To save the raw data use the command /afs/slac/package/pinger/pinger-tar.pl. You can get help on this script by going to http://www-iepm.slac.stanford.edu/pinger/scripttable.html and choosing pinger-tar.pl from the pull down list. It lists the directory to find all hosts with data. For each of these hosts it copies all files with names starting ping-* into the anonymous ftp space, then it un-compresses it and tars and compresses it into the FTP space. Partial output from running the script is seen below.

 

Code Block
Time so far=7688 secs cmd=rm /afs/slac/public/users/cottrell/vle.iiu.edu.pk/ping-*
Fri Nov 13 10:14:50 2015 Took 1 secs, for rm /afs/slac/public/users/cottrell/vle.iiu.edu.pk/ping-*
Copy data for host(10/199/210)=drwxrwsr-x  2 iepm     iepm    31744 Jul 21 05:23 wanmoninst1.cern.ch debug=0, production=true
Time so far=7689 secs cmd=cp -p /nfs/slac/g/net/pinger/pingerdata/hep/data/wanmoninst1.cern.ch/ping-* /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/
Fri Nov 13 10:15:28 2015 Took 38 secs, for cp -p /nfs/slac/g/net/pinger/pingerdata/hep/data/wanmoninst1.cern.ch/ping-* /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/
Time so far=7727 secs cmd=gunzip -f /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/ping-*
Fri Nov 13 10:17:06 2015 Took 98 secs, for gunzip -f /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/ping-*
Time so far=7825 secs cmd=tar -Pczf /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/wanmoninst1.cern.ch.tar /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/ping-*.txt
Fri Nov 13 10:18:04 2015 Took 58 secs, for tar -Pczf /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/wanmoninst1.cern.ch.tar /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/ping-*.txt
Fri Nov 13 10:18:04 2015: 168840707 bytes in /afs/slac/public/users/cottrell/wanmoninst1.cern.ch/wanmoninst1.cern.ch.tar(11/199/210), time so far=7883secs

This saves about 200 tar files in ftp://ftp.slac.stanford.edu/users/cottrell. They are for data from 2007-07 forwards. They appear as directories with the directory name being the name of the PingER monitoring agent (MA) host.  For example

The files are tar files and compressed. Together they occupy about 70GBytes compressed or about 300GBytes uncompressed.

Information on each host MA can be found by going to http://www-iepm.slac.stanford.edu/pinger/pingerworld/all-nodes.cf which can be require'd in a perl script, or for currently working MAs http://www-iepm.slac.stanford.edu/pinger/pingerworld/slaconly-nodes.cf  or in the XML file http://www-iepm.slac.stanford.edu/pinger/pingerworld/rss.xml .

A directory of the files (using ls -l /afs/slac/public/users/cottrell/*/*tar) can be found here.