...

This page describes, how the data collected by the SLAC PingER site, ends up as information, which is used by pingtable, motion charts, intensity maps and several other applications. Various scripts are used in turn to generate the data. The scripts in their turn are driven by a trscrontab that executes on pinger@pinger.slac.stanford.edu.

Scripts

• TimePing:** /afs/slac/package/pinger/timeping.pl
  • Represents the old script to perform ping measurements and store raw data.
  • Stores raw data on nfs at:

    Code Block
    /nfs/slac/g/net/pinger/pinger_mon_data/ping-<YYYY>-<MM>.txt

• PingER2:
  • /afs/slac/package/pinger/pinger2/share/pinger/pinger2.pl
  • Represents the new Tool to perform ping measurements and store raw data.

  • Wiki Markup
    \[[http://confluence.slac.stanford.edu/display/IEPM/PingER2+at+SLAC]\]

  • Stores raw data on nfs at:

    Code Block
    /nfs/slac/g/net/pinger/pinger2/data/ping-<YYYY>-<MM>.txt e.g. /nfs/slac/g/net/pinger/pinger2/data/ping-2011-02.txt

• Ping_Data
  • /afs/slac/g/www/cgi-wrap-bin/net/offsite_mon/ping_data/ping_data.pl
  • Represents the web interface(cgi script) used to fetch data from remote monitoring node.
  • zips the data before transfer.
• GetData
  • /afs/slac/package/pinger/getdata.pl

  • Wiki Markup
    queries ping_data\[[http://slac.stanford.edu/cgi-wrap/ping_data.pl]\] to fetch data.

  • Stores zipped File at

    Code Block
    /nfs/slac/g/net/pinger/pingerdata/hep/data/<host>/ping-<YYYY>-<MMM>.txt.gz

  • See Restoring PingER data for more details.
• Analyze
  • There is a group of analysis scripts, that pick up zipped data; do their analysis, aggregate data and prepare web reports.
  • The first script to be executed is analyze-hourly.pl which takes as input data the output of getdata.pl and from this aggregaytes the data to by day and writes it to the /nfs/slac/g/net/pinger/pingerreports/hep/<metric>/ directory with the file name <metric><size><by><yyyy><mm>-<dd>.txt.gz,
    Example output filename:

    Code Block
    /nfs/slac/g/net/pinger/pingerreports/hep/minimum_rtt/minimum_rtt-100-by-node-2006-09-28.txt.gz

    Example output format (there are 24 hourly lines like this per day/per host pair):

    Code Block
    icfamon.dl.ac.uk lns62.lns.cornell.edu 108.871 ... 109.620 icfamon.dl.ac.uk lns62.lns.cornell.edu

  • The remaining analyze scripts (analyze-daily.pl, analyze-monthly.pl, analyze-allmonths.pl, and analyze-allyears.pl) take as input the data from analyze-hourly.pl ancd create files of the form:  

    Code Block
    /nfs/slac/g/net/pinger/pingerreports/hep/<metric>-<size>-by-<site|node>(-<YYYY>?)(-<mm>?)(-<dd>?).txt.gz

  • More information can be found on running getdata.pl and the analyze scripts to recover missing data.

...