Page History

FTP Space

The FTP space is at: ftp://ftp.slac.stanford.edu/users/cottrell/. The equivalent local file space at  SLAC is /afs/slac/public/users/slac

Downloading recent data from the FTP:

The idea is that you retrieve all the existing Archived PingER hourly data from Anonymous FTP one time and then incrementally append recent data on say a daily basis. To append recent data proceed as follows:

...

PS: If needed files for the a period larger than 60 days, they must be downloaded manually from the FTP: ftp://ftp.slac.stanford.edu/users/cottrell/, see Retrieving Archived PingER hourly data from Anonymous FTP

Downloading all the data from the FTP:

1. Download the file from the FTP, i.e. copy it from ftp://ftp.slac.stanford.edu/users/cottrell/download_all.pl
2. Copy download_all.pl  to the location you want to download the files (e.g. /home/Documents/PingER)
3. Through your command line interface type: perl download_all.pl (make sure to have perl installed)
   

Updating the FTP

This section is only for the FTP maintainer at SLAC. 

...

ssh pinger@pinger.slac.stanford.edu

Output from running the command ftp_update.pl:

It represents how many files were missing during the update process.

Cron Job to run ftp-upate.pl automatically each day

The script runs every morning at 4AM. To modify the cron job you should edit the trscrontab:

...

lnxcron;480 00 4 * * * /opt/TWWfsw/bin/perl /afs/slac/package/pinger/ftp-update.pl

Log Files:

Log files with missing files can be found at:

...

$ /opt/TWWfsw/bin/perl /afs/slac/package/pinger/ftp-update-log.pl

 Algorithm

 Foreach metric
	Copy correspondent tar file to pinger_temp_files folder
	Untar the file inside pinger_temp_files folder 
	Check the most recent file in the recently untared folder
	Copy from pingerreports folder to the pinger_temp_files folder all the correspondent files until the current previous day
	Tar the updated folder
	Copy back to the FTP main folder
 

...