FTP Space
The FTP space is at: ftp://ftp.slac.stanford.edu/users/cottrell/. The equivalent local file space at SLAC is /afs/slac/public/users/slac
Downloading recent data from the FTP:
The idea is that you retrieve all the existing Archived PingER hourly data from Anonymous FTP one time and then incrementally append recent data on say a daily basis. To append recent data proceed as follows:
...
PS: If needed files for the a period larger than 60 days, they must be downloaded manually from the FTP: ftp://ftp.slac.stanford.edu/users/cottrell/, see Retrieving Archived PingER hourly data from Anonymous FTP
Downloading all the data from the FTP:
- Download the file from the FTP, i.e. copy it from ftp://ftp.slac.stanford.edu/users/cottrell/download_all.pl
- Copy download_all.pl to the location you want to download the files (e.g. /home/Documents/PingER)
- Through your command line interface type: perl download_all.pl (make sure to have perl installed)
Updating the FTP
This section is only for the FTP maintainer at SLAC.
...
ssh pinger@pinger.slac.stanford.edu
Output from running the command ftp_update.pl:
It represents how many files were missing during the update process.
Cron Job to run ftp-upate.pl automatically each day
The script runs every morning at 4AM. To modify the cron job you should edit the trscrontab:
...
lnxcron;480 00 4 * * * /opt/TWWfsw/bin/perl /afs/slac/package/pinger/ftp-update.pl
Log Files:
Log files with missing files can be found at:
...
$ /opt/TWWfsw/bin/perl /afs/slac/package/pinger/ftp-update-log.pl
Algorithm
Code Block | ||
---|---|---|
| ||
Foreach metric Copy correspondent tar file to pinger_temp_files folder Untar the file inside pinger_temp_files folder Check the most recent file in the recently untared folder Copy from pingerreports folder to the pinger_temp_files folder all the correspondent files until the current previous day Tar the updated folder Copy back to the FTP main folder |
...