FTP
...
Space
The FTP space is at: ftp://ftp.slac.stanford.edu/users/cottrell/. The equivalent local file space at SLAC is /afs/slac/public/users/slac
Downloading recent data from the FTP:
The idea is that you retrieve all the existing Archived PingER hourly data from Anonymous FTP one time and then incrementally append recent data on say a daily basis. To append recent data proceed as follows:
There is a file called download.pl in the FTP. This file can be used to download recent data from the FTP.
...
PS: If needed files for the a period larger than 60 days, they must be downloaded manually from the FTP: ftp://ftp.slac.stanford.edu/users/cottrell/, see Retrieving Archived PingER hourly data from Anonymous FTP
Downloading all the data from the FTP:
- Download the file from the FTP, i.e. copy it from ftp://ftp.slac.stanford.edu/users/cottrell/download_all.pl
- Copy download_all.pl to the location you want to download the files (e.g. /home/Documents/PingER)
- Through your command line interface type: perl download_all.pl (make sure to have perl installed)
Updating the FTP
This section is only for the FTP maintainer at SLAC.
The script responsible to update the public FTP site at SLAC is in the following location:
...
ssh pinger@pinger.slac.stanford.edu
Output from running the command ftp_update.pl:
It represents how many files were missing during the update process.
Cron Job to run ftp-upate.pl automatically each day
The script runs every morning at 4AM. To modify the cron job you should edit the trscrontab:
...
lnxcron;480 00 4 * * * /opt/TWWfsw/bin/perl /afs/slac/package/pinger/ftp-update.pl
Log Files:
Log files with missing files can be found at:
...
$ /opt/TWWfsw/bin/perl /afs/slac/package/pinger/ftp-update-log.pl
Algorithm
| Code Block | ||
|---|---|---|
| ||
Foreach metric Copy correspondent tar file to pinger_temp_files folder Untar the file inside pinger_temp_files folder Check the most recent file in the recently untared folder Copy from pingerreports folder to the pinger_temp_files folder all the correspondent files until the current previous day Tar the updated folder Copy back to the FTP main folder |
...