...
The SLAC account will need permissions to create a directory in /nfs/slac/g/net/pinger/pingerdata/hep/data/. This directory has permissions for user pinger and group iepm
Code Block 176cottrell@pinger:~$ls -ld /nfs/slac/g/net/pinger/pingerdata/hep/data drwxrwsr-x 220 pinger iepm 32768 May 16 00:45 /nfs/slac/g/net/pinger/pingerdata/hep/data/
To add the user to the iepm group
Code Block 178cottrell@pinger:~$ypgroup adduser -group iepm -u saqibali Jun 7 10:30:33 2018 User(s) 'saqibali' added to group 'iepm' Jun 7 10:30:33 2018 User(s) must logout/login for this to take effect. Jun 7 10:30:33 2018 Starting NIS post actions. Jun 7 10:30:33 2018 [/usr/ccs/bin/make group] copied group to /afs/slac/service/admin/NIS updated group pushed group 179cottrell@pinger:~$ypgroup exam -group iepm Group 'iepm': GID: 2087 Comment: Last modified at Jun 7 10:30:32 2018 by cottrell Owners: cottrell Members: cottrell, iepm, pinger, saqibali, ytl This is a secondary group.
Automating
Then we need to automate the steps with synchronized cronjobs, one at Beijing to do the compression and anonymous ftp of the recent data from the Beijing MA to the incoming ftp server at SLAC. Then one at SLAC to run at a suitable later time (when the ftp has completed) to copy the data from /afs/slac/public/incoming/saqibali to /nfs/slac/g/net/pinger/pingerdata/hep/data/pinger6.beijing.cn/. This in turn has to be synchronized with so it is completed before the analysis of the hourly data by wrap-analyze-all, that currently runs as a cron job at 11 minutes past 1am each morning (this time can be changed)
| Code Block |
|---|
11 1 * * * /usr/local/bin/bsub -W 180 -o /dev/null -q long /afs/slac/package/pinger/analysis/wrap-analyze-allmonths.pl --basedir /nfs/slac/g/net/pinger --usemetric --dataset hep 2>&1 #Takes ~ 2hr 15 min on pinger 11/11/2012. |
See https://confluence.slac.stanford.edu/display/IEPM/PingER+data+flow+at+SLAC for the data flow. It might be possible to modify the current gathering script (getdata.pl) to add step 2 support (i.e. gather the data from anonymous ftp that is basically acting as a proxy). This would be done via a script run at SLAC under a SLAC account (e.g. saqibali). This might be interesting since it also could be extended and a step to providing support for the Android PingER project at Amity in Delhi, India which also needs a proxy.
...