...
- The initial audiences were:
- Chin Fang for part of the Zettar demonstration of file transfer at the Super Computing 2014
- Renan Souza for the UFRJ Linked Open data project
- Ibrahim Abaker of UM for his Big Data project
- The hourly data was chosen rather than the raw data since it is cleaner having been through several filters.
- The hourly data is in: /nfs/slac/g/net/pinger/pingerreports/hep/<metric>/ directory with the file name <metric>
<size><by><yyyy><mm>-<dd>.txt.gz
- The hourly data is in: /nfs/slac/g/net/pinger/pingerreports/hep/<metric>/ directory with the file name <metric>
The raw (daily gathered data from all the monitoring hosts) is close to 400GBytes. This includes:
- /nfs/slac/g/net/pinger/pinger_mon_data/ping-<YYYY>-<MM>.txt and
- /nfs/slac/g/net/pinger/pinger2/data/ping-<YYYY>-<MM>.txt
- We ignore this data in the rest of this web page.
- /nfs/slac/g/net/pinger/pinger_mon_data/ping-<YYYY>-<MM>.txt and
Volume of data
There are roughly 100,000 files. The volumes of the files are shown below.
...