Files on disk on the Fermi Xrootd cluster
Infrequently the xrootd servers are scanned to find all the files that are on disk. Instead of scanning everything below /glast the scan is split into listings for all of it subdirectories.
/glast/ASP, /glast/Data, /glast/bt, /glast/level0, /glast/mc, ....
The results of the scans are stored in the directory
/nfs/farm/g/glast/u15/xrootd/files_on_disk/<YYYYMMDD>
where <YYYYMMDD> is the date the scan was taken.
There is also a link
/nfs/farm/g/glast/u15/xrootd/files_on_disk/current
that points to the most recent file listing.
File listings
For each subdirectory that is scanned the results are stored in the file:
filelist_<topdir>
e.g.: filelist_glast_Data for files below /glast/Data
<topdir> is the directory the scan started and '/' are replaced by '_'.
Each line in the file listing contains the
size(Bytes) atime mtime ctime filename host [migrate-status]
The migrate-status field is optional with vaules:
status |
description |
|---|---|
-1 |
migrate status could not be determined (no lock file) |
0 |
not migrated |
1 |
migrated |
e.g. :
1461254 1185332890 1178747325 1178747325 /glast/mc/ServiceChallenge/backgndSC-GR-v11r2/merit/backgndSC-GR-v11r2-000008-merit.root sulky02 0
The lines are sorted with respect to the data file names.
Command used to collect the data
> SrvFileListing --outdir /nfs/farm/g/glast/u15/xrootd/files_on_disk/<YYYYMMDD> --cfg ~glastdat/config/filelisting.cf --cfg_section file_listing --migr
(ScaRunOnHosts -f glast -r -w -p – /u/gl/glastdat/releases/prod_admin/bin/ScaRunner ...)
> cd /nfs/farm/g/glast/u15/xrootd/files_on_disk/<YYYYMMDD>
> SrvFileListingCompact.sh