You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 10 Next »

Files on disk on the Fermi Xrootd cluster

Infrequently the xrootd servers are scanned to find all the files that are on disk. The scan is split into directories below /glast:

/glast/ASP, /glast/Data, /glast/bt, /glast/level0, /glast/mc, ....

The results of the scans are stored in

/nfs/farm/g/glast/u18/xrootd/files_on_disk/<YYYYMMDD>

where <YYYYMMDD> is the date the scan was taken.
There is also a link

/nfs/farm/g/glast/u18/xrootd/files_on_disk/current

that points to the most recent file listing.

File listings

For each subdirectory that is scanned the results are stored in the file:

filelist_<topdir>
      e.g.: filelist_glast_Data for files below /glast/Data

<topdir> is the directory the scan started and '/' are replaced by '_'.
Each line in the file listing contains the

size(Bytes)   atime   mtime   ctime   filename   host   [migrate-status]

The migrate-status field is optional with vaules:

status

description

-1

migrate status could not be determined (no lock file)

0

not migrated

1

migrated

e.g. :

107536534 1243879126 1217984515 1217984515 /glast/ASP/DRP/PROD/DRP_daily_00005.tar.gz

The lines are sorted with respect to the data file names.

Summary Information

The file listing directory contains also summaries files that show the disk usage by top level directories and some sub-directories. The two summary files are:

  • usage_summary
    usage for top level dirs (/glast/Data, /glast/mc,...) and some subdirs
  • usage_subdirs
    usage for subdirs of /glast/Data/Flight, /glast/mc and /glast/mc/ServiceChallenge/

Command used to collect the data

The command SrvFlUsage will create the file listing for each server and produce the summaries:
> SrvFlUsage -a -r
The listing directory will be /nfs/farm/g/glast/u18/xrootd/files_on_disk/<YYYYMMDD>

  • No labels