This page describes various monitoring tools used for the Fermi Xrootd cluster.

Ganglia

• Ganglia Xrootd shows various metrics related to memory, I/O and load of the xrootd cluster.
• The redirectors are not shown in the xrootd Ganglia page but are part of the glastlnx cluster: glastlnx04 and glastlnx05

Disk Usage and Files

• Xrootd Disk Usage
• Files on disk

HPSS

Server Disk Usage

Twice a day a cron job runs on each xrootd data server and obtains the disk usage of that server. These values are written to files in nfs and a trscrontab job creates the webpage with the current
free diskspace

Cron job that collects the disk space info

The cronjob, running in crontab on each xrootd data server, is

/opt/xrootd/admin/mon_diskspace.sh

It collects the total and free diskspcae as well as the inode usage for ufs file systems (zfs has no inode restrictions).

The disk usage is stored in files:

...

• Files Backed up to HPSS
• FGST files added to HPSS
• Files added to HPSS
• List of files in HPSS.

• /nfs/farm/g/glast/

...

• u18/xrootd/

...

• hpss/

...

where server is the server name and YYYYMM is the year and month the values were collected. For example
.bq /nfs/farm/g/glast/u15/xrootd/diskspace/df_wain020_200806
contains all disk usage values for wain021 for Juni, 2008.

Each line in these files shows the disk usage for a particular date. The format is:

bd. DF  <date>  <server> <totalSpace>  <freeSpace>   <%Used>  \[<inodesFree>  <%inodesFree>\]

...

• file_listing/

  Contains the listing of files in HPSS. The current format is hl_<topdir><date> where <topdir> is the directory below all files are listed. The common _/glast prefix is omitted. The listing contains filename, the size of a file in bytes and the date the file was put into HPSS. The date format is YYYYMMDDHHMMSS.

Misc

• Testing access time to xrootd