AFS Home Directory
By default you get a fairly small AFS quota on your home directory. You can ask unix-admin
to increase it to 500MB or for other volumes to be added to your home directory with a quota of 500MB. SCCS has a formto make this request.
NFS filesystems
Dedicated ATLAS scratch space is available. You should create a directory for yourself with the format:/afs/slac.stanford.edu/g/atlas/work/<firstLetterOfUsername>/<username>
. It is actually an NFS disk space not backed up so that code are recommended to remain on your AFS space. For the moment this space is not automatically cleaned up, if it fills up we'll need to start doing that. Currently there are two 125GB volumes making up this space.
This space should be used for log files and other small files that don't need high performance access.
xrootd user space
This space is primarily for storing ROOT files, any type (POOL, ntuples, whatever). xrootd offers high performance access to these types of files.
...
Files in xrootd have a URL-type format. You can add them to a job and Athena knows how to use them. An example file would be:
Code Block |
---|
filelist = []
filelist += ["root://atl-xrdr//atlas/xrootd/atlasuserdisk/data09_cos/DPD_CALOCOMM/r733_p37/data09_cos.00121416.physics_L1Calo.merge.DPD_CALOCOMM.r733_p37_tid073973/DPD_CALOCOMM.073973._000046.pool.root.1"]
filelist += ["root://atl-xrdr//atlas/xrootd/atlasuserdisk/data09_cos/DPD_CALOCOMM/r733_p37/data09_cos.00121416.physics_L1Calo.merge.DPD_CALOCOMM.r733_p37_tid073973/DPD_CALOCOMM.073973._000016.pool.root.1"]
...
athenaCommonFlags.PoolESDInput=filelist
|
To access an xrootd file To access it in ROOT directly, do:unmigrated-wiki-markup
Code Block |
---|
root |
...
[0 |
...
] TXNetFile f(" |
...
root://atl-xrdr//atlas/xrootd/usr/g/gowdy/myFile.root");
|
To copy files in and out of xrootd:
{{}}
Code Block |
---|
xrdcp myFile.root root://atl-xrdr//atlas/xrootd/usr/g/gowdy/ |
...
xrdcp root://atl-xrdr//atlas/xrootd/usr/g/gowdy/myFile.root . |
...
|
Filesystem type access is not transparent currently due to the distributed nature of the xrootd system. However, the xrootd filesystem is MOUNTED on atlint01. You can should make a directory called /xrootd/atlas/usr/"first letter of username"/"username"/ in /xrootd/atlas/usr.{{ssh
No Format |
---|
ssh atlint01.slac.stanford.edu |
...
df -h xrootdfs 9.8T 972G 8.9T 10% /xrootd/atlas/usr |
...
xrootdfs 9.8T 972G 8.9T 10% /xrootd/atlas/dq2 |
...
xrootdfs 9.8T 972G 8.9T 10% /xrootd/atlas/atlasdatadisk |
...
xrootdfs 9.8T 972G 8.9T 10% /xrootd/atlas/atlasmcdisk |
...
xrootdfs 9.8T 972G 8.9T 10% /xrootd/atlas/atlasuserdisk |
...
xrootdfs 9.8T 972G 8.9T 10% /xrootd/atlas/atlasgroupdisk |
...
xrootdfs 9.8T 972G 8.9T 10% /xrootd/atlas/atlashotdisk cat /xrootd/atlas/usr/a/ahaas/test.txt |
...
|