Essential components:
- Move away from afs disks
- Build L1 locally, using containers
- Run executables using container
- Use SLURM commands in xml
- Move all L1 packages to git
Infrastructure needs:
- CVS is broken
- Singularity
- Pipeline
- Data migration
Sustainability wishlist:
- Get rid of SCons builds for L1
- Upgrade python to v3 and above
Open questions:
- do we still need a wrapper for cleanup?
- do we need isocRun for every executable?
- what are the options and queues for slurm?
S3DF Cheatsheet:
- Install ssh config as described here
- to login from terminal:
ssh slacd - NOTE: use terminal not XQuartz(?)
- afs was migrated to:
/sdf/group/fermi/a/ - nfs was migrated to:
/sdf/group/fermi/g/
Where to find/install stuff:
- working area:
/sdf/group/fermi/a/ground/PipelineConfig/L1Proc - pipeline:
/sdf/home/g/glast/a/pipeline-II/prod/pipeline - CVS, when live version is needed:
CVSROOT=:ext:monzani@centaurusa.slac.stanford.edu:/nfs/slac/g/glast/ground/cvs - CVS, to passively download old stuff:
CVSROOT=/sdf/group/fermi/g/glast_ground/cvs - the CVS viewer was moved a new location
Singularity cheatsheet
source /sdf/group/fermi/a/ground/PipelineConfig/L1Proc/5.9/start_rhel6.sh
singularity shell --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/fermi-rhel6.20230526.sif
singularity exec --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/fermi-rhel6.20230526.sif ./install.py
Pipeline cheatsheet
source /sdf/group/fermi/a/ground/PipelineConfig/L1Proc/5.9/start_rhel6.sh
singularity exec --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/fermi-rhel6.20230526.sif./install.py
/sdf/home/g/glast/a/pipeline-II/prod/pipeline load -m PROD /sdf/group/fermi/user/monzani/L1P-S3DF/5.9/xml/testVerifyS3df-5.9.xml
Overview
Content Tools