Page History
Essential components:
- Move away from afs disks
- Use containers for building L1 packagesBuild L1 locally, using container
- Run executables using container
- Use SLURM commands in xml
Sustainability wishlist:
- Move all L1 packages to git
Infrastructure needs:
- CVS is broken
- Singularity
- Pipeline
- Data migration
Sustainability wishlist:
- Get rid of SCons builds for L1
- Upgrade python to v3 and above
Open questions:
- do we still need a wrapper for cleanup?
- do we need isocRun for every executable?
- what are the options and queues for slurm?
- CVS is broken
- Singularity
- Pipeline
- Data migration
S3DF Cheatsheet:
- Install ssh config as described here
- to login from terminal:
ssh slacd - NOTE: use terminal not XQuartz(?)
- afs was migrated to:
/sdf/group/fermi/a/ - nfs was migrated to:
/sdf/group/fermi/g/
Where to find/install stuff:
- working area:
/sdf/group/fermi/
- a/
- ground/
- PipelineConfig/L1Proc
- pipeline:
/sdf/home/g/glast/a/pipeline-II/prod/pipeline - CVS, when live version is needed:
CVSROOT=:ext:monzani@centaurusa.slac.stanford.edu:/nfs/slac/g/glast/ground/cvs - CVS, to passively download old stuff:
CVSROOT=/sdf/group/fermi/g/glast_ground/cvs - the CVS viewer was moved a new location
| Info | ||
|---|---|---|
| ||
source /sdf/group/fermi/a/ground/PipelineConfig/L1Proc/5.9/start_rhel6.sh singularity shell --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/fermi-rhel6.20230526.sif singularity exec --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/fermi-rhel6.20230526.sif ./install.py |
| Info | ||
|---|---|---|
| ||
cd source /sdf/group/fermi/a/userground/monzaniPipelineConfig/L1P-S3DFL1Proc/5.9 singularity exec --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/slacdistrib_6.10fermi-rhel6.20230526.sif./install.py /sdf/home/g/glast/a/pipeline-II/prod/pipeline load -m PROD /sdf/group/fermi/user/monzani/L1P-S3DF/5.9/xml/testVerifyS3df-5.9.xml |