Essential components:

Sustainability wishlist:

  • Get rid of SCons builds for L1
  • Upgrade python to v3 and above

Open questions:

  • do we still need a wrapper for cleanup? 
  • do we need isocRun for every executable?
  • what are the options and queues for slurm?

Infrastructure needs:

  • CVS is broken
  • Singularity
  • Pipeline
  • Data migration

S3DF Cheatsheet:

  • Install ssh config as described here
  • to login from terminal: ssh slacd
  • NOTE: use terminal not XQuartz(?)
  • afs was migrated to: /sdf/group/fermi/a/
  • nfs was migrated to: /sdf/group/fermi/g/

Where to find/install stuff:

  • working area: /sdf/group/fermi/a/ground/PipelineConfig/L1Proc
  • pipeline: /sdf/home/g/glast/a/pipeline-II/prod/pipeline
  • CVS, when live version is needed:
  • CVS, to passively download old stuff:  CVSROOT=/sdf/group/fermi/g/glast_ground/cvs
  • the CVS viewer was moved a new location
  • singularity example (05/02/23): pipeline task, xml file
  • additional slurm parameters (08/15/23): --account fermi

Singularity cheatsheet

source /sdf/group/fermi/a/ground/PipelineConfig/L1Proc/5.9/ 

singularity shell --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/fermi-rhel6.20230526.sif

singularity exec --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/fermi-rhel6.20230526.sif ./

Pipeline cheatsheet

source /sdf/group/fermi/a/ground/PipelineConfig/L1Proc/5.9/ 

singularity exec --bind /sdf/group/fermi/a:/afs/slac/g/glast --bind /sdf:/sdf /sdf/group/fermi/sw/containers/fermi-rhel6.20230526.sif./

/sdf/home/g/glast/a/pipeline-II/prod/pipeline load -m PROD /sdf/group/fermi/user/monzani/L1P-S3DF/5.9/xml/testVerifyS3df-5.9.xml 

  • No labels