Confluence will be down for maintenance June 14 2024 at 6AM PT.
The S3DF (SLAC Shared Science Data Facility) is a new SLAC-wide computing facility. The S3DF will replace the PCDS current computer and storage resources used for the LCLS experiment data processing.
The S3DF has its own users home directories.
To access to the S3DF systems connect to the s3dflogin pool and login with you unix account:
% ssh s3dflogin.slac.stanford.edu
Within the S3DF the nodes are named sdf*. The login nodes don't have the data folders mounted and no Slurm tools. For data transfers, data transfer nodes (s3dfdtn.slac.stanford.edu) are provided.
An interactive cluster of nodes is available using the psana name. The interactive node provide access to the LCLS data and allows submitting Slurm jobs.
sdfloginNNN % ssh psana # interactive nodes, same name as in PCDS but different nodes
/sdf/group/lcls/ds with the two sub-directories for analysis (/sdf/group/lcls/ds/ana) and data-management (/sdf/group/lcls/ds). The ana folder contains many sub-directories for psana releases (sw), detector calibration (detector) and more. The above prefix is similar to the /cds/group/psdm in PCDS.
/sdf/data/lcls/ds/<instr>/<expt>/<expt-folders>
S3DF-maintained facility documentation can be found here.
To access data and submit to Slurm use the interactive cluster (ssh psana).
% source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/psconda.sh [-py2] % source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/setup_testrel
The command above activates by default the most recent python 3 version of psana. New psana versions do not support python 2 anymore, but it still possible to activate the last available python 2 environment (ana-4.0.45) using the -py2
option.
% source /sdf/group/lcls/ds/ana/sw/conda2/manage/bin/psconda.sh
Jupyter is provided by the onDemand service. We are not planning to run a standalone jupyterhub as is done at PCDS. For more information check the S3DF interactive compute docs.