You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 13 Next »

Under Construction (Not for Users)

The S3DF (SLAC Shared Science Data Facility) is a SLAC-wide computing facility. For LCLS the S3DF will replace the PCDS current computer and storage resources used for data processing.  

The S3DF has its own users home directories.

Accessing the S3DF

To access to the S3DF systems  connect to the s3dflogin pool and login with you unix account:

% ssh s3dflogin.slac.stanford.edu 

Within the S3DF the nodes are named sdf*.  The login nodes don't have the data folders mounted and no Slurm tools. An interactive cluster of nodes is available using the psana name:

sdfloginNNN % ssh psana      # same name as in PCDS but different nodes

For data transfers, data transfer nodes (s3dfdtn.slac.stanford.edu) are provided.

Setup in S3DF

Group folder for the data-systems is:

/sdf/group/lcls/ds with the two sub-directories for analysis (/sdf/group/lcls/ds/ana) and data-management (/sdf/group/lcls/ds).  The ana folder contains many sub-directories  for psana releases (sw), detector calibration (detector) and more. The above prefix is similar to the /cds/group/psdm in PCDS.

LCSL experimental data:

/sdf/data/lcls/ds/<instr>/<expt>/<expt-folders>

S3DF Documentation

S3DF-maintained facility documentation can be found here.

Using psana in S3DF

psana1

% source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/psconda.sh  [-py2]

The command above activates by default the most recent python 3 version of psana. New psana versions do not support python 2 anymore, but it still possible to activate the last available python 2 environment (ana-4.0.45) using the -py2 option.

psana2

% source /sdf/group/lcls/ds/ana/sw/conda2/manage/bin/psconda.sh

Jupyter

Jupyter is provided by the onDemand service. We are not planning to run a standalone jupyterhub as is done at PCDS. For more information check the S3DF interactive compute docs.

  • No labels