Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Under Construction (Not for Users)

The S3DF (SLAC Shared Science Data Facility) is a SLAC-wide computing facility. For LCLS the S3DF will replace the PCDS current computer and storage resources used for data processing.  

The S3DF has it's own users home directories.

Accessing the S3SDF

To access to the S3DF systems  connect to the s3dflogin

To get into the LCLS photon computing system you can connect to the pslogin pool from anywhere:

pool and login with you unix account:

No Format
% ssh sdf3login

...

.slac.stanford.edu

...

 

The login nodes The SDF using the SLAC Active Directory authentication.  This means you need to use your SLAC Windows account rather than your UNIX account (even if the SDF is entirely Linux based).  If you don't have a SLAC Windows account, users with a SLAC UNIX account (this is the same as your LCLS account) can generate an Active Directory password by following the instructions here: Accounts Portal.  It's supposed to be straightforward for U.S. residents/citizens.  foreign nationals will get a  may have to fill out an "HTTP Request Failed" error and will receive email about filling out a DOE "FACTS" form.To login, from a node inside slac (e.g. psnxopr, pslogin,...) type "ssh sdf-login".the data folders mounted. Eventually there will be LCLS specific interactive nodes. For data transfers the sdfdtn001 - sdfdtn005 are provided. 

Setup in S3DF

The group folder for the data-systems is:

/sdf/group/lcls/ds

it contains many subfolders for software and releases (sw), detector calibration (detector) and more. The above prefix corresponds to the /cds/group/psdm in PCDS.

All LCSL data are below:

/sdf/data/lcls/ds/<instr>/<expt>/<expt-folders>

SDF Documentation

Documentation on the SDF can be found here (scroll down a little to see the documentation).The SDF uses SLURM.  LCLS users should use the partition (queue) names "lcls".  Documentation on submitting jobs can be found at the SDF SLURM installation page.

To see your disk quota usage use this command: /sdf/sw/sdf-quota.sh

Using psana in SDF

...

psana1

No Format
% source 

...

/sdf/group/lcls/ds/

...

sw/

...

ana/

...

conda1/manage/bin/psconda.sh

...

  [-py2]

The default (no -py2) uses python3.

psana2

No Format
% source 

Experiment Folder

...

/sdf/group/lcls/ds/

...

sw/ana/conda2/manage/bin/psconda.sh