...
S3DF main page: https://s3df.slac.stanford.edu/public/doc/#/
S3DF accounts&access: https://s3df.slac.stanford.edu/public/doc/#/accounts-and-access(your unix account will need to be activated on the S3DF system)
Warning |
---|
|
...
Warning |
---|
So far data are only copied to the S3DF on request and run restores are to the PCDS Lustre file systems. |
A scratch folder is provided for every experiment and is accessible using the canonical path
/sdf/data/lcls/ds/<instr>/<expt>/<expt-folders>/scratch
The scratch folder lives on a dedicated high performance file system and the above path is a link to this file system.
In addition to the experiment scratch folder each users has its own scratch folder:
/sdf/scratch/users/<first character of name>/<user-name> (e.g. /sdf/scratch/users/w/wilko)
The users scratch space is limited to 100GB and as the experiment scratch folder old files will be automatically removed when the scratch file system is filling up. The df command will show the usage of a users scratch folder.An example notebook can be found here:/sdf/home/e/espov/s3df_demo.ipynb
...
Warning |
---|
onDemand requires a valid ssh-key (~/.ssh/s3df/id_ed25519) which are auto generated when an account is enabled in the S3DF. However, older accounts might not have this key but can create it running the following command on a login or interactive node: /sdf/group/lcls/ds/dm/bin/generate-keys.sh If you still have issues logging, go to https://vouch.slac.stanford.edu/logout and try loging in again. |
Please note that the "Files" application cannot read ACLs which means that (most likely) you will not be able to access your experiment directories from there. Jupyterlab (or interactive terminal session) from the psana nodes will not have this problem.
In the "Interactive Apps" select Jupyter, this opens the following form
...