Important locations
- FACET elog: http://physics-elog.slac.stanford.edu/facetelog/
- Important nodes: "rhel6-64.slac.stanford.edu" (general login node) "mcclogin" (node to reach the control servers) "facet-srv01" (control server, which requires access as fphysics@facet-srv01)
- Data storage:
/nfs/slac/g/facetdata/nas/nas-li20-pm00 (accessible from, e.g., mcclogin)
[eventually mirrored from: /nas/nas-li20-pm00/E320/ (which is accessible from facet-srv20)] - Data from first run: /u1/facet/matlab/data (you can access e.g., from fphysics@facet-srv20)
- Scopedata: /u1/facet/physics/e320/scopedata/ (copied to /nas/nas-li20-pm00/E320/)
- Attention: one might need to work explicitly in "bash" to use wildcharacters, e.g., : scp -r fphysics@facet-srv01:/u1/facet/physics/e320/scopedata/2021_08_13___22* /afs/slac/u/gu/smeuren/scopedata/
Copying files to your local computer
- Method A: use a bunch of scp to bring data to a node with internet access; then use scp from your local computer to download them. This can cause quota issues though.
- Method B (avoiding quota issues):
- tar the folder that you want to copy [ tar -zcvf file.tar.gz /path/to/dir/]
- use the script from Control network: little tricks to copy the tar file to your local computer
- Desperate means to download old data:
- copy the date from /nfs/etc. to a facet server (no quota issues there): (smeuren@mcclogin $ scp -r /nfs/slac/g/facetdata/nas/nas-li20-pm00/E320/2022/20220820/E320_03027/ fphysics@facet-srv20:/home/fphysics/smeuren/)
- tar the folder on the control computer and use Method B above
Example data analysis procedure (Version A)
- Go to the FACET elog: http://physics-elog.slac.stanford.edu/facetelog/
- Find the shift summary with information about the data sets taken, e.g., http://physics-elog.slac.stanford.edu/facetelog/show.jsp?dir=/2021/32/13.08&pos=2021-08-13T06:00:00
- Determine which run we want to analyze, e.g., http://physics-elog.slac.stanford.edu/facetelog/show.jsp?dir=/2021/32/13.08&pos=2021-08-13T04:50:00
- (Log into facet-srv20 (you need permission, see FACET Computing): ssh fphysics@facet-srv20 -Y): only needed if the data analysis should be done on the cluster
- Optional: verify, that you can access the path shown in the elog entry
- Log into a general SLAC computing note from your own computer, e.g., ssh smeuren@rhel6-64.slac.stanford.edu
- Get your personal home folder via pwd, e.g., /afs/slac.stanford.edu/u/gu/smeuren
- Log into mcclogin, e.g., ssh smeuren@mcclogin -Y
- smeuren@mcclogin $ scp -r fphysics@facet-srv20:/nas/nas-li20-pm00/E305/2021/20210813/E305_00292 /afs/slac/u/gu/smeuren/
Example data analysis procedure (Version B)
Here is how to copy data using the fastx3 webinterface:
Copy the data from fastx3 to your personal computer:
Nodes with access to the internet
- Log into mcclogin, e.g., ssh smeuren@mcclogin -Y
- Log into, e.g., ssh smeuren@rhel6-64.slac.stanford.edu -Y
- start firefox (slow due to x-forwarding)
Read the metadata (matlab) files from python
- Get access to python (e.g., on facet-srv01): source $PACKAGE_TOP/anaconda/envs/python3.7env/bin/activate On rhel: source /afs/slac/g/lcls/package/anaconda/envs/python3.7env/bin/activate (one might need to explicitly start a bash shell)
- run python3