Page tree
Skip to end of metadata
Go to start of metadata

You will first need a SLAC unix computer account to be access your data.

There are numerous ways to access your data. Each have their pro's and con's which will be discussed. All data in kept on SLAC's global file system and is available from all centrally managed hosts. 

All experimental data is stored under /gpfs/slac/cryo/fs1/exp/ and is organised within a directory that is the month of the experiment. eg if your experiment name is 20180520-CS01, then your data will be held under /gpfs/slac/cryo/fs1/exp/201805/20180520-CS01.

Permissions to access the data can be controlled via the elogbook https://cryoem-logbook.slac.stanford.edu/lgbk/experiments. One should add whomever should have access to the data to the list of 'collaborators' for the experiment.

RSYNC/SCP

Rsync can be used over ssh to bulk transfer/synchronise data across different locations. Please use dtn02.slac.stanford.edu for this purpose.

Globus

One can create a free globus account at https://globusonline.org. From there, one can download a local client (Globus Connect Personal) so that files may be copied to say your laptop, or staged to another Globus Endpoint that your institution may run.

The Endpoint for SLAC CryoEM's data is at slac#cryoem.

You should use your SLAC Unix Account as credentials to log into slac#cryoem endpoint (once you have a globus id)

SAMBA

If you are onsite at SLAC, you can access the data via samba/cifs. You should connect to zslaccfs in order to browse the global directory. From there you can access the cryo-EM disks under cryoem.

You should login with your SLAC Windows Account to use this.

  1. On your Linux machine, open a terminal window.
  2. Install the necessary software with the command sudo apt-get install -y samba samba-common python-glade2 system-config-samba.
  3. Type your sudo password and hit Enter.
  4. Allow the installation to complete.
  5. Open a new file browser window.
  6. At the bottom of the left navigation pane, click "Other Locations"
  7. At the bottom of the window, in the "Connect to Server" field, Type smb://zslaccfs/
  8. Open the cryoem directory.
  9. Log in with your SLAC Windows account username and password, leave the "Workgroup" field as the default value or if using Ubuntu the domain should be "slac".
  10. You can now browse the CryoEM disks in your Linux file browser.

Alternatively, you can mount it via command line. 

  1. Install cifs-utils. sudo apt-get install cifs-utils

  2. Create a directory where you want to mount it. sudo mkdir /mnt/slac
  3. sudo mount -t cifs -o username=SLAC_USERNAME,vers=1.0,domain=slac,uid=`id -u` //zslaccfs.slac.stanford.edu/cryoem/ /mnt/slac

    Note that the uid is important so that you as user can have the correct permissions on your local desktop.

 

 

SSHFS

You can also use the FUSE based SSHFS to mount the filesystem via ssh. It is recommended to ssh into dtn02.slac.stanford.edu in order to use this method.

Using SSHFS, the filesystem will be mounted locally so that you may browse the directory as you would with SAMBA etc.

BBCP

BBCP provides multi-stream parallel transfers of data that allows transfers speeds to be significantly higher than that of scp. Details TBD.

 

 

Summary

  GlobusSAMBASSHFSRSYNC/SCPBBCP
       
Software Install Clients available, Servers should already have it installedImplementation already baked into MAC OS and Windows. Simple install for Linux.Requires FUSE library. Not available for Windows (i think)Command line tools usually already installed in most Linux and MAC OSes. GUI's available for SCP.Command line tools only
Graphical Interface Yes (Web)Yes (OS)Yes (OS)PotentiallyNo
Command line interface YesYes (standard OS)Yes (standard OS)Yes (standard OS)Yes (standard OS)
Performance FastFastSlowSlowFast
Access AnywhereAt SLAC OnlyAnywhereAnywhereAnywhere
Credentials Globus ID + SLAC UnixSLAC WindowsSLAC UnixSLAC UnixSLAC Unix
Ease of Use EasyEasyMediumDifficultDifficult
       
       
  • No labels