Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: minor punctuation and formatting corrections

...

There are numerous ways to access your data. Each have their pro's and con's pros and cons which will be discussed. All data in is kept on SLAC's global file system and is available from all centrally managed hosts. 

All experimental data is stored under /sdf/group/cryoem/exp/YYYYMM/YYYYMMDD-AA## where Y is year, M is month, D is day, and AA## is the 4-character alphanumeric proposal number. Example: if your experiment name is 20180520-CS01, then your data will be held under located at /sdf/group/cryoem/exp/201805/20180520-CS01.

Permissions to access the data can be controlled via the elogbook https://cryoem-logbook.slac.stanford.edu/lgbk/experiments. One should add the SLAC unix ID whomever should have access to the data to the list of 'collaborators' for the experiment.

...

Globus

One can create a free globus Globus account at at https://globusonline.org. From there, one can download a local client (Globus Connect Personal) so that files may be copied to say your laptop, or staged to another Globus Endpoint that your institution may run.

...

You should use your SLAC Unix Account as credentials to log into slac#cryoem endpoint (once you have a globus idID).

SAMBA

If you are onsite at SLAC, you can access the data via samba/cifs. You should connect to zslaccfs in order to browse the global directory. From there you can access the cryo-EM disks under cryoem.

...

BBCP provides multi-stream parallel transfers of data that allows transfers speeds to be significantly higher than that of scp. Details TBD.



Summary



GlobusSAMBASSHFSRSYNC/SCPBBCP
Software Install
Clients available, Servers should already have it installedImplementation already baked into MAC OS and Windows. Simple install for Linux.Requires FUSE library. Not available for Windows (
i
I think)Command line tools usually already installed in most Linux and MAC OSes. GUI's available for SCP.Command line tools only
Graphical Interface
Yes (Web)Yes (OS)Yes (OS)PotentiallyNo
Command line interface
YesYes (standard OS)Yes (standard OS)Yes (standard OS)Yes (standard OS)
Performance
FastFastSlowSlowFast
Access
AnywhereAt SLAC OnlyAnywhereAnywhereAnywhere
Credentials
Globus ID + SLAC UnixSLAC WindowsSLAC UnixSLAC UnixSLAC Unix
Ease of Use
EasyEasyMediumDifficultDifficult