Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Data analysis during shifts

...

Code Block
[fphysics@facet-srv20 /nas/nas-li20-pm00 ]$ ll -hrt
total 24K
drwxrwxr-x 3 fphysics facet 4.0K Jul 23 16:03 E300
drwxrwxr-x 3 fphysics facet 4.0K Jul 23 16:53 E326
drwxrwxr-x 3 fphysics facet 4.0K Aug 11 16:09 E305
drwxrwxr-x 3 fphysics facet 4.0K Aug 11 17:18 E320
drwxrwxr-x 3 fphysics facet 4.0K Aug 12 16:13 E327
drwxrwxr-x 4 fphysics facet 4.0K Aug 13 13:36 TEST


Data retrieval after shifts

Everyday at 10 AM, the data is transferred from the NAS to SLAC Central Computing where it is redundantly stored (no data loss). Both FACET and FACET-II data is located here:

Code Block
sgess@rhel6-64c nas-li20-pm00 $ ll -hrt
total 11M
drwxrwxr-x 3 fdata ar 512 Apr  3  2015 E200qq
drwxrwxr-x 4 fdata ar 512 Dec  7  2015 THz
drwxrwxr-x 3 fdata ar 512 Dec  7  2015 T506
drwxrwxr-x 3 fdata ar 512 Dec  7  2015 E214
drwxrwxr-x 4 fdata ar 512 Dec 10  2015 T504
drwxrwxr-x 4 fdata ar 512 Jan 12  2016 E210
drwxrwxr-x 5 fdata ar 512 Feb  6  2016 E217
drwxrwxr-x 4 fdata ar 512 Feb 13  2016 E212
drwxrwxr-x 4 fdata ar 512 Feb 13  2016 E209
drwxrwxr-x 5 fdata ar 512 Feb 14  2016 E201
drwxrwxr-x 3 fdata ar 512 Feb 14  2016 E204
drwxrwxr-x 5 fdata ar 512 Feb 14  2016 E224
drwxrwxr-x 5 fdata ar 512 Feb 14  2016 E200
drwxrwxr-x 3 fdata ar 512 Feb 18  2016 E215
drwxrwxr-x 3 fdata ar 512 Feb 23  2016 nate
drwxrwxr-x 4 fdata ar 512 Mar 24  2016 E225
-rw-rw-rw- 1 fdata ar 11M Feb 26  2019 orig_img_00001.tif
drwxrwxrwx 3 fdata ar 512 Jul 23 16:03 E300
drwxrwxrwx 3 fdata ar 512 Aug 11 16:09 E305
drwxrwxr-x 5 fdata ar 512 Aug 13 13:36 TEST
drwxrwxrw- 2 fdata ar 512 Aug 14 15:04 E320
drwxrwxrw- 2 fdata ar 512 Aug 14 15:04 E326
drwxrwxrwx 3 fdata ar 512 Aug 15 12:13 E327


The best way to transfer data is to use the rsync command which is better than scp if the transfer gets interrupted.

To get the data, from your local machine do (for example):

Code Block
rsync -av sgess@rhel6-64.slac.stanford.edu:/nfs/slac/g/facetdata/nas/nas-li20-pm00/E300 .