You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 4 Next »

Mar. 2, 2021

Code:

import datetime as dt
t = dt.datetime.now()
print('Start at',t.strftime('%H:%M:%S'))

from psana import *
import sys
myrun=sys.argv[1]

t = dt.datetime.now()
print('Import done at',t.strftime('%H:%M:%S'))

dsource = MPIDataSource('exp=cxilu9218:run='+myrun+':smd:dir=/cds/data/drpsrcf/cxi/cxilu9218/xtc')
jungfraudet = Detector('jungfrau4M')

t = dt.datetime.now()
print('Detector done at',t.strftime('%H:%M:%S'))

for nevt,evt in enumerate(dsource.events()):
   calib = jungfraudet.calib(evt)

t = dt.datetime.now()
print('Job done at',t.strftime('%H:%M:%S'))

Results:

Nic Speed (Gb/s)NodesCores/NodeImport Time (s)Detector Creation Time (s)Analysis Time (MM:SS)
10112063626:57
10164102324:37
1026482213:17
10212064114:02
116415324:34
1112084026:42

Conclusions

  • Unlike Jan. 27 measurements below the hyper threading cores didn't seem to help.  Feels like "operator error" on my part?
  • Nodes with 10Gb NICs vs. 1Gb NICs didn't make a significant difference
  • Best configuration seems to be 2 nodes with 64 cores/node.

Jan. 27, 2021

Code:

from psana import *

dsource = MPIDataSource('exp=cxilu9218:run=237:smd:dir=/cds/drpsrcf/cxi/cxilu921
8/xtc/')
jungfraudet = Detector('jungfrau4M')

smldata = dsource.small_data('/cds/drpsrcf/cxi/cxilu9218/scratch/run237.h5',gath
er_interval=100)

partial_run_sum = None
for nevt,evt in enumerate(dsource.events()):

   calib = jungfraudet.calib(evt)
   if calib is None: continue
   jungfrau_sum = calib.sum()      # number
   smldata.event(jungfrau_sum=jungfrau_sum)

Results:

NodesCores/NodeTime (HH:MM:SS)
26416:06
16427:31
1321:43:29
212816:11
112016:45
224019:17
  • No labels