Read with smalldata callback

Software version: ps-4.5.16 

Cluster: srcf

MPI Version: openmpi 4.1.4

Data size: 6.6 GB for one smd and bigdata files. Note that the original data are from tmoc00018 run 463 which has 5 set of smd and bigdata files (1 timing and 4 hsds). One of the hsd stream was duplicated to generate up to 60 sets of smd and bigdata files.

Data location: /cds/data/drpsrcf/users/monarin/xtcdata

MPI Settings: Peak performance settings for different tests

Smd0: One node (n-stream threads)

Smd0-1Eb: One node

Smd0-nEb-mBd: Rank 0 (Smd0 )runs on its own node using 32 as maximum no. of threads. Other ranks are spread out with no. of maximum ranks per node = 50. Note that these no. of thread (32) and spreading factor (50) were based on empirical runs. 

Smd0 Performance (MHz)

Reading N smalldata file(s) using N thread(s)

Smd0-EvenBuilder Performance (kHz)

Smd0 is connected to one EventBuilder core on the same node. This performance measures event building process and other overheads (eg. MPI Send/Recv) with and without the smalldata callback.