...

2024-06-17 Test for mpi det.calib standard

Dataset

    ds = MPIDataSource('exp=xcsl1030422:run=237')
    det = Detector('XcsEndstation.0:Epix10ka2M.0')
    ds.break_after(nevents*size)

List of commands

> s3dflogin
> psana
srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash
...
[dubrovin@sdfmilan050:~/LCLS/con-py3]$


In other window
===============
> s3dflogin
ssh -Y sdfmilan050
cd LCLS/con-py3
source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/psconda.sh
source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/setup_testrel

mpirun -n   1 python Detector/examples/test-scaling-mpi-epix10ka2m.py 1
mpirun -n  80 python Detector/examples/test-scaling-mpi-epix10ka2m.py 1

...

hostname:sdfmilan219 rank:000 cpu:014 cmt:16p-v1 proc time (sec) mean: 0.2079 +/- 0.0032 rms: 0.0109 +/- 0.0022

Ratio: 1.33

2024-06-18 Test for mpi det.calib local with inserted timeing points

...

                           0.316   0.021 021    0.001  11.103   1.291   0.001   0.024   3.974 974  319.814   3.460   9.436   8.443   1.567

80-core:             ,rank 0: 0.373   0.024   0.002  12.639   1.674   0.001   0.017   4.744 384.576   4.154  11.336  10.108   2.100

...

                           0.396   0.024   0.002  13.547   1.691   0.001   0.018   4.621 381.572 572    4.092  11.252  10.070   2.106

Ratio:                  1.22.     1.2.          -       1.14.       1.29    -           -           1.16.   -               1.20      1.20.     1.20.     1.34   

References

• Scaling behavior of psana1 - Part 1 - det.calib method in multicore processing with mpi
• Scaling behavior of psana1 - Part 2 - test with command perf stat
• Scaling behavior of psana1 - Part 3 - test for reduced memory consumption