Page History
Table of Contents |
---|
Issue
Code Block | ||||
---|---|---|---|---|
| ||||
2024-01-04 1:22pm Li, Yee Ting; Kroeger, Wilko Hi Mikhail, (cc: Yee, Wilko since they may have an interest in this) When you have a chance, could you look at the scaling behavior of this script. It tries to "prefetch" the data from disk (for 100 events per core) with det.raw, and then times the behavior of det.calib: ~cpo/problems/cxix1000021_scaling/cxix1000021_scaling.py To do this get exclusive access to a batch node with this command: srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash The in another window ssh to the node that you have been allocated (the reason this is necessary is obscure: it has to do with an incompatible version of pmix used by srun that our mpi is unhappy with). In that new window run these two commands: mpirun -n 1 python cxix1000021_scaling.py mpirun -n 80 python cxix1000021_scaling.py For me the first one shows about .11s per event while the second shows about .25s per event, which is the poor scaling behavior we would like to understand. You can see logfiles in ~cpo/problems/cxix1000021_scaling in interactive_1core.log and interactive_80core.log. I think the fundamental question that I hope you could answer is: do all numpy operations in det.calib slow down on 80 cores, or is there some other cause for the poor scaling? From discussions we've had with Yee we suspect the poor scaling may be due to behavior of the hardware, but we don't know for sure. Happy to discuss this with you on zoom at any time, of course. Thanks for looking at this! chris p.s. following a suggestion by someone (Yee? Wilko?) I watched the cpu clock speeds in /proc/cpuinfo while the 80 core job was running. To my eye they seemed to vary between ~2.4MHz and ~3.0Mhz which didn't feel like quite enough |
List of commands for this test
Code Block | ||||
---|---|---|---|---|
| ||||
> s3dflogin > psana srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash Ex: ana-4.0.58-py3 [dubrovin@sdfiana001:~/LCLS/con-py3]$ srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash srun: job 37602834 queued and waiting for resources srun: job 37602834 has been allocated resources In .bashrc on host sdfiana001 In .bash_login ana-4.0.58-py3 [dubrovin@sdfmilan031:~/LCLS/con-py3]$ grab example from Chris: ~cpo/problems/cxix1000021_scaling/cxix1000021_scaling.py and modify it as explained below. In other window > s3dflogin ssh -Y sdfmilan031 cd LCLS/con-py3 source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/psconda.sh source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/setup_testrel mpirun -n 1 python test-cxix1000021_scaling.py mpirun -n 80 python test-cxix1000021_scaling.py |
Code for time monitoring
Code Block | ||||
---|---|---|---|---|
| ||||
def calib_jungfrau(det, evt, cmpars=(7,3,200,10), **kwa): """ Returns calibrated jungfrau data - gets constants - gets raw data - evaluates (code - pedestal - offset) - applys common mode correction if turned on - apply gain factor Parameters - det (psana.Detector) - Detector object - evt (psana.Event) - Event object - cmpars (tuple) - common mode parameters - cmpars[0] - algorithm # 7-for jungfrau - cmpars[1] - control bit-word 1-in rows, 2-in columns - cmpars[2] - maximal applied correction - **kwa - used here and passed to det.mask_v2 or det.mask_comb - nda_raw - if not None, substitutes evt.raw() - mbits - DEPRECATED parameter of the det.mask_comb(...) - mask - user defined mask passed as optional parameter """ t00 = time() src = det.source # - src (psana.Source) - Source object nda_raw = kwa.get('nda_raw', None) arr = det.raw(evt) if nda_raw is None else nda_raw # shape:(<npanels>, 512, 1024) dtype:uint16 if arr is None: return None t01 = time() peds = det.pedestals(evt) # - 4d pedestals shape:(3, 1, 512, 1024) dtype:float32 if peds is None: return None t02 = time() gain = det.gain(evt) # - 4d gains offs = det.offset(evt) # - 4d offset t03 = time() detname = string_from_source(det.source) cmp = det.common_mode(evt) if cmpars is None else cmpars t04 = time() if gain is None: gain = np.ones_like(peds) # - 4d gains if offs is None: offs = np.zeros_like(peds) # - 4d gains # cache gfac = store.gfac.get(detname, None) # det.name if gfac is None: gfac = divide_protected(np.ones_like(peds), gain) store.gfac[detname] = gfac store.arr1 = np.ones_like(arr, dtype=np.int8) t05 = time() # Define bool arrays of ranges # faster than bit operations gr0 = arr < BW1 # 490 us gr1 =(arr >= BW1) & (arr<BW2) # 714 us gr2 = arr >= BW3 # 400 us t06 = time() # Subtract pedestals arrf = np.array(arr & MSK, dtype=np.float32) t07 = time() arrf[gr0] -= peds[0,gr0] arrf[gr1] -= peds[1,gr1] #- arrf[gr1] arrf[gr2] -= peds[2,gr2] #- arrf[gr2] t08 = time() factor = np.select((gr0, gr1, gr2), (gfac[0,:], gfac[1,:], gfac[2,:]), default=1) # 2msec t09 = time() offset = np.select((gr0, gr1, gr2), (offs[0,:], offs[1,:], offs[2,:]), default=0) t10 = time() arrf -= offset # Apply offset correction t11 = time() if store.mask is None: store.mask = det.mask_total(evt, **kwa) mask = store.mask t12 = time() if cmp is not None: mode, cormax = int(cmp[1]), cmp[2] npixmin = cmp[3] if len(cmp)>3 else 10 if mode>0: #arr1 = store.arr1 #grhg = np.select((gr0, gr1), (arr1, arr1), default=0) logger.debug(info_ndarr(gr0, 'gain group0')) logger.debug(info_ndarr(mask, 'mask')) t0_sec_cm = time() gmask = np.bitwise_and(gr0, mask) if mask is not None else gr0 #sh = (nsegs, 512, 1024) hrows = 256 #512/2 for s in range(arrf.shape[0]): if mode & 4: # in banks: (512/2,1024/16) = (256,64) pixels # 100 ms common_mode_2d_hsplit_nbanks(arrf[s,:hrows,:], mask=gmask[s,:hrows,:], nbanks=16, cormax=cormax, npix_min=npixmin) common_mode_2d_hsplit_nbanks(arrf[s,hrows:,:], mask=gmask[s,hrows:,:], nbanks=16, cormax=cormax, npix_min=npixmin) if mode & 1: # in rows per bank: 1024/16 = 64 pixels # 275 ms common_mode_rows_hsplit_nbanks(arrf[s,], mask=gmask[s,], nbanks=16, cormax=cormax, npix_min=npixmin) if mode & 2: # in cols per bank: 512/2 = 256 pixels # 290 ms common_mode_cols(arrf[s,:hrows,:], mask=gmask[s,:hrows,:], cormax=cormax, npix_min=npixmin) common_mode_cols(arrf[s,hrows:,:], mask=gmask[s,hrows:,:], cormax=cormax, npix_min=npixmin) logger.debug('TIME: common-mode correction time = %.6f sec' % (time()-t0_sec_cm)) t13 = time() resp = arrf * factor if mask is None else arrf * factor * mask # gain correction t14 = time() times = np.array((t00, t01, t02, t03, t04, t05, t06, t07, t08, t09, t10, t11, t12, t13, t14), dtype=np.float64) return resp, times |
Timing histograms
Single core processing
80-core processing for ranks 0, 30, and 60
Results
Table shows mean time increment and their statistical uncertainty from associated histograms.
t point | time increment | point description | time for rank 0/1 | rank 0/80 | rank 30/80 | rank 60/80 |
---|---|---|---|---|---|---|
1 | t1 - t0 | det.raw | 0.8±0.2 ms | 4.0 ±0.6 ms | 3.2±0.4 ms | 3.5 ±0.8 ms |
2 | t2 - t1 | det.pedestals | 15±3 μs | 36 ±10 μs | 31±6 μs | 39 ±17 μs |
3 | t3 - t2 | det.gain,offset | 15±2 μs | 27 ±4 μs | 26±4 μs | 27 ±6 μs |
4 | ... | cmpars | 25±1 μs | 50 ±7 μs | 58±26 μs | 71 ±33 μs |
5 | gfac | 2±0 μs | 6 ±1 μs | 7±1 μs | 7 ±2 μs | |
6 | gr0,1,2 | 1.3±0.2 ms | 10.5 ±1.1 ms | 7.0±0.9 ms | 9.7 ±1.6 ms | |
7 | make arrf | 1.76±0.05 ms | 9.2 ±0.9 ms | 6.3±0.7 ms | 9.0 ±1.5 ms | |
8 | subtract peds | 93.7±3.1 ms | 191 ±11 ms | 181±15 ms | 259 ±26 ms | |
9 | eval gain factor for gain ranges | 4.9±0.6 ms | 20.3 ±1.5 ms | 14.6±1.2 ms | 17.3 ±2.0 ms | |
10 | eval offset for gain ranges | 6.2±0.4 ms | 18.5 ±1.3 ms | 18.4±1.4 ms | 19.2 ±2.1 ms | |
11 | subtract offset | 1.0±0.2 ms | 6.0 ±0.7 ms | 5.3±0.6 ms | 6.2 ±1.2 ms | |
12 | get mask | 3±2 μs | 6 ±2 μs | 6±2 μs | 7 ±2 μs | |
13 | common mode turned off | 7±1 μs | 15 ±2 μs | 17±2 μs | 20 ±3 μs | |
14 | t14 - t13 | apply gain factor and mask | 4.0±0.7 ms | 14.9 ±2.0 ms | 13.9±1.6 ms | 19.2 ±3.5 ms |
99 | t14 - t0 | per evt time, inside det.calib | 109.8±4.2 ms | 276 ±15 ms | 247±13 ms | 345 ±29 ms |
0 | t0 - t0 previous evt | time between consecutive det.calib | 115.4±3.9 ms | 335 ±16 ms | 307±14 ms | 398 ±32 ms |
Summary
- single core processing is faster than per/core time in 80–core case, factor 2.5-3 FOR ALL OPERATIONS
- in 80-core case: time per core is consistent between cores
- all constants are cashed and access to constants is fast at sub-milisecond level
- common mode correction is turned off, as well as mask?
- most time consuming operation is indexed pedestal subtraction
...
- bad single-to-multicore scaling issue has nothing to do with particular algorithm, it is common problem for any algorithm
2024-01-16 Test for simulated events
Time consuming code
Code Block | ||||
---|---|---|---|---|
| ||||
def time_consuming_algorithm(): sh2d = (1024,1024) sh3d = (3,) + sh2d a = random_standard(shape=sh2d, mu=10, sigma=2, dtype=np.float64) b = random_standard(shape=sh3d, mu=20, sigma=3, dtype=np.float64) gr1 = a>=11 gr2 = (a>9) & (a<11) gr3 = a<=9 a[gr1] -= b[0, gr1] a[gr2] -= b[1, gr2] a[gr3] -= b[2, gr3] |
2024-01-16 Test Summary
- runing on sdfmilan031 - shows minor ~ 5% the mean time difference between 1-core and 80-core processing is larger
2024-01-17 Test for simulated events with minor modifications
Test variation
- array shape is changed from (1024, 1024) → (8*512, 1024) 4M
- array generation is excluded from time measurement, only indexed subtraction contributes to time measurement
- do not pre-create random arrays, it is generated in each core... requires too much memory for all cores.
- run on sdfmilan047: ana-4.0.58-py3 [dubrovin@sdfmilan047:~/LCLS/con-py3]$ mpirun -n 80 python test-mpi-numpy-hist.py
Time consuming code
Code Block | ||||
---|---|---|---|---|
| ||||
def time_consuming_algorithm(a, b): gr1 = a>=11 gr2 = (a>9) & (a<11) gr3 = a<=9 t0_sec = time() a[gr1] -= b[0, gr1] a[gr2] -= b[1, gr2] a[gr3] -= b[2, gr3] return time() - t0_sec |
Results
Single core processing
80-core processing for ranks 0, 30, and 60
2024-01-17 Test Summary
- if random array generation is excluded from time measurement, the mean time difference between 1-core and 80-core processing is larger
- the main contribution to time difference comes from reserved host...
- sdfmilan047 - looks like extremely "time-noisy" in multi-core processing...
- sdfmilan031 - in previous test looks pretty "calm"
2024-01-19 Test for a few hosts
- The same simulation algorithm as before is used to compare processing time of different cores.
- To get rid of obvious fluctuation off time measurement between cores, a sample of cores is extended from three, 0,30,60 to seven 0,10,20,30,40,50,60 of 80.
- Mean processing time and its uncertainty in milliseconds for single core (core 0/1) and a few cores of 80 are shown in table.
- Ratio represents the ratio of 80-core average over core 0/1.
...
Code Block | ||||
---|---|---|---|---|
| ||||
2024-01-19 6:24PM Hi Mikhail, I think those code can fetch a physical core number: >>> import psutil >>> print(psutil.Process().cpu_num()) 3 >>> Can you add that to your numpy tests to make sure that cores 16-23 aren’t used by your mpi processes? I think Wilko thought those 8 cores run weka filesystem processes. Thanks, and have a good weekend, chris |
2024-01-19 Time difference vs array size
- shape is decreased in size from (8*512,1024) to (2*512,1024) 1M
...
host name | core 0/1 | 0/80 | 10/80 | 20/80 | 30/80 | 40/80 | 50/80 | 60/80 | 70/80 | 80-core average | Ratio | Largest ratio |
---|---|---|---|---|---|---|---|---|---|---|---|---|
sdfmilan225 | 766 ±20 | 1251 ±91 | 1099 ±108 | 958 ±174 | 955 ±199 | 1206 ±83 | 1086 ±106 | 949 ±181 | 952 ±231 | 1057 | 1.38 | 1.63 |
sdfmilan031 | 760 ±1 | 1141 ±81 | 1144 ±94 | 910 ±111 | 947 ±118 | 1221 ±74 | 1157 ±93 | 947 ±108 | 937 ±104 | 1051 | 1.38 | 1.61 |
2024-01-19-22 Test Summary
- weka FS nodes do not show up in processing ranks
- decreasing array size from 4M to 1M decreases time ratio from ~1.5 to 1.15
- increasing array size from 4M to 14M does not increases time ratio...
2024-01-22 Q&A
cpu_num = psutil.Process().cpu_num() vs runk
...
host name | job # | core 0/1 | 0/80 | 10/80 | 20/80 | 30/80 | 40/80 | 50/80 | 60/80 | 70/80 |
---|---|---|---|---|---|---|---|---|---|---|
sdfmilan215 | 1 | 0 | 8 | 36 | 66 | 111 | 2 | 41 | 67 | 101 |
sdfmilan215 | 2 | 0 | 11 | 39 | 71 | 97 | 1 | 42 | 66 | 103 |
sdfmilan215 | 3 | 0 | 4 | 40 | 69 | 101 | 10 | 33 | 77 | 107 |
2024-01-30 running in subprocesses
On allocated host run the same time consuming job on specified cpu using subprocess command
taskset --cpu-list %d python test-scaling-subproc.py %d
Simultaneous processing on cpu 0-7 of the same host
host name | cpu 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | |
---|---|---|---|---|---|---|---|---|---|
sdfmilan027 | 213 ±10 | 218 ±14 | 216 ±9 | 215 ±10 | 217 ±9 | 212 ±8 | 215 1±2 | 217 ±12 |
Code Block | ||||
---|---|---|---|---|
| ||||
requested cpu:001 cpu_num:001 nevt:000 time algo/total:0.258310/0.893963 cpu_num:001 nevt:010 time algo/total:0.203578/0.765441 cpu_num:001 nevt:020 time algo/total:0.204886/0.758621 cpu_num:001 nevt:030 time algo/total:0.207257/0.776058 cpu_num:001 nevt:040 time algo/total:0.240543/0.818005 cpu_num:001 nevt:050 time algo/total:0.219791/0.780273 cpu_num:001 nevt:060 time algo/total:0.221798/0.781831 cpu_num:001 nevt:070 time algo/total:0.227552/0.787389 cpu_num:001 nevt:080 time algo/total:0.224095/0.778408 cpu_num:001 nevt:090 time algo/total:0.226634/0.779186 |
Simultaneous processing on cpu 1, 8, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96 of the same host
host name | 1 | 8 | 24 | 32 | 40 | 48 | 56 | 64 | 72 | 80 | 88 | 96 | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
sdfmilan027 | 199 ±7 | 194 ±6 | 191 ±4 | 208 ±5 | 210 ±1 | 210 ±1 | 201 ±7 | 209 ±5 | 210 ±3 | 194 ±7 | 192 ±6 | 191 ±3 |
Code Block | ||||
---|---|---|---|---|
| ||||
requested cpu:096 cpu_num:096 nevt:000 time algo/total:0.201525/0.750702 cpu_num:096 nevt:010 time algo/total:0.200815/0.742284 cpu_num:096 nevt:020 time algo/total:0.199862/0.738482 cpu_num:096 nevt:030 time algo/total:0.200478/0.742564 cpu_num:096 nevt:040 time algo/total:0.200695/0.741042 cpu_num:096 nevt:050 time algo/total:0.199134/0.736679 cpu_num:096 nevt:060 time algo/total:0.198478/0.736582 cpu_num:096 nevt:070 time algo/total:0.198812/0.737684 cpu_num:096 nevt:080 time algo/total:0.200575/0.742578 cpu_num:096 nevt:090 time algo/total:0.200512/0.737443 |
2024-01-31 time consumption test in subprocess
Try to resolve mystery observed in previous test:
- time consuming algorithm takes ~200ms
- but time per event is ~740ms
Algorithm code
Code Block | ||||
---|---|---|---|---|
| ||||
def time_consuming_algorithm(): t01 = time() a, b = random_arrays() t02 = time() gr1 = a>=11 gr2 = (a>9) & (a<11) gr3 = a<=9 t03 = time() a[gr1] -= b[0, gr1] a[gr2] -= b[1, gr2] a[gr3] -= b[2, gr3] t04 = time() return (t01, t02, t03, t04) |
Code Block | ||||
---|---|---|---|---|
| ||||
def do_algo(cpu=0): hostname = get_hostname() #cpu_num = psutil.Process().cpu_num() print('requested cpu:%03d' % cpu) SAVE_FIGS = True nevents = 100 ntpoints = 6 arrts = np.zeros((nevents,ntpoints), dtype=np.float64) t05_old = time() for nevt in range(nevents): t00 = time() times = time_consuming_algorithm() cpu_num = psutil.Process().cpu_num() #if cpu_num >=16 and cpu_num <=23: # print('cpu_num:%03d nevt:%03d time:%.6f CPU_NUM IN WEKA RANGE [16,23]' % (cpu_num, nevt, dt_sec)) t05 = time() times = (t00,) + times + (t05,) arrts[nevt,:] = times dt_evt = t05 - t05_old t05_old = t05 if nevt%10>0: continue dt_alg = times[4] - times[3] dt_in = times[4] - times[1] print('cpu_num:%03d nevt:%03d times (sec)' % (cpu_num, nevt), \ ' random arrs: %.6f' % (times[2] - times[1]), \ ' indeces: %.6f' % (times[3] - times[2]), \ ' alg: %.6f' % (times[4] - times[3]), \ ' inside algo: %.6f' % (times[4] - times[1]), \ ' per event: %.6f' % dt_evt) ... fill-out and show histograms |
Per-event time split
Code Block | ||||
---|---|---|---|---|
| ||||
requested cpu:010 cpu_num:010 nevt:000 times (sec) random arrs: 0.530126 indeces: 0.009856 alg: 0.201348 inside algo: 0.741331 per event: 0.742876 cpu_num:010 nevt:010 times (sec) random arrs: 0.529047 indeces: 0.006796 alg: 0.199449 inside algo: 0.735292 per event: 0.736108 cpu_num:010 nevt:020 times (sec) random arrs: 0.529192 indeces: 0.006795 alg: 0.200225 inside algo: 0.736212 per event: 0.736941 cpu_num:010 nevt:030 times (sec) random arrs: 0.529076 indeces: 0.006807 alg: 0.198543 inside algo: 0.734425 per event: 0.735161 cpu_num:010 nevt:040 times (sec) random arrs: 0.529014 indeces: 0.006840 alg: 0.198867 inside algo: 0.734720 per event: 0.735475 cpu_num:010 nevt:050 times (sec) random arrs: 0.529560 indeces: 0.006824 alg: 0.199954 inside algo: 0.736338 per event: 0.737050 cpu_num:010 nevt:060 times (sec) random arrs: 0.529004 indeces: 0.006804 alg: 0.198679 inside algo: 0.734487 per event: 0.735210 cpu_num:010 nevt:070 times (sec) random arrs: 0.528883 indeces: 0.006833 alg: 0.199188 inside algo: 0.734903 per event: 0.735635 cpu_num:010 nevt:080 times (sec) random arrs: 0.528968 indeces: 0.006804 alg: 0.199556 inside algo: 0.735327 per event: 0.736039 cpu_num:010 nevt:090 times (sec) random arrs: 0.528690 indeces: 0.006826 alg: 0.199990 inside algo: 0.735506 per event: 0.736218 |
Summary for time consumption
Random array of shapes sh2d = (8*512,1024) and sh3d = (3, 8*512,1024) simulating raw data and calib constants takes ~0.5sec. In previous code only 2-panel shape (2*512,1024) was used.
...
Code Block | ||||
---|---|---|---|---|
| ||||
at 16 cpu requested cpu:015 cpu_num:015 nevt:000 times (sec) random arrs: 0.676525 indeces: 0.048282 alg: 0.345061 inside algo: 1.069867 per event: 1.073267 cpu_num:015 nevt:010 times (sec) random arrs: 0.557514 indeces: 0.012086 alg: 0.243178 inside algo: 0.812778 per event: 0.813630 cpu_num:015 nevt:020 times (sec) random arrs: 0.551355 indeces: 0.008622 alg: 0.257315 inside algo: 0.817291 per event: 0.818175 cpu_num:015 nevt:030 times (sec) random arrs: 0.556352 indeces: 0.008508 alg: 0.241447 inside algo: 0.806307 per event: 0.807756 cpu_num:015 nevt:040 times (sec) random arrs: 0.553430 indeces: 0.010278 alg: 0.211174 inside algo: 0.774882 per event: 0.777263 cpu_num:015 nevt:050 times (sec) random arrs: 0.549226 indeces: 0.009555 alg: 0.217025 inside algo: 0.775806 per event: 0.776775 cpu_num:015 nevt:060 times (sec) random arrs: 0.556838 indeces: 0.011403 alg: 0.218301 inside algo: 0.786542 per event: 0.787381 cpu_num:015 nevt:070 times (sec) random arrs: 0.564118 indeces: 0.013997 alg: 0.220398 inside algo: 0.798513 per event: 0.799616 cpu_num:015 nevt:080 times (sec) random arrs: 0.558824 indeces: 0.014296 alg: 0.218725 inside algo: 0.791845 per event: 0.793981 cpu_num:015 nevt:090 times (sec) random arrs: 0.552467 indeces: 0.013539 alg: 0.241585 inside algo: 0.807591 per event: 0.808606 === at 32 cpu requested cpu:000 cpu_num:000 nevt:000 times (sec) random arrs: 0.768741 indeces: 0.130826 alg: 0.534536 inside algo: 1.434103 per event: 1.437331 cpu_num:000 nevt:010 times (sec) random arrs: 0.707944 indeces: 0.084266 alg: 0.306825 inside algo: 1.099035 per event: 1.099948 cpu_num:000 nevt:020 times (sec) random arrs: 0.708561 indeces: 0.069767 alg: 0.378666 inside algo: 1.156994 per event: 1.158244 cpu_num:000 nevt:030 times (sec) random arrs: 0.761646 indeces: 0.061286 alg: 0.378687 inside algo: 1.201619 per event: 1.202453 cpu_num:000 nevt:040 times (sec) random arrs: 0.631669 indeces: 0.014007 alg: 0.269451 inside algo: 0.915127 per event: 0.916927 cpu_num:000 nevt:050 times (sec) random arrs: 0.711132 indeces: 0.067868 alg: 0.366595 inside algo: 1.145596 per event: 1.146980 cpu_num:000 nevt:060 times (sec) random arrs: 0.664688 indeces: 0.087194 alg: 0.469769 inside algo: 1.221651 per event: 1.223267 cpu_num:000 nevt:070 times (sec) random arrs: 0.735930 indeces: 0.022596 alg: 0.321454 inside algo: 1.079980 per event: 1.081903 cpu_num:000 nevt:080 times (sec) random arrs: 0.697990 indeces: 0.071118 alg: 0.263736 inside algo: 1.032844 per event: 1.033743 cpu_num:000 nevt:090 times (sec) random arrs: 0.577298 indeces: 0.008807 alg: 0.209763 inside algo: 0.795867 per event: 0.796584 requested cpu:015 cpu_num:015 nevt:000 times (sec) random arrs: 0.891085 indeces: 0.074366 alg: 0.475267 inside algo: 1.440718 per event: 1.443656 cpu_num:015 nevt:010 times (sec) random arrs: 0.646901 indeces: 0.029601 alg: 0.506834 inside algo: 1.183336 per event: 1.188114 cpu_num:015 nevt:020 times (sec) random arrs: 0.641244 indeces: 0.020880 alg: 0.362483 inside algo: 1.024606 per event: 1.025537 cpu_num:015 nevt:030 times (sec) random arrs: 0.653975 indeces: 0.038478 alg: 0.283170 inside algo: 0.975623 per event: 0.976723 cpu_num:015 nevt:040 times (sec) random arrs: 0.724432 indeces: 0.104294 alg: 0.365113 inside algo: 1.193839 per event: 1.196620 cpu_num:015 nevt:050 times (sec) random arrs: 0.669759 indeces: 0.027769 alg: 0.264526 inside algo: 0.962054 per event: 0.967170 cpu_num:015 nevt:060 times (sec) random arrs: 0.717789 indeces: 0.017697 alg: 0.332127 inside algo: 1.067613 per event: 1.069825 cpu_num:015 nevt:070 times (sec) random arrs: 0.677717 indeces: 0.034877 alg: 0.261328 inside algo: 0.973923 per event: 0.975290 cpu_num:015 nevt:080 times (sec) random arrs: 0.575024 indeces: 0.029689 alg: 0.380944 inside algo: 0.985657 per event: 0.989201 cpu_num:015 nevt:090 times (sec) random arrs: 0.605548 indeces: 0.025510 alg: 0.289985 inside algo: 0.921044 per event: 0.921819 requested cpu:039 cpu_num:039 nevt:000 times (sec) random arrs: 0.648366 indeces: 0.042368 alg: 0.421943 inside algo: 1.112678 per event: 1.114263 cpu_num:039 nevt:010 times (sec) random arrs: 0.583670 indeces: 0.014271 alg: 0.249655 inside algo: 0.847596 per event: 0.848407 cpu_num:039 nevt:020 times (sec) random arrs: 0.571773 indeces: 0.011460 alg: 0.220845 inside algo: 0.804077 per event: 0.806523 cpu_num:039 nevt:030 times (sec) random arrs: 0.574509 indeces: 0.011243 alg: 0.228133 inside algo: 0.813885 per event: 0.814791 cpu_num:039 nevt:040 times (sec) random arrs: 0.573384 indeces: 0.013692 alg: 0.228176 inside algo: 0.815251 per event: 0.816023 cpu_num:039 nevt:050 times (sec) random arrs: 0.589361 indeces: 0.019947 alg: 0.227057 inside algo: 0.836365 per event: 0.837242 cpu_num:039 nevt:060 times (sec) random arrs: 0.578790 indeces: 0.028885 alg: 0.233790 inside algo: 0.841465 per event: 0.842652 cpu_num:039 nevt:070 times (sec) random arrs: 0.580031 indeces: 0.009300 alg: 0.220303 inside algo: 0.809635 per event: 0.810407 cpu_num:039 nevt:080 times (sec) random arrs: 0.631875 indeces: 0.014580 alg: 0.232713 inside algo: 0.879168 per event: 0.879986 cpu_num:039 nevt:090 times (sec) random arrs: 0.613904 indeces: 0.025082 alg: 0.244429 inside algo: 0.883415 per event: 0.884130 |
2024-02-01 scaling for groups of busy cpus of the same host
Code Block | ||||
---|---|---|---|---|
| ||||
hostname:sdfmilan114 cpu:005 cmt:v1 proc time (sec) mean: 0.210 +/- 0.002 rms: 0.002 +/- 0.001 hostname:sdfmilan114 cpu:010 cmt:v1 proc time (sec) mean: 0.210 +/- 0.006 rms: 0.007 +/- 0.004 hostname:sdfmilan114 cpu:032 cmt:v1 proc time (sec) mean: 0.206 +/- 0.007 rms: 0.008 +/- 0.005 hostname:sdfmilan114 cpu:064 cmt:v1 proc time (sec) mean: 0.226 +/- 0.006 rms: 0.008 +/- 0.005 hostname:sdfmilan114 cpu:096 cmt:v1 proc time (sec) mean: 0.217 +/- 0.007 rms: 0.009 +/- 0.005 hostname:sdfmilan114 cpu:127 cmt:v1 proc time (sec) mean: 0.220 +/- 0.007 rms: 0.010 +/- 0.005 |
...
Code Block | ||||
---|---|---|---|---|
| ||||
hostname:sdfmilan114 cpu:000 cmt:v120 proc time (sec) mean: 0.484 +/- 0.044 rms: 0.131 +/- 0.031 hostname:sdfmilan114 cpu:001 cmt:v120 proc time (sec) mean: 0.490 +/- 0.048 rms: 0.147 +/- 0.034 hostname:sdfmilan114 cpu:002 cmt:v120 proc time (sec) mean: 0.488 +/- 0.046 rms: 0.141 +/- 0.033 hostname:sdfmilan114 cpu:003 cmt:v120 proc time (sec) mean: 0.490 +/- 0.045 rms: 0.144 +/- 0.032 hostname:sdfmilan114 cpu:004 cmt:v120 proc time (sec) mean: 0.487 +/- 0.045 rms: 0.140 +/- 0.032 hostname:sdfmilan114 cpu:005 cmt:v120 proc time (sec) mean: 0.492 +/- 0.046 rms: 0.144 +/- 0.032 hostname:sdfmilan114 cpu:006 cmt:v120 proc time (sec) mean: 0.486 +/- 0.044 rms: 0.139 +/- 0.031 hostname:sdfmilan114 cpu:007 cmt:v120 proc time (sec) mean: 0.494 +/- 0.047 rms: 0.141 +/- 0.033 hostname:sdfmilan114 cpu:008 cmt:v120 proc time (sec) mean: 0.463 +/- 0.045 rms: 0.133 +/- 0.032 hostname:sdfmilan114 cpu:009 cmt:v120 proc time (sec) mean: 0.469 +/- 0.050 rms: 0.161 +/- 0.035 hostname:sdfmilan114 cpu:010 cmt:v120 proc time (sec) mean: 0.476 +/- 0.053 rms: 0.150 +/- 0.037 hostname:sdfmilan114 cpu:011 cmt:v120 proc time (sec) mean: 0.474 +/- 0.050 rms: 0.156 +/- 0.035 hostname:sdfmilan114 cpu:012 cmt:v120 proc time (sec) mean: 0.479 +/- 0.048 rms: 0.154 +/- 0.034 hostname:sdfmilan114 cpu:013 cmt:v120 proc time (sec) mean: 0.476 +/- 0.052 rms: 0.169 +/- 0.037 hostname:sdfmilan114 cpu:014 cmt:v120 proc time (sec) mean: 0.480 +/- 0.053 rms: 0.160 +/- 0.038 hostname:sdfmilan114 cpu:015 cmt:v120 proc time (sec) mean: 0.465 +/- 0.048 rms: 0.149 +/- 0.034 hostname:sdfmilan114 cpu:024 cmt:v120 proc time (sec) mean: 0.282 +/- 0.018 rms: 0.022 +/- 0.013 hostname:sdfmilan114 cpu:025 cmt:v120 proc time (sec) mean: 0.282 +/- 0.018 rms: 0.021 +/- 0.013 hostname:sdfmilan114 cpu:026 cmt:v120 proc time (sec) mean: 0.284 +/- 0.024 rms: 0.029 +/- 0.017 hostname:sdfmilan114 cpu:027 cmt:v120 proc time (sec) mean: 0.283 +/- 0.021 rms: 0.024 +/- 0.015 hostname:sdfmilan114 cpu:028 cmt:v120 proc time (sec) mean: 0.280 +/- 0.018 rms: 0.021 +/- 0.013 hostname:sdfmilan114 cpu:029 cmt:v120 proc time (sec) mean: 0.281 +/- 0.020 rms: 0.023 +/- 0.014 hostname:sdfmilan114 cpu:030 cmt:v120 proc time (sec) mean: 0.281 +/- 0.022 rms: 0.027 +/- 0.016 hostname:sdfmilan114 cpu:031 cmt:v120 proc time (sec) mean: 0.281 +/- 0.020 rms: 0.024 +/- 0.014 hostname:sdfmilan114 cpu:032 cmt:v120 proc time (sec) mean: 0.391 +/- 0.045 rms: 0.108 +/- 0.032 hostname:sdfmilan114 cpu:033 cmt:v120 proc time (sec) mean: 0.387 +/- 0.051 rms: 0.114 +/- 0.036 hostname:sdfmilan114 cpu:034 cmt:v120 proc time (sec) mean: 0.399 +/- 0.048 rms: 0.122 +/- 0.034 hostname:sdfmilan114 cpu:035 cmt:v120 proc time (sec) mean: 0.379 +/- 0.048 rms: 0.114 +/- 0.034 hostname:sdfmilan114 cpu:036 cmt:v120 proc time (sec) mean: 0.392 +/- 0.048 rms: 0.117 +/- 0.034 hostname:sdfmilan114 cpu:037 cmt:v120 proc time (sec) mean: 0.392 +/- 0.047 rms: 0.110 +/- 0.033 hostname:sdfmilan114 cpu:038 cmt:v120 proc time (sec) mean: 0.397 +/- 0.045 rms: 0.107 +/- 0.032 hostname:sdfmilan114 cpu:039 cmt:v120 proc time (sec) mean: 0.414 +/- 0.048 rms: 0.124 +/- 0.034 hostname:sdfmilan114 cpu:040 cmt:v120 proc time (sec) mean: 0.403 +/- 0.051 rms: 0.128 +/- 0.036 hostname:sdfmilan114 cpu:041 cmt:v120 proc time (sec) mean: 0.397 +/- 0.055 rms: 0.136 +/- 0.039 hostname:sdfmilan114 cpu:042 cmt:v120 proc time (sec) mean: 0.393 +/- 0.050 rms: 0.124 +/- 0.035 hostname:sdfmilan114 cpu:043 cmt:v120 proc time (sec) mean: 0.391 +/- 0.046 rms: 0.111 +/- 0.032 hostname:sdfmilan114 cpu:044 cmt:v120 proc time (sec) mean: 0.381 +/- 0.050 rms: 0.114 +/- 0.035 hostname:sdfmilan114 cpu:045 cmt:v120 proc time (sec) mean: 0.387 +/- 0.047 rms: 0.110 +/- 0.033 hostname:sdfmilan114 cpu:046 cmt:v120 proc time (sec) mean: 0.379 +/- 0.051 rms: 0.112 +/- 0.036 hostname:sdfmilan114 cpu:047 cmt:v120 proc time (sec) mean: 0.402 +/- 0.056 rms: 0.142 +/- 0.040 hostname:sdfmilan114 cpu:048 cmt:v120 proc time (sec) mean: 0.357 +/- 0.045 rms: 0.083 +/- 0.032 hostname:sdfmilan114 cpu:049 cmt:v120 proc time (sec) mean: 0.356 +/- 0.046 rms: 0.082 +/- 0.032 hostname:sdfmilan114 cpu:050 cmt:v120 proc time (sec) mean: 0.348 +/- 0.044 rms: 0.080 +/- 0.031 hostname:sdfmilan114 cpu:051 cmt:v120 proc time (sec) mean: 0.345 +/- 0.043 rms: 0.076 +/- 0.031 hostname:sdfmilan114 cpu:052 cmt:v120 proc time (sec) mean: 0.352 +/- 0.033 rms: 0.059 +/- 0.023 hostname:sdfmilan114 cpu:053 cmt:v120 proc time (sec) mean: 0.355 +/- 0.034 rms: 0.063 +/- 0.024 hostname:sdfmilan114 cpu:054 cmt:v120 proc time (sec) mean: 0.358 +/- 0.038 rms: 0.069 +/- 0.027 hostname:sdfmilan114 cpu:055 cmt:v120 proc time (sec) mean: 0.356 +/- 0.043 rms: 0.083 +/- 0.030 hostname:sdfmilan114 cpu:056 cmt:v120 proc time (sec) mean: 0.366 +/- 0.036 rms: 0.070 +/- 0.026 hostname:sdfmilan114 cpu:057 cmt:v120 proc time (sec) mean: 0.362 +/- 0.044 rms: 0.086 +/- 0.031 hostname:sdfmilan114 cpu:058 cmt:v120 proc time (sec) mean: 0.359 +/- 0.034 rms: 0.070 +/- 0.024 hostname:sdfmilan114 cpu:059 cmt:v120 proc time (sec) mean: 0.354 +/- 0.035 rms: 0.065 +/- 0.025 hostname:sdfmilan114 cpu:060 cmt:v120 proc time (sec) mean: 0.367 +/- 0.036 rms: 0.071 +/- 0.025 hostname:sdfmilan114 cpu:061 cmt:v120 proc time (sec) mean: 0.374 +/- 0.038 rms: 0.077 +/- 0.027 hostname:sdfmilan114 cpu:062 cmt:v120 proc time (sec) mean: 0.366 +/- 0.032 rms: 0.066 +/- 0.023 hostname:sdfmilan114 cpu:063 cmt:v120 proc time (sec) mean: 0.348 +/- 0.031 rms: 0.059 +/- 0.022 hostname:sdfmilan114 cpu:064 cmt:v120 proc time (sec) mean: 0.583 +/- 0.061 rms: 0.196 +/- 0.043 hostname:sdfmilan114 cpu:065 cmt:v120 proc time (sec) mean: 0.609 +/- 0.065 rms: 0.207 +/- 0.046 hostname:sdfmilan114 cpu:066 cmt:v120 proc time (sec) mean: 0.583 +/- 0.061 rms: 0.178 +/- 0.043 hostname:sdfmilan114 cpu:067 cmt:v120 proc time (sec) mean: 0.564 +/- 0.058 rms: 0.169 +/- 0.041 hostname:sdfmilan114 cpu:068 cmt:v120 proc time (sec) mean: 0.613 +/- 0.068 rms: 0.215 +/- 0.048 hostname:sdfmilan114 cpu:069 cmt:v120 proc time (sec) mean: 0.583 +/- 0.059 rms: 0.191 +/- 0.042 hostname:sdfmilan114 cpu:070 cmt:v120 proc time (sec) mean: 0.594 +/- 0.065 rms: 0.205 +/- 0.046 hostname:sdfmilan114 cpu:071 cmt:v120 proc time (sec) mean: 0.581 +/- 0.063 rms: 0.176 +/- 0.045 hostname:sdfmilan114 cpu:072 cmt:v120 proc time (sec) mean: 0.592 +/- 0.058 rms: 0.200 +/- 0.041 hostname:sdfmilan114 cpu:073 cmt:v120 proc time (sec) mean: 0.595 +/- 0.056 rms: 0.196 +/- 0.040 hostname:sdfmilan114 cpu:074 cmt:v120 proc time (sec) mean: 0.559 +/- 0.050 rms: 0.164 +/- 0.036 hostname:sdfmilan114 cpu:075 cmt:v120 proc time (sec) mean: 0.570 +/- 0.062 rms: 0.203 +/- 0.044 hostname:sdfmilan114 cpu:076 cmt:v120 proc time (sec) mean: 0.553 +/- 0.059 rms: 0.181 +/- 0.042 hostname:sdfmilan114 cpu:077 cmt:v120 proc time (sec) mean: 0.557 +/- 0.062 rms: 0.181 +/- 0.044 hostname:sdfmilan114 cpu:078 cmt:v120 proc time (sec) mean: 0.616 +/- 0.073 rms: 0.232 +/- 0.051 hostname:sdfmilan114 cpu:079 cmt:v120 proc time (sec) mean: 0.596 +/- 0.066 rms: 0.217 +/- 0.046 hostname:sdfmilan114 cpu:080 cmt:v120 proc time (sec) mean: 0.412 +/- 0.054 rms: 0.133 +/- 0.038 hostname:sdfmilan114 cpu:081 cmt:v120 proc time (sec) mean: 0.465 +/- 0.076 rms: 0.206 +/- 0.054 hostname:sdfmilan114 cpu:082 cmt:v120 proc time (sec) mean: 0.442 +/- 0.062 rms: 0.172 +/- 0.044 hostname:sdfmilan114 cpu:083 cmt:v120 proc time (sec) mean: 0.432 +/- 0.070 rms: 0.171 +/- 0.049 hostname:sdfmilan114 cpu:084 cmt:v120 proc time (sec) mean: 0.425 +/- 0.063 rms: 0.158 +/- 0.045 hostname:sdfmilan114 cpu:085 cmt:v120 proc time (sec) mean: 0.448 +/- 0.079 rms: 0.198 +/- 0.056 hostname:sdfmilan114 cpu:086 cmt:v120 proc time (sec) mean: 0.427 +/- 0.062 rms: 0.156 +/- 0.044 hostname:sdfmilan114 cpu:087 cmt:v120 proc time (sec) mean: 0.427 +/- 0.061 rms: 0.162 +/- 0.043 hostname:sdfmilan114 cpu:088 cmt:v120 proc time (sec) mean: 0.414 +/- 0.064 rms: 0.147 +/- 0.046 hostname:sdfmilan114 cpu:089 cmt:v120 proc time (sec) mean: 0.440 +/- 0.064 rms: 0.163 +/- 0.045 hostname:sdfmilan114 cpu:090 cmt:v120 proc time (sec) mean: 0.406 +/- 0.053 rms: 0.122 +/- 0.038 hostname:sdfmilan114 cpu:091 cmt:v120 proc time (sec) mean: 0.443 +/- 0.073 rms: 0.194 +/- 0.052 hostname:sdfmilan114 cpu:092 cmt:v120 proc time (sec) mean: 0.417 +/- 0.061 rms: 0.142 +/- 0.043 hostname:sdfmilan114 cpu:093 cmt:v120 proc time (sec) mean: 0.406 +/- 0.056 rms: 0.121 +/- 0.040 hostname:sdfmilan114 cpu:094 cmt:v120 proc time (sec) mean: 0.423 +/- 0.075 rms: 0.176 +/- 0.053 hostname:sdfmilan114 cpu:095 cmt:v120 proc time (sec) mean: 0.444 +/- 0.065 rms: 0.177 +/- 0.046 hostname:sdfmilan114 cpu:096 cmt:v120 proc time (sec) mean: 0.464 +/- 0.043 rms: 0.112 +/- 0.031 hostname:sdfmilan114 cpu:097 cmt:v120 proc time (sec) mean: 0.465 +/- 0.042 rms: 0.105 +/- 0.030 hostname:sdfmilan114 cpu:098 cmt:v120 proc time (sec) mean: 0.484 +/- 0.050 rms: 0.132 +/- 0.036 hostname:sdfmilan114 cpu:099 cmt:v120 proc time (sec) mean: 0.489 +/- 0.045 rms: 0.120 +/- 0.032 hostname:sdfmilan114 cpu:100 cmt:v120 proc time (sec) mean: 0.465 +/- 0.045 rms: 0.122 +/- 0.031 hostname:sdfmilan114 cpu:101 cmt:v120 proc time (sec) mean: 0.477 +/- 0.047 rms: 0.118 +/- 0.033 hostname:sdfmilan114 cpu:102 cmt:v120 proc time (sec) mean: 0.465 +/- 0.043 rms: 0.110 +/- 0.030 hostname:sdfmilan114 cpu:103 cmt:v120 proc time (sec) mean: 0.459 +/- 0.043 rms: 0.104 +/- 0.031 hostname:sdfmilan114 cpu:104 cmt:v120 proc time (sec) mean: 0.500 +/- 0.046 rms: 0.130 +/- 0.033 hostname:sdfmilan114 cpu:105 cmt:v120 proc time (sec) mean: 0.466 +/- 0.042 rms: 0.104 +/- 0.029 hostname:sdfmilan114 cpu:106 cmt:v120 proc time (sec) mean: 0.468 +/- 0.045 rms: 0.122 +/- 0.032 hostname:sdfmilan114 cpu:107 cmt:v120 proc time (sec) mean: 0.480 +/- 0.045 rms: 0.121 +/- 0.032 hostname:sdfmilan114 cpu:108 cmt:v120 proc time (sec) mean: 0.472 +/- 0.046 rms: 0.123 +/- 0.033 hostname:sdfmilan114 cpu:109 cmt:v120 proc time (sec) mean: 0.472 +/- 0.044 rms: 0.112 +/- 0.031 hostname:sdfmilan114 cpu:110 cmt:v120 proc time (sec) mean: 0.479 +/- 0.046 rms: 0.117 +/- 0.033 hostname:sdfmilan114 cpu:111 cmt:v120 proc time (sec) mean: 0.472 +/- 0.043 rms: 0.114 +/- 0.031 hostname:sdfmilan114 cpu:112 cmt:v120 proc time (sec) mean: 0.544 +/- 0.047 rms: 0.139 +/- 0.033 hostname:sdfmilan114 cpu:113 cmt:v120 proc time (sec) mean: 0.545 +/- 0.046 rms: 0.138 +/- 0.033 hostname:sdfmilan114 cpu:114 cmt:v120 proc time (sec) mean: 0.542 +/- 0.047 rms: 0.138 +/- 0.033 hostname:sdfmilan114 cpu:115 cmt:v120 proc time (sec) mean: 0.544 +/- 0.046 rms: 0.131 +/- 0.033 hostname:sdfmilan114 cpu:116 cmt:v120 proc time (sec) mean: 0.550 +/- 0.049 rms: 0.142 +/- 0.034 hostname:sdfmilan114 cpu:117 cmt:v120 proc time (sec) mean: 0.538 +/- 0.048 rms: 0.139 +/- 0.034 hostname:sdfmilan114 cpu:118 cmt:v120 proc time (sec) mean: 0.538 +/- 0.054 rms: 0.160 +/- 0.038 hostname:sdfmilan114 cpu:119 cmt:v120 proc time (sec) mean: 0.536 +/- 0.051 rms: 0.148 +/- 0.036 hostname:sdfmilan114 cpu:120 cmt:v120 proc time (sec) mean: 0.542 +/- 0.046 rms: 0.131 +/- 0.032 hostname:sdfmilan114 cpu:121 cmt:v120 proc time (sec) mean: 0.553 +/- 0.046 rms: 0.137 +/- 0.033 hostname:sdfmilan114 cpu:122 cmt:v120 proc time (sec) mean: 0.549 +/- 0.048 rms: 0.154 +/- 0.034 hostname:sdfmilan114 cpu:123 cmt:v120 proc time (sec) mean: 0.544 +/- 0.043 rms: 0.127 +/- 0.030 hostname:sdfmilan114 cpu:124 cmt:v120 proc time (sec) mean: 0.536 +/- 0.047 rms: 0.137 +/- 0.033 hostname:sdfmilan114 cpu:125 cmt:v120 proc time (sec) mean: 0.536 +/- 0.047 rms: 0.145 +/- 0.033 hostname:sdfmilan114 cpu:126 cmt:v120 proc time (sec) mean: 0.555 +/- 0.047 rms: 0.144 +/- 0.033 hostname:sdfmilan114 cpu:127 cmt:v120 proc time (sec) mean: 0.539 +/- 0.045 rms: 0.131 +/- 0.031 mean time (sec): 0.4537 Repeat test hostname:sdfmilan114 cpu:000 cmt:v120-2 proc time (sec) mean: 0.319 +/- 0.022 rms: 0.032 +/- 0.016 hostname:sdfmilan114 cpu:001 cmt:v120-2 proc time (sec) mean: 0.317 +/- 0.023 rms: 0.037 +/- 0.017 hostname:sdfmilan114 cpu:002 cmt:v120-2 proc time (sec) mean: 0.323 +/- 0.023 rms: 0.035 +/- 0.016 hostname:sdfmilan114 cpu:003 cmt:v120-2 proc time (sec) mean: 0.329 +/- 0.027 rms: 0.040 +/- 0.019 hostname:sdfmilan114 cpu:004 cmt:v120-2 proc time (sec) mean: 0.324 +/- 0.022 rms: 0.033 +/- 0.016 hostname:sdfmilan114 cpu:005 cmt:v120-2 proc time (sec) mean: 0.328 +/- 0.023 rms: 0.033 +/- 0.016 hostname:sdfmilan114 cpu:006 cmt:v120-2 proc time (sec) mean: 0.322 +/- 0.022 rms: 0.034 +/- 0.015 hostname:sdfmilan114 cpu:007 cmt:v120-2 proc time (sec) mean: 0.313 +/- 0.022 rms: 0.035 +/- 0.015 hostname:sdfmilan114 cpu:008 cmt:v120-2 proc time (sec) mean: 0.333 +/- 0.029 rms: 0.040 +/- 0.021 hostname:sdfmilan114 cpu:009 cmt:v120-2 proc time (sec) mean: 0.318 +/- 0.025 rms: 0.035 +/- 0.017 hostname:sdfmilan114 cpu:010 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.031 rms: 0.045 +/- 0.022 hostname:sdfmilan114 cpu:011 cmt:v120-2 proc time (sec) mean: 0.336 +/- 0.026 rms: 0.039 +/- 0.019 hostname:sdfmilan114 cpu:012 cmt:v120-2 proc time (sec) mean: 0.330 +/- 0.027 rms: 0.040 +/- 0.019 hostname:sdfmilan114 cpu:013 cmt:v120-2 proc time (sec) mean: 0.333 +/- 0.026 rms: 0.035 +/- 0.018 hostname:sdfmilan114 cpu:014 cmt:v120-2 proc time (sec) mean: 0.326 +/- 0.026 rms: 0.037 +/- 0.019 hostname:sdfmilan114 cpu:015 cmt:v120-2 proc time (sec) mean: 0.323 +/- 0.025 rms: 0.036 +/- 0.018 hostname:sdfmilan114 cpu:024 cmt:v120-2 proc time (sec) mean: 0.276 +/- 0.005 rms: 0.005 +/- 0.003 hostname:sdfmilan114 cpu:025 cmt:v120-2 proc time (sec) mean: 0.276 +/- 0.005 rms: 0.005 +/- 0.003 hostname:sdfmilan114 cpu:026 cmt:v120-2 proc time (sec) mean: 0.279 +/- 0.012 rms: 0.013 +/- 0.008 hostname:sdfmilan114 cpu:027 cmt:v120-2 proc time (sec) mean: 0.276 +/- 0.007 rms: 0.007 +/- 0.005 hostname:sdfmilan114 cpu:028 cmt:v120-2 proc time (sec) mean: 0.277 +/- 0.009 rms: 0.010 +/- 0.007 hostname:sdfmilan114 cpu:029 cmt:v120-2 proc time (sec) mean: 0.277 +/- 0.008 rms: 0.009 +/- 0.006 hostname:sdfmilan114 cpu:030 cmt:v120-2 proc time (sec) mean: 0.277 +/- 0.013 rms: 0.014 +/- 0.009 hostname:sdfmilan114 cpu:031 cmt:v120-2 proc time (sec) mean: 0.279 +/- 0.013 rms: 0.014 +/- 0.009 hostname:sdfmilan114 cpu:032 cmt:v120-2 proc time (sec) mean: 0.339 +/- 0.024 rms: 0.039 +/- 0.017 hostname:sdfmilan114 cpu:033 cmt:v120-2 proc time (sec) mean: 0.348 +/- 0.026 rms: 0.042 +/- 0.018 hostname:sdfmilan114 cpu:034 cmt:v120-2 proc time (sec) mean: 0.334 +/- 0.024 rms: 0.041 +/- 0.017 hostname:sdfmilan114 cpu:035 cmt:v120-2 proc time (sec) mean: 0.340 +/- 0.024 rms: 0.038 +/- 0.017 hostname:sdfmilan114 cpu:036 cmt:v120-2 proc time (sec) mean: 0.339 +/- 0.024 rms: 0.039 +/- 0.017 hostname:sdfmilan114 cpu:037 cmt:v120-2 proc time (sec) mean: 0.341 +/- 0.023 rms: 0.035 +/- 0.016 hostname:sdfmilan114 cpu:038 cmt:v120-2 proc time (sec) mean: 0.340 +/- 0.027 rms: 0.045 +/- 0.019 hostname:sdfmilan114 cpu:039 cmt:v120-2 proc time (sec) mean: 0.339 +/- 0.023 rms: 0.037 +/- 0.016 hostname:sdfmilan114 cpu:040 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.022 rms: 0.034 +/- 0.016 hostname:sdfmilan114 cpu:041 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.024 rms: 0.037 +/- 0.017 hostname:sdfmilan114 cpu:042 cmt:v120-2 proc time (sec) mean: 0.329 +/- 0.022 rms: 0.035 +/- 0.015 hostname:sdfmilan114 cpu:043 cmt:v120-2 proc time (sec) mean: 0.338 +/- 0.025 rms: 0.038 +/- 0.017 hostname:sdfmilan114 cpu:044 cmt:v120-2 proc time (sec) mean: 0.330 +/- 0.023 rms: 0.033 +/- 0.016 hostname:sdfmilan114 cpu:045 cmt:v120-2 proc time (sec) mean: 0.338 +/- 0.024 rms: 0.037 +/- 0.017 hostname:sdfmilan114 cpu:046 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.023 rms: 0.034 +/- 0.016 hostname:sdfmilan114 cpu:047 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.023 rms: 0.033 +/- 0.016 hostname:sdfmilan114 cpu:048 cmt:v120-2 proc time (sec) mean: 0.329 +/- 0.023 rms: 0.037 +/- 0.016 hostname:sdfmilan114 cpu:049 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.023 rms: 0.037 +/- 0.016 hostname:sdfmilan114 cpu:050 cmt:v120-2 proc time (sec) mean: 0.324 +/- 0.024 rms: 0.037 +/- 0.017 hostname:sdfmilan114 cpu:051 cmt:v120-2 proc time (sec) mean: 0.333 +/- 0.025 rms: 0.040 +/- 0.018 hostname:sdfmilan114 cpu:052 cmt:v120-2 proc time (sec) mean: 0.335 +/- 0.023 rms: 0.034 +/- 0.016 hostname:sdfmilan114 cpu:053 cmt:v120-2 proc time (sec) mean: 0.335 +/- 0.025 rms: 0.041 +/- 0.018 hostname:sdfmilan114 cpu:054 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.021 rms: 0.029 +/- 0.015 hostname:sdfmilan114 cpu:055 cmt:v120-2 proc time (sec) mean: 0.331 +/- 0.023 rms: 0.037 +/- 0.016 hostname:sdfmilan114 cpu:056 cmt:v120-2 proc time (sec) mean: 0.338 +/- 0.026 rms: 0.043 +/- 0.018 hostname:sdfmilan114 cpu:057 cmt:v120-2 proc time (sec) mean: 0.335 +/- 0.025 rms: 0.042 +/- 0.018 hostname:sdfmilan114 cpu:058 cmt:v120-2 proc time (sec) mean: 0.334 +/- 0.024 rms: 0.041 +/- 0.017 hostname:sdfmilan114 cpu:059 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.023 rms: 0.038 +/- 0.016 hostname:sdfmilan114 cpu:060 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.024 rms: 0.042 +/- 0.017 hostname:sdfmilan114 cpu:061 cmt:v120-2 proc time (sec) mean: 0.333 +/- 0.024 rms: 0.040 +/- 0.017 hostname:sdfmilan114 cpu:062 cmt:v120-2 proc time (sec) mean: 0.328 +/- 0.023 rms: 0.034 +/- 0.016 hostname:sdfmilan114 cpu:063 cmt:v120-2 proc time (sec) mean: 0.336 +/- 0.024 rms: 0.041 +/- 0.017 hostname:sdfmilan114 cpu:064 cmt:v120-2 proc time (sec) mean: 0.528 +/- 0.042 rms: 0.091 +/- 0.030 hostname:sdfmilan114 cpu:065 cmt:v120-2 proc time (sec) mean: 0.527 +/- 0.042 rms: 0.098 +/- 0.030 hostname:sdfmilan114 cpu:066 cmt:v120-2 proc time (sec) mean: 0.527 +/- 0.041 rms: 0.094 +/- 0.029 hostname:sdfmilan114 cpu:067 cmt:v120-2 proc time (sec) mean: 0.517 +/- 0.040 rms: 0.092 +/- 0.028 hostname:sdfmilan114 cpu:068 cmt:v120-2 proc time (sec) mean: 0.518 +/- 0.045 rms: 0.105 +/- 0.032 hostname:sdfmilan114 cpu:069 cmt:v120-2 proc time (sec) mean: 0.518 +/- 0.044 rms: 0.104 +/- 0.031 hostname:sdfmilan114 cpu:070 cmt:v120-2 proc time (sec) mean: 0.524 +/- 0.044 rms: 0.104 +/- 0.031 hostname:sdfmilan114 cpu:071 cmt:v120-2 proc time (sec) mean: 0.529 +/- 0.043 rms: 0.099 +/- 0.030 hostname:sdfmilan114 cpu:072 cmt:v120-2 proc time (sec) mean: 0.522 +/- 0.045 rms: 0.108 +/- 0.032 hostname:sdfmilan114 cpu:073 cmt:v120-2 proc time (sec) mean: 0.533 +/- 0.044 rms: 0.101 +/- 0.031 hostname:sdfmilan114 cpu:074 cmt:v120-2 proc time (sec) mean: 0.527 +/- 0.044 rms: 0.098 +/- 0.031 hostname:sdfmilan114 cpu:075 cmt:v120-2 proc time (sec) mean: 0.526 +/- 0.044 rms: 0.108 +/- 0.031 hostname:sdfmilan114 cpu:076 cmt:v120-2 proc time (sec) mean: 0.514 +/- 0.044 rms: 0.098 +/- 0.031 hostname:sdfmilan114 cpu:077 cmt:v120-2 proc time (sec) mean: 0.518 +/- 0.045 rms: 0.103 +/- 0.032 hostname:sdfmilan114 cpu:078 cmt:v120-2 proc time (sec) mean: 0.510 +/- 0.041 rms: 0.105 +/- 0.029 hostname:sdfmilan114 cpu:079 cmt:v120-2 proc time (sec) mean: 0.515 +/- 0.046 rms: 0.104 +/- 0.032 hostname:sdfmilan114 cpu:080 cmt:v120-2 proc time (sec) mean: 0.381 +/- 0.292 rms: 0.500 +/- 0.206 hostname:sdfmilan114 cpu:081 cmt:v120-2 proc time (sec) mean: 0.316 +/- 0.022 rms: 0.034 +/- 0.016 hostname:sdfmilan114 cpu:082 cmt:v120-2 proc time (sec) mean: 0.321 +/- 0.104 rms: 0.160 +/- 0.074 hostname:sdfmilan114 cpu:083 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.105 rms: 0.159 +/- 0.074 hostname:sdfmilan114 cpu:084 cmt:v120-2 proc time (sec) mean: 0.311 +/- 0.020 rms: 0.028 +/- 0.014 hostname:sdfmilan114 cpu:085 cmt:v120-2 proc time (sec) mean: 0.350 +/- 0.251 rms: 0.422 +/- 0.178 hostname:sdfmilan114 cpu:086 cmt:v120-2 proc time (sec) mean: 0.315 +/- 0.022 rms: 0.033 +/- 0.015 hostname:sdfmilan114 cpu:087 cmt:v120-2 proc time (sec) mean: 0.315 +/- 0.020 rms: 0.029 +/- 0.014 hostname:sdfmilan114 cpu:088 cmt:v120-2 proc time (sec) mean: 0.352 +/- 0.241 rms: 0.411 +/- 0.171 hostname:sdfmilan114 cpu:089 cmt:v120-2 proc time (sec) mean: 0.323 +/- 0.111 rms: 0.170 +/- 0.078 hostname:sdfmilan114 cpu:090 cmt:v120-2 proc time (sec) mean: 0.354 +/- 0.184 rms: 0.293 +/- 0.130 hostname:sdfmilan114 cpu:091 cmt:v120-2 proc time (sec) mean: 0.308 +/- 0.019 rms: 0.028 +/- 0.014 hostname:sdfmilan114 cpu:092 cmt:v120-2 proc time (sec) mean: 0.351 +/- 0.226 rms: 0.348 +/- 0.160 hostname:sdfmilan114 cpu:093 cmt:v120-2 proc time (sec) mean: 0.328 +/- 0.082 rms: 0.136 +/- 0.058 hostname:sdfmilan114 cpu:094 cmt:v120-2 proc time (sec) mean: 0.340 +/- 0.128 rms: 0.207 +/- 0.090 hostname:sdfmilan114 cpu:095 cmt:v120-2 proc time (sec) mean: 0.324 +/- 0.027 rms: 0.042 +/- 0.019 hostname:sdfmilan114 cpu:096 cmt:v120-2 proc time (sec) mean: 0.417 +/- 0.033 rms: 0.071 +/- 0.023 hostname:sdfmilan114 cpu:097 cmt:v120-2 proc time (sec) mean: 0.451 +/- 0.137 rms: 0.297 +/- 0.097 hostname:sdfmilan114 cpu:098 cmt:v120-2 proc time (sec) mean: 0.430 +/- 0.031 rms: 0.070 +/- 0.022 hostname:sdfmilan114 cpu:099 cmt:v120-2 proc time (sec) mean: 0.415 +/- 0.033 rms: 0.070 +/- 0.023 hostname:sdfmilan114 cpu:100 cmt:v120-2 proc time (sec) mean: 0.423 +/- 0.034 rms: 0.077 +/- 0.024 hostname:sdfmilan114 cpu:101 cmt:v120-2 proc time (sec) mean: 0.423 +/- 0.033 rms: 0.073 +/- 0.024 hostname:sdfmilan114 cpu:102 cmt:v120-2 proc time (sec) mean: 0.419 +/- 0.032 rms: 0.073 +/- 0.023 hostname:sdfmilan114 cpu:103 cmt:v120-2 proc time (sec) mean: 0.425 +/- 0.029 rms: 0.061 +/- 0.021 hostname:sdfmilan114 cpu:104 cmt:v120-2 proc time (sec) mean: 0.404 +/- 0.032 rms: 0.069 +/- 0.023 hostname:sdfmilan114 cpu:105 cmt:v120-2 proc time (sec) mean: 0.426 +/- 0.031 rms: 0.065 +/- 0.022 hostname:sdfmilan114 cpu:106 cmt:v120-2 proc time (sec) mean: 0.412 +/- 0.033 rms: 0.069 +/- 0.023 hostname:sdfmilan114 cpu:107 cmt:v120-2 proc time (sec) mean: 0.420 +/- 0.030 rms: 0.063 +/- 0.021 hostname:sdfmilan114 cpu:108 cmt:v120-2 proc time (sec) mean: 0.417 +/- 0.033 rms: 0.069 +/- 0.023 hostname:sdfmilan114 cpu:109 cmt:v120-2 proc time (sec) mean: 0.416 +/- 0.030 rms: 0.063 +/- 0.021 hostname:sdfmilan114 cpu:110 cmt:v120-2 proc time (sec) mean: 0.417 +/- 0.031 rms: 0.065 +/- 0.022 hostname:sdfmilan114 cpu:111 cmt:v120-2 proc time (sec) mean: 0.410 +/- 0.031 rms: 0.068 +/- 0.022 hostname:sdfmilan114 cpu:112 cmt:v120-2 proc time (sec) mean: 0.471 +/- 0.046 rms: 0.107 +/- 0.033 hostname:sdfmilan114 cpu:113 cmt:v120-2 proc time (sec) mean: 0.455 +/- 0.035 rms: 0.082 +/- 0.025 hostname:sdfmilan114 cpu:114 cmt:v120-2 proc time (sec) mean: 0.477 +/- 0.037 rms: 0.095 +/- 0.026 hostname:sdfmilan114 cpu:115 cmt:v120-2 proc time (sec) mean: 0.475 +/- 0.035 rms: 0.087 +/- 0.025 hostname:sdfmilan114 cpu:116 cmt:v120-2 proc time (sec) mean: 0.472 +/- 0.035 rms: 0.086 +/- 0.025 hostname:sdfmilan114 cpu:117 cmt:v120-2 proc time (sec) mean: 0.474 +/- 0.036 rms: 0.089 +/- 0.025 hostname:sdfmilan114 cpu:118 cmt:v120-2 proc time (sec) mean: 0.463 +/- 0.036 rms: 0.084 +/- 0.026 hostname:sdfmilan114 cpu:119 cmt:v120-2 proc time (sec) mean: 0.467 +/- 0.035 rms: 0.085 +/- 0.025 hostname:sdfmilan114 cpu:120 cmt:v120-2 proc time (sec) mean: 0.452 +/- 0.037 rms: 0.089 +/- 0.026 hostname:sdfmilan114 cpu:121 cmt:v120-2 proc time (sec) mean: 0.472 +/- 0.037 rms: 0.093 +/- 0.026 hostname:sdfmilan114 cpu:122 cmt:v120-2 proc time (sec) mean: 0.466 +/- 0.037 rms: 0.093 +/- 0.026 hostname:sdfmilan114 cpu:123 cmt:v120-2 proc time (sec) mean: 0.466 +/- 0.035 rms: 0.080 +/- 0.024 hostname:sdfmilan114 cpu:124 cmt:v120-2 proc time (sec) mean: 0.467 +/- 0.036 rms: 0.092 +/- 0.026 hostname:sdfmilan114 cpu:125 cmt:v120-2 proc time (sec) mean: 0.451 +/- 0.035 rms: 0.088 +/- 0.025 hostname:sdfmilan114 cpu:126 cmt:v120-2 proc time (sec) mean: 0.460 +/- 0.037 rms: 0.091 +/- 0.026 hostname:sdfmilan114 cpu:127 cmt:v120-2 proc time (sec) mean: 0.475 +/- 0.035 rms: 0.086 +/- 0.025 mean time (sec): 0.3834 2024-02-02 The same job on sdfmilan216 hostname:sdfmilan216 cpu:000 cmt:v120 proc time (sec) mean: 0.288 +/- 0.010 rms: 0.018 +/- 0.007 hostname:sdfmilan216 cpu:001 cmt:v120 proc time (sec) mean: 0.288 +/- 0.009 rms: 0.016 +/- 0.007 hostname:sdfmilan216 cpu:002 cmt:v120 proc time (sec) mean: 0.293 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:003 cmt:v120 proc time (sec) mean: 0.294 +/- 0.014 rms: 0.028 +/- 0.010 hostname:sdfmilan216 cpu:004 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.023 +/- 0.009 hostname:sdfmilan216 cpu:005 cmt:v120 proc time (sec) mean: 0.295 +/- 0.012 rms: 0.023 +/- 0.008 hostname:sdfmilan216 cpu:006 cmt:v120 proc time (sec) mean: 0.293 +/- 0.014 rms: 0.025 +/- 0.010 hostname:sdfmilan216 cpu:007 cmt:v120 proc time (sec) mean: 0.287 +/- 0.013 rms: 0.023 +/- 0.009 hostname:sdfmilan216 cpu:008 cmt:v120 proc time (sec) mean: 0.295 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:009 cmt:v120 proc time (sec) mean: 0.294 +/- 0.015 rms: 0.028 +/- 0.010 hostname:sdfmilan216 cpu:010 cmt:v120 proc time (sec) mean: 0.298 +/- 0.013 rms: 0.027 +/- 0.009 hostname:sdfmilan216 cpu:011 cmt:v120 proc time (sec) mean: 0.297 +/- 0.014 rms: 0.028 +/- 0.010 hostname:sdfmilan216 cpu:012 cmt:v120 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.026 +/- 0.009 hostname:sdfmilan216 cpu:013 cmt:v120 proc time (sec) mean: 0.297 +/- 0.013 rms: 0.026 +/- 0.009 hostname:sdfmilan216 cpu:014 cmt:v120 proc time (sec) mean: 0.287 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:015 cmt:v120 proc time (sec) mean: 0.291 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:024 cmt:v120 proc time (sec) mean: 0.255 +/- 0.008 rms: 0.010 +/- 0.006 hostname:sdfmilan216 cpu:025 cmt:v120 proc time (sec) mean: 0.260 +/- 0.009 rms: 0.013 +/- 0.006 hostname:sdfmilan216 cpu:026 cmt:v120 proc time (sec) mean: 0.266 +/- 0.009 rms: 0.014 +/- 0.006 hostname:sdfmilan216 cpu:027 cmt:v120 proc time (sec) mean: 0.259 +/- 0.007 rms: 0.010 +/- 0.005 hostname:sdfmilan216 cpu:028 cmt:v120 proc time (sec) mean: 0.261 +/- 0.009 rms: 0.013 +/- 0.007 hostname:sdfmilan216 cpu:029 cmt:v120 proc time (sec) mean: 0.263 +/- 0.008 rms: 0.011 +/- 0.006 hostname:sdfmilan216 cpu:030 cmt:v120 proc time (sec) mean: 0.263 +/- 0.008 rms: 0.012 +/- 0.006 hostname:sdfmilan216 cpu:031 cmt:v120 proc time (sec) mean: 0.262 +/- 0.008 rms: 0.012 +/- 0.006 hostname:sdfmilan216 cpu:032 cmt:v120 proc time (sec) mean: 0.297 +/- 0.015 rms: 0.027 +/- 0.010 hostname:sdfmilan216 cpu:033 cmt:v120 proc time (sec) mean: 0.289 +/- 0.013 rms: 0.023 +/- 0.009 hostname:sdfmilan216 cpu:034 cmt:v120 proc time (sec) mean: 0.289 +/- 0.016 rms: 0.029 +/- 0.012 hostname:sdfmilan216 cpu:035 cmt:v120 proc time (sec) mean: 0.293 +/- 0.016 rms: 0.028 +/- 0.011 hostname:sdfmilan216 cpu:036 cmt:v120 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:037 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.024 +/- 0.009 hostname:sdfmilan216 cpu:038 cmt:v120 proc time (sec) mean: 0.293 +/- 0.015 rms: 0.028 +/- 0.011 hostname:sdfmilan216 cpu:039 cmt:v120 proc time (sec) mean: 0.289 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:040 cmt:v120 proc time (sec) mean: 0.287 +/- 0.012 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:041 cmt:v120 proc time (sec) mean: 0.289 +/- 0.013 rms: 0.023 +/- 0.009 hostname:sdfmilan216 cpu:042 cmt:v120 proc time (sec) mean: 0.289 +/- 0.010 rms: 0.018 +/- 0.007 hostname:sdfmilan216 cpu:043 cmt:v120 proc time (sec) mean: 0.289 +/- 0.010 rms: 0.016 +/- 0.007 hostname:sdfmilan216 cpu:044 cmt:v120 proc time (sec) mean: 0.292 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:045 cmt:v120 proc time (sec) mean: 0.286 +/- 0.011 rms: 0.021 +/- 0.008 hostname:sdfmilan216 cpu:046 cmt:v120 proc time (sec) mean: 0.293 +/- 0.012 rms: 0.023 +/- 0.009 hostname:sdfmilan216 cpu:047 cmt:v120 proc time (sec) mean: 0.294 +/- 0.012 rms: 0.023 +/- 0.008 hostname:sdfmilan216 cpu:048 cmt:v120 proc time (sec) mean: 0.285 +/- 0.018 rms: 0.039 +/- 0.012 hostname:sdfmilan216 cpu:049 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:050 cmt:v120 proc time (sec) mean: 0.297 +/- 0.013 rms: 0.026 +/- 0.009 hostname:sdfmilan216 cpu:051 cmt:v120 proc time (sec) mean: 0.292 +/- 0.012 rms: 0.024 +/- 0.009 hostname:sdfmilan216 cpu:052 cmt:v120 proc time (sec) mean: 0.288 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:053 cmt:v120 proc time (sec) mean: 0.292 +/- 0.014 rms: 0.028 +/- 0.010 hostname:sdfmilan216 cpu:054 cmt:v120 proc time (sec) mean: 0.296 +/- 0.012 rms: 0.023 +/- 0.008 hostname:sdfmilan216 cpu:055 cmt:v120 proc time (sec) mean: 0.292 +/- 0.012 rms: 0.024 +/- 0.009 hostname:sdfmilan216 cpu:056 cmt:v120 proc time (sec) mean: 0.289 +/- 0.012 rms: 0.022 +/- 0.008 hostname:sdfmilan216 cpu:057 cmt:v120 proc time (sec) mean: 0.296 +/- 0.012 rms: 0.023 +/- 0.008 hostname:sdfmilan216 cpu:058 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:059 cmt:v120 proc time (sec) mean: 0.313 +/- 0.014 rms: 0.029 +/- 0.010 hostname:sdfmilan216 cpu:060 cmt:v120 proc time (sec) mean: 0.296 +/- 0.014 rms: 0.030 +/- 0.010 hostname:sdfmilan216 cpu:061 cmt:v120 proc time (sec) mean: 0.300 +/- 0.016 rms: 0.033 +/- 0.011 hostname:sdfmilan216 cpu:062 cmt:v120 proc time (sec) mean: 0.290 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:063 cmt:v120 proc time (sec) mean: 0.296 +/- 0.013 rms: 0.026 +/- 0.009 hostname:sdfmilan216 cpu:064 cmt:v120 proc time (sec) mean: 0.294 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:065 cmt:v120 proc time (sec) mean: 0.282 +/- 0.011 rms: 0.018 +/- 0.008 hostname:sdfmilan216 cpu:066 cmt:v120 proc time (sec) mean: 0.290 +/- 0.013 rms: 0.026 +/- 0.009 hostname:sdfmilan216 cpu:067 cmt:v120 proc time (sec) mean: 0.291 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:068 cmt:v120 proc time (sec) mean: 0.278 +/- 0.014 rms: 0.022 +/- 0.010 hostname:sdfmilan216 cpu:069 cmt:v120 proc time (sec) mean: 0.288 +/- 0.013 rms: 0.023 +/- 0.009 hostname:sdfmilan216 cpu:070 cmt:v120 proc time (sec) mean: 0.292 +/- 0.012 rms: 0.024 +/- 0.009 hostname:sdfmilan216 cpu:071 cmt:v120 proc time (sec) mean: 0.289 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:072 cmt:v120 proc time (sec) mean: 0.290 +/- 0.015 rms: 0.028 +/- 0.011 hostname:sdfmilan216 cpu:073 cmt:v120 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.026 +/- 0.009 hostname:sdfmilan216 cpu:074 cmt:v120 proc time (sec) mean: 0.294 +/- 0.016 rms: 0.032 +/- 0.011 hostname:sdfmilan216 cpu:075 cmt:v120 proc time (sec) mean: 0.295 +/- 0.016 rms: 0.030 +/- 0.011 hostname:sdfmilan216 cpu:076 cmt:v120 proc time (sec) mean: 0.292 +/- 0.017 rms: 0.032 +/- 0.012 hostname:sdfmilan216 cpu:077 cmt:v120 proc time (sec) mean: 0.294 +/- 0.017 rms: 0.033 +/- 0.012 hostname:sdfmilan216 cpu:078 cmt:v120 proc time (sec) mean: 0.294 +/- 0.016 rms: 0.030 +/- 0.012 hostname:sdfmilan216 cpu:079 cmt:v120 proc time (sec) mean: 0.287 +/- 0.014 rms: 0.024 +/- 0.010 hostname:sdfmilan216 cpu:080 cmt:v120 proc time (sec) mean: 0.290 +/- 0.014 rms: 0.026 +/- 0.010 hostname:sdfmilan216 cpu:081 cmt:v120 proc time (sec) mean: 0.289 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:082 cmt:v120 proc time (sec) mean: 0.284 +/- 0.019 rms: 0.032 +/- 0.013 hostname:sdfmilan216 cpu:083 cmt:v120 proc time (sec) mean: 0.292 +/- 0.011 rms: 0.020 +/- 0.008 hostname:sdfmilan216 cpu:084 cmt:v120 proc time (sec) mean: 0.290 +/- 0.014 rms: 0.025 +/- 0.010 hostname:sdfmilan216 cpu:085 cmt:v120 proc time (sec) mean: 0.285 +/- 0.014 rms: 0.024 +/- 0.010 hostname:sdfmilan216 cpu:086 cmt:v120 proc time (sec) mean: 0.283 +/- 0.011 rms: 0.019 +/- 0.008 hostname:sdfmilan216 cpu:087 cmt:v120 proc time (sec) mean: 0.292 +/- 0.012 rms: 0.021 +/- 0.009 hostname:sdfmilan216 cpu:088 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:089 cmt:v120 proc time (sec) mean: 0.289 +/- 0.017 rms: 0.031 +/- 0.012 hostname:sdfmilan216 cpu:090 cmt:v120 proc time (sec) mean: 0.296 +/- 0.017 rms: 0.030 +/- 0.012 hostname:sdfmilan216 cpu:091 cmt:v120 proc time (sec) mean: 0.294 +/- 0.020 rms: 0.037 +/- 0.014 hostname:sdfmilan216 cpu:092 cmt:v120 proc time (sec) mean: 0.287 +/- 0.012 rms: 0.022 +/- 0.009 hostname:sdfmilan216 cpu:093 cmt:v120 proc time (sec) mean: 0.289 +/- 0.014 rms: 0.026 +/- 0.010 hostname:sdfmilan216 cpu:094 cmt:v120 proc time (sec) mean: 0.293 +/- 0.013 rms: 0.025 +/- 0.009 hostname:sdfmilan216 cpu:095 cmt:v120 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.032 +/- 0.012 hostname:sdfmilan216 cpu:096 cmt:v120 proc time (sec) mean: 0.293 +/- 0.015 rms: 0.028 +/- 0.011 hostname:sdfmilan216 cpu:097 cmt:v120 proc time (sec) mean: 0.290 +/- 0.015 rms: 0.030 +/- 0.011 hostname:sdfmilan216 cpu:098 cmt:v120 proc time (sec) mean: 0.290 +/- 0.015 rms: 0.028 +/- 0.011 hostname:sdfmilan216 cpu:099 cmt:v120 proc time (sec) mean: 0.293 +/- 0.018 rms: 0.034 +/- 0.013 hostname:sdfmilan216 cpu:100 cmt:v120 proc time (sec) mean: 0.295 +/- 0.015 rms: 0.026 +/- 0.010 hostname:sdfmilan216 cpu:101 cmt:v120 proc time (sec) mean: 0.290 +/- 0.013 rms: 0.024 +/- 0.009 hostname:sdfmilan216 cpu:102 cmt:v120 proc time (sec) mean: 0.295 +/- 0.015 rms: 0.028 +/- 0.011 hostname:sdfmilan216 cpu:103 cmt:v120 proc time (sec) mean: 0.291 +/- 0.014 rms: 0.026 +/- 0.010 hostname:sdfmilan216 cpu:104 cmt:v120 proc time (sec) mean: 0.297 +/- 0.016 rms: 0.033 +/- 0.011 hostname:sdfmilan216 cpu:105 cmt:v120 proc time (sec) mean: 0.292 +/- 0.016 rms: 0.028 +/- 0.011 hostname:sdfmilan216 cpu:106 cmt:v120 proc time (sec) mean: 0.292 +/- 0.014 rms: 0.028 +/- 0.010 hostname:sdfmilan216 cpu:107 cmt:v120 proc time (sec) mean: 0.293 +/- 0.014 rms: 0.026 +/- 0.010 hostname:sdfmilan216 cpu:108 cmt:v120 proc time (sec) mean: 0.294 +/- 0.018 rms: 0.034 +/- 0.013 hostname:sdfmilan216 cpu:109 cmt:v120 proc time (sec) mean: 0.294 +/- 0.015 rms: 0.030 +/- 0.011 hostname:sdfmilan216 cpu:110 cmt:v120 proc time (sec) mean: 0.295 +/- 0.016 rms: 0.030 +/- 0.011 hostname:sdfmilan216 cpu:111 cmt:v120 proc time (sec) mean: 0.298 +/- 0.015 rms: 0.030 +/- 0.011 hostname:sdfmilan216 cpu:112 cmt:v120 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.036 +/- 0.012 hostname:sdfmilan216 cpu:113 cmt:v120 proc time (sec) mean: 0.298 +/- 0.015 rms: 0.032 +/- 0.011 hostname:sdfmilan216 cpu:114 cmt:v120 proc time (sec) mean: 0.292 +/- 0.017 rms: 0.034 +/- 0.012 hostname:sdfmilan216 cpu:115 cmt:v120 proc time (sec) mean: 0.289 +/- 0.018 rms: 0.033 +/- 0.013 hostname:sdfmilan216 cpu:116 cmt:v120 proc time (sec) mean: 0.299 +/- 0.016 rms: 0.033 +/- 0.011 hostname:sdfmilan216 cpu:117 cmt:v120 proc time (sec) mean: 0.297 +/- 0.015 rms: 0.031 +/- 0.011 hostname:sdfmilan216 cpu:118 cmt:v120 proc time (sec) mean: 0.302 +/- 0.018 rms: 0.035 +/- 0.013 hostname:sdfmilan216 cpu:119 cmt:v120 proc time (sec) mean: 0.300 +/- 0.015 rms: 0.032 +/- 0.011 hostname:sdfmilan216 cpu:120 cmt:v120 proc time (sec) mean: 0.293 +/- 0.016 rms: 0.033 +/- 0.011 hostname:sdfmilan216 cpu:121 cmt:v120 proc time (sec) mean: 0.301 +/- 0.017 rms: 0.035 +/- 0.012 hostname:sdfmilan216 cpu:122 cmt:v120 proc time (sec) mean: 0.295 +/- 0.014 rms: 0.030 +/- 0.010 hostname:sdfmilan216 cpu:123 cmt:v120 proc time (sec) mean: 0.298 +/- 0.016 rms: 0.032 +/- 0.011 hostname:sdfmilan216 cpu:124 cmt:v120 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.033 +/- 0.012 hostname:sdfmilan216 cpu:125 cmt:v120 proc time (sec) mean: 0.300 +/- 0.017 rms: 0.035 +/- 0.012 hostname:sdfmilan216 cpu:126 cmt:v120 proc time (sec) mean: 0.292 +/- 0.017 rms: 0.032 +/- 0.012 hostname:sdfmilan216 cpu:127 cmt:v120 proc time (sec) mean: 0.303 +/- 0.021 rms: 0.047 +/- 0.015 mean time (sec): 0.2904 |
Summary of the group test
number of CPUs | CPU in the group | time, msec |
---|---|---|
1 per test | single 5,10,32,64,96,127 | 206-226 |
8 | 0-7 | 225 |
8 | 8-15 | 221 |
8 | 24-31 | 224 |
8 | 120-127 | 216 |
15 | every 8-th, 0,8,24,32,...120 | 203 |
16 | 0-15 | 282 |
16 | 32-47 | 282 |
16 | 64-79 | 287 |
16 | 112-127 | 248 |
28 | 0-31 excl. weka | 262 |
32 | 32-63 | 287 |
32 | 64-95 | 272 |
32 | 96-127 | 382 |
56 | 0-63 excl. weka | 288 |
64 | 64-127 | 428 |
120 | 0-127 excl. weka | 454 |
120 | 0-127 excl. weka repeat | 383 |
120 | 0-127 on sdfmilan216 | 298 |
Part 2 of this analysis
References
References
- Part 2 - Scaling behavior of psana1 - test with command perf stat Part 3 - test for reduced memory consumption
- Scaling behavior of psana1 - test for reduced resource consumption- Part 4 - det.calib for epix10ka2m
- Jungfrau References
- Method det.calib algorithms
Overview
Content Tools