Issue

2024-01-04 email from Chris

2024-01-04 1:22pm
Li, Yee Ting;
Kroeger, Wilko
Hi Mikhail, (cc: Yee, Wilko since they may have an interest in this)

When you have a chance, could you look at the scaling behavior of this script.
It tries to "prefetch" the data from disk (for 100 events per core) with det.raw,
and then times the behavior of det.calib:

~cpo/problems/cxix1000021_scaling/cxix1000021_scaling.py

To do this get exclusive access to a batch node with this command:

srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash

The in another window ssh to the node that you have been allocated
(the reason this is necessary is obscure: it has to do with an incompatible
version of pmix used by srun that our mpi is unhappy with).
In that new window run these two commands:

mpirun -n 1 python cxix1000021_scaling.py
mpirun -n 80 python cxix1000021_scaling.py

For me the first one shows about .11s per event while the second shows about .25s per event,
which is the poor scaling behavior we would like to understand.
You can see logfiles in ~cpo/problems/cxix1000021_scaling in interactive_1core.log and interactive_80core.log.

I think the fundamental question that I hope you could answer is:
do all numpy operations in det.calib slow down on 80 cores,
or is there some other cause for the poor scaling?
From discussions we've had with Yee we suspect the poor scaling may
be due to behavior of the hardware, but we don't know for sure.

Happy to discuss this with you on zoom at any time, of course.
Thanks for looking at this!

chris

p.s. following a suggestion by someone (Yee? Wilko?)
I watched the cpu clock speeds in /proc/cpuinfo while the 80 core job was running.
To my eye they seemed to vary between ~2.4MHz and ~3.0Mhz which didn't feel like quite enough

List of commands for this test

commands for test

> s3dflogin
> psana
srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash
Ex:
ana-4.0.58-py3 [dubrovin@sdfiana001:~/LCLS/con-py3]$ srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash
srun: job 37602834 queued and waiting for resources
srun: job 37602834 has been allocated resources
In .bashrc on host sdfiana001
In .bash_login
ana-4.0.58-py3 [dubrovin@sdfmilan031:~/LCLS/con-py3]$

grab example from Chris:
~cpo/problems/cxix1000021_scaling/cxix1000021_scaling.py
and modify it as explained below.

In other window
> s3dflogin
ssh -Y sdfmilan031
cd LCLS/con-py3
source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/psconda.sh
source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/setup_testrel

mpirun -n 1 python test-cxix1000021_scaling.py
mpirun -n 80 python test-cxix1000021_scaling.py

Code for time monitoring

calib_jungfrau with inserted timing point

def calib_jungfrau(det, evt, cmpars=(7,3,200,10), **kwa):
    """
    Returns calibrated jungfrau data

    - gets constants
    - gets raw data
    - evaluates (code - pedestal - offset)
    - applys common mode correction if turned on
    - apply gain factor

    Parameters

    - det (psana.Detector) - Detector object
    - evt (psana.Event)    - Event object
    - cmpars (tuple) - common mode parameters
        - cmpars[0] - algorithm # 7-for jungfrau
        - cmpars[1] - control bit-word 1-in rows, 2-in columns
        - cmpars[2] - maximal applied correction
    - **kwa - used here and passed to det.mask_v2 or det.mask_comb
      - nda_raw - if not None, substitutes evt.raw()
      - mbits - DEPRECATED parameter of the det.mask_comb(...)
      - mask - user defined mask passed as optional parameter
    """

    t00 = time()

    src = det.source # - src (psana.Source)   - Source object

    nda_raw = kwa.get('nda_raw', None)
    arr = det.raw(evt) if nda_raw is None else nda_raw # shape:(<npanels>, 512, 1024) dtype:uint16
    if arr is None: return None

    t01 = time()

    peds = det.pedestals(evt) # - 4d pedestals shape:(3, 1, 512, 1024) dtype:float32
    if peds is None: return None

    t02 = time()

    gain = det.gain(evt)      # - 4d gains
    offs = det.offset(evt)    # - 4d offset

    t03 = time()

    detname = string_from_source(det.source)
    cmp = det.common_mode(evt) if cmpars is None else cmpars

    t04 = time()

    if gain is None: gain = np.ones_like(peds)  # - 4d gains
    if offs is None: offs = np.zeros_like(peds) # - 4d gains

    # cache
    gfac = store.gfac.get(detname, None) # det.name
    if gfac is None:
       gfac = divide_protected(np.ones_like(peds), gain)
       store.gfac[detname] = gfac
       store.arr1 = np.ones_like(arr, dtype=np.int8)

    t05 = time()

    # Define bool arrays of ranges
    # faster than bit operations
    gr0 = arr <  BW1              # 490 us
    gr1 =(arr >= BW1) & (arr<BW2) # 714 us
    gr2 = arr >= BW3              # 400 us

    t06 = time()

    # Subtract pedestals
    arrf = np.array(arr & MSK, dtype=np.float32)

    t07 = time()

    arrf[gr0] -= peds[0,gr0]
    arrf[gr1] -= peds[1,gr1] #- arrf[gr1]
    arrf[gr2] -= peds[2,gr2] #- arrf[gr2]

    t08 = time()

    factor = np.select((gr0, gr1, gr2), (gfac[0,:], gfac[1,:], gfac[2,:]), default=1) # 2msec

    t09 = time()

    offset = np.select((gr0, gr1, gr2), (offs[0,:], offs[1,:], offs[2,:]), default=0)

    t10 = time()

    arrf -= offset # Apply offset correction

    t11 = time()

    if store.mask is None:
       store.mask = det.mask_total(evt, **kwa)
    mask = store.mask

    t12 = time()

    if cmp is not None:
      mode, cormax = int(cmp[1]), cmp[2]
      npixmin = cmp[3] if len(cmp)>3 else 10
      if mode>0:
        #arr1 = store.arr1
        #grhg = np.select((gr0,  gr1), (arr1, arr1), default=0)
        logger.debug(info_ndarr(gr0, 'gain group0'))
        logger.debug(info_ndarr(mask, 'mask'))
        t0_sec_cm = time()
        gmask = np.bitwise_and(gr0, mask) if mask is not None else gr0
        #sh = (nsegs, 512, 1024)
        hrows = 256 #512/2
        for s in range(arrf.shape[0]):
          if mode & 4: # in banks: (512/2,1024/16) = (256,64) pixels # 100 ms
            common_mode_2d_hsplit_nbanks(arrf[s,:hrows,:], mask=gmask[s,:hrows,:], nbanks=16, cormax=cormax, npix_min=npixmin)
            common_mode_2d_hsplit_nbanks(arrf[s,hrows:,:], mask=gmask[s,hrows:,:], nbanks=16, cormax=cormax, npix_min=npixmin)

          if mode & 1: # in rows per bank: 1024/16 = 64 pixels # 275 ms
            common_mode_rows_hsplit_nbanks(arrf[s,], mask=gmask[s,], nbanks=16, cormax=cormax, npix_min=npixmin)

          if mode & 2: # in cols per bank: 512/2 = 256 pixels  # 290 ms
            common_mode_cols(arrf[s,:hrows,:], mask=gmask[s,:hrows,:], cormax=cormax, npix_min=npixmin)
            common_mode_cols(arrf[s,hrows:,:], mask=gmask[s,hrows:,:], cormax=cormax, npix_min=npixmin)

        logger.debug('TIME: common-mode correction time = %.6f sec' % (time()-t0_sec_cm))

    t13 = time()

    resp = arrf * factor if mask is None else arrf * factor * mask # gain correction

    t14 = time()
    times = np.array((t00, t01, t02, t03, t04, t05, t06, t07, t08, t09, t10, t11, t12, t13, t14), dtype=np.float64)

    return resp, times

Timing histograms

Single core processing

80-core processing for ranks 0, 30, and 60

Results

Table shows mean time increment and their statistical uncertainty from associated histograms.

t point	time increment	point description	time for rank 0/1	rank 0/80	rank 30/80	rank 60/80
1	t1 - t0	det.raw	0.8±0.2 ms	4.0 ±0.6 ms	3.2±0.4 ms	3.5 ±0.8 ms
2	t2 - t1	det.pedestals	15±3 μs	36 ±10 μs	31±6 μs	39 ±17 μs
3	t3 - t2	det.gain,offset	15±2 μs	27 ±4 μs	26±4 μs	27 ±6 μs
4	...	cmpars	25±1 μs	50 ±7 μs	58±26 μs	71 ±33 μs
5		gfac	2±0 μs	6 ±1 μs	7±1 μs	7 ±2 μs
6		gr0,1,2	1.3±0.2 ms	10.5 ±1.1 ms	7.0±0.9 ms	9.7 ±1.6 ms
7		make arrf	1.76±0.05 ms	9.2 ±0.9 ms	6.3±0.7 ms	9.0 ±1.5 ms
8		subtract peds	93.7±3.1 ms	191 ±11 ms	181±15 ms	259 ±26 ms
9		eval gain factor for gain ranges	4.9±0.6 ms	20.3 ±1.5 ms	14.6±1.2 ms	17.3 ±2.0 ms
10		eval offset for gain ranges	6.2±0.4 ms	18.5 ±1.3 ms	18.4±1.4 ms	19.2 ±2.1 ms
11		subtract offset	1.0±0.2 ms	6.0 ±0.7 ms	5.3±0.6 ms	6.2 ±1.2 ms
12		get mask	3±2 μs	6 ±2 μs	6±2 μs	7 ±2 μs
13		common mode turned off	7±1 μs	15 ±2 μs	17±2 μs	20 ±3 μs
14	t14 - t13	apply gain factor and mask	4.0±0.7 ms	14.9 ±2.0 ms	13.9±1.6 ms	19.2 ±3.5 ms
99	t14 - t0	per evt time, inside det.calib	109.8±4.2 ms	276 ±15 ms	247±13 ms	345 ±29 ms
0	t0 - t0 previous evt	time between consecutive det.calib	115.4±3.9 ms	335 ±16 ms	307±14 ms	398 ±32 ms

Summary

single core processing is faster than per/core time in 80–core case, factor 2.5-3 FOR ALL OPERATIONS
in 80-core case: time per core is consistent between cores
all constants are cashed and access to constants is fast at sub-milisecond level
common mode correction is turned off, as well as mask?
most time consuming operation is indexed pedestal subtraction

indexed by gain ranges pedestal subtraction

    t07 = time()

    arrf[gr0] -= peds[0,gr0]
    arrf[gr1] -= peds[1,gr1]
    arrf[gr2] -= peds[2,gr2]

    t08 = time()

bad single-to-multicore scaling issue has nothing to do with particular algorithm, it is common problem for any algorithm

2024-01-16 Test for simulated events

Time consuming code

Time consuming code

def time_consuming_algorithm():
    sh2d = (1024,1024)
    sh3d = (3,) + sh2d
    a = random_standard(shape=sh2d, mu=10, sigma=2, dtype=np.float64)
    b = random_standard(shape=sh3d, mu=20, sigma=3, dtype=np.float64)
    gr1 = a>=11
    gr2 = (a>9) & (a<11)
    gr3 = a<=9
    a[gr1] -= b[0, gr1]
    a[gr2] -= b[1, gr2]
    a[gr3] -= b[2, gr3]

2024-01-16 Test Summary

runing on sdfmilan031 - shows minor ~ 5% the mean time difference between 1-core and 80-core processing is larger

2024-01-17 Test for simulated events with minor modifications

Test variation

array shape is changed from (1024, 1024) → (8*512, 1024) 4M
array generation is excluded from time measurement, only indexed subtraction contributes to time measurement
do not pre-create random arrays, it is generated in each core... requires too much memory for all cores.
run on sdfmilan047: ana-4.0.58-py3 [dubrovin@sdfmilan047:~/LCLS/con-py3]$ mpirun -n 80 python test-mpi-numpy-hist.py

Time consuming code

Time consuming code

def time_consuming_algorithm(a, b):
    gr1 = a>=11
    gr2 = (a>9) & (a<11)
    gr3 = a<=9
    t0_sec = time()
    a[gr1] -= b[0, gr1]
    a[gr2] -= b[1, gr2]
    a[gr3] -= b[2, gr3]
    return time() - t0_sec

Results

Single core processing

80-core processing for ranks 0, 30, and 60

2024-01-17 Test Summary

if random array generation is excluded from time measurement, the mean time difference between 1-core and 80-core processing is larger
the main contribution to time difference comes from reserved host...
- sdfmilan047 - looks like extremely "time-noisy" in multi-core processing...
- sdfmilan031 - in previous test looks pretty "calm"

2024-01-19 Test for a few hosts

The same simulation algorithm as before is used to compare processing time of different cores.
To get rid of obvious fluctuation off time measurement between cores, a sample of cores is extended from three, 0,30,60 to seven 0,10,20,30,40,50,60 of 80.
Mean processing time and its uncertainty in milliseconds for single core (core 0/1) and a few cores of 80 are shown in table.
Ratio represents the ratio of 80-core average over core 0/1.

host name	core 0/1	0/80	10/80	20/80	30/80	40/80	50/80	60/80	70/80	80-core average	Ratio	Largest ratio
sdfmilan027	192 ±6	241 ±19	430 ±32	336 ±24	287 ±16	245 ±17	412 ±30	342 ±24		327.6	1.71	2.24
sdfmilan049	210 ±1	280 ±19	369 ±28	245 ±45	282 ±17	290 ±24	367 ±28	242 ±37		296.4	1.41	1.75
sdfmilan056	191 ±3	328 ±21	269 ±40	258 ±32	347 ±28	324 ±22	254 ±34	346 ±30		303.7	1.59	1.82
sdfmilan057	190 ±4	262 ±20	292 ±21	439 ±26	226 ±12	256 ±19	297 ±20	467 ±36		319.9	1.68	2.46
sdfmilan065	203 ±7	281 ±15	345 ±23	245 ±22	248 ±20	276 ±15	353 ±24	250 ±22		285.4	1.41	1.74
sdfmilan105	190 ±2	261 ±36	277 ±20	282 ±15	276 ±14	263 ±48	273 ±19	284 ±26		273.7	1.44	1.49
sdfmilan130	190 ±3	394 ±26	270 ±23	323 ±20	230 ±10	379 ±27	276 ±24	322 ±20		313.4	1.65	2.07
sdfmilan202	210 ±0	346 ±32	351 ±28	281 ±16	286 ±16	355 ±34	345 ±28	297 ±16		323.0	1.54	1.69
sdfmilan203	191 ±4	281 ±26	355 ±31	288 ±26	332 ±44	271 ±32	347 ±26	282 ±21		308.0	1.61	1.86
sdfmilan225	204 ±7	409 ±29	296 ±23	230 ±10	230 ±10	398 ±26	289 ±24	232 ±9		297.7	1.46	2.00
sdfmilan213 cpu_num	293 6 0	339 ±18 13	355 ±22 45	605 ±104 74	388 ±27 103	337 ±18 5	361 ±21 44	613 ±95 72	422 ±27 106	427.5	1.46	2.09
sdfmilan047 cpu_num	210 1 0	639 ±34 8	483 ±219 32	474 ±284 65	744 ±75 104	637 ±43 40	588 ±266 36	443 ±202 67	722 ±75 110	590.8	2.81	3.54
sdfmilan220 cpu_num	210 1 0	649 ±29 7	669 ±134 34	500 ±214 76	1039 ±95 105	707 ±50 10	654 ±113 40	490 ±229 72	1040 ±83 104	718.5	3.42	4.95

Last 3 lines in table also show cpu_num to prevent contribution from weka nodes

Wilko & Chris about weka nodes

2024-01-19 6:24PM
Hi Mikhail,
I think those code can fetch a physical core number:
>>> import psutil
>>> print(psutil.Process().cpu_num())
3
>>>
Can you add that to your numpy tests to make sure that cores 16-23 aren’t used by your mpi processes?  I think Wilko thought those 8 cores run weka filesystem processes.
Thanks, and have a good weekend,
chris

2024-01-19 Time difference vs array size

shape is decreased in size from (8*512,1024) to (2*512,1024) 1M

host name	core 0/1	0/80	10/80	20/80	30/80	40/80	50/80	60/80	70/80	80-core average	Ratio	Largest ratio
sdfmilan039	47.6 ±0.7	56.0 ±2.5	59.2 ±4.7	59.9 ±6.3	52.8 ±3.4	56.3 ±2.4	58.6 ±5.0	51.2 ±9.9	51.3 ±3.3	55.7	1.17	1.26
sdfmilan225	47.6 ±0.5	56.6 ±3.2	55.4 ±4.2	52.8 ±2.4	52.3 ±2.3	55.8 ±3.8	55.3 ±3.5	52.5 ±2.5	52.0 ±2.4	54.1	1.14	1.19

shape is increased in size from (32*512,1024) 16M

host name	core 0/1	0/80	10/80	20/80	30/80	40/80	50/80	60/80	70/80	80-core average	Ratio	Largest ratio
sdfmilan225	766 ±20	1251 ±91	1099 ±108	958 ±174	955 ±199	1206 ±83	1086 ±106	949 ±181	952 ±231	1057	1.38	1.63
sdfmilan031	760 ±1	1141 ±81	1144 ±94	910 ±111	947 ±118	1221 ±74	1157 ±93	947 ±108	937 ±104	1051	1.38	1.61

2024-01-19-22 Test Summary

weka FS nodes do not show up in processing ranks
decreasing array size from 4M to 1M decreases time ratio from ~1.5 to 1.15
increasing array size from 4M to 14M does not increases time ratio...

2024-01-22 Q&A

cpu_num = psutil.Process().cpu_num() vs runk

rank and cpu number are linked for all events
cpu number assigned to rank differently for each job
16 ≤ cpu_num ≤ 23 - are not found in data processing

sdfmilan125 linking between rank and cpu_num

rank:20 cpu_num:073 nevt:044 time:0.277427
rank:10 cpu_num:046 nevt:030 time:0.632612
rank:00 cpu_num:000 nevt:046 time:0.651162
rank:20 cpu_num:073 nevt:045 time:0.266946
rank:10 cpu_num:046 nevt:031 time:0.272130
rank:00 cpu_num:000 nevt:047 time:0.574547
rank:20 cpu_num:073 nevt:046 time:0.329882
rank:10 cpu_num:046 nevt:032 time:0.287877
rank:00 cpu_num:000 nevt:048 time:0.493901
rank:20 cpu_num:073 nevt:047 time:0.436152
rank:10 cpu_num:046 nevt:033 time:0.902722
rank:00 cpu_num:000 nevt:049 time:0.505073
rank:20 cpu_num:073 nevt:048 time:0.272120
rank:00 cpu_num:000 nevt:050 time:0.519510
rank:20 cpu_num:073 nevt:049 time:0.360761
rank:10 cpu_num:046 nevt:034 time:0.555629
rank:20 cpu_num:073 nevt:050 time:0.291751
rank:00 cpu_num:000 nevt:051 time:0.666105
rank:10 cpu_num:046 nevt:035 time:0.371877
rank:20 cpu_num:073 nevt:051 time:0.764429
rank:00 cpu_num:000 nevt:052 time:0.672750
rank:20 cpu_num:073 nevt:052 time:0.325827
rank:00 cpu_num:000 nevt:053 time:0.328918
rank:10 cpu_num:046 nevt:036 time:0.332080
rank:00 cpu_num:000 nevt:054 time:0.358017
rank:20 cpu_num:073 nevt:053 time:0.290833
rank:10 cpu_num:046 nevt:037 time:0.980106
rank:00 cpu_num:000 nevt:055 time:0.487292
rank:20 cpu_num:073 nevt:054 time:0.333488

host name	job #	0/80	10/80	20/80	30/80	40/80	50/80	60/80	70/80
sdfmilan215	1	8	36	66	111	2	41	67	101
sdfmilan215	2	11	39	71	97	1	42	66	103
sdfmilan215	3	4	40	69	101	10	33	77	107

2024-01-30 running in subprocesses

On allocated host run the same time consuming job on specified cpu using subprocess command

taskset --cpu-list %d python test-scaling-subproc.py %d

Simultaneous processing on cpu 0-7 of the same host

host name	cpu 0	1	2	3	4	5	6	7
sdfmilan027	213 ±10	218 ±14	216 ±9	215 ±10	217 ±9	212 ±8	215 1±2	217 ±12

time [sec] consumption per algorithm and pre entire event

requested cpu:001
cpu_num:001 nevt:000 time algo/total:0.258310/0.893963
cpu_num:001 nevt:010 time algo/total:0.203578/0.765441
cpu_num:001 nevt:020 time algo/total:0.204886/0.758621
cpu_num:001 nevt:030 time algo/total:0.207257/0.776058
cpu_num:001 nevt:040 time algo/total:0.240543/0.818005
cpu_num:001 nevt:050 time algo/total:0.219791/0.780273
cpu_num:001 nevt:060 time algo/total:0.221798/0.781831
cpu_num:001 nevt:070 time algo/total:0.227552/0.787389
cpu_num:001 nevt:080 time algo/total:0.224095/0.778408
cpu_num:001 nevt:090 time algo/total:0.226634/0.779186

Simultaneous processing on cpu 1, 8, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96 of the same host

host name	1	8	24	32	40	48	56	64	72	80	88	96
sdfmilan027	199 ±7	194 ±6	191 ±4	208 ±5	210 ±1	210 ±1	201 ±7	209 ±5	210 ±3	194 ±7	192 ±6	191 ±3

time [sec] consumption per algorithm and pre entire event

requested cpu:096
cpu_num:096 nevt:000 time algo/total:0.201525/0.750702
cpu_num:096 nevt:010 time algo/total:0.200815/0.742284
cpu_num:096 nevt:020 time algo/total:0.199862/0.738482
cpu_num:096 nevt:030 time algo/total:0.200478/0.742564
cpu_num:096 nevt:040 time algo/total:0.200695/0.741042
cpu_num:096 nevt:050 time algo/total:0.199134/0.736679
cpu_num:096 nevt:060 time algo/total:0.198478/0.736582
cpu_num:096 nevt:070 time algo/total:0.198812/0.737684
cpu_num:096 nevt:080 time algo/total:0.200575/0.742578
cpu_num:096 nevt:090 time algo/total:0.200512/0.737443

2024-01-31 time consumption test in subprocess

Try to resolve mystery observed in previous test:

time consuming algorithm takes ~200ms
but time per event is ~740ms

Algorithm code

method time_consuming_code

def time_consuming_algorithm():
    t01 = time()
    a, b = random_arrays()
    t02 = time()
    gr1 = a>=11
    gr2 = (a>9) & (a<11)
    gr3 = a<=9
    t03 = time()
    a[gr1] -= b[0, gr1]
    a[gr2] -= b[1, gr2]
    a[gr3] -= b[2, gr3]
    t04 = time()
    return (t01, t02, t03, t04)

code simulating the event loop

def do_algo(cpu=0):

    hostname = get_hostname()
    #cpu_num = psutil.Process().cpu_num()
    print('requested cpu:%03d' % cpu)

    SAVE_FIGS = True
    nevents = 100
    ntpoints = 6
    arrts = np.zeros((nevents,ntpoints), dtype=np.float64)
    t05_old = time()

    for nevt in range(nevents):
        t00 = time()
        times = time_consuming_algorithm()
        cpu_num = psutil.Process().cpu_num()
        #if cpu_num >=16 and cpu_num <=23:
        #    print('cpu_num:%03d nevt:%03d time:%.6f CPU_NUM IN WEKA RANGE [16,23]' % (cpu_num, nevt, dt_sec))
        t05 = time()
        times = (t00,) + times + (t05,)
        arrts[nevt,:] = times
        dt_evt = t05 - t05_old
        t05_old = t05
        if nevt%10>0: continue
        dt_alg = times[4] - times[3]
        dt_in  = times[4] - times[1]
        print('cpu_num:%03d nevt:%03d  times (sec)' % (cpu_num, nevt), \
             ' random arrs: %.6f' % (times[2] - times[1]), \
             ' indeces: %.6f'     % (times[3] - times[2]), \
             ' alg: %.6f'         % (times[4] - times[3]), \
             ' inside algo: %.6f' % (times[4] - times[1]), \
             ' per event: %.6f'   % dt_evt)
        ...
        fill-out and show histograms

Per-event time split

per-event time split

requested cpu:010
cpu_num:010 nevt:000  times (sec)  random arrs: 0.530126  indeces: 0.009856  alg: 0.201348  inside algo: 0.741331  per event: 0.742876
cpu_num:010 nevt:010  times (sec)  random arrs: 0.529047  indeces: 0.006796  alg: 0.199449  inside algo: 0.735292  per event: 0.736108
cpu_num:010 nevt:020  times (sec)  random arrs: 0.529192  indeces: 0.006795  alg: 0.200225  inside algo: 0.736212  per event: 0.736941
cpu_num:010 nevt:030  times (sec)  random arrs: 0.529076  indeces: 0.006807  alg: 0.198543  inside algo: 0.734425  per event: 0.735161
cpu_num:010 nevt:040  times (sec)  random arrs: 0.529014  indeces: 0.006840  alg: 0.198867  inside algo: 0.734720  per event: 0.735475
cpu_num:010 nevt:050  times (sec)  random arrs: 0.529560  indeces: 0.006824  alg: 0.199954  inside algo: 0.736338  per event: 0.737050
cpu_num:010 nevt:060  times (sec)  random arrs: 0.529004  indeces: 0.006804  alg: 0.198679  inside algo: 0.734487  per event: 0.735210
cpu_num:010 nevt:070  times (sec)  random arrs: 0.528883  indeces: 0.006833  alg: 0.199188  inside algo: 0.734903  per event: 0.735635
cpu_num:010 nevt:080  times (sec)  random arrs: 0.528968  indeces: 0.006804  alg: 0.199556  inside algo: 0.735327  per event: 0.736039
cpu_num:010 nevt:090  times (sec)  random arrs: 0.528690  indeces: 0.006826  alg: 0.199990  inside algo: 0.735506  per event: 0.736218

Summary for time consumption

Random array of shapes sh2d = (8*512,1024) and sh3d = (3, 8*512,1024) simulating raw data and calib constants takes ~0.5sec. In previous code only 2-panel shape (2*512,1024) was used.

host name

number

of CPU

cpu0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

sdfmilan126

16

220 16

225 17

225 16

223 15

227 14

223 14

225 15

229 14

224 16

229 14

227 14

222 15

221 16

231 13

228 15

231 12

32

334 24

332 25

335 22

332 21

343 23

335 22

323 21

338 22

351 24

340 22

345 23

339 22

331 20

348 23

354 23

357 24

time split for cpu 15

at 16 cpu
requested cpu:015
cpu_num:015 nevt:000  times (sec)  random arrs: 0.676525  indeces: 0.048282  alg: 0.345061  inside algo: 1.069867  per event: 1.073267
cpu_num:015 nevt:010  times (sec)  random arrs: 0.557514  indeces: 0.012086  alg: 0.243178  inside algo: 0.812778  per event: 0.813630
cpu_num:015 nevt:020  times (sec)  random arrs: 0.551355  indeces: 0.008622  alg: 0.257315  inside algo: 0.817291  per event: 0.818175
cpu_num:015 nevt:030  times (sec)  random arrs: 0.556352  indeces: 0.008508  alg: 0.241447  inside algo: 0.806307  per event: 0.807756
cpu_num:015 nevt:040  times (sec)  random arrs: 0.553430  indeces: 0.010278  alg: 0.211174  inside algo: 0.774882  per event: 0.777263
cpu_num:015 nevt:050  times (sec)  random arrs: 0.549226  indeces: 0.009555  alg: 0.217025  inside algo: 0.775806  per event: 0.776775
cpu_num:015 nevt:060  times (sec)  random arrs: 0.556838  indeces: 0.011403  alg: 0.218301  inside algo: 0.786542  per event: 0.787381
cpu_num:015 nevt:070  times (sec)  random arrs: 0.564118  indeces: 0.013997  alg: 0.220398  inside algo: 0.798513  per event: 0.799616
cpu_num:015 nevt:080  times (sec)  random arrs: 0.558824  indeces: 0.014296  alg: 0.218725  inside algo: 0.791845  per event: 0.793981
cpu_num:015 nevt:090  times (sec)  random arrs: 0.552467  indeces: 0.013539  alg: 0.241585  inside algo: 0.807591  per event: 0.808606

===
at 32 cpu

requested cpu:000
cpu_num:000 nevt:000  times (sec)  random arrs: 0.768741  indeces: 0.130826  alg: 0.534536  inside algo: 1.434103  per event: 1.437331
cpu_num:000 nevt:010  times (sec)  random arrs: 0.707944  indeces: 0.084266  alg: 0.306825  inside algo: 1.099035  per event: 1.099948
cpu_num:000 nevt:020  times (sec)  random arrs: 0.708561  indeces: 0.069767  alg: 0.378666  inside algo: 1.156994  per event: 1.158244
cpu_num:000 nevt:030  times (sec)  random arrs: 0.761646  indeces: 0.061286  alg: 0.378687  inside algo: 1.201619  per event: 1.202453
cpu_num:000 nevt:040  times (sec)  random arrs: 0.631669  indeces: 0.014007  alg: 0.269451  inside algo: 0.915127  per event: 0.916927
cpu_num:000 nevt:050  times (sec)  random arrs: 0.711132  indeces: 0.067868  alg: 0.366595  inside algo: 1.145596  per event: 1.146980
cpu_num:000 nevt:060  times (sec)  random arrs: 0.664688  indeces: 0.087194  alg: 0.469769  inside algo: 1.221651  per event: 1.223267
cpu_num:000 nevt:070  times (sec)  random arrs: 0.735930  indeces: 0.022596  alg: 0.321454  inside algo: 1.079980  per event: 1.081903
cpu_num:000 nevt:080  times (sec)  random arrs: 0.697990  indeces: 0.071118  alg: 0.263736  inside algo: 1.032844  per event: 1.033743
cpu_num:000 nevt:090  times (sec)  random arrs: 0.577298  indeces: 0.008807  alg: 0.209763  inside algo: 0.795867  per event: 0.796584

requested cpu:015
cpu_num:015 nevt:000  times (sec)  random arrs: 0.891085  indeces: 0.074366  alg: 0.475267  inside algo: 1.440718  per event: 1.443656
cpu_num:015 nevt:010  times (sec)  random arrs: 0.646901  indeces: 0.029601  alg: 0.506834  inside algo: 1.183336  per event: 1.188114
cpu_num:015 nevt:020  times (sec)  random arrs: 0.641244  indeces: 0.020880  alg: 0.362483  inside algo: 1.024606  per event: 1.025537
cpu_num:015 nevt:030  times (sec)  random arrs: 0.653975  indeces: 0.038478  alg: 0.283170  inside algo: 0.975623  per event: 0.976723
cpu_num:015 nevt:040  times (sec)  random arrs: 0.724432  indeces: 0.104294  alg: 0.365113  inside algo: 1.193839  per event: 1.196620
cpu_num:015 nevt:050  times (sec)  random arrs: 0.669759  indeces: 0.027769  alg: 0.264526  inside algo: 0.962054  per event: 0.967170
cpu_num:015 nevt:060  times (sec)  random arrs: 0.717789  indeces: 0.017697  alg: 0.332127  inside algo: 1.067613  per event: 1.069825
cpu_num:015 nevt:070  times (sec)  random arrs: 0.677717  indeces: 0.034877  alg: 0.261328  inside algo: 0.973923  per event: 0.975290
cpu_num:015 nevt:080  times (sec)  random arrs: 0.575024  indeces: 0.029689  alg: 0.380944  inside algo: 0.985657  per event: 0.989201
cpu_num:015 nevt:090  times (sec)  random arrs: 0.605548  indeces: 0.025510  alg: 0.289985  inside algo: 0.921044  per event: 0.921819

requested cpu:039
cpu_num:039 nevt:000  times (sec)  random arrs: 0.648366  indeces: 0.042368  alg: 0.421943  inside algo: 1.112678  per event: 1.114263
cpu_num:039 nevt:010  times (sec)  random arrs: 0.583670  indeces: 0.014271  alg: 0.249655  inside algo: 0.847596  per event: 0.848407
cpu_num:039 nevt:020  times (sec)  random arrs: 0.571773  indeces: 0.011460  alg: 0.220845  inside algo: 0.804077  per event: 0.806523
cpu_num:039 nevt:030  times (sec)  random arrs: 0.574509  indeces: 0.011243  alg: 0.228133  inside algo: 0.813885  per event: 0.814791
cpu_num:039 nevt:040  times (sec)  random arrs: 0.573384  indeces: 0.013692  alg: 0.228176  inside algo: 0.815251  per event: 0.816023
cpu_num:039 nevt:050  times (sec)  random arrs: 0.589361  indeces: 0.019947  alg: 0.227057  inside algo: 0.836365  per event: 0.837242
cpu_num:039 nevt:060  times (sec)  random arrs: 0.578790  indeces: 0.028885  alg: 0.233790  inside algo: 0.841465  per event: 0.842652
cpu_num:039 nevt:070  times (sec)  random arrs: 0.580031  indeces: 0.009300  alg: 0.220303  inside algo: 0.809635  per event: 0.810407
cpu_num:039 nevt:080  times (sec)  random arrs: 0.631875  indeces: 0.014580  alg: 0.232713  inside algo: 0.879168  per event: 0.879986
cpu_num:039 nevt:090  times (sec)  random arrs: 0.613904  indeces: 0.025082  alg: 0.244429  inside algo: 0.883415  per event: 0.884130

2024-02-01 scaling for groups of busy cpus of the same host

single cpu running job for a few of them

hostname:sdfmilan114 cpu:005 cmt:v1 proc time (sec) mean: 0.210 +/- 0.002 rms: 0.002 +/- 0.001
hostname:sdfmilan114 cpu:010 cmt:v1 proc time (sec) mean: 0.210 +/- 0.006 rms: 0.007 +/- 0.004
hostname:sdfmilan114 cpu:032 cmt:v1 proc time (sec) mean: 0.206 +/- 0.007 rms: 0.008 +/- 0.005
hostname:sdfmilan114 cpu:064 cmt:v1 proc time (sec) mean: 0.226 +/- 0.006 rms: 0.008 +/- 0.005
hostname:sdfmilan114 cpu:096 cmt:v1 proc time (sec) mean: 0.217 +/- 0.007 rms: 0.009 +/- 0.005
hostname:sdfmilan114 cpu:127 cmt:v1 proc time (sec) mean: 0.220 +/- 0.007 rms: 0.010 +/- 0.005

8-CPU groups, 0-7, 8-15, 24-31, 120-127

hostname:sdfmilan114 cpu:000 cmt:v08-1 proc time (sec) mean: 0.227 +/- 0.009 rms: 0.016 +/- 0.007
hostname:sdfmilan114 cpu:001 cmt:v08-1 proc time (sec) mean: 0.227 +/- 0.008 rms: 0.011 +/- 0.006
hostname:sdfmilan114 cpu:002 cmt:v08-1 proc time (sec) mean: 0.224 +/- 0.010 rms: 0.016 +/- 0.007
hostname:sdfmilan114 cpu:003 cmt:v08-1 proc time (sec) mean: 0.213 +/- 0.008 rms: 0.010 +/- 0.006
hostname:sdfmilan114 cpu:004 cmt:v08-1 proc time (sec) mean: 0.224 +/- 0.009 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:005 cmt:v08-1 proc time (sec) mean: 0.223 +/- 0.008 rms: 0.011 +/- 0.006
hostname:sdfmilan114 cpu:006 cmt:v08-1 proc time (sec) mean: 0.227 +/- 0.009 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:007 cmt:v08-1 proc time (sec) mean: 0.235 +/- 0.008 rms: 0.011 +/- 0.006
mean time (sec): 0.2250

hostname:sdfmilan114 cpu:008 cmt:v08-2 proc time (sec) mean: 0.223 +/- 0.011 rms: 0.017 +/- 0.008
hostname:sdfmilan114 cpu:009 cmt:v08-2 proc time (sec) mean: 0.224 +/- 0.009 rms: 0.015 +/- 0.006
hostname:sdfmilan114 cpu:010 cmt:v08-2 proc time (sec) mean: 0.222 +/- 0.009 rms: 0.013 +/- 0.006
hostname:sdfmilan114 cpu:011 cmt:v08-2 proc time (sec) mean: 0.217 +/- 0.008 rms: 0.011 +/- 0.006
hostname:sdfmilan114 cpu:012 cmt:v08-2 proc time (sec) mean: 0.220 +/- 0.008 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:013 cmt:v08-2 proc time (sec) mean: 0.219 +/- 0.010 rms: 0.014 +/- 0.007
hostname:sdfmilan114 cpu:014 cmt:v08-2 proc time (sec) mean: 0.221 +/- 0.010 rms: 0.016 +/- 0.007
hostname:sdfmilan114 cpu:015 cmt:v08-2 proc time (sec) mean: 0.223 +/- 0.009 rms: 0.015 +/- 0.007
mean time (sec): 0.2211

hostname:sdfmilan114 cpu:024 cmt:v08-3 proc time (sec) mean: 0.229 +/- 0.009 rms: 0.013 +/- 0.006
hostname:sdfmilan114 cpu:025 cmt:v08-3 proc time (sec) mean: 0.225 +/- 0.009 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:026 cmt:v08-3 proc time (sec) mean: 0.224 +/- 0.010 rms: 0.017 +/- 0.007
hostname:sdfmilan114 cpu:027 cmt:v08-3 proc time (sec) mean: 0.214 +/- 0.008 rms: 0.010 +/- 0.006
hostname:sdfmilan114 cpu:028 cmt:v08-3 proc time (sec) mean: 0.228 +/- 0.009 rms: 0.013 +/- 0.006
hostname:sdfmilan114 cpu:029 cmt:v08-3 proc time (sec) mean: 0.228 +/- 0.009 rms: 0.014 +/- 0.007
hostname:sdfmilan114 cpu:030 cmt:v08-3 proc time (sec) mean: 0.223 +/- 0.009 rms: 0.015 +/- 0.007
hostname:sdfmilan114 cpu:031 cmt:v08-3 proc time (sec) mean: 0.221 +/- 0.010 rms: 0.016 +/- 0.007
mean time (sec): 0.2240

hostname:sdfmilan114 cpu:120 cmt:v08-5 proc time (sec) mean: 0.218 +/- 0.009 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:121 cmt:v08-5 proc time (sec) mean: 0.218 +/- 0.009 rms: 0.013 +/- 0.006
hostname:sdfmilan114 cpu:122 cmt:v08-5 proc time (sec) mean: 0.211 +/- 0.006 rms: 0.007 +/- 0.004
hostname:sdfmilan114 cpu:123 cmt:v08-5 proc time (sec) mean: 0.212 +/- 0.008 rms: 0.010 +/- 0.006
hostname:sdfmilan114 cpu:124 cmt:v08-5 proc time (sec) mean: 0.214 +/- 0.007 rms: 0.009 +/- 0.005
hostname:sdfmilan114 cpu:125 cmt:v08-5 proc time (sec) mean: 0.214 +/- 0.008 rms: 0.009 +/- 0.006
hostname:sdfmilan114 cpu:126 cmt:v08-5 proc time (sec) mean: 0.218 +/- 0.008 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:127 cmt:v08-5 proc time (sec) mean: 0.219 +/- 0.008 rms: 0.012 +/- 0.006
mean time (sec): 0.2155

each eights CPU: 0,8,24,32,40,...96, 104,112,120

hostname:sdfmilan114 cpu:000 cmt:vx8 proc time (sec) mean: 0.205 +/- 0.007 rms: 0.009 +/- 0.005
hostname:sdfmilan114 cpu:008 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.000 rms: 0.000 +/- 0.000
hostname:sdfmilan114 cpu:024 cmt:vx8 proc time (sec) mean: 0.192 +/- 0.005 rms: 0.006 +/- 0.004
hostname:sdfmilan114 cpu:032 cmt:vx8 proc time (sec) mean: 0.194 +/- 0.007 rms: 0.008 +/- 0.005
hostname:sdfmilan114 cpu:040 cmt:vx8 proc time (sec) mean: 0.204 +/- 0.007 rms: 0.009 +/- 0.005
hostname:sdfmilan114 cpu:048 cmt:vx8 proc time (sec) mean: 0.201 +/- 0.007 rms: 0.010 +/- 0.005
hostname:sdfmilan114 cpu:056 cmt:vx8 proc time (sec) mean: 0.204 +/- 0.007 rms: 0.009 +/- 0.005
hostname:sdfmilan114 cpu:064 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.002 rms: 0.002 +/- 0.001
hostname:sdfmilan114 cpu:072 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.002 rms: 0.002 +/- 0.001
hostname:sdfmilan114 cpu:080 cmt:vx8 proc time (sec) mean: 0.199 +/- 0.007 rms: 0.010 +/- 0.005
hostname:sdfmilan114 cpu:088 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.000 rms: 0.000 +/- 0.000
hostname:sdfmilan114 cpu:096 cmt:vx8 proc time (sec) mean: 0.201 +/- 0.007 rms: 0.010 +/- 0.005
hostname:sdfmilan114 cpu:104 cmt:vx8 proc time (sec) mean: 0.203 +/- 0.007 rms: 0.010 +/- 0.005
hostname:sdfmilan114 cpu:112 cmt:vx8 proc time (sec) mean: 0.201 +/- 0.007 rms: 0.010 +/- 0.005
hostname:sdfmilan114 cpu:120 cmt:vx8 proc time (sec) mean: 0.205 +/- 0.007 rms: 0.009 +/- 0.005
mean time (sec): 0.2033

16-CPU groups: 0-15, 32-47, 64-79,112-127

hostname:sdfmilan114 cpu:000 cmt:v16-1 proc time (sec) mean: 0.277 +/- 0.015 rms: 0.036 +/- 0.011
hostname:sdfmilan114 cpu:001 cmt:v16-1 proc time (sec) mean: 0.273 +/- 0.016 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:002 cmt:v16-1 proc time (sec) mean: 0.274 +/- 0.016 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:003 cmt:v16-1 proc time (sec) mean: 0.280 +/- 0.015 rms: 0.036 +/- 0.011
hostname:sdfmilan114 cpu:004 cmt:v16-1 proc time (sec) mean: 0.278 +/- 0.016 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:005 cmt:v16-1 proc time (sec) mean: 0.284 +/- 0.015 rms: 0.038 +/- 0.010
hostname:sdfmilan114 cpu:006 cmt:v16-1 proc time (sec) mean: 0.279 +/- 0.014 rms: 0.035 +/- 0.010
hostname:sdfmilan114 cpu:007 cmt:v16-1 proc time (sec) mean: 0.282 +/- 0.014 rms: 0.035 +/- 0.010
hostname:sdfmilan114 cpu:008 cmt:v16-1 proc time (sec) mean: 0.291 +/- 0.015 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:009 cmt:v16-1 proc time (sec) mean: 0.290 +/- 0.015 rms: 0.042 +/- 0.011
hostname:sdfmilan114 cpu:010 cmt:v16-1 proc time (sec) mean: 0.281 +/- 0.016 rms: 0.042 +/- 0.012
hostname:sdfmilan114 cpu:011 cmt:v16-1 proc time (sec) mean: 0.292 +/- 0.015 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:012 cmt:v16-1 proc time (sec) mean: 0.281 +/- 0.016 rms: 0.040 +/- 0.011
hostname:sdfmilan114 cpu:013 cmt:v16-1 proc time (sec) mean: 0.283 +/- 0.015 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:014 cmt:v16-1 proc time (sec) mean: 0.286 +/- 0.016 rms: 0.042 +/- 0.011
hostname:sdfmilan114 cpu:015 cmt:v16-1 proc time (sec) mean: 0.286 +/- 0.016 rms: 0.042 +/- 0.011
mean time (sec): 0.2823

hostname:sdfmilan114 cpu:032 cmt:v16-2 proc time (sec) mean: 0.283 +/- 0.017 rms: 0.041 +/- 0.012
hostname:sdfmilan114 cpu:033 cmt:v16-2 proc time (sec) mean: 0.284 +/- 0.016 rms: 0.041 +/- 0.011
hostname:sdfmilan114 cpu:034 cmt:v16-2 proc time (sec) mean: 0.281 +/- 0.015 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:035 cmt:v16-2 proc time (sec) mean: 0.287 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:036 cmt:v16-2 proc time (sec) mean: 0.283 +/- 0.017 rms: 0.041 +/- 0.012
hostname:sdfmilan114 cpu:037 cmt:v16-2 proc time (sec) mean: 0.289 +/- 0.017 rms: 0.044 +/- 0.012
hostname:sdfmilan114 cpu:038 cmt:v16-2 proc time (sec) mean: 0.286 +/- 0.016 rms: 0.042 +/- 0.011
hostname:sdfmilan114 cpu:039 cmt:v16-2 proc time (sec) mean: 0.284 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:040 cmt:v16-2 proc time (sec) mean: 0.284 +/- 0.016 rms: 0.040 +/- 0.011
hostname:sdfmilan114 cpu:041 cmt:v16-2 proc time (sec) mean: 0.280 +/- 0.015 rms: 0.036 +/- 0.011
hostname:sdfmilan114 cpu:042 cmt:v16-2 proc time (sec) mean: 0.279 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:043 cmt:v16-2 proc time (sec) mean: 0.282 +/- 0.015 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:044 cmt:v16-2 proc time (sec) mean: 0.281 +/- 0.015 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:045 cmt:v16-2 proc time (sec) mean: 0.277 +/- 0.016 rms: 0.040 +/- 0.012
hostname:sdfmilan114 cpu:046 cmt:v16-2 proc time (sec) mean: 0.283 +/- 0.015 rms: 0.036 +/- 0.011
hostname:sdfmilan114 cpu:047 cmt:v16-2 proc time (sec) mean: 0.275 +/- 0.016 rms: 0.040 +/- 0.011
mean time (sec): 0.2824

hostname:sdfmilan114 cpu:064 cmt:v16-3 proc time (sec) mean: 0.283 +/- 0.015 rms: 0.036 +/- 0.011
hostname:sdfmilan114 cpu:065 cmt:v16-3 proc time (sec) mean: 0.280 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:066 cmt:v16-3 proc time (sec) mean: 0.288 +/- 0.016 rms: 0.042 +/- 0.011
hostname:sdfmilan114 cpu:067 cmt:v16-3 proc time (sec) mean: 0.282 +/- 0.015 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:068 cmt:v16-3 proc time (sec) mean: 0.276 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:069 cmt:v16-3 proc time (sec) mean: 0.283 +/- 0.016 rms: 0.040 +/- 0.011
hostname:sdfmilan114 cpu:070 cmt:v16-3 proc time (sec) mean: 0.292 +/- 0.015 rms: 0.037 +/- 0.011
hostname:sdfmilan114 cpu:071 cmt:v16-3 proc time (sec) mean: 0.282 +/- 0.016 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:072 cmt:v16-3 proc time (sec) mean: 0.288 +/- 0.016 rms: 0.042 +/- 0.011
hostname:sdfmilan114 cpu:073 cmt:v16-3 proc time (sec) mean: 0.291 +/- 0.017 rms: 0.045 +/- 0.012
hostname:sdfmilan114 cpu:074 cmt:v16-3 proc time (sec) mean: 0.290 +/- 0.017 rms: 0.046 +/- 0.012
hostname:sdfmilan114 cpu:075 cmt:v16-3 proc time (sec) mean: 0.288 +/- 0.016 rms: 0.043 +/- 0.011
hostname:sdfmilan114 cpu:076 cmt:v16-3 proc time (sec) mean: 0.295 +/- 0.017 rms: 0.049 +/- 0.012
hostname:sdfmilan114 cpu:077 cmt:v16-3 proc time (sec) mean: 0.287 +/- 0.018 rms: 0.048 +/- 0.013
hostname:sdfmilan114 cpu:078 cmt:v16-3 proc time (sec) mean: 0.287 +/- 0.018 rms: 0.048 +/- 0.012
hostname:sdfmilan114 cpu:079 cmt:v16-3 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.047 +/- 0.012
mean time (sec): 0.2866

hostname:sdfmilan114 cpu:112 cmt:v16-4 proc time (sec) mean: 0.244 +/- 0.015 rms: 0.031 +/- 0.010
hostname:sdfmilan114 cpu:113 cmt:v16-4 proc time (sec) mean: 0.247 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan114 cpu:114 cmt:v16-4 proc time (sec) mean: 0.246 +/- 0.016 rms: 0.032 +/- 0.011
hostname:sdfmilan114 cpu:115 cmt:v16-4 proc time (sec) mean: 0.246 +/- 0.013 rms: 0.027 +/- 0.009
hostname:sdfmilan114 cpu:116 cmt:v16-4 proc time (sec) mean: 0.249 +/- 0.015 rms: 0.030 +/- 0.011
hostname:sdfmilan114 cpu:117 cmt:v16-4 proc time (sec) mean: 0.252 +/- 0.013 rms: 0.027 +/- 0.009
hostname:sdfmilan114 cpu:118 cmt:v16-4 proc time (sec) mean: 0.251 +/- 0.013 rms: 0.028 +/- 0.009
hostname:sdfmilan114 cpu:119 cmt:v16-4 proc time (sec) mean: 0.250 +/- 0.013 rms: 0.029 +/- 0.009
hostname:sdfmilan114 cpu:120 cmt:v16-4 proc time (sec) mean: 0.250 +/- 0.012 rms: 0.023 +/- 0.008
hostname:sdfmilan114 cpu:121 cmt:v16-4 proc time (sec) mean: 0.249 +/- 0.015 rms: 0.035 +/- 0.011
hostname:sdfmilan114 cpu:122 cmt:v16-4 proc time (sec) mean: 0.245 +/- 0.014 rms: 0.030 +/- 0.010
hostname:sdfmilan114 cpu:123 cmt:v16-4 proc time (sec) mean: 0.245 +/- 0.013 rms: 0.027 +/- 0.009
hostname:sdfmilan114 cpu:124 cmt:v16-4 proc time (sec) mean: 0.254 +/- 0.014 rms: 0.034 +/- 0.010
hostname:sdfmilan114 cpu:125 cmt:v16-4 proc time (sec) mean: 0.252 +/- 0.014 rms: 0.034 +/- 0.010
hostname:sdfmilan114 cpu:126 cmt:v16-4 proc time (sec) mean: 0.248 +/- 0.014 rms: 0.030 +/- 0.010
hostname:sdfmilan114 cpu:127 cmt:v16-4 proc time (sec) mean: 0.246 +/- 0.014 rms: 0.030 +/- 0.010
mean time (sec): 0.2484

32-CPU groups: 0-31 excluding weka, 32-63, 64-95, 96-127

hostname:sdfmilan114 cpu:000 cmt:v24 proc time (sec) mean: 0.278 +/- 0.017 rms: 0.039 +/- 0.012
hostname:sdfmilan114 cpu:001 cmt:v24 proc time (sec) mean: 0.279 +/- 0.017 rms: 0.040 +/- 0.012
hostname:sdfmilan114 cpu:002 cmt:v24 proc time (sec) mean: 0.282 +/- 0.017 rms: 0.038 +/- 0.012
hostname:sdfmilan114 cpu:003 cmt:v24 proc time (sec) mean: 0.279 +/- 0.017 rms: 0.041 +/- 0.012
hostname:sdfmilan114 cpu:004 cmt:v24 proc time (sec) mean: 0.283 +/- 0.017 rms: 0.040 +/- 0.012
hostname:sdfmilan114 cpu:005 cmt:v24 proc time (sec) mean: 0.280 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:006 cmt:v24 proc time (sec) mean: 0.282 +/- 0.016 rms: 0.038 +/- 0.012
hostname:sdfmilan114 cpu:007 cmt:v24 proc time (sec) mean: 0.284 +/- 0.017 rms: 0.040 +/- 0.012
hostname:sdfmilan114 cpu:008 cmt:v24 proc time (sec) mean: 0.278 +/- 0.018 rms: 0.042 +/- 0.013
hostname:sdfmilan114 cpu:009 cmt:v24 proc time (sec) mean: 0.289 +/- 0.018 rms: 0.042 +/- 0.012
hostname:sdfmilan114 cpu:010 cmt:v24 proc time (sec) mean: 0.287 +/- 0.019 rms: 0.044 +/- 0.013
hostname:sdfmilan114 cpu:011 cmt:v24 proc time (sec) mean: 0.283 +/- 0.017 rms: 0.040 +/- 0.012
hostname:sdfmilan114 cpu:012 cmt:v24 proc time (sec) mean: 0.280 +/- 0.018 rms: 0.040 +/- 0.013
hostname:sdfmilan114 cpu:013 cmt:v24 proc time (sec) mean: 0.281 +/- 0.017 rms: 0.040 +/- 0.012
hostname:sdfmilan114 cpu:014 cmt:v24 proc time (sec) mean: 0.285 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:015 cmt:v24 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.043 +/- 0.012
hostname:sdfmilan114 cpu:024 cmt:v24 proc time (sec) mean: 0.216 +/- 0.008 rms: 0.011 +/- 0.006
hostname:sdfmilan114 cpu:025 cmt:v24 proc time (sec) mean: 0.221 +/- 0.009 rms: 0.013 +/- 0.006
hostname:sdfmilan114 cpu:026 cmt:v24 proc time (sec) mean: 0.222 +/- 0.008 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:027 cmt:v24 proc time (sec) mean: 0.226 +/- 0.008 rms: 0.011 +/- 0.006
hostname:sdfmilan114 cpu:028 cmt:v24 proc time (sec) mean: 0.216 +/- 0.008 rms: 0.011 +/- 0.006
hostname:sdfmilan114 cpu:029 cmt:v24 proc time (sec) mean: 0.222 +/- 0.010 rms: 0.015 +/- 0.007
hostname:sdfmilan114 cpu:030 cmt:v24 proc time (sec) mean: 0.221 +/- 0.008 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:031 cmt:v24 proc time (sec) mean: 0.220 +/- 0.011 rms: 0.016 +/- 0.008
mean time (sec): 0.2620

hostname:sdfmilan114 cpu:032 cmt:v32-1 proc time (sec) mean: 0.289 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:033 cmt:v32-1 proc time (sec) mean: 0.282 +/- 0.016 rms: 0.034 +/- 0.011
hostname:sdfmilan114 cpu:034 cmt:v32-1 proc time (sec) mean: 0.277 +/- 0.016 rms: 0.035 +/- 0.011
hostname:sdfmilan114 cpu:035 cmt:v32-1 proc time (sec) mean: 0.287 +/- 0.015 rms: 0.036 +/- 0.011
hostname:sdfmilan114 cpu:036 cmt:v32-1 proc time (sec) mean: 0.287 +/- 0.015 rms: 0.034 +/- 0.010
hostname:sdfmilan114 cpu:037 cmt:v32-1 proc time (sec) mean: 0.280 +/- 0.016 rms: 0.040 +/- 0.012
hostname:sdfmilan114 cpu:038 cmt:v32-1 proc time (sec) mean: 0.285 +/- 0.016 rms: 0.037 +/- 0.011
hostname:sdfmilan114 cpu:039 cmt:v32-1 proc time (sec) mean: 0.286 +/- 0.016 rms: 0.037 +/- 0.011
hostname:sdfmilan114 cpu:040 cmt:v32-1 proc time (sec) mean: 0.289 +/- 0.018 rms: 0.041 +/- 0.013
hostname:sdfmilan114 cpu:041 cmt:v32-1 proc time (sec) mean: 0.295 +/- 0.016 rms: 0.041 +/- 0.011
hostname:sdfmilan114 cpu:042 cmt:v32-1 proc time (sec) mean: 0.285 +/- 0.016 rms: 0.042 +/- 0.012
hostname:sdfmilan114 cpu:043 cmt:v32-1 proc time (sec) mean: 0.286 +/- 0.016 rms: 0.040 +/- 0.012
hostname:sdfmilan114 cpu:044 cmt:v32-1 proc time (sec) mean: 0.295 +/- 0.016 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:045 cmt:v32-1 proc time (sec) mean: 0.287 +/- 0.015 rms: 0.035 +/- 0.010
hostname:sdfmilan114 cpu:046 cmt:v32-1 proc time (sec) mean: 0.294 +/- 0.015 rms: 0.040 +/- 0.011
hostname:sdfmilan114 cpu:047 cmt:v32-1 proc time (sec) mean: 0.285 +/- 0.015 rms: 0.036 +/- 0.011
hostname:sdfmilan114 cpu:048 cmt:v32-1 proc time (sec) mean: 0.282 +/- 0.016 rms: 0.036 +/- 0.011
hostname:sdfmilan114 cpu:049 cmt:v32-1 proc time (sec) mean: 0.289 +/- 0.014 rms: 0.034 +/- 0.010
hostname:sdfmilan114 cpu:050 cmt:v32-1 proc time (sec) mean: 0.279 +/- 0.016 rms: 0.037 +/- 0.011
hostname:sdfmilan114 cpu:051 cmt:v32-1 proc time (sec) mean: 0.278 +/- 0.015 rms: 0.035 +/- 0.011
hostname:sdfmilan114 cpu:052 cmt:v32-1 proc time (sec) mean: 0.285 +/- 0.015 rms: 0.035 +/- 0.010
hostname:sdfmilan114 cpu:053 cmt:v32-1 proc time (sec) mean: 0.279 +/- 0.015 rms: 0.035 +/- 0.011
hostname:sdfmilan114 cpu:054 cmt:v32-1 proc time (sec) mean: 0.279 +/- 0.015 rms: 0.032 +/- 0.010
hostname:sdfmilan114 cpu:055 cmt:v32-1 proc time (sec) mean: 0.277 +/- 0.016 rms: 0.035 +/- 0.011
hostname:sdfmilan114 cpu:056 cmt:v32-1 proc time (sec) mean: 0.286 +/- 0.017 rms: 0.043 +/- 0.012
hostname:sdfmilan114 cpu:057 cmt:v32-1 proc time (sec) mean: 0.300 +/- 0.017 rms: 0.047 +/- 0.012
hostname:sdfmilan114 cpu:058 cmt:v32-1 proc time (sec) mean: 0.290 +/- 0.018 rms: 0.047 +/- 0.013
hostname:sdfmilan114 cpu:059 cmt:v32-1 proc time (sec) mean: 0.289 +/- 0.017 rms: 0.044 +/- 0.012
hostname:sdfmilan114 cpu:060 cmt:v32-1 proc time (sec) mean: 0.292 +/- 0.018 rms: 0.045 +/- 0.012
hostname:sdfmilan114 cpu:061 cmt:v32-1 proc time (sec) mean: 0.297 +/- 0.017 rms: 0.046 +/- 0.012
hostname:sdfmilan114 cpu:062 cmt:v32-1 proc time (sec) mean: 0.291 +/- 0.016 rms: 0.040 +/- 0.011
hostname:sdfmilan114 cpu:063 cmt:v32-1 proc time (sec) mean: 0.296 +/- 0.017 rms: 0.046 +/- 0.012
mean time (sec): 0.2868

hostname:sdfmilan114 cpu:064 cmt:v32-2 proc time (sec) mean: 0.283 +/- 0.017 rms: 0.042 +/- 0.012
hostname:sdfmilan114 cpu:065 cmt:v32-2 proc time (sec) mean: 0.284 +/- 0.016 rms: 0.038 +/- 0.012
hostname:sdfmilan114 cpu:066 cmt:v32-2 proc time (sec) mean: 0.277 +/- 0.016 rms: 0.039 +/- 0.011
hostname:sdfmilan114 cpu:067 cmt:v32-2 proc time (sec) mean: 0.282 +/- 0.017 rms: 0.042 +/- 0.012
hostname:sdfmilan114 cpu:068 cmt:v32-2 proc time (sec) mean: 0.283 +/- 0.017 rms: 0.044 +/- 0.012
hostname:sdfmilan114 cpu:069 cmt:v32-2 proc time (sec) mean: 0.287 +/- 0.017 rms: 0.046 +/- 0.012
hostname:sdfmilan114 cpu:070 cmt:v32-2 proc time (sec) mean: 0.282 +/- 0.020 rms: 0.053 +/- 0.014
hostname:sdfmilan114 cpu:071 cmt:v32-2 proc time (sec) mean: 0.287 +/- 0.017 rms: 0.042 +/- 0.012
hostname:sdfmilan114 cpu:072 cmt:v32-2 proc time (sec) mean: 0.280 +/- 0.018 rms: 0.043 +/- 0.013
hostname:sdfmilan114 cpu:073 cmt:v32-2 proc time (sec) mean: 0.292 +/- 0.017 rms: 0.045 +/- 0.012
hostname:sdfmilan114 cpu:074 cmt:v32-2 proc time (sec) mean: 0.284 +/- 0.018 rms: 0.045 +/- 0.013
hostname:sdfmilan114 cpu:075 cmt:v32-2 proc time (sec) mean: 0.280 +/- 0.017 rms: 0.042 +/- 0.012
hostname:sdfmilan114 cpu:076 cmt:v32-2 proc time (sec) mean: 0.279 +/- 0.018 rms: 0.044 +/- 0.013
hostname:sdfmilan114 cpu:077 cmt:v32-2 proc time (sec) mean: 0.286 +/- 0.016 rms: 0.042 +/- 0.012
hostname:sdfmilan114 cpu:078 cmt:v32-2 proc time (sec) mean: 0.282 +/- 0.018 rms: 0.047 +/- 0.013
hostname:sdfmilan114 cpu:079 cmt:v32-2 proc time (sec) mean: 0.292 +/- 0.017 rms: 0.044 +/- 0.012
hostname:sdfmilan114 cpu:080 cmt:v32-2 proc time (sec) mean: 0.259 +/- 0.013 rms: 0.023 +/- 0.009
hostname:sdfmilan114 cpu:081 cmt:v32-2 proc time (sec) mean: 0.260 +/- 0.012 rms: 0.023 +/- 0.008
hostname:sdfmilan114 cpu:082 cmt:v32-2 proc time (sec) mean: 0.258 +/- 0.012 rms: 0.024 +/- 0.008
hostname:sdfmilan114 cpu:083 cmt:v32-2 proc time (sec) mean: 0.264 +/- 0.012 rms: 0.025 +/- 0.009
hostname:sdfmilan114 cpu:084 cmt:v32-2 proc time (sec) mean: 0.260 +/- 0.011 rms: 0.019 +/- 0.008
hostname:sdfmilan114 cpu:085 cmt:v32-2 proc time (sec) mean: 0.262 +/- 0.012 rms: 0.024 +/- 0.008
hostname:sdfmilan114 cpu:086 cmt:v32-2 proc time (sec) mean: 0.263 +/- 0.012 rms: 0.022 +/- 0.008
hostname:sdfmilan114 cpu:087 cmt:v32-2 proc time (sec) mean: 0.259 +/- 0.012 rms: 0.024 +/- 0.009
hostname:sdfmilan114 cpu:088 cmt:v32-2 proc time (sec) mean: 0.258 +/- 0.011 rms: 0.022 +/- 0.008
hostname:sdfmilan114 cpu:089 cmt:v32-2 proc time (sec) mean: 0.255 +/- 0.013 rms: 0.023 +/- 0.009
hostname:sdfmilan114 cpu:090 cmt:v32-2 proc time (sec) mean: 0.259 +/- 0.013 rms: 0.024 +/- 0.009
hostname:sdfmilan114 cpu:091 cmt:v32-2 proc time (sec) mean: 0.256 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan114 cpu:092 cmt:v32-2 proc time (sec) mean: 0.258 +/- 0.014 rms: 0.028 +/- 0.010
hostname:sdfmilan114 cpu:093 cmt:v32-2 proc time (sec) mean: 0.260 +/- 0.012 rms: 0.024 +/- 0.009
hostname:sdfmilan114 cpu:094 cmt:v32-2 proc time (sec) mean: 0.266 +/- 0.014 rms: 0.029 +/- 0.010
hostname:sdfmilan114 cpu:095 cmt:v32-2 proc time (sec) mean: 0.267 +/- 0.013 rms: 0.027 +/- 0.009
mean time (sec): 0.2720


hostname:sdfmilan114 cpu:096 cmt:v32-3 proc time (sec) mean: 0.408 +/- 0.022 rms: 0.072 +/- 0.016
hostname:sdfmilan114 cpu:097 cmt:v32-3 proc time (sec) mean: 0.390 +/- 0.021 rms: 0.071 +/- 0.015
hostname:sdfmilan114 cpu:098 cmt:v32-3 proc time (sec) mean: 0.385 +/- 0.021 rms: 0.071 +/- 0.015
hostname:sdfmilan114 cpu:099 cmt:v32-3 proc time (sec) mean: 0.386 +/- 0.021 rms: 0.072 +/- 0.015
hostname:sdfmilan114 cpu:100 cmt:v32-3 proc time (sec) mean: 0.385 +/- 0.024 rms: 0.085 +/- 0.017
hostname:sdfmilan114 cpu:101 cmt:v32-3 proc time (sec) mean: 0.393 +/- 0.021 rms: 0.069 +/- 0.015
hostname:sdfmilan114 cpu:102 cmt:v32-3 proc time (sec) mean: 0.387 +/- 0.021 rms: 0.067 +/- 0.014
hostname:sdfmilan114 cpu:103 cmt:v32-3 proc time (sec) mean: 0.391 +/- 0.021 rms: 0.073 +/- 0.015
hostname:sdfmilan114 cpu:104 cmt:v32-3 proc time (sec) mean: 0.373 +/- 0.023 rms: 0.087 +/- 0.016
hostname:sdfmilan114 cpu:105 cmt:v32-3 proc time (sec) mean: 0.374 +/- 0.020 rms: 0.069 +/- 0.014
hostname:sdfmilan114 cpu:106 cmt:v32-3 proc time (sec) mean: 0.385 +/- 0.021 rms: 0.071 +/- 0.015
hostname:sdfmilan114 cpu:107 cmt:v32-3 proc time (sec) mean: 0.374 +/- 0.022 rms: 0.073 +/- 0.015
hostname:sdfmilan114 cpu:108 cmt:v32-3 proc time (sec) mean: 0.381 +/- 0.021 rms: 0.075 +/- 0.015
hostname:sdfmilan114 cpu:109 cmt:v32-3 proc time (sec) mean: 0.377 +/- 0.019 rms: 0.063 +/- 0.013
hostname:sdfmilan114 cpu:110 cmt:v32-3 proc time (sec) mean: 0.389 +/- 0.022 rms: 0.080 +/- 0.016
hostname:sdfmilan114 cpu:111 cmt:v32-3 proc time (sec) mean: 0.367 +/- 0.021 rms: 0.075 +/- 0.015
hostname:sdfmilan114 cpu:112 cmt:v32-3 proc time (sec) mean: 0.383 +/- 0.021 rms: 0.064 +/- 0.015
hostname:sdfmilan114 cpu:113 cmt:v32-3 proc time (sec) mean: 0.384 +/- 0.021 rms: 0.066 +/- 0.015
hostname:sdfmilan114 cpu:114 cmt:v32-3 proc time (sec) mean: 0.382 +/- 0.021 rms: 0.070 +/- 0.015
hostname:sdfmilan114 cpu:115 cmt:v32-3 proc time (sec) mean: 0.384 +/- 0.021 rms: 0.064 +/- 0.015
hostname:sdfmilan114 cpu:116 cmt:v32-3 proc time (sec) mean: 0.385 +/- 0.021 rms: 0.071 +/- 0.015
hostname:sdfmilan114 cpu:117 cmt:v32-3 proc time (sec) mean: 0.383 +/- 0.020 rms: 0.069 +/- 0.014
hostname:sdfmilan114 cpu:118 cmt:v32-3 proc time (sec) mean: 0.391 +/- 0.021 rms: 0.074 +/- 0.015
hostname:sdfmilan114 cpu:119 cmt:v32-3 proc time (sec) mean: 0.385 +/- 0.020 rms: 0.067 +/- 0.014
hostname:sdfmilan114 cpu:120 cmt:v32-3 proc time (sec) mean: 0.369 +/- 0.021 rms: 0.061 +/- 0.014
hostname:sdfmilan114 cpu:121 cmt:v32-3 proc time (sec) mean: 0.371 +/- 0.019 rms: 0.053 +/- 0.013
hostname:sdfmilan114 cpu:122 cmt:v32-3 proc time (sec) mean: 0.375 +/- 0.022 rms: 0.076 +/- 0.015
hostname:sdfmilan114 cpu:123 cmt:v32-3 proc time (sec) mean: 0.383 +/- 0.022 rms: 0.073 +/- 0.016
hostname:sdfmilan114 cpu:124 cmt:v32-3 proc time (sec) mean: 0.376 +/- 0.019 rms: 0.060 +/- 0.014
hostname:sdfmilan114 cpu:125 cmt:v32-3 proc time (sec) mean: 0.382 +/- 0.019 rms: 0.063 +/- 0.014
hostname:sdfmilan114 cpu:126 cmt:v32-3 proc time (sec) mean: 0.375 +/- 0.020 rms: 0.062 +/- 0.014
hostname:sdfmilan114 cpu:127 cmt:v32-3 proc time (sec) mean: 0.362 +/- 0.020 rms: 0.057 +/- 0.014
mean time (sec): 0.3817

64-CPU groups 0-63 excluding weeka, 64-127

hostname:sdfmilan114 cpu:000 cmt:v56 proc time (sec) mean: 0.283 +/- 0.017 rms: 0.027 +/- 0.012
hostname:sdfmilan114 cpu:001 cmt:v56 proc time (sec) mean: 0.289 +/- 0.014 rms: 0.024 +/- 0.010
hostname:sdfmilan114 cpu:002 cmt:v56 proc time (sec) mean: 0.286 +/- 0.015 rms: 0.025 +/- 0.010
hostname:sdfmilan114 cpu:003 cmt:v56 proc time (sec) mean: 0.290 +/- 0.014 rms: 0.024 +/- 0.010
hostname:sdfmilan114 cpu:004 cmt:v56 proc time (sec) mean: 0.287 +/- 0.014 rms: 0.026 +/- 0.010
hostname:sdfmilan114 cpu:005 cmt:v56 proc time (sec) mean: 0.289 +/- 0.014 rms: 0.026 +/- 0.010
hostname:sdfmilan114 cpu:006 cmt:v56 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan114 cpu:007 cmt:v56 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan114 cpu:008 cmt:v56 proc time (sec) mean: 0.293 +/- 0.016 rms: 0.030 +/- 0.011
hostname:sdfmilan114 cpu:009 cmt:v56 proc time (sec) mean: 0.287 +/- 0.016 rms: 0.027 +/- 0.012
hostname:sdfmilan114 cpu:010 cmt:v56 proc time (sec) mean: 0.293 +/- 0.016 rms: 0.028 +/- 0.011
hostname:sdfmilan114 cpu:011 cmt:v56 proc time (sec) mean: 0.290 +/- 0.013 rms: 0.023 +/- 0.009
hostname:sdfmilan114 cpu:012 cmt:v56 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.024 +/- 0.009
hostname:sdfmilan114 cpu:013 cmt:v56 proc time (sec) mean: 0.291 +/- 0.014 rms: 0.023 +/- 0.010
hostname:sdfmilan114 cpu:014 cmt:v56 proc time (sec) mean: 0.291 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan114 cpu:015 cmt:v56 proc time (sec) mean: 0.294 +/- 0.014 rms: 0.026 +/- 0.010
hostname:sdfmilan114 cpu:024 cmt:v56 proc time (sec) mean: 0.260 +/- 0.009 rms: 0.013 +/- 0.006
hostname:sdfmilan114 cpu:025 cmt:v56 proc time (sec) mean: 0.261 +/- 0.009 rms: 0.013 +/- 0.006
hostname:sdfmilan114 cpu:026 cmt:v56 proc time (sec) mean: 0.258 +/- 0.011 rms: 0.014 +/- 0.008
hostname:sdfmilan114 cpu:027 cmt:v56 proc time (sec) mean: 0.263 +/- 0.008 rms: 0.011 +/- 0.005
hostname:sdfmilan114 cpu:028 cmt:v56 proc time (sec) mean: 0.262 +/- 0.008 rms: 0.012 +/- 0.006
hostname:sdfmilan114 cpu:029 cmt:v56 proc time (sec) mean: 0.266 +/- 0.009 rms: 0.014 +/- 0.006
hostname:sdfmilan114 cpu:030 cmt:v56 proc time (sec) mean: 0.259 +/- 0.007 rms: 0.010 +/- 0.005
hostname:sdfmilan114 cpu:031 cmt:v56 proc time (sec) mean: 0.263 +/- 0.007 rms: 0.010 +/- 0.005
hostname:sdfmilan114 cpu:032 cmt:v56 proc time (sec) mean: 0.300 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan114 cpu:033 cmt:v56 proc time (sec) mean: 0.295 +/- 0.014 rms: 0.025 +/- 0.010
hostname:sdfmilan114 cpu:034 cmt:v56 proc time (sec) mean: 0.287 +/- 0.013 rms: 0.024 +/- 0.009
hostname:sdfmilan114 cpu:035 cmt:v56 proc time (sec) mean: 0.299 +/- 0.014 rms: 0.027 +/- 0.010
hostname:sdfmilan114 cpu:036 cmt:v56 proc time (sec) mean: 0.291 +/- 0.015 rms: 0.028 +/- 0.011
hostname:sdfmilan114 cpu:037 cmt:v56 proc time (sec) mean: 0.296 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan114 cpu:038 cmt:v56 proc time (sec) mean: 0.296 +/- 0.014 rms: 0.027 +/- 0.010
hostname:sdfmilan114 cpu:039 cmt:v56 proc time (sec) mean: 0.296 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan114 cpu:040 cmt:v56 proc time (sec) mean: 0.302 +/- 0.014 rms: 0.029 +/- 0.010
hostname:sdfmilan114 cpu:041 cmt:v56 proc time (sec) mean: 0.293 +/- 0.015 rms: 0.029 +/- 0.011
hostname:sdfmilan114 cpu:042 cmt:v56 proc time (sec) mean: 0.294 +/- 0.014 rms: 0.027 +/- 0.010
hostname:sdfmilan114 cpu:043 cmt:v56 proc time (sec) mean: 0.298 +/- 0.017 rms: 0.033 +/- 0.012
hostname:sdfmilan114 cpu:044 cmt:v56 proc time (sec) mean: 0.286 +/- 0.015 rms: 0.026 +/- 0.010
hostname:sdfmilan114 cpu:045 cmt:v56 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan114 cpu:046 cmt:v56 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.027 +/- 0.010
hostname:sdfmilan114 cpu:047 cmt:v56 proc time (sec) mean: 0.296 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan114 cpu:048 cmt:v56 proc time (sec) mean: 0.293 +/- 0.016 rms: 0.026 +/- 0.011
hostname:sdfmilan114 cpu:049 cmt:v56 proc time (sec) mean: 0.287 +/- 0.019 rms: 0.033 +/- 0.013
hostname:sdfmilan114 cpu:050 cmt:v56 proc time (sec) mean: 0.295 +/- 0.015 rms: 0.030 +/- 0.011
hostname:sdfmilan114 cpu:051 cmt:v56 proc time (sec) mean: 0.292 +/- 0.018 rms: 0.028 +/- 0.013
hostname:sdfmilan114 cpu:052 cmt:v56 proc time (sec) mean: 0.291 +/- 0.016 rms: 0.029 +/- 0.011
hostname:sdfmilan114 cpu:053 cmt:v56 proc time (sec) mean: 0.291 +/- 0.018 rms: 0.030 +/- 0.013
hostname:sdfmilan114 cpu:054 cmt:v56 proc time (sec) mean: 0.296 +/- 0.016 rms: 0.029 +/- 0.012
hostname:sdfmilan114 cpu:055 cmt:v56 proc time (sec) mean: 0.289 +/- 0.016 rms: 0.026 +/- 0.011
hostname:sdfmilan114 cpu:056 cmt:v56 proc time (sec) mean: 0.288 +/- 0.016 rms: 0.030 +/- 0.011
hostname:sdfmilan114 cpu:057 cmt:v56 proc time (sec) mean: 0.299 +/- 0.016 rms: 0.031 +/- 0.011
hostname:sdfmilan114 cpu:058 cmt:v56 proc time (sec) mean: 0.292 +/- 0.015 rms: 0.026 +/- 0.011
hostname:sdfmilan114 cpu:059 cmt:v56 proc time (sec) mean: 0.291 +/- 0.015 rms: 0.027 +/- 0.010
hostname:sdfmilan114 cpu:060 cmt:v56 proc time (sec) mean: 0.293 +/- 0.015 rms: 0.027 +/- 0.011
hostname:sdfmilan114 cpu:061 cmt:v56 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.029 +/- 0.012
hostname:sdfmilan114 cpu:062 cmt:v56 proc time (sec) mean: 0.290 +/- 0.018 rms: 0.031 +/- 0.013
hostname:sdfmilan114 cpu:063 cmt:v56 proc time (sec) mean: 0.290 +/- 0.015 rms: 0.026 +/- 0.010 
mean time (sec): 0.2879

hostname:sdfmilan114 cpu:064 cmt:v64 proc time (sec) mean: 0.497 +/- 0.029 rms: 0.098 +/- 0.020
hostname:sdfmilan114 cpu:065 cmt:v64 proc time (sec) mean: 0.493 +/- 0.029 rms: 0.095 +/- 0.020
hostname:sdfmilan114 cpu:066 cmt:v64 proc time (sec) mean: 0.506 +/- 0.027 rms: 0.093 +/- 0.019
hostname:sdfmilan114 cpu:067 cmt:v64 proc time (sec) mean: 0.495 +/- 0.026 rms: 0.087 +/- 0.018
hostname:sdfmilan114 cpu:068 cmt:v64 proc time (sec) mean: 0.510 +/- 0.030 rms: 0.099 +/- 0.021
hostname:sdfmilan114 cpu:069 cmt:v64 proc time (sec) mean: 0.511 +/- 0.032 rms: 0.104 +/- 0.022
hostname:sdfmilan114 cpu:070 cmt:v64 proc time (sec) mean: 0.496 +/- 0.027 rms: 0.089 +/- 0.019
hostname:sdfmilan114 cpu:071 cmt:v64 proc time (sec) mean: 0.523 +/- 0.030 rms: 0.098 +/- 0.021
hostname:sdfmilan114 cpu:072 cmt:v64 proc time (sec) mean: 0.494 +/- 0.028 rms: 0.098 +/- 0.019
hostname:sdfmilan114 cpu:073 cmt:v64 proc time (sec) mean: 0.513 +/- 0.028 rms: 0.104 +/- 0.020
hostname:sdfmilan114 cpu:074 cmt:v64 proc time (sec) mean: 0.506 +/- 0.027 rms: 0.099 +/- 0.019
hostname:sdfmilan114 cpu:075 cmt:v64 proc time (sec) mean: 0.497 +/- 0.028 rms: 0.096 +/- 0.020
hostname:sdfmilan114 cpu:076 cmt:v64 proc time (sec) mean: 0.510 +/- 0.029 rms: 0.106 +/- 0.021
hostname:sdfmilan114 cpu:077 cmt:v64 proc time (sec) mean: 0.500 +/- 0.028 rms: 0.100 +/- 0.020
hostname:sdfmilan114 cpu:078 cmt:v64 proc time (sec) mean: 0.509 +/- 0.029 rms: 0.104 +/- 0.021
hostname:sdfmilan114 cpu:079 cmt:v64 proc time (sec) mean: 0.513 +/- 0.026 rms: 0.096 +/- 0.019
hostname:sdfmilan114 cpu:080 cmt:v64 proc time (sec) mean: 0.322 +/- 0.015 rms: 0.036 +/- 0.010
hostname:sdfmilan114 cpu:081 cmt:v64 proc time (sec) mean: 0.314 +/- 0.016 rms: 0.038 +/- 0.011
hostname:sdfmilan114 cpu:082 cmt:v64 proc time (sec) mean: 0.319 +/- 0.013 rms: 0.030 +/- 0.009
hostname:sdfmilan114 cpu:083 cmt:v64 proc time (sec) mean: 0.316 +/- 0.015 rms: 0.031 +/- 0.011
hostname:sdfmilan114 cpu:084 cmt:v64 proc time (sec) mean: 0.318 +/- 0.014 rms: 0.033 +/- 0.010
hostname:sdfmilan114 cpu:085 cmt:v64 proc time (sec) mean: 0.311 +/- 0.013 rms: 0.030 +/- 0.010
hostname:sdfmilan114 cpu:086 cmt:v64 proc time (sec) mean: 0.308 +/- 0.014 rms: 0.030 +/- 0.010
hostname:sdfmilan114 cpu:087 cmt:v64 proc time (sec) mean: 0.320 +/- 0.015 rms: 0.037 +/- 0.011
hostname:sdfmilan114 cpu:088 cmt:v64 proc time (sec) mean: 0.318 +/- 0.013 rms: 0.031 +/- 0.009
hostname:sdfmilan114 cpu:089 cmt:v64 proc time (sec) mean: 0.315 +/- 0.017 rms: 0.038 +/- 0.012
hostname:sdfmilan114 cpu:090 cmt:v64 proc time (sec) mean: 0.318 +/- 0.016 rms: 0.037 +/- 0.011
hostname:sdfmilan114 cpu:091 cmt:v64 proc time (sec) mean: 0.321 +/- 0.017 rms: 0.041 +/- 0.012
hostname:sdfmilan114 cpu:092 cmt:v64 proc time (sec) mean: 0.317 +/- 0.016 rms: 0.037 +/- 0.011
hostname:sdfmilan114 cpu:093 cmt:v64 proc time (sec) mean: 0.325 +/- 0.014 rms: 0.033 +/- 0.010
hostname:sdfmilan114 cpu:094 cmt:v64 proc time (sec) mean: 0.316 +/- 0.013 rms: 0.029 +/- 0.009
hostname:sdfmilan114 cpu:095 cmt:v64 proc time (sec) mean: 0.322 +/- 0.014 rms: 0.030 +/- 0.010
hostname:sdfmilan114 cpu:096 cmt:v64 proc time (sec) mean: 0.424 +/- 0.021 rms: 0.078 +/- 0.015
hostname:sdfmilan114 cpu:097 cmt:v64 proc time (sec) mean: 0.422 +/- 0.021 rms: 0.070 +/- 0.015
hostname:sdfmilan114 cpu:098 cmt:v64 proc time (sec) mean: 0.431 +/- 0.022 rms: 0.076 +/- 0.016
hostname:sdfmilan114 cpu:099 cmt:v64 proc time (sec) mean: 0.415 +/- 0.021 rms: 0.075 +/- 0.015
hostname:sdfmilan114 cpu:100 cmt:v64 proc time (sec) mean: 0.416 +/- 0.020 rms: 0.068 +/- 0.014
hostname:sdfmilan114 cpu:101 cmt:v64 proc time (sec) mean: 0.417 +/- 0.021 rms: 0.075 +/- 0.015
hostname:sdfmilan114 cpu:102 cmt:v64 proc time (sec) mean: 0.423 +/- 0.022 rms: 0.078 +/- 0.016
hostname:sdfmilan114 cpu:103 cmt:v64 proc time (sec) mean: 0.419 +/- 0.022 rms: 0.074 +/- 0.015
hostname:sdfmilan114 cpu:104 cmt:v64 proc time (sec) mean: 0.429 +/- 0.021 rms: 0.073 +/- 0.015
hostname:sdfmilan114 cpu:105 cmt:v64 proc time (sec) mean: 0.414 +/- 0.021 rms: 0.073 +/- 0.015
hostname:sdfmilan114 cpu:106 cmt:v64 proc time (sec) mean: 0.420 +/- 0.020 rms: 0.069 +/- 0.014
hostname:sdfmilan114 cpu:107 cmt:v64 proc time (sec) mean: 0.431 +/- 0.022 rms: 0.081 +/- 0.016
hostname:sdfmilan114 cpu:108 cmt:v64 proc time (sec) mean: 0.434 +/- 0.021 rms: 0.079 +/- 0.015
hostname:sdfmilan114 cpu:109 cmt:v64 proc time (sec) mean: 0.418 +/- 0.022 rms: 0.076 +/- 0.016
hostname:sdfmilan114 cpu:110 cmt:v64 proc time (sec) mean: 0.415 +/- 0.021 rms: 0.076 +/- 0.015
hostname:sdfmilan114 cpu:111 cmt:v64 proc time (sec) mean: 0.414 +/- 0.020 rms: 0.071 +/- 0.014
hostname:sdfmilan114 cpu:112 cmt:v64 proc time (sec) mean: 0.443 +/- 0.024 rms: 0.085 +/- 0.017
hostname:sdfmilan114 cpu:113 cmt:v64 proc time (sec) mean: 0.443 +/- 0.023 rms: 0.082 +/- 0.016
hostname:sdfmilan114 cpu:114 cmt:v64 proc time (sec) mean: 0.441 +/- 0.023 rms: 0.083 +/- 0.016
hostname:sdfmilan114 cpu:115 cmt:v64 proc time (sec) mean: 0.450 +/- 0.024 rms: 0.086 +/- 0.017
hostname:sdfmilan114 cpu:116 cmt:v64 proc time (sec) mean: 0.458 +/- 0.023 rms: 0.081 +/- 0.016
hostname:sdfmilan114 cpu:117 cmt:v64 proc time (sec) mean: 0.439 +/- 0.023 rms: 0.083 +/- 0.016
hostname:sdfmilan114 cpu:118 cmt:v64 proc time (sec) mean: 0.432 +/- 0.024 rms: 0.084 +/- 0.017
hostname:sdfmilan114 cpu:119 cmt:v64 proc time (sec) mean: 0.445 +/- 0.023 rms: 0.085 +/- 0.016
hostname:sdfmilan114 cpu:120 cmt:v64 proc time (sec) mean: 0.464 +/- 0.025 rms: 0.093 +/- 0.018
hostname:sdfmilan114 cpu:121 cmt:v64 proc time (sec) mean: 0.460 +/- 0.025 rms: 0.093 +/- 0.018
hostname:sdfmilan114 cpu:122 cmt:v64 proc time (sec) mean: 0.456 +/- 0.022 rms: 0.080 +/- 0.016
hostname:sdfmilan114 cpu:123 cmt:v64 proc time (sec) mean: 0.457 +/- 0.024 rms: 0.088 +/- 0.017
hostname:sdfmilan114 cpu:124 cmt:v64 proc time (sec) mean: 0.469 +/- 0.024 rms: 0.089 +/- 0.017
hostname:sdfmilan114 cpu:125 cmt:v64 proc time (sec) mean: 0.446 +/- 0.021 rms: 0.076 +/- 0.015
hostname:sdfmilan114 cpu:126 cmt:v64 proc time (sec) mean: 0.459 +/- 0.025 rms: 0.094 +/- 0.017
hostname:sdfmilan114 cpu:127 cmt:v64 proc time (sec) mean: 0.459 +/- 0.022 rms: 0.084 +/- 0.016
mean time (sec): 0.4237

120 CPU, all excluding weka

hostname:sdfmilan114 cpu:000 cmt:v120 proc time (sec) mean: 0.484 +/- 0.044 rms: 0.131 +/- 0.031
hostname:sdfmilan114 cpu:001 cmt:v120 proc time (sec) mean: 0.490 +/- 0.048 rms: 0.147 +/- 0.034
hostname:sdfmilan114 cpu:002 cmt:v120 proc time (sec) mean: 0.488 +/- 0.046 rms: 0.141 +/- 0.033
hostname:sdfmilan114 cpu:003 cmt:v120 proc time (sec) mean: 0.490 +/- 0.045 rms: 0.144 +/- 0.032
hostname:sdfmilan114 cpu:004 cmt:v120 proc time (sec) mean: 0.487 +/- 0.045 rms: 0.140 +/- 0.032
hostname:sdfmilan114 cpu:005 cmt:v120 proc time (sec) mean: 0.492 +/- 0.046 rms: 0.144 +/- 0.032
hostname:sdfmilan114 cpu:006 cmt:v120 proc time (sec) mean: 0.486 +/- 0.044 rms: 0.139 +/- 0.031
hostname:sdfmilan114 cpu:007 cmt:v120 proc time (sec) mean: 0.494 +/- 0.047 rms: 0.141 +/- 0.033
hostname:sdfmilan114 cpu:008 cmt:v120 proc time (sec) mean: 0.463 +/- 0.045 rms: 0.133 +/- 0.032
hostname:sdfmilan114 cpu:009 cmt:v120 proc time (sec) mean: 0.469 +/- 0.050 rms: 0.161 +/- 0.035
hostname:sdfmilan114 cpu:010 cmt:v120 proc time (sec) mean: 0.476 +/- 0.053 rms: 0.150 +/- 0.037
hostname:sdfmilan114 cpu:011 cmt:v120 proc time (sec) mean: 0.474 +/- 0.050 rms: 0.156 +/- 0.035
hostname:sdfmilan114 cpu:012 cmt:v120 proc time (sec) mean: 0.479 +/- 0.048 rms: 0.154 +/- 0.034
hostname:sdfmilan114 cpu:013 cmt:v120 proc time (sec) mean: 0.476 +/- 0.052 rms: 0.169 +/- 0.037
hostname:sdfmilan114 cpu:014 cmt:v120 proc time (sec) mean: 0.480 +/- 0.053 rms: 0.160 +/- 0.038
hostname:sdfmilan114 cpu:015 cmt:v120 proc time (sec) mean: 0.465 +/- 0.048 rms: 0.149 +/- 0.034
hostname:sdfmilan114 cpu:024 cmt:v120 proc time (sec) mean: 0.282 +/- 0.018 rms: 0.022 +/- 0.013
hostname:sdfmilan114 cpu:025 cmt:v120 proc time (sec) mean: 0.282 +/- 0.018 rms: 0.021 +/- 0.013
hostname:sdfmilan114 cpu:026 cmt:v120 proc time (sec) mean: 0.284 +/- 0.024 rms: 0.029 +/- 0.017
hostname:sdfmilan114 cpu:027 cmt:v120 proc time (sec) mean: 0.283 +/- 0.021 rms: 0.024 +/- 0.015
hostname:sdfmilan114 cpu:028 cmt:v120 proc time (sec) mean: 0.280 +/- 0.018 rms: 0.021 +/- 0.013
hostname:sdfmilan114 cpu:029 cmt:v120 proc time (sec) mean: 0.281 +/- 0.020 rms: 0.023 +/- 0.014
hostname:sdfmilan114 cpu:030 cmt:v120 proc time (sec) mean: 0.281 +/- 0.022 rms: 0.027 +/- 0.016
hostname:sdfmilan114 cpu:031 cmt:v120 proc time (sec) mean: 0.281 +/- 0.020 rms: 0.024 +/- 0.014
hostname:sdfmilan114 cpu:032 cmt:v120 proc time (sec) mean: 0.391 +/- 0.045 rms: 0.108 +/- 0.032
hostname:sdfmilan114 cpu:033 cmt:v120 proc time (sec) mean: 0.387 +/- 0.051 rms: 0.114 +/- 0.036
hostname:sdfmilan114 cpu:034 cmt:v120 proc time (sec) mean: 0.399 +/- 0.048 rms: 0.122 +/- 0.034
hostname:sdfmilan114 cpu:035 cmt:v120 proc time (sec) mean: 0.379 +/- 0.048 rms: 0.114 +/- 0.034
hostname:sdfmilan114 cpu:036 cmt:v120 proc time (sec) mean: 0.392 +/- 0.048 rms: 0.117 +/- 0.034
hostname:sdfmilan114 cpu:037 cmt:v120 proc time (sec) mean: 0.392 +/- 0.047 rms: 0.110 +/- 0.033
hostname:sdfmilan114 cpu:038 cmt:v120 proc time (sec) mean: 0.397 +/- 0.045 rms: 0.107 +/- 0.032
hostname:sdfmilan114 cpu:039 cmt:v120 proc time (sec) mean: 0.414 +/- 0.048 rms: 0.124 +/- 0.034
hostname:sdfmilan114 cpu:040 cmt:v120 proc time (sec) mean: 0.403 +/- 0.051 rms: 0.128 +/- 0.036
hostname:sdfmilan114 cpu:041 cmt:v120 proc time (sec) mean: 0.397 +/- 0.055 rms: 0.136 +/- 0.039
hostname:sdfmilan114 cpu:042 cmt:v120 proc time (sec) mean: 0.393 +/- 0.050 rms: 0.124 +/- 0.035
hostname:sdfmilan114 cpu:043 cmt:v120 proc time (sec) mean: 0.391 +/- 0.046 rms: 0.111 +/- 0.032
hostname:sdfmilan114 cpu:044 cmt:v120 proc time (sec) mean: 0.381 +/- 0.050 rms: 0.114 +/- 0.035
hostname:sdfmilan114 cpu:045 cmt:v120 proc time (sec) mean: 0.387 +/- 0.047 rms: 0.110 +/- 0.033
hostname:sdfmilan114 cpu:046 cmt:v120 proc time (sec) mean: 0.379 +/- 0.051 rms: 0.112 +/- 0.036
hostname:sdfmilan114 cpu:047 cmt:v120 proc time (sec) mean: 0.402 +/- 0.056 rms: 0.142 +/- 0.040
hostname:sdfmilan114 cpu:048 cmt:v120 proc time (sec) mean: 0.357 +/- 0.045 rms: 0.083 +/- 0.032
hostname:sdfmilan114 cpu:049 cmt:v120 proc time (sec) mean: 0.356 +/- 0.046 rms: 0.082 +/- 0.032
hostname:sdfmilan114 cpu:050 cmt:v120 proc time (sec) mean: 0.348 +/- 0.044 rms: 0.080 +/- 0.031
hostname:sdfmilan114 cpu:051 cmt:v120 proc time (sec) mean: 0.345 +/- 0.043 rms: 0.076 +/- 0.031
hostname:sdfmilan114 cpu:052 cmt:v120 proc time (sec) mean: 0.352 +/- 0.033 rms: 0.059 +/- 0.023
hostname:sdfmilan114 cpu:053 cmt:v120 proc time (sec) mean: 0.355 +/- 0.034 rms: 0.063 +/- 0.024
hostname:sdfmilan114 cpu:054 cmt:v120 proc time (sec) mean: 0.358 +/- 0.038 rms: 0.069 +/- 0.027
hostname:sdfmilan114 cpu:055 cmt:v120 proc time (sec) mean: 0.356 +/- 0.043 rms: 0.083 +/- 0.030
hostname:sdfmilan114 cpu:056 cmt:v120 proc time (sec) mean: 0.366 +/- 0.036 rms: 0.070 +/- 0.026
hostname:sdfmilan114 cpu:057 cmt:v120 proc time (sec) mean: 0.362 +/- 0.044 rms: 0.086 +/- 0.031
hostname:sdfmilan114 cpu:058 cmt:v120 proc time (sec) mean: 0.359 +/- 0.034 rms: 0.070 +/- 0.024
hostname:sdfmilan114 cpu:059 cmt:v120 proc time (sec) mean: 0.354 +/- 0.035 rms: 0.065 +/- 0.025
hostname:sdfmilan114 cpu:060 cmt:v120 proc time (sec) mean: 0.367 +/- 0.036 rms: 0.071 +/- 0.025
hostname:sdfmilan114 cpu:061 cmt:v120 proc time (sec) mean: 0.374 +/- 0.038 rms: 0.077 +/- 0.027
hostname:sdfmilan114 cpu:062 cmt:v120 proc time (sec) mean: 0.366 +/- 0.032 rms: 0.066 +/- 0.023
hostname:sdfmilan114 cpu:063 cmt:v120 proc time (sec) mean: 0.348 +/- 0.031 rms: 0.059 +/- 0.022
hostname:sdfmilan114 cpu:064 cmt:v120 proc time (sec) mean: 0.583 +/- 0.061 rms: 0.196 +/- 0.043
hostname:sdfmilan114 cpu:065 cmt:v120 proc time (sec) mean: 0.609 +/- 0.065 rms: 0.207 +/- 0.046
hostname:sdfmilan114 cpu:066 cmt:v120 proc time (sec) mean: 0.583 +/- 0.061 rms: 0.178 +/- 0.043
hostname:sdfmilan114 cpu:067 cmt:v120 proc time (sec) mean: 0.564 +/- 0.058 rms: 0.169 +/- 0.041
hostname:sdfmilan114 cpu:068 cmt:v120 proc time (sec) mean: 0.613 +/- 0.068 rms: 0.215 +/- 0.048
hostname:sdfmilan114 cpu:069 cmt:v120 proc time (sec) mean: 0.583 +/- 0.059 rms: 0.191 +/- 0.042
hostname:sdfmilan114 cpu:070 cmt:v120 proc time (sec) mean: 0.594 +/- 0.065 rms: 0.205 +/- 0.046
hostname:sdfmilan114 cpu:071 cmt:v120 proc time (sec) mean: 0.581 +/- 0.063 rms: 0.176 +/- 0.045
hostname:sdfmilan114 cpu:072 cmt:v120 proc time (sec) mean: 0.592 +/- 0.058 rms: 0.200 +/- 0.041
hostname:sdfmilan114 cpu:073 cmt:v120 proc time (sec) mean: 0.595 +/- 0.056 rms: 0.196 +/- 0.040
hostname:sdfmilan114 cpu:074 cmt:v120 proc time (sec) mean: 0.559 +/- 0.050 rms: 0.164 +/- 0.036
hostname:sdfmilan114 cpu:075 cmt:v120 proc time (sec) mean: 0.570 +/- 0.062 rms: 0.203 +/- 0.044
hostname:sdfmilan114 cpu:076 cmt:v120 proc time (sec) mean: 0.553 +/- 0.059 rms: 0.181 +/- 0.042
hostname:sdfmilan114 cpu:077 cmt:v120 proc time (sec) mean: 0.557 +/- 0.062 rms: 0.181 +/- 0.044
hostname:sdfmilan114 cpu:078 cmt:v120 proc time (sec) mean: 0.616 +/- 0.073 rms: 0.232 +/- 0.051
hostname:sdfmilan114 cpu:079 cmt:v120 proc time (sec) mean: 0.596 +/- 0.066 rms: 0.217 +/- 0.046
hostname:sdfmilan114 cpu:080 cmt:v120 proc time (sec) mean: 0.412 +/- 0.054 rms: 0.133 +/- 0.038
hostname:sdfmilan114 cpu:081 cmt:v120 proc time (sec) mean: 0.465 +/- 0.076 rms: 0.206 +/- 0.054
hostname:sdfmilan114 cpu:082 cmt:v120 proc time (sec) mean: 0.442 +/- 0.062 rms: 0.172 +/- 0.044
hostname:sdfmilan114 cpu:083 cmt:v120 proc time (sec) mean: 0.432 +/- 0.070 rms: 0.171 +/- 0.049
hostname:sdfmilan114 cpu:084 cmt:v120 proc time (sec) mean: 0.425 +/- 0.063 rms: 0.158 +/- 0.045
hostname:sdfmilan114 cpu:085 cmt:v120 proc time (sec) mean: 0.448 +/- 0.079 rms: 0.198 +/- 0.056
hostname:sdfmilan114 cpu:086 cmt:v120 proc time (sec) mean: 0.427 +/- 0.062 rms: 0.156 +/- 0.044
hostname:sdfmilan114 cpu:087 cmt:v120 proc time (sec) mean: 0.427 +/- 0.061 rms: 0.162 +/- 0.043
hostname:sdfmilan114 cpu:088 cmt:v120 proc time (sec) mean: 0.414 +/- 0.064 rms: 0.147 +/- 0.046
hostname:sdfmilan114 cpu:089 cmt:v120 proc time (sec) mean: 0.440 +/- 0.064 rms: 0.163 +/- 0.045
hostname:sdfmilan114 cpu:090 cmt:v120 proc time (sec) mean: 0.406 +/- 0.053 rms: 0.122 +/- 0.038
hostname:sdfmilan114 cpu:091 cmt:v120 proc time (sec) mean: 0.443 +/- 0.073 rms: 0.194 +/- 0.052
hostname:sdfmilan114 cpu:092 cmt:v120 proc time (sec) mean: 0.417 +/- 0.061 rms: 0.142 +/- 0.043
hostname:sdfmilan114 cpu:093 cmt:v120 proc time (sec) mean: 0.406 +/- 0.056 rms: 0.121 +/- 0.040
hostname:sdfmilan114 cpu:094 cmt:v120 proc time (sec) mean: 0.423 +/- 0.075 rms: 0.176 +/- 0.053
hostname:sdfmilan114 cpu:095 cmt:v120 proc time (sec) mean: 0.444 +/- 0.065 rms: 0.177 +/- 0.046
hostname:sdfmilan114 cpu:096 cmt:v120 proc time (sec) mean: 0.464 +/- 0.043 rms: 0.112 +/- 0.031
hostname:sdfmilan114 cpu:097 cmt:v120 proc time (sec) mean: 0.465 +/- 0.042 rms: 0.105 +/- 0.030
hostname:sdfmilan114 cpu:098 cmt:v120 proc time (sec) mean: 0.484 +/- 0.050 rms: 0.132 +/- 0.036
hostname:sdfmilan114 cpu:099 cmt:v120 proc time (sec) mean: 0.489 +/- 0.045 rms: 0.120 +/- 0.032
hostname:sdfmilan114 cpu:100 cmt:v120 proc time (sec) mean: 0.465 +/- 0.045 rms: 0.122 +/- 0.031
hostname:sdfmilan114 cpu:101 cmt:v120 proc time (sec) mean: 0.477 +/- 0.047 rms: 0.118 +/- 0.033
hostname:sdfmilan114 cpu:102 cmt:v120 proc time (sec) mean: 0.465 +/- 0.043 rms: 0.110 +/- 0.030
hostname:sdfmilan114 cpu:103 cmt:v120 proc time (sec) mean: 0.459 +/- 0.043 rms: 0.104 +/- 0.031
hostname:sdfmilan114 cpu:104 cmt:v120 proc time (sec) mean: 0.500 +/- 0.046 rms: 0.130 +/- 0.033
hostname:sdfmilan114 cpu:105 cmt:v120 proc time (sec) mean: 0.466 +/- 0.042 rms: 0.104 +/- 0.029
hostname:sdfmilan114 cpu:106 cmt:v120 proc time (sec) mean: 0.468 +/- 0.045 rms: 0.122 +/- 0.032
hostname:sdfmilan114 cpu:107 cmt:v120 proc time (sec) mean: 0.480 +/- 0.045 rms: 0.121 +/- 0.032
hostname:sdfmilan114 cpu:108 cmt:v120 proc time (sec) mean: 0.472 +/- 0.046 rms: 0.123 +/- 0.033
hostname:sdfmilan114 cpu:109 cmt:v120 proc time (sec) mean: 0.472 +/- 0.044 rms: 0.112 +/- 0.031
hostname:sdfmilan114 cpu:110 cmt:v120 proc time (sec) mean: 0.479 +/- 0.046 rms: 0.117 +/- 0.033
hostname:sdfmilan114 cpu:111 cmt:v120 proc time (sec) mean: 0.472 +/- 0.043 rms: 0.114 +/- 0.031
hostname:sdfmilan114 cpu:112 cmt:v120 proc time (sec) mean: 0.544 +/- 0.047 rms: 0.139 +/- 0.033
hostname:sdfmilan114 cpu:113 cmt:v120 proc time (sec) mean: 0.545 +/- 0.046 rms: 0.138 +/- 0.033
hostname:sdfmilan114 cpu:114 cmt:v120 proc time (sec) mean: 0.542 +/- 0.047 rms: 0.138 +/- 0.033
hostname:sdfmilan114 cpu:115 cmt:v120 proc time (sec) mean: 0.544 +/- 0.046 rms: 0.131 +/- 0.033
hostname:sdfmilan114 cpu:116 cmt:v120 proc time (sec) mean: 0.550 +/- 0.049 rms: 0.142 +/- 0.034
hostname:sdfmilan114 cpu:117 cmt:v120 proc time (sec) mean: 0.538 +/- 0.048 rms: 0.139 +/- 0.034
hostname:sdfmilan114 cpu:118 cmt:v120 proc time (sec) mean: 0.538 +/- 0.054 rms: 0.160 +/- 0.038
hostname:sdfmilan114 cpu:119 cmt:v120 proc time (sec) mean: 0.536 +/- 0.051 rms: 0.148 +/- 0.036
hostname:sdfmilan114 cpu:120 cmt:v120 proc time (sec) mean: 0.542 +/- 0.046 rms: 0.131 +/- 0.032
hostname:sdfmilan114 cpu:121 cmt:v120 proc time (sec) mean: 0.553 +/- 0.046 rms: 0.137 +/- 0.033
hostname:sdfmilan114 cpu:122 cmt:v120 proc time (sec) mean: 0.549 +/- 0.048 rms: 0.154 +/- 0.034
hostname:sdfmilan114 cpu:123 cmt:v120 proc time (sec) mean: 0.544 +/- 0.043 rms: 0.127 +/- 0.030
hostname:sdfmilan114 cpu:124 cmt:v120 proc time (sec) mean: 0.536 +/- 0.047 rms: 0.137 +/- 0.033
hostname:sdfmilan114 cpu:125 cmt:v120 proc time (sec) mean: 0.536 +/- 0.047 rms: 0.145 +/- 0.033
hostname:sdfmilan114 cpu:126 cmt:v120 proc time (sec) mean: 0.555 +/- 0.047 rms: 0.144 +/- 0.033
hostname:sdfmilan114 cpu:127 cmt:v120 proc time (sec) mean: 0.539 +/- 0.045 rms: 0.131 +/- 0.031
mean time (sec): 0.4537

Repeat test
hostname:sdfmilan114 cpu:000 cmt:v120-2 proc time (sec) mean: 0.319 +/- 0.022 rms: 0.032 +/- 0.016
hostname:sdfmilan114 cpu:001 cmt:v120-2 proc time (sec) mean: 0.317 +/- 0.023 rms: 0.037 +/- 0.017
hostname:sdfmilan114 cpu:002 cmt:v120-2 proc time (sec) mean: 0.323 +/- 0.023 rms: 0.035 +/- 0.016
hostname:sdfmilan114 cpu:003 cmt:v120-2 proc time (sec) mean: 0.329 +/- 0.027 rms: 0.040 +/- 0.019
hostname:sdfmilan114 cpu:004 cmt:v120-2 proc time (sec) mean: 0.324 +/- 0.022 rms: 0.033 +/- 0.016
hostname:sdfmilan114 cpu:005 cmt:v120-2 proc time (sec) mean: 0.328 +/- 0.023 rms: 0.033 +/- 0.016
hostname:sdfmilan114 cpu:006 cmt:v120-2 proc time (sec) mean: 0.322 +/- 0.022 rms: 0.034 +/- 0.015
hostname:sdfmilan114 cpu:007 cmt:v120-2 proc time (sec) mean: 0.313 +/- 0.022 rms: 0.035 +/- 0.015
hostname:sdfmilan114 cpu:008 cmt:v120-2 proc time (sec) mean: 0.333 +/- 0.029 rms: 0.040 +/- 0.021
hostname:sdfmilan114 cpu:009 cmt:v120-2 proc time (sec) mean: 0.318 +/- 0.025 rms: 0.035 +/- 0.017
hostname:sdfmilan114 cpu:010 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.031 rms: 0.045 +/- 0.022
hostname:sdfmilan114 cpu:011 cmt:v120-2 proc time (sec) mean: 0.336 +/- 0.026 rms: 0.039 +/- 0.019
hostname:sdfmilan114 cpu:012 cmt:v120-2 proc time (sec) mean: 0.330 +/- 0.027 rms: 0.040 +/- 0.019
hostname:sdfmilan114 cpu:013 cmt:v120-2 proc time (sec) mean: 0.333 +/- 0.026 rms: 0.035 +/- 0.018
hostname:sdfmilan114 cpu:014 cmt:v120-2 proc time (sec) mean: 0.326 +/- 0.026 rms: 0.037 +/- 0.019
hostname:sdfmilan114 cpu:015 cmt:v120-2 proc time (sec) mean: 0.323 +/- 0.025 rms: 0.036 +/- 0.018
hostname:sdfmilan114 cpu:024 cmt:v120-2 proc time (sec) mean: 0.276 +/- 0.005 rms: 0.005 +/- 0.003
hostname:sdfmilan114 cpu:025 cmt:v120-2 proc time (sec) mean: 0.276 +/- 0.005 rms: 0.005 +/- 0.003
hostname:sdfmilan114 cpu:026 cmt:v120-2 proc time (sec) mean: 0.279 +/- 0.012 rms: 0.013 +/- 0.008
hostname:sdfmilan114 cpu:027 cmt:v120-2 proc time (sec) mean: 0.276 +/- 0.007 rms: 0.007 +/- 0.005
hostname:sdfmilan114 cpu:028 cmt:v120-2 proc time (sec) mean: 0.277 +/- 0.009 rms: 0.010 +/- 0.007
hostname:sdfmilan114 cpu:029 cmt:v120-2 proc time (sec) mean: 0.277 +/- 0.008 rms: 0.009 +/- 0.006
hostname:sdfmilan114 cpu:030 cmt:v120-2 proc time (sec) mean: 0.277 +/- 0.013 rms: 0.014 +/- 0.009
hostname:sdfmilan114 cpu:031 cmt:v120-2 proc time (sec) mean: 0.279 +/- 0.013 rms: 0.014 +/- 0.009
hostname:sdfmilan114 cpu:032 cmt:v120-2 proc time (sec) mean: 0.339 +/- 0.024 rms: 0.039 +/- 0.017
hostname:sdfmilan114 cpu:033 cmt:v120-2 proc time (sec) mean: 0.348 +/- 0.026 rms: 0.042 +/- 0.018
hostname:sdfmilan114 cpu:034 cmt:v120-2 proc time (sec) mean: 0.334 +/- 0.024 rms: 0.041 +/- 0.017
hostname:sdfmilan114 cpu:035 cmt:v120-2 proc time (sec) mean: 0.340 +/- 0.024 rms: 0.038 +/- 0.017
hostname:sdfmilan114 cpu:036 cmt:v120-2 proc time (sec) mean: 0.339 +/- 0.024 rms: 0.039 +/- 0.017
hostname:sdfmilan114 cpu:037 cmt:v120-2 proc time (sec) mean: 0.341 +/- 0.023 rms: 0.035 +/- 0.016
hostname:sdfmilan114 cpu:038 cmt:v120-2 proc time (sec) mean: 0.340 +/- 0.027 rms: 0.045 +/- 0.019
hostname:sdfmilan114 cpu:039 cmt:v120-2 proc time (sec) mean: 0.339 +/- 0.023 rms: 0.037 +/- 0.016
hostname:sdfmilan114 cpu:040 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.022 rms: 0.034 +/- 0.016
hostname:sdfmilan114 cpu:041 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.024 rms: 0.037 +/- 0.017
hostname:sdfmilan114 cpu:042 cmt:v120-2 proc time (sec) mean: 0.329 +/- 0.022 rms: 0.035 +/- 0.015
hostname:sdfmilan114 cpu:043 cmt:v120-2 proc time (sec) mean: 0.338 +/- 0.025 rms: 0.038 +/- 0.017
hostname:sdfmilan114 cpu:044 cmt:v120-2 proc time (sec) mean: 0.330 +/- 0.023 rms: 0.033 +/- 0.016
hostname:sdfmilan114 cpu:045 cmt:v120-2 proc time (sec) mean: 0.338 +/- 0.024 rms: 0.037 +/- 0.017
hostname:sdfmilan114 cpu:046 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.023 rms: 0.034 +/- 0.016
hostname:sdfmilan114 cpu:047 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.023 rms: 0.033 +/- 0.016
hostname:sdfmilan114 cpu:048 cmt:v120-2 proc time (sec) mean: 0.329 +/- 0.023 rms: 0.037 +/- 0.016
hostname:sdfmilan114 cpu:049 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.023 rms: 0.037 +/- 0.016
hostname:sdfmilan114 cpu:050 cmt:v120-2 proc time (sec) mean: 0.324 +/- 0.024 rms: 0.037 +/- 0.017
hostname:sdfmilan114 cpu:051 cmt:v120-2 proc time (sec) mean: 0.333 +/- 0.025 rms: 0.040 +/- 0.018
hostname:sdfmilan114 cpu:052 cmt:v120-2 proc time (sec) mean: 0.335 +/- 0.023 rms: 0.034 +/- 0.016
hostname:sdfmilan114 cpu:053 cmt:v120-2 proc time (sec) mean: 0.335 +/- 0.025 rms: 0.041 +/- 0.018
hostname:sdfmilan114 cpu:054 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.021 rms: 0.029 +/- 0.015
hostname:sdfmilan114 cpu:055 cmt:v120-2 proc time (sec) mean: 0.331 +/- 0.023 rms: 0.037 +/- 0.016
hostname:sdfmilan114 cpu:056 cmt:v120-2 proc time (sec) mean: 0.338 +/- 0.026 rms: 0.043 +/- 0.018
hostname:sdfmilan114 cpu:057 cmt:v120-2 proc time (sec) mean: 0.335 +/- 0.025 rms: 0.042 +/- 0.018
hostname:sdfmilan114 cpu:058 cmt:v120-2 proc time (sec) mean: 0.334 +/- 0.024 rms: 0.041 +/- 0.017
hostname:sdfmilan114 cpu:059 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.023 rms: 0.038 +/- 0.016
hostname:sdfmilan114 cpu:060 cmt:v120-2 proc time (sec) mean: 0.337 +/- 0.024 rms: 0.042 +/- 0.017
hostname:sdfmilan114 cpu:061 cmt:v120-2 proc time (sec) mean: 0.333 +/- 0.024 rms: 0.040 +/- 0.017
hostname:sdfmilan114 cpu:062 cmt:v120-2 proc time (sec) mean: 0.328 +/- 0.023 rms: 0.034 +/- 0.016
hostname:sdfmilan114 cpu:063 cmt:v120-2 proc time (sec) mean: 0.336 +/- 0.024 rms: 0.041 +/- 0.017
hostname:sdfmilan114 cpu:064 cmt:v120-2 proc time (sec) mean: 0.528 +/- 0.042 rms: 0.091 +/- 0.030
hostname:sdfmilan114 cpu:065 cmt:v120-2 proc time (sec) mean: 0.527 +/- 0.042 rms: 0.098 +/- 0.030
hostname:sdfmilan114 cpu:066 cmt:v120-2 proc time (sec) mean: 0.527 +/- 0.041 rms: 0.094 +/- 0.029
hostname:sdfmilan114 cpu:067 cmt:v120-2 proc time (sec) mean: 0.517 +/- 0.040 rms: 0.092 +/- 0.028
hostname:sdfmilan114 cpu:068 cmt:v120-2 proc time (sec) mean: 0.518 +/- 0.045 rms: 0.105 +/- 0.032
hostname:sdfmilan114 cpu:069 cmt:v120-2 proc time (sec) mean: 0.518 +/- 0.044 rms: 0.104 +/- 0.031
hostname:sdfmilan114 cpu:070 cmt:v120-2 proc time (sec) mean: 0.524 +/- 0.044 rms: 0.104 +/- 0.031
hostname:sdfmilan114 cpu:071 cmt:v120-2 proc time (sec) mean: 0.529 +/- 0.043 rms: 0.099 +/- 0.030
hostname:sdfmilan114 cpu:072 cmt:v120-2 proc time (sec) mean: 0.522 +/- 0.045 rms: 0.108 +/- 0.032
hostname:sdfmilan114 cpu:073 cmt:v120-2 proc time (sec) mean: 0.533 +/- 0.044 rms: 0.101 +/- 0.031
hostname:sdfmilan114 cpu:074 cmt:v120-2 proc time (sec) mean: 0.527 +/- 0.044 rms: 0.098 +/- 0.031
hostname:sdfmilan114 cpu:075 cmt:v120-2 proc time (sec) mean: 0.526 +/- 0.044 rms: 0.108 +/- 0.031
hostname:sdfmilan114 cpu:076 cmt:v120-2 proc time (sec) mean: 0.514 +/- 0.044 rms: 0.098 +/- 0.031
hostname:sdfmilan114 cpu:077 cmt:v120-2 proc time (sec) mean: 0.518 +/- 0.045 rms: 0.103 +/- 0.032
hostname:sdfmilan114 cpu:078 cmt:v120-2 proc time (sec) mean: 0.510 +/- 0.041 rms: 0.105 +/- 0.029
hostname:sdfmilan114 cpu:079 cmt:v120-2 proc time (sec) mean: 0.515 +/- 0.046 rms: 0.104 +/- 0.032
hostname:sdfmilan114 cpu:080 cmt:v120-2 proc time (sec) mean: 0.381 +/- 0.292 rms: 0.500 +/- 0.206
hostname:sdfmilan114 cpu:081 cmt:v120-2 proc time (sec) mean: 0.316 +/- 0.022 rms: 0.034 +/- 0.016
hostname:sdfmilan114 cpu:082 cmt:v120-2 proc time (sec) mean: 0.321 +/- 0.104 rms: 0.160 +/- 0.074
hostname:sdfmilan114 cpu:083 cmt:v120-2 proc time (sec) mean: 0.332 +/- 0.105 rms: 0.159 +/- 0.074
hostname:sdfmilan114 cpu:084 cmt:v120-2 proc time (sec) mean: 0.311 +/- 0.020 rms: 0.028 +/- 0.014
hostname:sdfmilan114 cpu:085 cmt:v120-2 proc time (sec) mean: 0.350 +/- 0.251 rms: 0.422 +/- 0.178
hostname:sdfmilan114 cpu:086 cmt:v120-2 proc time (sec) mean: 0.315 +/- 0.022 rms: 0.033 +/- 0.015
hostname:sdfmilan114 cpu:087 cmt:v120-2 proc time (sec) mean: 0.315 +/- 0.020 rms: 0.029 +/- 0.014
hostname:sdfmilan114 cpu:088 cmt:v120-2 proc time (sec) mean: 0.352 +/- 0.241 rms: 0.411 +/- 0.171
hostname:sdfmilan114 cpu:089 cmt:v120-2 proc time (sec) mean: 0.323 +/- 0.111 rms: 0.170 +/- 0.078
hostname:sdfmilan114 cpu:090 cmt:v120-2 proc time (sec) mean: 0.354 +/- 0.184 rms: 0.293 +/- 0.130
hostname:sdfmilan114 cpu:091 cmt:v120-2 proc time (sec) mean: 0.308 +/- 0.019 rms: 0.028 +/- 0.014
hostname:sdfmilan114 cpu:092 cmt:v120-2 proc time (sec) mean: 0.351 +/- 0.226 rms: 0.348 +/- 0.160
hostname:sdfmilan114 cpu:093 cmt:v120-2 proc time (sec) mean: 0.328 +/- 0.082 rms: 0.136 +/- 0.058
hostname:sdfmilan114 cpu:094 cmt:v120-2 proc time (sec) mean: 0.340 +/- 0.128 rms: 0.207 +/- 0.090
hostname:sdfmilan114 cpu:095 cmt:v120-2 proc time (sec) mean: 0.324 +/- 0.027 rms: 0.042 +/- 0.019
hostname:sdfmilan114 cpu:096 cmt:v120-2 proc time (sec) mean: 0.417 +/- 0.033 rms: 0.071 +/- 0.023
hostname:sdfmilan114 cpu:097 cmt:v120-2 proc time (sec) mean: 0.451 +/- 0.137 rms: 0.297 +/- 0.097
hostname:sdfmilan114 cpu:098 cmt:v120-2 proc time (sec) mean: 0.430 +/- 0.031 rms: 0.070 +/- 0.022
hostname:sdfmilan114 cpu:099 cmt:v120-2 proc time (sec) mean: 0.415 +/- 0.033 rms: 0.070 +/- 0.023
hostname:sdfmilan114 cpu:100 cmt:v120-2 proc time (sec) mean: 0.423 +/- 0.034 rms: 0.077 +/- 0.024
hostname:sdfmilan114 cpu:101 cmt:v120-2 proc time (sec) mean: 0.423 +/- 0.033 rms: 0.073 +/- 0.024
hostname:sdfmilan114 cpu:102 cmt:v120-2 proc time (sec) mean: 0.419 +/- 0.032 rms: 0.073 +/- 0.023
hostname:sdfmilan114 cpu:103 cmt:v120-2 proc time (sec) mean: 0.425 +/- 0.029 rms: 0.061 +/- 0.021
hostname:sdfmilan114 cpu:104 cmt:v120-2 proc time (sec) mean: 0.404 +/- 0.032 rms: 0.069 +/- 0.023
hostname:sdfmilan114 cpu:105 cmt:v120-2 proc time (sec) mean: 0.426 +/- 0.031 rms: 0.065 +/- 0.022
hostname:sdfmilan114 cpu:106 cmt:v120-2 proc time (sec) mean: 0.412 +/- 0.033 rms: 0.069 +/- 0.023
hostname:sdfmilan114 cpu:107 cmt:v120-2 proc time (sec) mean: 0.420 +/- 0.030 rms: 0.063 +/- 0.021
hostname:sdfmilan114 cpu:108 cmt:v120-2 proc time (sec) mean: 0.417 +/- 0.033 rms: 0.069 +/- 0.023
hostname:sdfmilan114 cpu:109 cmt:v120-2 proc time (sec) mean: 0.416 +/- 0.030 rms: 0.063 +/- 0.021
hostname:sdfmilan114 cpu:110 cmt:v120-2 proc time (sec) mean: 0.417 +/- 0.031 rms: 0.065 +/- 0.022
hostname:sdfmilan114 cpu:111 cmt:v120-2 proc time (sec) mean: 0.410 +/- 0.031 rms: 0.068 +/- 0.022
hostname:sdfmilan114 cpu:112 cmt:v120-2 proc time (sec) mean: 0.471 +/- 0.046 rms: 0.107 +/- 0.033
hostname:sdfmilan114 cpu:113 cmt:v120-2 proc time (sec) mean: 0.455 +/- 0.035 rms: 0.082 +/- 0.025
hostname:sdfmilan114 cpu:114 cmt:v120-2 proc time (sec) mean: 0.477 +/- 0.037 rms: 0.095 +/- 0.026
hostname:sdfmilan114 cpu:115 cmt:v120-2 proc time (sec) mean: 0.475 +/- 0.035 rms: 0.087 +/- 0.025
hostname:sdfmilan114 cpu:116 cmt:v120-2 proc time (sec) mean: 0.472 +/- 0.035 rms: 0.086 +/- 0.025
hostname:sdfmilan114 cpu:117 cmt:v120-2 proc time (sec) mean: 0.474 +/- 0.036 rms: 0.089 +/- 0.025
hostname:sdfmilan114 cpu:118 cmt:v120-2 proc time (sec) mean: 0.463 +/- 0.036 rms: 0.084 +/- 0.026
hostname:sdfmilan114 cpu:119 cmt:v120-2 proc time (sec) mean: 0.467 +/- 0.035 rms: 0.085 +/- 0.025
hostname:sdfmilan114 cpu:120 cmt:v120-2 proc time (sec) mean: 0.452 +/- 0.037 rms: 0.089 +/- 0.026
hostname:sdfmilan114 cpu:121 cmt:v120-2 proc time (sec) mean: 0.472 +/- 0.037 rms: 0.093 +/- 0.026
hostname:sdfmilan114 cpu:122 cmt:v120-2 proc time (sec) mean: 0.466 +/- 0.037 rms: 0.093 +/- 0.026
hostname:sdfmilan114 cpu:123 cmt:v120-2 proc time (sec) mean: 0.466 +/- 0.035 rms: 0.080 +/- 0.024
hostname:sdfmilan114 cpu:124 cmt:v120-2 proc time (sec) mean: 0.467 +/- 0.036 rms: 0.092 +/- 0.026
hostname:sdfmilan114 cpu:125 cmt:v120-2 proc time (sec) mean: 0.451 +/- 0.035 rms: 0.088 +/- 0.025
hostname:sdfmilan114 cpu:126 cmt:v120-2 proc time (sec) mean: 0.460 +/- 0.037 rms: 0.091 +/- 0.026
hostname:sdfmilan114 cpu:127 cmt:v120-2 proc time (sec) mean: 0.475 +/- 0.035 rms: 0.086 +/- 0.025
mean time (sec): 0.3834

2024-02-02 The same job on sdfmilan216

hostname:sdfmilan216 cpu:000 cmt:v120 proc time (sec) mean: 0.288 +/- 0.010 rms: 0.018 +/- 0.007
hostname:sdfmilan216 cpu:001 cmt:v120 proc time (sec) mean: 0.288 +/- 0.009 rms: 0.016 +/- 0.007
hostname:sdfmilan216 cpu:002 cmt:v120 proc time (sec) mean: 0.293 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:003 cmt:v120 proc time (sec) mean: 0.294 +/- 0.014 rms: 0.028 +/- 0.010
hostname:sdfmilan216 cpu:004 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.023 +/- 0.009
hostname:sdfmilan216 cpu:005 cmt:v120 proc time (sec) mean: 0.295 +/- 0.012 rms: 0.023 +/- 0.008
hostname:sdfmilan216 cpu:006 cmt:v120 proc time (sec) mean: 0.293 +/- 0.014 rms: 0.025 +/- 0.010
hostname:sdfmilan216 cpu:007 cmt:v120 proc time (sec) mean: 0.287 +/- 0.013 rms: 0.023 +/- 0.009
hostname:sdfmilan216 cpu:008 cmt:v120 proc time (sec) mean: 0.295 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:009 cmt:v120 proc time (sec) mean: 0.294 +/- 0.015 rms: 0.028 +/- 0.010
hostname:sdfmilan216 cpu:010 cmt:v120 proc time (sec) mean: 0.298 +/- 0.013 rms: 0.027 +/- 0.009
hostname:sdfmilan216 cpu:011 cmt:v120 proc time (sec) mean: 0.297 +/- 0.014 rms: 0.028 +/- 0.010
hostname:sdfmilan216 cpu:012 cmt:v120 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan216 cpu:013 cmt:v120 proc time (sec) mean: 0.297 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan216 cpu:014 cmt:v120 proc time (sec) mean: 0.287 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:015 cmt:v120 proc time (sec) mean: 0.291 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:024 cmt:v120 proc time (sec) mean: 0.255 +/- 0.008 rms: 0.010 +/- 0.006
hostname:sdfmilan216 cpu:025 cmt:v120 proc time (sec) mean: 0.260 +/- 0.009 rms: 0.013 +/- 0.006
hostname:sdfmilan216 cpu:026 cmt:v120 proc time (sec) mean: 0.266 +/- 0.009 rms: 0.014 +/- 0.006
hostname:sdfmilan216 cpu:027 cmt:v120 proc time (sec) mean: 0.259 +/- 0.007 rms: 0.010 +/- 0.005
hostname:sdfmilan216 cpu:028 cmt:v120 proc time (sec) mean: 0.261 +/- 0.009 rms: 0.013 +/- 0.007
hostname:sdfmilan216 cpu:029 cmt:v120 proc time (sec) mean: 0.263 +/- 0.008 rms: 0.011 +/- 0.006
hostname:sdfmilan216 cpu:030 cmt:v120 proc time (sec) mean: 0.263 +/- 0.008 rms: 0.012 +/- 0.006
hostname:sdfmilan216 cpu:031 cmt:v120 proc time (sec) mean: 0.262 +/- 0.008 rms: 0.012 +/- 0.006
hostname:sdfmilan216 cpu:032 cmt:v120 proc time (sec) mean: 0.297 +/- 0.015 rms: 0.027 +/- 0.010
hostname:sdfmilan216 cpu:033 cmt:v120 proc time (sec) mean: 0.289 +/- 0.013 rms: 0.023 +/- 0.009
hostname:sdfmilan216 cpu:034 cmt:v120 proc time (sec) mean: 0.289 +/- 0.016 rms: 0.029 +/- 0.012
hostname:sdfmilan216 cpu:035 cmt:v120 proc time (sec) mean: 0.293 +/- 0.016 rms: 0.028 +/- 0.011
hostname:sdfmilan216 cpu:036 cmt:v120 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:037 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.024 +/- 0.009
hostname:sdfmilan216 cpu:038 cmt:v120 proc time (sec) mean: 0.293 +/- 0.015 rms: 0.028 +/- 0.011
hostname:sdfmilan216 cpu:039 cmt:v120 proc time (sec) mean: 0.289 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:040 cmt:v120 proc time (sec) mean: 0.287 +/- 0.012 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:041 cmt:v120 proc time (sec) mean: 0.289 +/- 0.013 rms: 0.023 +/- 0.009
hostname:sdfmilan216 cpu:042 cmt:v120 proc time (sec) mean: 0.289 +/- 0.010 rms: 0.018 +/- 0.007
hostname:sdfmilan216 cpu:043 cmt:v120 proc time (sec) mean: 0.289 +/- 0.010 rms: 0.016 +/- 0.007
hostname:sdfmilan216 cpu:044 cmt:v120 proc time (sec) mean: 0.292 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:045 cmt:v120 proc time (sec) mean: 0.286 +/- 0.011 rms: 0.021 +/- 0.008
hostname:sdfmilan216 cpu:046 cmt:v120 proc time (sec) mean: 0.293 +/- 0.012 rms: 0.023 +/- 0.009
hostname:sdfmilan216 cpu:047 cmt:v120 proc time (sec) mean: 0.294 +/- 0.012 rms: 0.023 +/- 0.008
hostname:sdfmilan216 cpu:048 cmt:v120 proc time (sec) mean: 0.285 +/- 0.018 rms: 0.039 +/- 0.012
hostname:sdfmilan216 cpu:049 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:050 cmt:v120 proc time (sec) mean: 0.297 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan216 cpu:051 cmt:v120 proc time (sec) mean: 0.292 +/- 0.012 rms: 0.024 +/- 0.009
hostname:sdfmilan216 cpu:052 cmt:v120 proc time (sec) mean: 0.288 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:053 cmt:v120 proc time (sec) mean: 0.292 +/- 0.014 rms: 0.028 +/- 0.010
hostname:sdfmilan216 cpu:054 cmt:v120 proc time (sec) mean: 0.296 +/- 0.012 rms: 0.023 +/- 0.008
hostname:sdfmilan216 cpu:055 cmt:v120 proc time (sec) mean: 0.292 +/- 0.012 rms: 0.024 +/- 0.009
hostname:sdfmilan216 cpu:056 cmt:v120 proc time (sec) mean: 0.289 +/- 0.012 rms: 0.022 +/- 0.008
hostname:sdfmilan216 cpu:057 cmt:v120 proc time (sec) mean: 0.296 +/- 0.012 rms: 0.023 +/- 0.008
hostname:sdfmilan216 cpu:058 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:059 cmt:v120 proc time (sec) mean: 0.313 +/- 0.014 rms: 0.029 +/- 0.010
hostname:sdfmilan216 cpu:060 cmt:v120 proc time (sec) mean: 0.296 +/- 0.014 rms: 0.030 +/- 0.010
hostname:sdfmilan216 cpu:061 cmt:v120 proc time (sec) mean: 0.300 +/- 0.016 rms: 0.033 +/- 0.011
hostname:sdfmilan216 cpu:062 cmt:v120 proc time (sec) mean: 0.290 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:063 cmt:v120 proc time (sec) mean: 0.296 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan216 cpu:064 cmt:v120 proc time (sec) mean: 0.294 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:065 cmt:v120 proc time (sec) mean: 0.282 +/- 0.011 rms: 0.018 +/- 0.008
hostname:sdfmilan216 cpu:066 cmt:v120 proc time (sec) mean: 0.290 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan216 cpu:067 cmt:v120 proc time (sec) mean: 0.291 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:068 cmt:v120 proc time (sec) mean: 0.278 +/- 0.014 rms: 0.022 +/- 0.010
hostname:sdfmilan216 cpu:069 cmt:v120 proc time (sec) mean: 0.288 +/- 0.013 rms: 0.023 +/- 0.009
hostname:sdfmilan216 cpu:070 cmt:v120 proc time (sec) mean: 0.292 +/- 0.012 rms: 0.024 +/- 0.009
hostname:sdfmilan216 cpu:071 cmt:v120 proc time (sec) mean: 0.289 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:072 cmt:v120 proc time (sec) mean: 0.290 +/- 0.015 rms: 0.028 +/- 0.011
hostname:sdfmilan216 cpu:073 cmt:v120 proc time (sec) mean: 0.294 +/- 0.013 rms: 0.026 +/- 0.009
hostname:sdfmilan216 cpu:074 cmt:v120 proc time (sec) mean: 0.294 +/- 0.016 rms: 0.032 +/- 0.011
hostname:sdfmilan216 cpu:075 cmt:v120 proc time (sec) mean: 0.295 +/- 0.016 rms: 0.030 +/- 0.011
hostname:sdfmilan216 cpu:076 cmt:v120 proc time (sec) mean: 0.292 +/- 0.017 rms: 0.032 +/- 0.012
hostname:sdfmilan216 cpu:077 cmt:v120 proc time (sec) mean: 0.294 +/- 0.017 rms: 0.033 +/- 0.012
hostname:sdfmilan216 cpu:078 cmt:v120 proc time (sec) mean: 0.294 +/- 0.016 rms: 0.030 +/- 0.012
hostname:sdfmilan216 cpu:079 cmt:v120 proc time (sec) mean: 0.287 +/- 0.014 rms: 0.024 +/- 0.010
hostname:sdfmilan216 cpu:080 cmt:v120 proc time (sec) mean: 0.290 +/- 0.014 rms: 0.026 +/- 0.010
hostname:sdfmilan216 cpu:081 cmt:v120 proc time (sec) mean: 0.289 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:082 cmt:v120 proc time (sec) mean: 0.284 +/- 0.019 rms: 0.032 +/- 0.013
hostname:sdfmilan216 cpu:083 cmt:v120 proc time (sec) mean: 0.292 +/- 0.011 rms: 0.020 +/- 0.008
hostname:sdfmilan216 cpu:084 cmt:v120 proc time (sec) mean: 0.290 +/- 0.014 rms: 0.025 +/- 0.010
hostname:sdfmilan216 cpu:085 cmt:v120 proc time (sec) mean: 0.285 +/- 0.014 rms: 0.024 +/- 0.010
hostname:sdfmilan216 cpu:086 cmt:v120 proc time (sec) mean: 0.283 +/- 0.011 rms: 0.019 +/- 0.008
hostname:sdfmilan216 cpu:087 cmt:v120 proc time (sec) mean: 0.292 +/- 0.012 rms: 0.021 +/- 0.009
hostname:sdfmilan216 cpu:088 cmt:v120 proc time (sec) mean: 0.292 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:089 cmt:v120 proc time (sec) mean: 0.289 +/- 0.017 rms: 0.031 +/- 0.012
hostname:sdfmilan216 cpu:090 cmt:v120 proc time (sec) mean: 0.296 +/- 0.017 rms: 0.030 +/- 0.012
hostname:sdfmilan216 cpu:091 cmt:v120 proc time (sec) mean: 0.294 +/- 0.020 rms: 0.037 +/- 0.014
hostname:sdfmilan216 cpu:092 cmt:v120 proc time (sec) mean: 0.287 +/- 0.012 rms: 0.022 +/- 0.009
hostname:sdfmilan216 cpu:093 cmt:v120 proc time (sec) mean: 0.289 +/- 0.014 rms: 0.026 +/- 0.010
hostname:sdfmilan216 cpu:094 cmt:v120 proc time (sec) mean: 0.293 +/- 0.013 rms: 0.025 +/- 0.009
hostname:sdfmilan216 cpu:095 cmt:v120 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.032 +/- 0.012
hostname:sdfmilan216 cpu:096 cmt:v120 proc time (sec) mean: 0.293 +/- 0.015 rms: 0.028 +/- 0.011
hostname:sdfmilan216 cpu:097 cmt:v120 proc time (sec) mean: 0.290 +/- 0.015 rms: 0.030 +/- 0.011
hostname:sdfmilan216 cpu:098 cmt:v120 proc time (sec) mean: 0.290 +/- 0.015 rms: 0.028 +/- 0.011
hostname:sdfmilan216 cpu:099 cmt:v120 proc time (sec) mean: 0.293 +/- 0.018 rms: 0.034 +/- 0.013
hostname:sdfmilan216 cpu:100 cmt:v120 proc time (sec) mean: 0.295 +/- 0.015 rms: 0.026 +/- 0.010
hostname:sdfmilan216 cpu:101 cmt:v120 proc time (sec) mean: 0.290 +/- 0.013 rms: 0.024 +/- 0.009
hostname:sdfmilan216 cpu:102 cmt:v120 proc time (sec) mean: 0.295 +/- 0.015 rms: 0.028 +/- 0.011
hostname:sdfmilan216 cpu:103 cmt:v120 proc time (sec) mean: 0.291 +/- 0.014 rms: 0.026 +/- 0.010
hostname:sdfmilan216 cpu:104 cmt:v120 proc time (sec) mean: 0.297 +/- 0.016 rms: 0.033 +/- 0.011
hostname:sdfmilan216 cpu:105 cmt:v120 proc time (sec) mean: 0.292 +/- 0.016 rms: 0.028 +/- 0.011
hostname:sdfmilan216 cpu:106 cmt:v120 proc time (sec) mean: 0.292 +/- 0.014 rms: 0.028 +/- 0.010
hostname:sdfmilan216 cpu:107 cmt:v120 proc time (sec) mean: 0.293 +/- 0.014 rms: 0.026 +/- 0.010
hostname:sdfmilan216 cpu:108 cmt:v120 proc time (sec) mean: 0.294 +/- 0.018 rms: 0.034 +/- 0.013
hostname:sdfmilan216 cpu:109 cmt:v120 proc time (sec) mean: 0.294 +/- 0.015 rms: 0.030 +/- 0.011
hostname:sdfmilan216 cpu:110 cmt:v120 proc time (sec) mean: 0.295 +/- 0.016 rms: 0.030 +/- 0.011
hostname:sdfmilan216 cpu:111 cmt:v120 proc time (sec) mean: 0.298 +/- 0.015 rms: 0.030 +/- 0.011
hostname:sdfmilan216 cpu:112 cmt:v120 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.036 +/- 0.012
hostname:sdfmilan216 cpu:113 cmt:v120 proc time (sec) mean: 0.298 +/- 0.015 rms: 0.032 +/- 0.011
hostname:sdfmilan216 cpu:114 cmt:v120 proc time (sec) mean: 0.292 +/- 0.017 rms: 0.034 +/- 0.012
hostname:sdfmilan216 cpu:115 cmt:v120 proc time (sec) mean: 0.289 +/- 0.018 rms: 0.033 +/- 0.013
hostname:sdfmilan216 cpu:116 cmt:v120 proc time (sec) mean: 0.299 +/- 0.016 rms: 0.033 +/- 0.011
hostname:sdfmilan216 cpu:117 cmt:v120 proc time (sec) mean: 0.297 +/- 0.015 rms: 0.031 +/- 0.011
hostname:sdfmilan216 cpu:118 cmt:v120 proc time (sec) mean: 0.302 +/- 0.018 rms: 0.035 +/- 0.013
hostname:sdfmilan216 cpu:119 cmt:v120 proc time (sec) mean: 0.300 +/- 0.015 rms: 0.032 +/- 0.011
hostname:sdfmilan216 cpu:120 cmt:v120 proc time (sec) mean: 0.293 +/- 0.016 rms: 0.033 +/- 0.011
hostname:sdfmilan216 cpu:121 cmt:v120 proc time (sec) mean: 0.301 +/- 0.017 rms: 0.035 +/- 0.012
hostname:sdfmilan216 cpu:122 cmt:v120 proc time (sec) mean: 0.295 +/- 0.014 rms: 0.030 +/- 0.010
hostname:sdfmilan216 cpu:123 cmt:v120 proc time (sec) mean: 0.298 +/- 0.016 rms: 0.032 +/- 0.011
hostname:sdfmilan216 cpu:124 cmt:v120 proc time (sec) mean: 0.293 +/- 0.017 rms: 0.033 +/- 0.012
hostname:sdfmilan216 cpu:125 cmt:v120 proc time (sec) mean: 0.300 +/- 0.017 rms: 0.035 +/- 0.012
hostname:sdfmilan216 cpu:126 cmt:v120 proc time (sec) mean: 0.292 +/- 0.017 rms: 0.032 +/- 0.012
hostname:sdfmilan216 cpu:127 cmt:v120 proc time (sec) mean: 0.303 +/- 0.021 rms: 0.047 +/- 0.015
mean time (sec): 0.2904

Summary of the group test

number of CPUs	CPU in the group	time, msec
1 per test	single 5,10,32,64,96,127	206-226
8	0-7	225
8	8-15	221
8	24-31	224
8	120-127	216
15	every 8-th, 0,8,24,32,...120	203
16	0-15	282
16	32-47	282
16	64-79	287
16	112-127	248
28	0-31 excl. weka	262
32	32-63	287
32	64-95	272
32	96-127	382
56	0-63 excl. weka	288
64	64-127	428
120	0-127 excl. weka	454
120	0-127 excl. weka repeat	383
120	0-127 on sdfmilan216	298

Page tree

Issue

List of commands for this test

Code for time monitoring

Timing histograms

Single core processing

80-core processing for ranks 0, 30, and 60

Results

Summary

2024-01-16 Test for simulated events

Time consuming code

2024-01-16 Test Summary

2024-01-17 Test for simulated events with minor modifications

Test variation

Time consuming code

Results

Single core processing

80-core processing for ranks 0, 30, and 60

2024-01-17 Test Summary

2024-01-19 Test for a few hosts

2024-01-19 Time difference vs array size

2024-01-19-22 Test Summary

2024-01-22 Q&A

2024-01-30 running in subprocesses

Simultaneous processing on cpu 0-7 of the same host

Simultaneous processing on cpu 1, 8, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96 of the same host

2024-01-31 time consumption test in subprocess

Algorithm code

Per-event time split

Summary for time consumption

2024-02-01 scaling for groups of busy cpus of the same host

Summary of the group test

References

Page tree

Scaling behavior of psana1 - Part 1 - det.calib method in multicore processing with mpi

Issue

List of commands for this test

Code for time monitoring

Timing histograms

Single core processing

80-core processing for ranks 0, 30, and 60

Results

Summary

2024-01-16 Test for simulated events

Time consuming code

2024-01-16 Test Summary

2024-01-17 Test for simulated events with minor modifications

Test variation

Time consuming code

Results

Single core processing

80-core processing for ranks 0, 30, and 60

2024-01-17 Test Summary

2024-01-19 Test for a few hosts

2024-01-19 Time difference vs array size

2024-01-19-22 Test Summary

2024-01-22 Q&A

2024-01-30 running in subprocesses

Simultaneous processing on cpu 0-7 of the same host

Simultaneous processing on cpu 1, 8, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96 of the same host

2024-01-31 time consumption test in subprocess

Algorithm code

Per-event time split

Summary for time consumption

2024-02-01 scaling for groups of busy cpus of the same host

Summary of the group test

References