You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 36 Next »

Issue

2024-01-04 email from Chris
2024-01-04 1:22pm
Li, Yee Ting;
Kroeger, Wilko
Hi Mikhail, (cc: Yee, Wilko since they may have an interest in this)

When you have a chance, could you look at the scaling behavior of this script.
It tries to "prefetch" the data from disk (for 100 events per core) with det.raw,
and then times the behavior of det.calib:

~cpo/problems/cxix1000021_scaling/cxix1000021_scaling.py

To do this get exclusive access to a batch node with this command:

srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash

The in another window ssh to the node that you have been allocated
(the reason this is necessary is obscure: it has to do with an incompatible
version of pmix used by srun that our mpi is unhappy with).
In that new window run these two commands:

mpirun -n 1 python cxix1000021_scaling.py
mpirun -n 80 python cxix1000021_scaling.py

For me the first one shows about .11s per event while the second shows about .25s per event,
which is the poor scaling behavior we would like to understand.
You can see logfiles in ~cpo/problems/cxix1000021_scaling in interactive_1core.log and interactive_80core.log.

I think the fundamental question that I hope you could answer is:
do all numpy operations in det.calib slow down on 80 cores,
or is there some other cause for the poor scaling?
From discussions we've had with Yee we suspect the poor scaling may
be due to behavior of the hardware, but we don't know for sure.

Happy to discuss this with you on zoom at any time, of course.
Thanks for looking at this!

chris

p.s. following a suggestion by someone (Yee? Wilko?)
I watched the cpu clock speeds in /proc/cpuinfo while the 80 core job was running.
To my eye they seemed to vary between ~2.4MHz and ~3.0Mhz which didn't feel like quite enough

List of commands for this test

commands for test
> s3dflogin
> psana
srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash
Ex:
ana-4.0.58-py3 [dubrovin@sdfiana001:~/LCLS/con-py3]$ srun --partition milano --account lcls:prjdat21 -n 1 --time=01:00:00 --exclusive --pty /bin/bash
srun: job 37602834 queued and waiting for resources
srun: job 37602834 has been allocated resources
In .bashrc on host sdfiana001
In .bash_login
ana-4.0.58-py3 [dubrovin@sdfmilan031:~/LCLS/con-py3]$

grab example from Chris:
~cpo/problems/cxix1000021_scaling/cxix1000021_scaling.py
and modify it as explained below.

In other window
> s3dflogin
ssh -Y sdfmilan031
cd LCLS/con-py3
source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/psconda.sh
source /sdf/group/lcls/ds/ana/sw/conda1/manage/bin/setup_testrel

mpirun -n 1 python test-cxix1000021_scaling.py
mpirun -n 80 python test-cxix1000021_scaling.py

Code for time monitoring

calib_jungfrau with inserted timing point
def calib_jungfrau(det, evt, cmpars=(7,3,200,10), **kwa):
    """
    Returns calibrated jungfrau data

    - gets constants
    - gets raw data
    - evaluates (code - pedestal - offset)
    - applys common mode correction if turned on
    - apply gain factor

    Parameters

    - det (psana.Detector) - Detector object
    - evt (psana.Event)    - Event object
    - cmpars (tuple) - common mode parameters
        - cmpars[0] - algorithm # 7-for jungfrau
        - cmpars[1] - control bit-word 1-in rows, 2-in columns
        - cmpars[2] - maximal applied correction
    - **kwa - used here and passed to det.mask_v2 or det.mask_comb
      - nda_raw - if not None, substitutes evt.raw()
      - mbits - DEPRECATED parameter of the det.mask_comb(...)
      - mask - user defined mask passed as optional parameter
    """

    t00 = time()

    src = det.source # - src (psana.Source)   - Source object

    nda_raw = kwa.get('nda_raw', None)
    arr = det.raw(evt) if nda_raw is None else nda_raw # shape:(<npanels>, 512, 1024) dtype:uint16
    if arr is None: return None

    t01 = time()

    peds = det.pedestals(evt) # - 4d pedestals shape:(3, 1, 512, 1024) dtype:float32
    if peds is None: return None

    t02 = time()

    gain = det.gain(evt)      # - 4d gains
    offs = det.offset(evt)    # - 4d offset

    t03 = time()

    detname = string_from_source(det.source)
    cmp = det.common_mode(evt) if cmpars is None else cmpars

    t04 = time()

    if gain is None: gain = np.ones_like(peds)  # - 4d gains
    if offs is None: offs = np.zeros_like(peds) # - 4d gains

    # cache
    gfac = store.gfac.get(detname, None) # det.name
    if gfac is None:
       gfac = divide_protected(np.ones_like(peds), gain)
       store.gfac[detname] = gfac
       store.arr1 = np.ones_like(arr, dtype=np.int8)

    t05 = time()

    # Define bool arrays of ranges
    # faster than bit operations
    gr0 = arr <  BW1              # 490 us
    gr1 =(arr >= BW1) & (arr<BW2) # 714 us
    gr2 = arr >= BW3              # 400 us

    t06 = time()

    # Subtract pedestals
    arrf = np.array(arr & MSK, dtype=np.float32)

    t07 = time()

    arrf[gr0] -= peds[0,gr0]
    arrf[gr1] -= peds[1,gr1] #- arrf[gr1]
    arrf[gr2] -= peds[2,gr2] #- arrf[gr2]

    t08 = time()

    factor = np.select((gr0, gr1, gr2), (gfac[0,:], gfac[1,:], gfac[2,:]), default=1) # 2msec

    t09 = time()

    offset = np.select((gr0, gr1, gr2), (offs[0,:], offs[1,:], offs[2,:]), default=0)

    t10 = time()

    arrf -= offset # Apply offset correction

    t11 = time()

    if store.mask is None:
       store.mask = det.mask_total(evt, **kwa)
    mask = store.mask

    t12 = time()

    if cmp is not None:
      mode, cormax = int(cmp[1]), cmp[2]
      npixmin = cmp[3] if len(cmp)>3 else 10
      if mode>0:
        #arr1 = store.arr1
        #grhg = np.select((gr0,  gr1), (arr1, arr1), default=0)
        logger.debug(info_ndarr(gr0, 'gain group0'))
        logger.debug(info_ndarr(mask, 'mask'))
        t0_sec_cm = time()
        gmask = np.bitwise_and(gr0, mask) if mask is not None else gr0
        #sh = (nsegs, 512, 1024)
        hrows = 256 #512/2
        for s in range(arrf.shape[0]):
          if mode & 4: # in banks: (512/2,1024/16) = (256,64) pixels # 100 ms
            common_mode_2d_hsplit_nbanks(arrf[s,:hrows,:], mask=gmask[s,:hrows,:], nbanks=16, cormax=cormax, npix_min=npixmin)
            common_mode_2d_hsplit_nbanks(arrf[s,hrows:,:], mask=gmask[s,hrows:,:], nbanks=16, cormax=cormax, npix_min=npixmin)

          if mode & 1: # in rows per bank: 1024/16 = 64 pixels # 275 ms
            common_mode_rows_hsplit_nbanks(arrf[s,], mask=gmask[s,], nbanks=16, cormax=cormax, npix_min=npixmin)

          if mode & 2: # in cols per bank: 512/2 = 256 pixels  # 290 ms
            common_mode_cols(arrf[s,:hrows,:], mask=gmask[s,:hrows,:], cormax=cormax, npix_min=npixmin)
            common_mode_cols(arrf[s,hrows:,:], mask=gmask[s,hrows:,:], cormax=cormax, npix_min=npixmin)

        logger.debug('TIME: common-mode correction time = %.6f sec' % (time()-t0_sec_cm))

    t13 = time()

    resp = arrf * factor if mask is None else arrf * factor * mask # gain correction

    t14 = time()
    times = np.array((t00, t01, t02, t03, t04, t05, t06, t07, t08, t09, t10, t11, t12, t13, t14), dtype=np.float64)

    return resp, times

Timing histograms

Single core processing

80-core processing for ranks 0, 30, and 60

Results

Table shows mean time increment and their statistical uncertainty from associated histograms.

t pointtime incrementpoint descriptiontime for rank 0/1rank 0/80rank 30/80rank 60/80
1t1 - t0det.raw0.8±0.2 ms4.0 ±0.6 ms3.2±0.4 ms3.5 ±0.8 ms
2t2 - t1det.pedestals15±3 μs36 ±10 μs31±6 μs39 ±17 μs
3t3 - t2det.gain,offset15±2 μs27 ±4 μs26±4 μs27 ±6 μs
4...cmpars25±1 μs50 ±7 μs58±26 μs71 ±33 μs
5
gfac2±0 μs6 ±1 μs7±1 μs7 ±2 μs
6
gr0,1,21.3±0.2 ms10.5 ±1.1 ms7.0±0.9 ms9.7 ±1.6 ms
7
make arrf1.76±0.05 ms9.2 ±0.9 ms6.3±0.7 ms9.0 ±1.5 ms
8
subtract peds93.7±3.1 ms191 ±11 ms181±15 ms259 ±26 ms
9
eval gain factor for gain ranges4.9±0.6 ms20.3 ±1.5 ms14.6±1.2 ms17.3 ±2.0 ms
10
eval offset for gain ranges6.2±0.4 ms18.5 ±1.3 ms18.4±1.4 ms19.2 ±2.1 ms
11
subtract offset1.0±0.2 ms6.0 ±0.7 ms5.3±0.6 ms6.2 ±1.2 ms
12
get mask3±2 μs6 ±2 μs6±2 μs7 ±2 μs
13
common mode turned off7±1 μs15 ±2 μs17±2 μs20 ±3 μs
14t14 - t13apply gain factor and mask4.0±0.7 ms14.9 ±2.0 ms13.9±1.6 ms19.2 ±3.5 ms
99t14 - t0per evt time, inside det.calib109.8±4.2 ms276 ±15 ms247±13 ms345 ±29 ms
0t0 - t0 previous evttime between consecutive det.calib115.4±3.9 ms335 ±16 ms307±14 ms398 ±32 ms

Summary

  • single core processing is faster than per/core time in 80–core case, factor 2.5-3 FOR ALL OPERATIONS
  • in 80-core case: time per core is consistent between cores
  • all constants are cashed and access to constants is fast at sub-milisecond level
  • common mode correction is turned off, as well as mask?
  • most time consuming operation is indexed pedestal subtraction
indexed by gain ranges pedestal subtraction
    t07 = time()

    arrf[gr0] -= peds[0,gr0]
    arrf[gr1] -= peds[1,gr1]
    arrf[gr2] -= peds[2,gr2]

    t08 = time() 
  • bad single-to-multicore scaling issue has nothing to do with particular algorithm, it is common problem for any algorithm

2024-01-16 Test for simulated events

Time consuming code

Time consuming code
def time_consuming_algorithm():
    sh2d = (1024,1024)
    sh3d = (3,) + sh2d
    a = random_standard(shape=sh2d, mu=10, sigma=2, dtype=np.float64)
    b = random_standard(shape=sh3d, mu=20, sigma=3, dtype=np.float64)
    gr1 = a>=11
    gr2 = (a>9) & (a<11)
    gr3 = a<=9
    a[gr1] -= b[0, gr1]
    a[gr2] -= b[1, gr2]
    a[gr3] -= b[2, gr3]

2024-01-16 Test Summary

  • runing on sdfmilan031 - shows minor ~ 5% the mean time difference between 1-core and 80-core processing is larger

2024-01-17 Test for simulated events with minor modifications

Test variation

  • array shape is changed from (1024, 1024) → (8*512, 1024) 4M
  • array generation is excluded from time measurement, only indexed subtraction contributes to time measurement
  • do not pre-create random arrays, it is generated in each core... requires too much memory for all cores.
  • run on sdfmilan047: ana-4.0.58-py3 [dubrovin@sdfmilan047:~/LCLS/con-py3]$ mpirun -n 80 python test-mpi-numpy-hist.py

Time consuming code

Time consuming code
def time_consuming_algorithm(a, b):
    gr1 = a>=11
    gr2 = (a>9) & (a<11)
    gr3 = a<=9
    t0_sec = time()
    a[gr1] -= b[0, gr1]
    a[gr2] -= b[1, gr2]
    a[gr3] -= b[2, gr3]
    return time() - t0_sec

Results

Single core processing

80-core processing for ranks 0, 30, and 60

2024-01-17 Test Summary

  • if random array generation is excluded from time measurement, the mean time difference between 1-core and 80-core processing is larger
  • the main contribution to time difference comes from reserved host...
    • sdfmilan047 - looks like extremely "time-noisy" in multi-core processing...
    • sdfmilan031 -  in previous test looks pretty "calm"

2024-01-19 Test for a few hosts

  • The same simulation algorithm as before is used to compare processing time of different cores.
  • To get rid of obvious fluctuation off time measurement between cores, a sample of cores is extended from three, 0,30,60 to seven 0,10,20,30,40,50,60 of 80. 
  • Mean processing time and its uncertainty in milliseconds for single core (core 0/1) and a few cores of 80 are shown in table.
  • Ratio represents the ratio of 80-core average over core 0/1.
host namecore 0/10/8010/8020/8030/8040/8050/8060/8070/8080-core averageRatioLargest ratio
sdfmilan027192 ±6241 ±19430 ±32336 ±24287 ±16245 ±17412 ±30342 ±24
327.61.712.24
sdfmilan049210 ±1280 ±19369 ±28245 ±45282 ±17290 ±24367 ±28242 ±37
296.41.411.75
sdfmilan056191 ±3328 ±21269 ±40258 ±32347 ±28324 ±22254 ±34346 ±30
303.71.591.82
sdfmilan057190 ±4262 ±20292 ±21439 ±26226 ±12256 ±19297 ±20467 ±36
319.91.682.46
sdfmilan065203 ±7281 ±15345 ±23245 ±22248 ±20276 ±15353 ±24250 ±22
285.41.411.74
sdfmilan105190 ±2261 ±36277 ±20282 ±15276 ±14263 ±48273 ±19284 ±26
273.71.441.49
sdfmilan130190 ±3394 ±26270 ±23323 ±20230 ±10379 ±27276 ±24322 ±20
313.41.652.07
sdfmilan202210 ±0346 ±32351 ±28281 ±16286 ±16355 ±34345 ±28297 ±16
323.01.541.69
sdfmilan203191 ±4281 ±26355 ±31288 ±26332 ±44271 ±32347 ±26282 ±21
308.01.611.86
sdfmilan225204 ±7409 ±29296 ±23230 ±10230 ±10398 ±26289 ±24232 ±9
297.71.462.00

sdfmilan213

cpu_num

293 6

0

339 ±18

13

355 ±22

45

605 ±104

74

388 ±27

103

337 ±18

5

361 ±21

44

613 ±95

72

422 ±27

106

427.51.462.09

sdfmilan047

cpu_num

210 1

0

639 ±34

8

483 ±219

32

474 ±284

65

744 ±75

104

637 ±43

40

588 ±266

36

443 ±202

67

722 ±75

110

590.82.813.54

sdfmilan220

cpu_num

210 1

0

649 ±29

7


669 ±134

34

500 ±214

76

1039 ±95

105

707 ±50

10

654 ±113

40

490 ±229

72

1040 ±83

104

718.53.424.95

Last 3 lines in table also show cpu_num to prevent contribution from weka nodes

Wilko & Chris about weka nodes
2024-01-19 6:24PM
Hi Mikhail,
I think those code can fetch a physical core number:
>>> import psutil
>>> print(psutil.Process().cpu_num())
3
>>>
Can you add that to your numpy tests to make sure that cores 16-23 aren’t used by your mpi processes?  I think Wilko thought those 8 cores run weka filesystem processes.
Thanks, and have a good weekend,
chris

2024-01-19 Time difference vs array size

  • shape is decreased in size from (8*512,1024) to (2*512,1024) 1M
host namecore 0/10/8010/8020/8030/8040/8050/8060/8070/8080-core averageRatioLargest ratio
sdfmilan03947.6 ±0.756.0 ±2.559.2 ±4.759.9 ±6.352.8 ±3.456.3 ±2.458.6 ±5.051.2 ±9.951.3 ±3.355.71.171.26
sdfmilan22547.6 ±0.556.6 ±3.255.4 ±4.252.8 ±2.452.3 ±2.355.8 ±3.855.3 ±3.552.5 ±2.552.0 ±2.454.11.141.19


  • shape is increased in size from (32*512,1024) 16M
host namecore 0/10/8010/8020/8030/8040/8050/8060/8070/8080-core averageRatioLargest ratio
sdfmilan225766 ±201251 ±91 1099 ±108958 ±174955 ±1991206 ±831086 ±106949 ±181952 ±23110571.381.63
sdfmilan031760 ±11141 ±81 1144 ±94910 ±111947 ±1181221 ±741157 ±93947 ±108937 ±10410511.381.61

2024-01-19-22 Test Summary

  • weka FS nodes do not show up in processing ranks
  • decreasing array size from 4M to 1M decreases time ratio from ~1.5 to 1.15
  • increasing array size from 4M to 14M does not increases time ratio...

2024-01-22 Q&A

cpu_num = psutil.Process().cpu_num() vs runk

  • rank and cpu number are linked for all events
  • cpu number assigned to rank differently for each job
  • 16 ≤ cpu_num ≤ 23 - are not found in data processing
sdfmilan125 linking between rank and cpu_num
rank:20 cpu_num:073 nevt:044 time:0.277427
rank:10 cpu_num:046 nevt:030 time:0.632612
rank:00 cpu_num:000 nevt:046 time:0.651162
rank:20 cpu_num:073 nevt:045 time:0.266946
rank:10 cpu_num:046 nevt:031 time:0.272130
rank:00 cpu_num:000 nevt:047 time:0.574547
rank:20 cpu_num:073 nevt:046 time:0.329882
rank:10 cpu_num:046 nevt:032 time:0.287877
rank:00 cpu_num:000 nevt:048 time:0.493901
rank:20 cpu_num:073 nevt:047 time:0.436152
rank:10 cpu_num:046 nevt:033 time:0.902722
rank:00 cpu_num:000 nevt:049 time:0.505073
rank:20 cpu_num:073 nevt:048 time:0.272120
rank:00 cpu_num:000 nevt:050 time:0.519510
rank:20 cpu_num:073 nevt:049 time:0.360761
rank:10 cpu_num:046 nevt:034 time:0.555629
rank:20 cpu_num:073 nevt:050 time:0.291751
rank:00 cpu_num:000 nevt:051 time:0.666105
rank:10 cpu_num:046 nevt:035 time:0.371877
rank:20 cpu_num:073 nevt:051 time:0.764429
rank:00 cpu_num:000 nevt:052 time:0.672750
rank:20 cpu_num:073 nevt:052 time:0.325827
rank:00 cpu_num:000 nevt:053 time:0.328918
rank:10 cpu_num:046 nevt:036 time:0.332080
rank:00 cpu_num:000 nevt:054 time:0.358017
rank:20 cpu_num:073 nevt:053 time:0.290833
rank:10 cpu_num:046 nevt:037 time:0.980106
rank:00 cpu_num:000 nevt:055 time:0.487292
rank:20 cpu_num:073 nevt:054 time:0.333488
host namejob #core 0/10/8010/8020/8030/8040/8050/8060/8070/80
sdfmilan215108366611124167101
sdfmilan215201139719714266103
sdfmilan2153044069101103377107


2024-01-30 running in subprocesses

On allocated host run the same time consuming job on specified cpu using subprocess command

taskset --cpu-list %d python test-scaling-subproc.py %d

Simultaneous processing on cpu 0-7 of the same host

host namecpu 01234567
sdfmilan027213 ±10218 ±14216 ±9215 ±10217 ±9212 ±8215 1±2217 ±12
time [sec] consumption per algorithm and pre entire event
requested cpu:001
cpu_num:001 nevt:000 time algo/total:0.258310/0.893963
cpu_num:001 nevt:010 time algo/total:0.203578/0.765441
cpu_num:001 nevt:020 time algo/total:0.204886/0.758621
cpu_num:001 nevt:030 time algo/total:0.207257/0.776058
cpu_num:001 nevt:040 time algo/total:0.240543/0.818005
cpu_num:001 nevt:050 time algo/total:0.219791/0.780273
cpu_num:001 nevt:060 time algo/total:0.221798/0.781831
cpu_num:001 nevt:070 time algo/total:0.227552/0.787389
cpu_num:001 nevt:080 time algo/total:0.224095/0.778408
cpu_num:001 nevt:090 time algo/total:0.226634/0.779186

Simultaneous processing on cpu 1, 8, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96 of the same host

host name1824324048566472808896
sdfmilan027199 ±7194 ±6191 ±4208 ±5210 ±1210 ±1201 ±7209 ±5210 ±3194 ±7192 ±6191 ±3
time [sec] consumption per algorithm and pre entire event
requested cpu:096
cpu_num:096 nevt:000 time algo/total:0.201525/0.750702
cpu_num:096 nevt:010 time algo/total:0.200815/0.742284
cpu_num:096 nevt:020 time algo/total:0.199862/0.738482
cpu_num:096 nevt:030 time algo/total:0.200478/0.742564
cpu_num:096 nevt:040 time algo/total:0.200695/0.741042
cpu_num:096 nevt:050 time algo/total:0.199134/0.736679
cpu_num:096 nevt:060 time algo/total:0.198478/0.736582
cpu_num:096 nevt:070 time algo/total:0.198812/0.737684
cpu_num:096 nevt:080 time algo/total:0.200575/0.742578
cpu_num:096 nevt:090 time algo/total:0.200512/0.737443


2024-01-31 time consumption test in subprocess

Try to resolve mystery observed in previous test:

  • time consuming algorithm takes ~200ms
  • but time per event is ~740ms

Algorithm code

method time_consuming_code
def time_consuming_algorithm():
    t01 = time()
    a, b = random_arrays()
    t02 = time()
    gr1 = a>=11
    gr2 = (a>9) & (a<11)
    gr3 = a<=9
    t03 = time()
    a[gr1] -= b[0, gr1]
    a[gr2] -= b[1, gr2]
    a[gr3] -= b[2, gr3]
    t04 = time()
    return (t01, t02, t03, t04)
code simulating the event loop
def do_algo(cpu=0):

    hostname = get_hostname()
    #cpu_num = psutil.Process().cpu_num()
    print('requested cpu:%03d' % cpu)

    SAVE_FIGS = True
    nevents = 100
    ntpoints = 6
    arrts = np.zeros((nevents,ntpoints), dtype=np.float64)
    t05_old = time()

    for nevt in range(nevents):
        t00 = time()
        times = time_consuming_algorithm()
        cpu_num = psutil.Process().cpu_num()
        #if cpu_num >=16 and cpu_num <=23:
        #    print('cpu_num:%03d nevt:%03d time:%.6f CPU_NUM IN WEKA RANGE [16,23]' % (cpu_num, nevt, dt_sec))
        t05 = time()
        times = (t00,) + times + (t05,)
        arrts[nevt,:] = times
        dt_evt = t05 - t05_old
        t05_old = t05
        if nevt%10>0: continue
        dt_alg = times[4] - times[3]
        dt_in  = times[4] - times[1]
        print('cpu_num:%03d nevt:%03d  times (sec)' % (cpu_num, nevt), \
             ' random arrs: %.6f' % (times[2] - times[1]), \
             ' indeces: %.6f'     % (times[3] - times[2]), \
             ' alg: %.6f'         % (times[4] - times[3]), \
             ' inside algo: %.6f' % (times[4] - times[1]), \
             ' per event: %.6f'   % dt_evt)
        ...
        fill-out and show histograms

Per-event time split

per-event time split
requested cpu:010
cpu_num:010 nevt:000  times (sec)  random arrs: 0.530126  indeces: 0.009856  alg: 0.201348  inside algo: 0.741331  per event: 0.742876
cpu_num:010 nevt:010  times (sec)  random arrs: 0.529047  indeces: 0.006796  alg: 0.199449  inside algo: 0.735292  per event: 0.736108
cpu_num:010 nevt:020  times (sec)  random arrs: 0.529192  indeces: 0.006795  alg: 0.200225  inside algo: 0.736212  per event: 0.736941
cpu_num:010 nevt:030  times (sec)  random arrs: 0.529076  indeces: 0.006807  alg: 0.198543  inside algo: 0.734425  per event: 0.735161
cpu_num:010 nevt:040  times (sec)  random arrs: 0.529014  indeces: 0.006840  alg: 0.198867  inside algo: 0.734720  per event: 0.735475
cpu_num:010 nevt:050  times (sec)  random arrs: 0.529560  indeces: 0.006824  alg: 0.199954  inside algo: 0.736338  per event: 0.737050
cpu_num:010 nevt:060  times (sec)  random arrs: 0.529004  indeces: 0.006804  alg: 0.198679  inside algo: 0.734487  per event: 0.735210
cpu_num:010 nevt:070  times (sec)  random arrs: 0.528883  indeces: 0.006833  alg: 0.199188  inside algo: 0.734903  per event: 0.735635
cpu_num:010 nevt:080  times (sec)  random arrs: 0.528968  indeces: 0.006804  alg: 0.199556  inside algo: 0.735327  per event: 0.736039
cpu_num:010 nevt:090  times (sec)  random arrs: 0.528690  indeces: 0.006826  alg: 0.199990  inside algo: 0.735506  per event: 0.736218

Summary for time consumption

Random array of shapes sh2d = (8*512,1024) and sh3d = (3, 8*512,1024) simulating raw data and calib constants takes ~0.5sec. In previous code only 2-panel shape (2*512,1024) was used.

host name

number

of CPU

cpu0123456789101112131415
sdfmilan12616220 16225 17225 16223 15227 14223 14225 15

229 14

224 16229 14227  14222 15221 16231 13228 15231 12

32334 24332 25335 22332 21343 23335 22323 21338 22351 24

340 22

345 23339 22331 20348 23354 23357 24
time split for cpu 15
at 16 cpu
requested cpu:015
cpu_num:015 nevt:000  times (sec)  random arrs: 0.676525  indeces: 0.048282  alg: 0.345061  inside algo: 1.069867  per event: 1.073267
cpu_num:015 nevt:010  times (sec)  random arrs: 0.557514  indeces: 0.012086  alg: 0.243178  inside algo: 0.812778  per event: 0.813630
cpu_num:015 nevt:020  times (sec)  random arrs: 0.551355  indeces: 0.008622  alg: 0.257315  inside algo: 0.817291  per event: 0.818175
cpu_num:015 nevt:030  times (sec)  random arrs: 0.556352  indeces: 0.008508  alg: 0.241447  inside algo: 0.806307  per event: 0.807756
cpu_num:015 nevt:040  times (sec)  random arrs: 0.553430  indeces: 0.010278  alg: 0.211174  inside algo: 0.774882  per event: 0.777263
cpu_num:015 nevt:050  times (sec)  random arrs: 0.549226  indeces: 0.009555  alg: 0.217025  inside algo: 0.775806  per event: 0.776775
cpu_num:015 nevt:060  times (sec)  random arrs: 0.556838  indeces: 0.011403  alg: 0.218301  inside algo: 0.786542  per event: 0.787381
cpu_num:015 nevt:070  times (sec)  random arrs: 0.564118  indeces: 0.013997  alg: 0.220398  inside algo: 0.798513  per event: 0.799616
cpu_num:015 nevt:080  times (sec)  random arrs: 0.558824  indeces: 0.014296  alg: 0.218725  inside algo: 0.791845  per event: 0.793981
cpu_num:015 nevt:090  times (sec)  random arrs: 0.552467  indeces: 0.013539  alg: 0.241585  inside algo: 0.807591  per event: 0.808606

===
at 32 cpu

requested cpu:000
cpu_num:000 nevt:000  times (sec)  random arrs: 0.768741  indeces: 0.130826  alg: 0.534536  inside algo: 1.434103  per event: 1.437331
cpu_num:000 nevt:010  times (sec)  random arrs: 0.707944  indeces: 0.084266  alg: 0.306825  inside algo: 1.099035  per event: 1.099948
cpu_num:000 nevt:020  times (sec)  random arrs: 0.708561  indeces: 0.069767  alg: 0.378666  inside algo: 1.156994  per event: 1.158244
cpu_num:000 nevt:030  times (sec)  random arrs: 0.761646  indeces: 0.061286  alg: 0.378687  inside algo: 1.201619  per event: 1.202453
cpu_num:000 nevt:040  times (sec)  random arrs: 0.631669  indeces: 0.014007  alg: 0.269451  inside algo: 0.915127  per event: 0.916927
cpu_num:000 nevt:050  times (sec)  random arrs: 0.711132  indeces: 0.067868  alg: 0.366595  inside algo: 1.145596  per event: 1.146980
cpu_num:000 nevt:060  times (sec)  random arrs: 0.664688  indeces: 0.087194  alg: 0.469769  inside algo: 1.221651  per event: 1.223267
cpu_num:000 nevt:070  times (sec)  random arrs: 0.735930  indeces: 0.022596  alg: 0.321454  inside algo: 1.079980  per event: 1.081903
cpu_num:000 nevt:080  times (sec)  random arrs: 0.697990  indeces: 0.071118  alg: 0.263736  inside algo: 1.032844  per event: 1.033743
cpu_num:000 nevt:090  times (sec)  random arrs: 0.577298  indeces: 0.008807  alg: 0.209763  inside algo: 0.795867  per event: 0.796584

requested cpu:015
cpu_num:015 nevt:000  times (sec)  random arrs: 0.891085  indeces: 0.074366  alg: 0.475267  inside algo: 1.440718  per event: 1.443656
cpu_num:015 nevt:010  times (sec)  random arrs: 0.646901  indeces: 0.029601  alg: 0.506834  inside algo: 1.183336  per event: 1.188114
cpu_num:015 nevt:020  times (sec)  random arrs: 0.641244  indeces: 0.020880  alg: 0.362483  inside algo: 1.024606  per event: 1.025537
cpu_num:015 nevt:030  times (sec)  random arrs: 0.653975  indeces: 0.038478  alg: 0.283170  inside algo: 0.975623  per event: 0.976723
cpu_num:015 nevt:040  times (sec)  random arrs: 0.724432  indeces: 0.104294  alg: 0.365113  inside algo: 1.193839  per event: 1.196620
cpu_num:015 nevt:050  times (sec)  random arrs: 0.669759  indeces: 0.027769  alg: 0.264526  inside algo: 0.962054  per event: 0.967170
cpu_num:015 nevt:060  times (sec)  random arrs: 0.717789  indeces: 0.017697  alg: 0.332127  inside algo: 1.067613  per event: 1.069825
cpu_num:015 nevt:070  times (sec)  random arrs: 0.677717  indeces: 0.034877  alg: 0.261328  inside algo: 0.973923  per event: 0.975290
cpu_num:015 nevt:080  times (sec)  random arrs: 0.575024  indeces: 0.029689  alg: 0.380944  inside algo: 0.985657  per event: 0.989201
cpu_num:015 nevt:090  times (sec)  random arrs: 0.605548  indeces: 0.025510  alg: 0.289985  inside algo: 0.921044  per event: 0.921819

requested cpu:039
cpu_num:039 nevt:000  times (sec)  random arrs: 0.648366  indeces: 0.042368  alg: 0.421943  inside algo: 1.112678  per event: 1.114263
cpu_num:039 nevt:010  times (sec)  random arrs: 0.583670  indeces: 0.014271  alg: 0.249655  inside algo: 0.847596  per event: 0.848407
cpu_num:039 nevt:020  times (sec)  random arrs: 0.571773  indeces: 0.011460  alg: 0.220845  inside algo: 0.804077  per event: 0.806523
cpu_num:039 nevt:030  times (sec)  random arrs: 0.574509  indeces: 0.011243  alg: 0.228133  inside algo: 0.813885  per event: 0.814791
cpu_num:039 nevt:040  times (sec)  random arrs: 0.573384  indeces: 0.013692  alg: 0.228176  inside algo: 0.815251  per event: 0.816023
cpu_num:039 nevt:050  times (sec)  random arrs: 0.589361  indeces: 0.019947  alg: 0.227057  inside algo: 0.836365  per event: 0.837242
cpu_num:039 nevt:060  times (sec)  random arrs: 0.578790  indeces: 0.028885  alg: 0.233790  inside algo: 0.841465  per event: 0.842652
cpu_num:039 nevt:070  times (sec)  random arrs: 0.580031  indeces: 0.009300  alg: 0.220303  inside algo: 0.809635  per event: 0.810407
cpu_num:039 nevt:080  times (sec)  random arrs: 0.631875  indeces: 0.014580  alg: 0.232713  inside algo: 0.879168  per event: 0.879986
cpu_num:039 nevt:090  times (sec)  random arrs: 0.613904  indeces: 0.025082  alg: 0.244429  inside algo: 0.883415  per event: 0.884130


2024-02-01 scaling for groups of busy cpus of the same host

single cpu running job for a few of them
hostname:sdfmilan114 cpu:005 cmt:v1 proc time (sec) mean: 0.210 +/- 0.002 rms: 0.002 +/- 0.001
hostname:sdfmilan114 cpu:010 cmt:v1 proc time (sec) mean: 0.210 +/- 0.006 rms: 0.007 +/- 0.004
hostname:sdfmilan114 cpu:032 cmt:v1 proc time (sec) mean: 0.206 +/- 0.007 rms: 0.008 +/- 0.005
hostname:sdfmilan114 cpu:064 cmt:v1 proc time (sec) mean: 0.226 +/- 0.006 rms: 0.008 +/- 0.005
hostname:sdfmilan114 cpu:096 cmt:v1 proc time (sec) mean: 0.217 +/- 0.007 rms: 0.009 +/- 0.005
hostname:sdfmilan114 cpu:127 cmt:v1 proc time (sec) mean: 0.220 +/- 0.007 rms: 0.010 +/- 0.005
CPU 0-7
hostname:sdfmilan114 cpu:000 cmt:v0-7 proc time (sec) mean: 0.215 +/- 0.017 rms: 0.020 +/- 0.012
hostname:sdfmilan114 cpu:001 cmt:v0-7 proc time (sec) mean: 0.217 +/- 0.014 rms: 0.018 +/- 0.010
hostname:sdfmilan114 cpu:002 cmt:v0-7 proc time (sec) mean: 0.214 +/- 0.017 rms: 0.019 +/- 0.012
hostname:sdfmilan114 cpu:003 cmt:v0-7 proc time (sec) mean: 0.213 +/- 0.018 rms: 0.019 +/- 0.012
hostname:sdfmilan114 cpu:004 cmt:v0-7 proc time (sec) mean: 0.213 +/- 0.016 rms: 0.017 +/- 0.011
hostname:sdfmilan114 cpu:005 cmt:v0-7 proc time (sec) mean: 0.215 +/- 0.023 rms: 0.025 +/- 0.016
hostname:sdfmilan114 cpu:006 cmt:v0-7 proc time (sec) mean: 0.216 +/- 0.022 rms: 0.026 +/- 0.016
hostname:sdfmilan114 cpu:007 cmt:v0-7 proc time (sec) mean: 0.218 +/- 0.017 rms: 0.022 +/- 0.012
mean time (sec): 0.2151
figs/fig-subpr-v0-7-sdfmilan114-summary-ordered.txt
CPU 0,8,24,32,40,...96
hostname:sdfmilan114 cpu:000 cmt:vx8 proc time (sec) mean: 0.209 +/- 0.007 rms: 0.008 +/- 0.005
hostname:sdfmilan114 cpu:008 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.012 rms: 0.013 +/- 0.009
hostname:sdfmilan114 cpu:024 cmt:vx8 proc time (sec) mean: 0.195 +/- 0.009 rms: 0.011 +/- 0.006
hostname:sdfmilan114 cpu:032 cmt:vx8 proc time (sec) mean: 0.211 +/- 0.010 rms: 0.010 +/- 0.007
hostname:sdfmilan114 cpu:040 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.004 rms: 0.004 +/- 0.003
hostname:sdfmilan114 cpu:048 cmt:vx8 proc time (sec) mean: 0.211 +/- 0.010 rms: 0.010 +/- 0.007
hostname:sdfmilan114 cpu:056 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.012 rms: 0.013 +/- 0.009
hostname:sdfmilan114 cpu:064 cmt:vx8 proc time (sec) mean: 0.211 +/- 0.006 rms: 0.006 +/- 0.004
hostname:sdfmilan114 cpu:072 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.002 rms: 0.002 +/- 0.001
hostname:sdfmilan114 cpu:080 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.004 rms: 0.004 +/- 0.003
hostname:sdfmilan114 cpu:088 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.004 rms: 0.004 +/- 0.003
hostname:sdfmilan114 cpu:096 cmt:vx8 proc time (sec) mean: 0.210 +/- 0.002 rms: 0.002 +/- 0.001
mean time (sec): 0.2089
figs/fig-subpr-vx8-sdfmilan114-summary-ordered.txt
CPU 0-15
hostname:sdfmilan114 cpu:000 cmt:v16 proc time (sec) mean: 0.221 +/- 0.040 rms: 0.050 +/- 0.028
hostname:sdfmilan114 cpu:001 cmt:v16 proc time (sec) mean: 0.220 +/- 0.044 rms: 0.050 +/- 0.031
hostname:sdfmilan114 cpu:002 cmt:v16 proc time (sec) mean: 0.220 +/- 0.045 rms: 0.050 +/- 0.032
hostname:sdfmilan114 cpu:003 cmt:v16 proc time (sec) mean: 0.221 +/- 0.043 rms: 0.052 +/- 0.030
hostname:sdfmilan114 cpu:004 cmt:v16 proc time (sec) mean: 0.220 +/- 0.045 rms: 0.052 +/- 0.032
hostname:sdfmilan114 cpu:005 cmt:v16 proc time (sec) mean: 0.219 +/- 0.043 rms: 0.047 +/- 0.031
hostname:sdfmilan114 cpu:006 cmt:v16 proc time (sec) mean: 0.224 +/- 0.035 rms: 0.049 +/- 0.025
hostname:sdfmilan114 cpu:007 cmt:v16 proc time (sec) mean: 0.220 +/- 0.039 rms: 0.048 +/- 0.028
hostname:sdfmilan114 cpu:008 cmt:v16 proc time (sec) mean: 0.222 +/- 0.045 rms: 0.053 +/- 0.032
hostname:sdfmilan114 cpu:009 cmt:v16 proc time (sec) mean: 0.218 +/- 0.037 rms: 0.043 +/- 0.026
hostname:sdfmilan114 cpu:010 cmt:v16 proc time (sec) mean: 0.219 +/- 0.051 rms: 0.055 +/- 0.036
hostname:sdfmilan114 cpu:011 cmt:v16 proc time (sec) mean: 0.221 +/- 0.042 rms: 0.049 +/- 0.029
hostname:sdfmilan114 cpu:012 cmt:v16 proc time (sec) mean: 0.220 +/- 0.037 rms: 0.043 +/- 0.026
hostname:sdfmilan114 cpu:013 cmt:v16 proc time (sec) mean: 0.222 +/- 0.039 rms: 0.047 +/- 0.028
hostname:sdfmilan114 cpu:014 cmt:v16 proc time (sec) mean: 0.220 +/- 0.049 rms: 0.055 +/- 0.035
hostname:sdfmilan114 cpu:015 cmt:v16 proc time (sec) mean: 0.220 +/- 0.041 rms: 0.046 +/- 0.029
mean time (sec): 0.2204
figs/fig-subpr-v16-sdfmilan114-summary-ordered.txt 
CPU groups of 32, 0-31 excluding weka, 32-63, 64-95, 96-127
hostname:sdfmilan114 cpu:000 cmt:v32_1 proc time (sec) mean: 0.431 +/- 0.032 rms: 0.139 +/- 0.022
hostname:sdfmilan114 cpu:001 cmt:v32_1 proc time (sec) mean: 0.435 +/- 0.037 rms: 0.158 +/- 0.026
hostname:sdfmilan114 cpu:002 cmt:v32_1 proc time (sec) mean: 0.435 +/- 0.035 rms: 0.155 +/- 0.025
hostname:sdfmilan114 cpu:003 cmt:v32_1 proc time (sec) mean: 0.436 +/- 0.033 rms: 0.149 +/- 0.023
hostname:sdfmilan114 cpu:004 cmt:v32_1 proc time (sec) mean: 0.427 +/- 0.032 rms: 0.146 +/- 0.023
hostname:sdfmilan114 cpu:005 cmt:v32_1 proc time (sec) mean: 0.437 +/- 0.034 rms: 0.156 +/- 0.024
hostname:sdfmilan114 cpu:006 cmt:v32_1 proc time (sec) mean: 0.438 +/- 0.035 rms: 0.147 +/- 0.025
hostname:sdfmilan114 cpu:007 cmt:v32_1 proc time (sec) mean: 0.441 +/- 0.038 rms: 0.162 +/- 0.027
hostname:sdfmilan114 cpu:008 cmt:v32_1 proc time (sec) mean: 0.458 +/- 0.035 rms: 0.158 +/- 0.025
hostname:sdfmilan114 cpu:009 cmt:v32_1 proc time (sec) mean: 0.449 +/- 0.032 rms: 0.147 +/- 0.023
hostname:sdfmilan114 cpu:010 cmt:v32_1 proc time (sec) mean: 0.450 +/- 0.031 rms: 0.147 +/- 0.022
hostname:sdfmilan114 cpu:011 cmt:v32_1 proc time (sec) mean: 0.456 +/- 0.036 rms: 0.160 +/- 0.025
hostname:sdfmilan114 cpu:012 cmt:v32_1 proc time (sec) mean: 0.449 +/- 0.031 rms: 0.148 +/- 0.022
hostname:sdfmilan114 cpu:013 cmt:v32_1 proc time (sec) mean: 0.442 +/- 0.032 rms: 0.148 +/- 0.023
hostname:sdfmilan114 cpu:014 cmt:v32_1 proc time (sec) mean: 0.443 +/- 0.031 rms: 0.146 +/- 0.022
hostname:sdfmilan114 cpu:015 cmt:v32_1 proc time (sec) mean: 0.457 +/- 0.035 rms: 0.155 +/- 0.025
hostname:sdfmilan114 cpu:024 cmt:v32_1 proc time (sec) mean: 0.271 +/- 0.032 rms: 0.068 +/- 0.022
hostname:sdfmilan114 cpu:025 cmt:v32_1 proc time (sec) mean: 0.261 +/- 0.034 rms: 0.073 +/- 0.024
hostname:sdfmilan114 cpu:026 cmt:v32_1 proc time (sec) mean: 0.245 +/- 0.031 rms: 0.053 +/- 0.022
hostname:sdfmilan114 cpu:027 cmt:v32_1 proc time (sec) mean: 0.269 +/- 0.032 rms: 0.072 +/- 0.022
hostname:sdfmilan114 cpu:028 cmt:v32_1 proc time (sec) mean: 0.253 +/- 0.041 rms: 0.072 +/- 0.029
hostname:sdfmilan114 cpu:029 cmt:v32_1 proc time (sec) mean: 0.256 +/- 0.032 rms: 0.060 +/- 0.023
hostname:sdfmilan114 cpu:030 cmt:v32_1 proc time (sec) mean: 0.268 +/- 0.032 rms: 0.070 +/- 0.023
hostname:sdfmilan114 cpu:031 cmt:v32_1 proc time (sec) mean: 0.282 +/- 0.030 rms: 0.076 +/- 0.021
hostname:sdfmilan114 cpu:032 cmt:v32_1 proc time (sec) mean: 0.300 +/- 0.022 rms: 0.065 +/- 0.016
hostname:sdfmilan114 cpu:033 cmt:v32_1 proc time (sec) mean: 0.308 +/- 0.024 rms: 0.064 +/- 0.017
hostname:sdfmilan114 cpu:034 cmt:v32_1 proc time (sec) mean: 0.290 +/- 0.019 rms: 0.051 +/- 0.014
hostname:sdfmilan114 cpu:035 cmt:v32_1 proc time (sec) mean: 0.279 +/- 0.023 rms: 0.058 +/- 0.017
hostname:sdfmilan114 cpu:036 cmt:v32_1 proc time (sec) mean: 0.280 +/- 0.017 rms: 0.045 +/- 0.012
hostname:sdfmilan114 cpu:037 cmt:v32_1 proc time (sec) mean: 0.275 +/- 0.019 rms: 0.047 +/- 0.013
hostname:sdfmilan114 cpu:038 cmt:v32_1 proc time (sec) mean: 0.312 +/- 0.021 rms: 0.061 +/- 0.015
hostname:sdfmilan114 cpu:039 cmt:v32_1 proc time (sec) mean: 0.281 +/- 0.026 rms: 0.066 +/- 0.019
mean time (sec): 0.3598
figs/fig-subpr-v32_1-sdfmilan114-summary-ordered.txt

tail -2000 figs/fig-subpr-v32_2-sdfmilan114-summary-ordered.txt

hostname:sdfmilan114 cpu:032 cmt:v32_2 proc time (sec) mean: 0.459 +/- 0.025 rms: 0.096 +/- 0.018
hostname:sdfmilan114 cpu:033 cmt:v32_2 proc time (sec) mean: 0.472 +/- 0.025 rms: 0.093 +/- 0.018
hostname:sdfmilan114 cpu:034 cmt:v32_2 proc time (sec) mean: 0.473 +/- 0.024 rms: 0.098 +/- 0.017
hostname:sdfmilan114 cpu:035 cmt:v32_2 proc time (sec) mean: 0.482 +/- 0.024 rms: 0.090 +/- 0.017
hostname:sdfmilan114 cpu:036 cmt:v32_2 proc time (sec) mean: 0.460 +/- 0.027 rms: 0.111 +/- 0.019
hostname:sdfmilan114 cpu:037 cmt:v32_2 proc time (sec) mean: 0.464 +/- 0.025 rms: 0.100 +/- 0.017
hostname:sdfmilan114 cpu:038 cmt:v32_2 proc time (sec) mean: 0.469 +/- 0.026 rms: 0.105 +/- 0.018
hostname:sdfmilan114 cpu:039 cmt:v32_2 proc time (sec) mean: 0.466 +/- 0.026 rms: 0.102 +/- 0.018
hostname:sdfmilan114 cpu:040 cmt:v32_2 proc time (sec) mean: 0.462 +/- 0.022 rms: 0.078 +/- 0.016
hostname:sdfmilan114 cpu:041 cmt:v32_2 proc time (sec) mean: 0.454 +/- 0.024 rms: 0.087 +/- 0.017
hostname:sdfmilan114 cpu:042 cmt:v32_2 proc time (sec) mean: 0.459 +/- 0.024 rms: 0.088 +/- 0.017
hostname:sdfmilan114 cpu:043 cmt:v32_2 proc time (sec) mean: 0.470 +/- 0.026 rms: 0.099 +/- 0.018
hostname:sdfmilan114 cpu:044 cmt:v32_2 proc time (sec) mean: 0.458 +/- 0.025 rms: 0.092 +/- 0.018
hostname:sdfmilan114 cpu:045 cmt:v32_2 proc time (sec) mean: 0.475 +/- 0.024 rms: 0.089 +/- 0.017
hostname:sdfmilan114 cpu:046 cmt:v32_2 proc time (sec) mean: 0.445 +/- 0.024 rms: 0.091 +/- 0.017
hostname:sdfmilan114 cpu:047 cmt:v32_2 proc time (sec) mean: 0.457 +/- 0.023 rms: 0.087 +/- 0.016
hostname:sdfmilan114 cpu:048 cmt:v32_2 proc time (sec) mean: 0.559 +/- 0.038 rms: 0.166 +/- 0.027
hostname:sdfmilan114 cpu:049 cmt:v32_2 proc time (sec) mean: 0.556 +/- 0.037 rms: 0.150 +/- 0.026
hostname:sdfmilan114 cpu:050 cmt:v32_2 proc time (sec) mean: 0.559 +/- 0.035 rms: 0.164 +/- 0.025
hostname:sdfmilan114 cpu:051 cmt:v32_2 proc time (sec) mean: 0.564 +/- 0.038 rms: 0.171 +/- 0.027
hostname:sdfmilan114 cpu:052 cmt:v32_2 proc time (sec) mean: 0.551 +/- 0.034 rms: 0.147 +/- 0.024
hostname:sdfmilan114 cpu:053 cmt:v32_2 proc time (sec) mean: 0.554 +/- 0.037 rms: 0.160 +/- 0.026
hostname:sdfmilan114 cpu:054 cmt:v32_2 proc time (sec) mean: 0.560 +/- 0.036 rms: 0.155 +/- 0.026
hostname:sdfmilan114 cpu:055 cmt:v32_2 proc time (sec) mean: 0.560 +/- 0.036 rms: 0.151 +/- 0.025
hostname:sdfmilan114 cpu:056 cmt:v32_2 proc time (sec) mean: 0.572 +/- 0.034 rms: 0.151 +/- 0.024
hostname:sdfmilan114 cpu:057 cmt:v32_2 proc time (sec) mean: 0.585 +/- 0.041 rms: 0.171 +/- 0.029
hostname:sdfmilan114 cpu:058 cmt:v32_2 proc time (sec) mean: 0.570 +/- 0.039 rms: 0.161 +/- 0.027
hostname:sdfmilan114 cpu:059 cmt:v32_2 proc time (sec) mean: 0.586 +/- 0.037 rms: 0.168 +/- 0.026
hostname:sdfmilan114 cpu:060 cmt:v32_2 proc time (sec) mean: 0.585 +/- 0.038 rms: 0.173 +/- 0.027
hostname:sdfmilan114 cpu:061 cmt:v32_2 proc time (sec) mean: 0.586 +/- 0.034 rms: 0.155 +/- 0.024
hostname:sdfmilan114 cpu:062 cmt:v32_2 proc time (sec) mean: 0.586 +/- 0.035 rms: 0.154 +/- 0.025
hostname:sdfmilan114 cpu:063 cmt:v32_2 proc time (sec) mean: 0.574 +/- 0.035 rms: 0.162 +/- 0.025
mean time (sec): 0.5166

tail -2000 figs/fig-subpr-v32_3-sdfmilan114-summary-ordered.txt

hostname:sdfmilan114 cpu:064 cmt:v32_3 proc time (sec) mean: 0.474 +/- 0.028 rms: 0.117 +/- 0.020
hostname:sdfmilan114 cpu:065 cmt:v32_3 proc time (sec) mean: 0.476 +/- 0.029 rms: 0.120 +/- 0.021
hostname:sdfmilan114 cpu:066 cmt:v32_3 proc time (sec) mean: 0.486 +/- 0.030 rms: 0.118 +/- 0.021
hostname:sdfmilan114 cpu:067 cmt:v32_3 proc time (sec) mean: 0.481 +/- 0.030 rms: 0.124 +/- 0.021
hostname:sdfmilan114 cpu:068 cmt:v32_3 proc time (sec) mean: 0.477 +/- 0.028 rms: 0.112 +/- 0.020
hostname:sdfmilan114 cpu:069 cmt:v32_3 proc time (sec) mean: 0.466 +/- 0.027 rms: 0.110 +/- 0.019
hostname:sdfmilan114 cpu:070 cmt:v32_3 proc time (sec) mean: 0.489 +/- 0.029 rms: 0.116 +/- 0.021
hostname:sdfmilan114 cpu:071 cmt:v32_3 proc time (sec) mean: 0.472 +/- 0.028 rms: 0.113 +/- 0.020
hostname:sdfmilan114 cpu:072 cmt:v32_3 proc time (sec) mean: 0.476 +/- 0.028 rms: 0.119 +/- 0.020
hostname:sdfmilan114 cpu:073 cmt:v32_3 proc time (sec) mean: 0.482 +/- 0.030 rms: 0.117 +/- 0.021
hostname:sdfmilan114 cpu:074 cmt:v32_3 proc time (sec) mean: 0.470 +/- 0.030 rms: 0.122 +/- 0.021
hostname:sdfmilan114 cpu:075 cmt:v32_3 proc time (sec) mean: 0.465 +/- 0.028 rms: 0.117 +/- 0.020
hostname:sdfmilan114 cpu:076 cmt:v32_3 proc time (sec) mean: 0.466 +/- 0.031 rms: 0.131 +/- 0.022
hostname:sdfmilan114 cpu:077 cmt:v32_3 proc time (sec) mean: 0.467 +/- 0.029 rms: 0.125 +/- 0.021
hostname:sdfmilan114 cpu:078 cmt:v32_3 proc time (sec) mean: 0.461 +/- 0.029 rms: 0.123 +/- 0.020
hostname:sdfmilan114 cpu:079 cmt:v32_3 proc time (sec) mean: 0.473 +/- 0.029 rms: 0.120 +/- 0.020
hostname:sdfmilan114 cpu:080 cmt:v32_3 proc time (sec) mean: 0.422 +/- 0.028 rms: 0.118 +/- 0.020
hostname:sdfmilan114 cpu:081 cmt:v32_3 proc time (sec) mean: 0.426 +/- 0.029 rms: 0.117 +/- 0.020
hostname:sdfmilan114 cpu:082 cmt:v32_3 proc time (sec) mean: 0.429 +/- 0.028 rms: 0.122 +/- 0.020
hostname:sdfmilan114 cpu:083 cmt:v32_3 proc time (sec) mean: 0.426 +/- 0.029 rms: 0.118 +/- 0.021
hostname:sdfmilan114 cpu:084 cmt:v32_3 proc time (sec) mean: 0.427 +/- 0.028 rms: 0.118 +/- 0.020
hostname:sdfmilan114 cpu:085 cmt:v32_3 proc time (sec) mean: 0.434 +/- 0.029 rms: 0.111 +/- 0.021
hostname:sdfmilan114 cpu:086 cmt:v32_3 proc time (sec) mean: 0.426 +/- 0.029 rms: 0.123 +/- 0.020
hostname:sdfmilan114 cpu:087 cmt:v32_3 proc time (sec) mean: 0.442 +/- 0.029 rms: 0.125 +/- 0.021
hostname:sdfmilan114 cpu:088 cmt:v32_3 proc time (sec) mean: 0.430 +/- 0.030 rms: 0.114 +/- 0.021
hostname:sdfmilan114 cpu:089 cmt:v32_3 proc time (sec) mean: 0.438 +/- 0.028 rms: 0.120 +/- 0.020
hostname:sdfmilan114 cpu:090 cmt:v32_3 proc time (sec) mean: 0.430 +/- 0.028 rms: 0.125 +/- 0.020
hostname:sdfmilan114 cpu:091 cmt:v32_3 proc time (sec) mean: 0.429 +/- 0.026 rms: 0.113 +/- 0.019
hostname:sdfmilan114 cpu:092 cmt:v32_3 proc time (sec) mean: 0.418 +/- 0.027 rms: 0.115 +/- 0.019
hostname:sdfmilan114 cpu:093 cmt:v32_3 proc time (sec) mean: 0.425 +/- 0.027 rms: 0.118 +/- 0.019
hostname:sdfmilan114 cpu:094 cmt:v32_3 proc time (sec) mean: 0.422 +/- 0.027 rms: 0.116 +/- 0.019
hostname:sdfmilan114 cpu:095 cmt:v32_3 proc time (sec) mean: 0.432 +/- 0.027 rms: 0.110 +/- 0.019
mean time (sec): 0.4512

tail -2000 figs/fig-subpr-v32_4-sdfmilan114-summary-ordered.txt

hostname:sdfmilan114 cpu:096 cmt:v32_4 proc time (sec) mean: 0.519 +/- 0.027 rms: 0.099 +/- 0.019
hostname:sdfmilan114 cpu:097 cmt:v32_4 proc time (sec) mean: 0.527 +/- 0.030 rms: 0.104 +/- 0.021
hostname:sdfmilan114 cpu:098 cmt:v32_4 proc time (sec) mean: 0.523 +/- 0.027 rms: 0.102 +/- 0.019
hostname:sdfmilan114 cpu:099 cmt:v32_4 proc time (sec) mean: 0.528 +/- 0.027 rms: 0.094 +/- 0.019
hostname:sdfmilan114 cpu:100 cmt:v32_4 proc time (sec) mean: 0.518 +/- 0.031 rms: 0.118 +/- 0.022
hostname:sdfmilan114 cpu:101 cmt:v32_4 proc time (sec) mean: 0.522 +/- 0.029 rms: 0.109 +/- 0.021
hostname:sdfmilan114 cpu:102 cmt:v32_4 proc time (sec) mean: 0.508 +/- 0.027 rms: 0.104 +/- 0.019
hostname:sdfmilan114 cpu:103 cmt:v32_4 proc time (sec) mean: 0.524 +/- 0.029 rms: 0.111 +/- 0.020
hostname:sdfmilan114 cpu:104 cmt:v32_4 proc time (sec) mean: 0.533 +/- 0.030 rms: 0.111 +/- 0.021
hostname:sdfmilan114 cpu:105 cmt:v32_4 proc time (sec) mean: 0.543 +/- 0.030 rms: 0.108 +/- 0.021
hostname:sdfmilan114 cpu:106 cmt:v32_4 proc time (sec) mean: 0.535 +/- 0.032 rms: 0.114 +/- 0.023
hostname:sdfmilan114 cpu:107 cmt:v32_4 proc time (sec) mean: 0.538 +/- 0.033 rms: 0.112 +/- 0.023
hostname:sdfmilan114 cpu:108 cmt:v32_4 proc time (sec) mean: 0.545 +/- 0.030 rms: 0.106 +/- 0.021
hostname:sdfmilan114 cpu:109 cmt:v32_4 proc time (sec) mean: 0.551 +/- 0.031 rms: 0.106 +/- 0.022
hostname:sdfmilan114 cpu:110 cmt:v32_4 proc time (sec) mean: 0.547 +/- 0.030 rms: 0.116 +/- 0.021
hostname:sdfmilan114 cpu:111 cmt:v32_4 proc time (sec) mean: 0.536 +/- 0.034 rms: 0.114 +/- 0.024
hostname:sdfmilan114 cpu:112 cmt:v32_4 proc time (sec) mean: 0.617 +/- 0.037 rms: 0.170 +/- 0.026
hostname:sdfmilan114 cpu:113 cmt:v32_4 proc time (sec) mean: 0.617 +/- 0.038 rms: 0.174 +/- 0.027
hostname:sdfmilan114 cpu:114 cmt:v32_4 proc time (sec) mean: 0.625 +/- 0.038 rms: 0.168 +/- 0.027
hostname:sdfmilan114 cpu:115 cmt:v32_4 proc time (sec) mean: 0.623 +/- 0.034 rms: 0.162 +/- 0.024
hostname:sdfmilan114 cpu:116 cmt:v32_4 proc time (sec) mean: 0.622 +/- 0.039 rms: 0.173 +/- 0.028
hostname:sdfmilan114 cpu:117 cmt:v32_4 proc time (sec) mean: 0.607 +/- 0.034 rms: 0.156 +/- 0.024
hostname:sdfmilan114 cpu:118 cmt:v32_4 proc time (sec) mean: 0.593 +/- 0.035 rms: 0.163 +/- 0.025
hostname:sdfmilan114 cpu:119 cmt:v32_4 proc time (sec) mean: 0.611 +/- 0.034 rms: 0.170 +/- 0.024
hostname:sdfmilan114 cpu:120 cmt:v32_4 proc time (sec) mean: 0.623 +/- 0.041 rms: 0.184 +/- 0.029
hostname:sdfmilan114 cpu:121 cmt:v32_4 proc time (sec) mean: 0.622 +/- 0.040 rms: 0.186 +/- 0.028
hostname:sdfmilan114 cpu:122 cmt:v32_4 proc time (sec) mean: 0.621 +/- 0.041 rms: 0.184 +/- 0.029
hostname:sdfmilan114 cpu:123 cmt:v32_4 proc time (sec) mean: 0.635 +/- 0.045 rms: 0.181 +/- 0.032
hostname:sdfmilan114 cpu:124 cmt:v32_4 proc time (sec) mean: 0.619 +/- 0.039 rms: 0.176 +/- 0.028
hostname:sdfmilan114 cpu:125 cmt:v32_4 proc time (sec) mean: 0.632 +/- 0.043 rms: 0.184 +/- 0.030
hostname:sdfmilan114 cpu:126 cmt:v32_4 proc time (sec) mean: 0.618 +/- 0.035 rms: 0.177 +/- 0.025
hostname:sdfmilan114 cpu:127 cmt:v32_4 proc time (sec) mean: 0.616 +/- 0.039 rms: 0.182 +/- 0.028
mean time (sec): 0.5749
CPU 0-69 and group 64-127
hostname:sdfmilan114 cpu:000 cmt:v64-1 proc time (sec) mean: 0.938 +/- 0.060 rms: 0.259 +/- 0.042
hostname:sdfmilan114 cpu:001 cmt:v64-1 proc time (sec) mean: 0.906 +/- 0.052 rms: 0.236 +/- 0.037
hostname:sdfmilan114 cpu:002 cmt:v64-1 proc time (sec) mean: 0.914 +/- 0.054 rms: 0.245 +/- 0.038
hostname:sdfmilan114 cpu:003 cmt:v64-1 proc time (sec) mean: 0.937 +/- 0.070 rms: 0.273 +/- 0.050
hostname:sdfmilan114 cpu:004 cmt:v64-1 proc time (sec) mean: 0.957 +/- 0.066 rms: 0.250 +/- 0.046
hostname:sdfmilan114 cpu:005 cmt:v64-1 proc time (sec) mean: 0.937 +/- 0.056 rms: 0.242 +/- 0.039
hostname:sdfmilan114 cpu:006 cmt:v64-1 proc time (sec) mean: 0.941 +/- 0.059 rms: 0.248 +/- 0.042
hostname:sdfmilan114 cpu:007 cmt:v64-1 proc time (sec) mean: 0.930 +/- 0.063 rms: 0.246 +/- 0.045
hostname:sdfmilan114 cpu:008 cmt:v64-1 proc time (sec) mean: 0.895 +/- 0.047 rms: 0.241 +/- 0.033
hostname:sdfmilan114 cpu:009 cmt:v64-1 proc time (sec) mean: 0.908 +/- 0.044 rms: 0.206 +/- 0.031
hostname:sdfmilan114 cpu:010 cmt:v64-1 proc time (sec) mean: 0.925 +/- 0.049 rms: 0.233 +/- 0.035
hostname:sdfmilan114 cpu:011 cmt:v64-1 proc time (sec) mean: 0.906 +/- 0.044 rms: 0.208 +/- 0.031
hostname:sdfmilan114 cpu:012 cmt:v64-1 proc time (sec) mean: 0.910 +/- 0.049 rms: 0.225 +/- 0.035
hostname:sdfmilan114 cpu:013 cmt:v64-1 proc time (sec) mean: 0.903 +/- 0.044 rms: 0.223 +/- 0.031
hostname:sdfmilan114 cpu:014 cmt:v64-1 proc time (sec) mean: 0.928 +/- 0.045 rms: 0.208 +/- 0.032
hostname:sdfmilan114 cpu:015 cmt:v64-1 proc time (sec) mean: 0.917 +/- 0.048 rms: 0.222 +/- 0.034
hostname:sdfmilan114 cpu:024 cmt:v64-1 proc time (sec) mean: 0.524 +/- 0.029 rms: 0.130 +/- 0.021
hostname:sdfmilan114 cpu:025 cmt:v64-1 proc time (sec) mean: 0.473 +/- 0.042 rms: 0.178 +/- 0.030
hostname:sdfmilan114 cpu:026 cmt:v64-1 proc time (sec) mean: 0.446 +/- 0.043 rms: 0.170 +/- 0.030
hostname:sdfmilan114 cpu:027 cmt:v64-1 proc time (sec) mean: 0.424 +/- 0.045 rms: 0.155 +/- 0.032
hostname:sdfmilan114 cpu:028 cmt:v64-1 proc time (sec) mean: 0.423 +/- 0.042 rms: 0.140 +/- 0.030
hostname:sdfmilan114 cpu:029 cmt:v64-1 proc time (sec) mean: 0.467 +/- 0.045 rms: 0.176 +/- 0.032
hostname:sdfmilan114 cpu:030 cmt:v64-1 proc time (sec) mean: 0.437 +/- 0.043 rms: 0.163 +/- 0.030
hostname:sdfmilan114 cpu:031 cmt:v64-1 proc time (sec) mean: 0.478 +/- 0.033 rms: 0.152 +/- 0.023
hostname:sdfmilan114 cpu:032 cmt:v64-1 proc time (sec) mean: 0.631 +/- 0.037 rms: 0.158 +/- 0.026
hostname:sdfmilan114 cpu:033 cmt:v64-1 proc time (sec) mean: 0.631 +/- 0.037 rms: 0.162 +/- 0.026
hostname:sdfmilan114 cpu:034 cmt:v64-1 proc time (sec) mean: 0.596 +/- 0.041 rms: 0.184 +/- 0.029
hostname:sdfmilan114 cpu:035 cmt:v64-1 proc time (sec) mean: 0.630 +/- 0.044 rms: 0.195 +/- 0.031
hostname:sdfmilan114 cpu:036 cmt:v64-1 proc time (sec) mean: 0.629 +/- 0.036 rms: 0.160 +/- 0.026
hostname:sdfmilan114 cpu:037 cmt:v64-1 proc time (sec) mean: 0.620 +/- 0.039 rms: 0.171 +/- 0.028
hostname:sdfmilan114 cpu:038 cmt:v64-1 proc time (sec) mean: 0.630 +/- 0.036 rms: 0.150 +/- 0.025
hostname:sdfmilan114 cpu:039 cmt:v64-1 proc time (sec) mean: 0.622 +/- 0.036 rms: 0.164 +/- 0.025
hostname:sdfmilan114 cpu:040 cmt:v64-1 proc time (sec) mean: 0.626 +/- 0.038 rms: 0.162 +/- 0.027
hostname:sdfmilan114 cpu:041 cmt:v64-1 proc time (sec) mean: 0.615 +/- 0.038 rms: 0.169 +/- 0.027
hostname:sdfmilan114 cpu:042 cmt:v64-1 proc time (sec) mean: 0.585 +/- 0.034 rms: 0.155 +/- 0.024
hostname:sdfmilan114 cpu:043 cmt:v64-1 proc time (sec) mean: 0.609 +/- 0.039 rms: 0.174 +/- 0.027
hostname:sdfmilan114 cpu:044 cmt:v64-1 proc time (sec) mean: 0.628 +/- 0.035 rms: 0.161 +/- 0.025
hostname:sdfmilan114 cpu:045 cmt:v64-1 proc time (sec) mean: 0.608 +/- 0.034 rms: 0.152 +/- 0.024
hostname:sdfmilan114 cpu:046 cmt:v64-1 proc time (sec) mean: 0.597 +/- 0.033 rms: 0.148 +/- 0.023
hostname:sdfmilan114 cpu:047 cmt:v64-1 proc time (sec) mean: 0.603 +/- 0.032 rms: 0.147 +/- 0.022
hostname:sdfmilan114 cpu:048 cmt:v64-1 proc time (sec) mean: 0.872 +/- 0.060 rms: 0.340 +/- 0.043
hostname:sdfmilan114 cpu:049 cmt:v64-1 proc time (sec) mean: 0.892 +/- 0.060 rms: 0.352 +/- 0.042
hostname:sdfmilan114 cpu:050 cmt:v64-1 proc time (sec) mean: 0.871 +/- 0.058 rms: 0.349 +/- 0.041
hostname:sdfmilan114 cpu:051 cmt:v64-1 proc time (sec) mean: 0.856 +/- 0.058 rms: 0.335 +/- 0.041
hostname:sdfmilan114 cpu:052 cmt:v64-1 proc time (sec) mean: 0.893 +/- 0.058 rms: 0.340 +/- 0.041
hostname:sdfmilan114 cpu:053 cmt:v64-1 proc time (sec) mean: 0.903 +/- 0.059 rms: 0.360 +/- 0.042
hostname:sdfmilan114 cpu:054 cmt:v64-1 proc time (sec) mean: 0.907 +/- 0.063 rms: 0.351 +/- 0.045
hostname:sdfmilan114 cpu:055 cmt:v64-1 proc time (sec) mean: 0.890 +/- 0.064 rms: 0.345 +/- 0.045
hostname:sdfmilan114 cpu:056 cmt:v64-1 proc time (sec) mean: 0.907 +/- 0.063 rms: 0.366 +/- 0.045
hostname:sdfmilan114 cpu:057 cmt:v64-1 proc time (sec) mean: 0.883 +/- 0.061 rms: 0.360 +/- 0.043
hostname:sdfmilan114 cpu:058 cmt:v64-1 proc time (sec) mean: 0.901 +/- 0.058 rms: 0.344 +/- 0.041
hostname:sdfmilan114 cpu:059 cmt:v64-1 proc time (sec) mean: 0.875 +/- 0.062 rms: 0.349 +/- 0.044
hostname:sdfmilan114 cpu:060 cmt:v64-1 proc time (sec) mean: 0.883 +/- 0.061 rms: 0.346 +/- 0.043
hostname:sdfmilan114 cpu:061 cmt:v64-1 proc time (sec) mean: 0.877 +/- 0.059 rms: 0.341 +/- 0.042
hostname:sdfmilan114 cpu:062 cmt:v64-1 proc time (sec) mean: 0.873 +/- 0.064 rms: 0.355 +/- 0.045
hostname:sdfmilan114 cpu:063 cmt:v64-1 proc time (sec) mean: 0.884 +/- 0.072 rms: 0.374 +/- 0.051
hostname:sdfmilan114 cpu:064 cmt:v64-1 proc time (sec) mean: 0.246 +/- 0.102 rms: 0.139 +/- 0.072
hostname:sdfmilan114 cpu:065 cmt:v64-1 proc time (sec) mean: 0.237 +/- 0.088 rms: 0.107 +/- 0.063
hostname:sdfmilan114 cpu:066 cmt:v64-1 proc time (sec) mean: 0.236 +/- 0.070 rms: 0.104 +/- 0.050
hostname:sdfmilan114 cpu:067 cmt:v64-1 proc time (sec) mean: 0.236 +/- 0.102 rms: 0.119 +/- 0.072
hostname:sdfmilan114 cpu:068 cmt:v64-1 proc time (sec) mean: 0.234 +/- 0.099 rms: 0.131 +/- 0.070
hostname:sdfmilan114 cpu:069 cmt:v64-1 proc time (sec) mean: 0.247 +/- 0.110 rms: 0.153 +/- 0.078
mean time (sec): 0.7079

hostname:sdfmilan114 cpu:064 cmt:v64-2 proc time (sec) mean: 1.037 +/- 0.082 rms: 0.438 +/- 0.058
hostname:sdfmilan114 cpu:065 cmt:v64-2 proc time (sec) mean: 1.039 +/- 0.075 rms: 0.423 +/- 0.053
hostname:sdfmilan114 cpu:066 cmt:v64-2 proc time (sec) mean: 1.043 +/- 0.079 rms: 0.439 +/- 0.056
hostname:sdfmilan114 cpu:067 cmt:v64-2 proc time (sec) mean: 1.045 +/- 0.082 rms: 0.416 +/- 0.058
hostname:sdfmilan114 cpu:068 cmt:v64-2 proc time (sec) mean: 1.028 +/- 0.080 rms: 0.424 +/- 0.056
hostname:sdfmilan114 cpu:069 cmt:v64-2 proc time (sec) mean: 1.055 +/- 0.077 rms: 0.438 +/- 0.055
hostname:sdfmilan114 cpu:070 cmt:v64-2 proc time (sec) mean: 1.037 +/- 0.074 rms: 0.421 +/- 0.052
hostname:sdfmilan114 cpu:071 cmt:v64-2 proc time (sec) mean: 1.034 +/- 0.083 rms: 0.443 +/- 0.059
hostname:sdfmilan114 cpu:072 cmt:v64-2 proc time (sec) mean: 1.045 +/- 0.079 rms: 0.431 +/- 0.056
hostname:sdfmilan114 cpu:073 cmt:v64-2 proc time (sec) mean: 1.057 +/- 0.078 rms: 0.414 +/- 0.055
hostname:sdfmilan114 cpu:074 cmt:v64-2 proc time (sec) mean: 1.044 +/- 0.076 rms: 0.432 +/- 0.054
hostname:sdfmilan114 cpu:075 cmt:v64-2 proc time (sec) mean: 1.037 +/- 0.073 rms: 0.403 +/- 0.052
hostname:sdfmilan114 cpu:076 cmt:v64-2 proc time (sec) mean: 1.027 +/- 0.071 rms: 0.383 +/- 0.050
hostname:sdfmilan114 cpu:077 cmt:v64-2 proc time (sec) mean: 1.021 +/- 0.066 rms: 0.385 +/- 0.047
hostname:sdfmilan114 cpu:078 cmt:v64-2 proc time (sec) mean: 1.023 +/- 0.080 rms: 0.410 +/- 0.056
hostname:sdfmilan114 cpu:079 cmt:v64-2 proc time (sec) mean: 1.043 +/- 0.078 rms: 0.408 +/- 0.055
hostname:sdfmilan114 cpu:080 cmt:v64-2 proc time (sec) mean: 0.947 +/- 0.057 rms: 0.288 +/- 0.040
hostname:sdfmilan114 cpu:081 cmt:v64-2 proc time (sec) mean: 0.948 +/- 0.053 rms: 0.275 +/- 0.038
hostname:sdfmilan114 cpu:082 cmt:v64-2 proc time (sec) mean: 0.976 +/- 0.055 rms: 0.294 +/- 0.039
hostname:sdfmilan114 cpu:083 cmt:v64-2 proc time (sec) mean: 0.954 +/- 0.050 rms: 0.279 +/- 0.035
hostname:sdfmilan114 cpu:084 cmt:v64-2 proc time (sec) mean: 0.979 +/- 0.055 rms: 0.293 +/- 0.039
hostname:sdfmilan114 cpu:085 cmt:v64-2 proc time (sec) mean: 0.982 +/- 0.052 rms: 0.277 +/- 0.037
hostname:sdfmilan114 cpu:086 cmt:v64-2 proc time (sec) mean: 0.982 +/- 0.058 rms: 0.301 +/- 0.041
hostname:sdfmilan114 cpu:087 cmt:v64-2 proc time (sec) mean: 0.956 +/- 0.057 rms: 0.297 +/- 0.041
hostname:sdfmilan114 cpu:088 cmt:v64-2 proc time (sec) mean: 0.956 +/- 0.059 rms: 0.312 +/- 0.042
hostname:sdfmilan114 cpu:089 cmt:v64-2 proc time (sec) mean: 0.967 +/- 0.063 rms: 0.317 +/- 0.044
hostname:sdfmilan114 cpu:090 cmt:v64-2 proc time (sec) mean: 0.958 +/- 0.062 rms: 0.327 +/- 0.044
hostname:sdfmilan114 cpu:091 cmt:v64-2 proc time (sec) mean: 0.945 +/- 0.058 rms: 0.300 +/- 0.041
hostname:sdfmilan114 cpu:092 cmt:v64-2 proc time (sec) mean: 0.958 +/- 0.058 rms: 0.308 +/- 0.041
hostname:sdfmilan114 cpu:093 cmt:v64-2 proc time (sec) mean: 0.960 +/- 0.065 rms: 0.316 +/- 0.046
hostname:sdfmilan114 cpu:094 cmt:v64-2 proc time (sec) mean: 0.963 +/- 0.066 rms: 0.335 +/- 0.047
hostname:sdfmilan114 cpu:095 cmt:v64-2 proc time (sec) mean: 0.955 +/- 0.059 rms: 0.318 +/- 0.042
hostname:sdfmilan114 cpu:096 cmt:v64-2 proc time (sec) mean: 0.773 +/- 0.039 rms: 0.178 +/- 0.027
hostname:sdfmilan114 cpu:097 cmt:v64-2 proc time (sec) mean: 0.764 +/- 0.045 rms: 0.199 +/- 0.032
hostname:sdfmilan114 cpu:098 cmt:v64-2 proc time (sec) mean: 0.775 +/- 0.038 rms: 0.179 +/- 0.027
hostname:sdfmilan114 cpu:099 cmt:v64-2 proc time (sec) mean: 0.773 +/- 0.038 rms: 0.167 +/- 0.027
hostname:sdfmilan114 cpu:100 cmt:v64-2 proc time (sec) mean: 0.802 +/- 0.043 rms: 0.216 +/- 0.030
hostname:sdfmilan114 cpu:101 cmt:v64-2 proc time (sec) mean: 0.776 +/- 0.040 rms: 0.195 +/- 0.028
hostname:sdfmilan114 cpu:102 cmt:v64-2 proc time (sec) mean: 0.767 +/- 0.039 rms: 0.175 +/- 0.027
hostname:sdfmilan114 cpu:103 cmt:v64-2 proc time (sec) mean: 0.777 +/- 0.040 rms: 0.194 +/- 0.028
hostname:sdfmilan114 cpu:104 cmt:v64-2 proc time (sec) mean: 0.752 +/- 0.037 rms: 0.169 +/- 0.026
hostname:sdfmilan114 cpu:105 cmt:v64-2 proc time (sec) mean: 0.749 +/- 0.035 rms: 0.154 +/- 0.025
hostname:sdfmilan114 cpu:106 cmt:v64-2 proc time (sec) mean: 0.783 +/- 0.035 rms: 0.161 +/- 0.025
hostname:sdfmilan114 cpu:107 cmt:v64-2 proc time (sec) mean: 0.745 +/- 0.035 rms: 0.151 +/- 0.025
hostname:sdfmilan114 cpu:108 cmt:v64-2 proc time (sec) mean: 0.763 +/- 0.037 rms: 0.160 +/- 0.026
hostname:sdfmilan114 cpu:109 cmt:v64-2 proc time (sec) mean: 0.780 +/- 0.034 rms: 0.148 +/- 0.024
hostname:sdfmilan114 cpu:110 cmt:v64-2 proc time (sec) mean: 0.778 +/- 0.035 rms: 0.163 +/- 0.025
hostname:sdfmilan114 cpu:111 cmt:v64-2 proc time (sec) mean: 0.799 +/- 0.036 rms: 0.162 +/- 0.025
hostname:sdfmilan114 cpu:112 cmt:v64-2 proc time (sec) mean: 0.927 +/- 0.043 rms: 0.232 +/- 0.031
hostname:sdfmilan114 cpu:113 cmt:v64-2 proc time (sec) mean: 0.933 +/- 0.043 rms: 0.238 +/- 0.031
hostname:sdfmilan114 cpu:114 cmt:v64-2 proc time (sec) mean: 0.949 +/- 0.047 rms: 0.242 +/- 0.033
hostname:sdfmilan114 cpu:115 cmt:v64-2 proc time (sec) mean: 0.937 +/- 0.045 rms: 0.239 +/- 0.032
hostname:sdfmilan114 cpu:116 cmt:v64-2 proc time (sec) mean: 0.948 +/- 0.046 rms: 0.239 +/- 0.032
hostname:sdfmilan114 cpu:117 cmt:v64-2 proc time (sec) mean: 0.938 +/- 0.046 rms: 0.219 +/- 0.032
hostname:sdfmilan114 cpu:118 cmt:v64-2 proc time (sec) mean: 0.936 +/- 0.042 rms: 0.222 +/- 0.030
hostname:sdfmilan114 cpu:119 cmt:v64-2 proc time (sec) mean: 0.942 +/- 0.044 rms: 0.235 +/- 0.031
hostname:sdfmilan114 cpu:120 cmt:v64-2 proc time (sec) mean: 0.937 +/- 0.048 rms: 0.262 +/- 0.034
hostname:sdfmilan114 cpu:121 cmt:v64-2 proc time (sec) mean: 0.929 +/- 0.048 rms: 0.262 +/- 0.034
hostname:sdfmilan114 cpu:122 cmt:v64-2 proc time (sec) mean: 0.933 +/- 0.048 rms: 0.262 +/- 0.034
hostname:sdfmilan114 cpu:123 cmt:v64-2 proc time (sec) mean: 0.931 +/- 0.046 rms: 0.256 +/- 0.032
hostname:sdfmilan114 cpu:124 cmt:v64-2 proc time (sec) mean: 0.931 +/- 0.044 rms: 0.247 +/- 0.031
hostname:sdfmilan114 cpu:125 cmt:v64-2 proc time (sec) mean: 0.927 +/- 0.046 rms: 0.262 +/- 0.033
hostname:sdfmilan114 cpu:126 cmt:v64-2 proc time (sec) mean: 0.922 +/- 0.047 rms: 0.244 +/- 0.033
hostname:sdfmilan114 cpu:127 cmt:v64-2 proc time (sec) mean: 0.941 +/- 0.048 rms: 0.268 +/- 0.034
mean time (sec): 0.9268 
112 CPU, all excluding weka
hostname:sdfmilan114 cpu:000 cmt:v112 proc time (sec) mean: 1.073 +/- 0.033 rms: 0.125 +/- 0.023
hostname:sdfmilan114 cpu:000 cmt:v112 proc time (sec) mean: 1.083 +/- 0.064 rms: 0.154 +/- 0.045
hostname:sdfmilan114 cpu:001 cmt:v112 proc time (sec) mean: 1.049 +/- 0.032 rms: 0.112 +/- 0.023
hostname:sdfmilan114 cpu:001 cmt:v112 proc time (sec) mean: 1.075 +/- 0.054 rms: 0.143 +/- 0.038
hostname:sdfmilan114 cpu:002 cmt:v112 proc time (sec) mean: 1.059 +/- 0.031 rms: 0.106 +/- 0.022
hostname:sdfmilan114 cpu:002 cmt:v112 proc time (sec) mean: 1.106 +/- 0.087 rms: 0.179 +/- 0.061
hostname:sdfmilan114 cpu:003 cmt:v112 proc time (sec) mean: 1.068 +/- 0.041 rms: 0.134 +/- 0.029
hostname:sdfmilan114 cpu:003 cmt:v112 proc time (sec) mean: 1.074 +/- 0.062 rms: 0.155 +/- 0.044
hostname:sdfmilan114 cpu:004 cmt:v112 proc time (sec) mean: 1.080 +/- 0.041 rms: 0.148 +/- 0.029
hostname:sdfmilan114 cpu:004 cmt:v112 proc time (sec) mean: 1.082 +/- 0.064 rms: 0.162 +/- 0.045
hostname:sdfmilan114 cpu:005 cmt:v112 proc time (sec) mean: 1.061 +/- 0.072 rms: 0.171 +/- 0.051
hostname:sdfmilan114 cpu:005 cmt:v112 proc time (sec) mean: 1.073 +/- 0.031 rms: 0.114 +/- 0.022
hostname:sdfmilan114 cpu:006 cmt:v112 proc time (sec) mean: 1.078 +/- 0.047 rms: 0.184 +/- 0.033
hostname:sdfmilan114 cpu:006 cmt:v112 proc time (sec) mean: 1.094 +/- 0.072 rms: 0.165 +/- 0.051
hostname:sdfmilan114 cpu:007 cmt:v112 proc time (sec) mean: 1.059 +/- 0.033 rms: 0.122 +/- 0.023
hostname:sdfmilan114 cpu:007 cmt:v112 proc time (sec) mean: 1.099 +/- 0.095 rms: 0.188 +/- 0.067
hostname:sdfmilan114 cpu:008 cmt:v112 proc time (sec) mean: 1.061 +/- 0.054 rms: 0.136 +/- 0.038
hostname:sdfmilan114 cpu:008 cmt:v112 proc time (sec) mean: 1.095 +/- 0.040 rms: 0.141 +/- 0.028
hostname:sdfmilan114 cpu:009 cmt:v112 proc time (sec) mean: 1.070 +/- 0.062 rms: 0.159 +/- 0.044
hostname:sdfmilan114 cpu:009 cmt:v112 proc time (sec) mean: 1.082 +/- 0.034 rms: 0.125 +/- 0.024
hostname:sdfmilan114 cpu:010 cmt:v112 proc time (sec) mean: 1.058 +/- 0.052 rms: 0.131 +/- 0.037
hostname:sdfmilan114 cpu:010 cmt:v112 proc time (sec) mean: 1.102 +/- 0.045 rms: 0.157 +/- 0.032
hostname:sdfmilan114 cpu:011 cmt:v112 proc time (sec) mean: 1.065 +/- 0.058 rms: 0.141 +/- 0.041
hostname:sdfmilan114 cpu:011 cmt:v112 proc time (sec) mean: 1.081 +/- 0.037 rms: 0.144 +/- 0.026
hostname:sdfmilan114 cpu:012 cmt:v112 proc time (sec) mean: 1.088 +/- 0.052 rms: 0.137 +/- 0.037
hostname:sdfmilan114 cpu:012 cmt:v112 proc time (sec) mean: 1.093 +/- 0.041 rms: 0.163 +/- 0.029
hostname:sdfmilan114 cpu:013 cmt:v112 proc time (sec) mean: 1.091 +/- 0.068 rms: 0.162 +/- 0.048
hostname:sdfmilan114 cpu:013 cmt:v112 proc time (sec) mean: 1.096 +/- 0.035 rms: 0.127 +/- 0.025
hostname:sdfmilan114 cpu:014 cmt:v112 proc time (sec) mean: 1.088 +/- 0.055 rms: 0.142 +/- 0.039
hostname:sdfmilan114 cpu:014 cmt:v112 proc time (sec) mean: 1.103 +/- 0.037 rms: 0.139 +/- 0.026
hostname:sdfmilan114 cpu:015 cmt:v112 proc time (sec) mean: 1.085 +/- 0.039 rms: 0.142 +/- 0.028
hostname:sdfmilan114 cpu:015 cmt:v112 proc time (sec) mean: 1.093 +/- 0.074 rms: 0.171 +/- 0.052
hostname:sdfmilan114 cpu:024 cmt:v112 proc time (sec) mean: 0.565 +/- 0.043 rms: 0.181 +/- 0.030
hostname:sdfmilan114 cpu:024 cmt:v112 proc time (sec) mean: 0.595 +/- 0.049 rms: 0.148 +/- 0.035
hostname:sdfmilan114 cpu:025 cmt:v112 proc time (sec) mean: 0.563 +/- 0.030 rms: 0.138 +/- 0.021
hostname:sdfmilan114 cpu:025 cmt:v112 proc time (sec) mean: 0.567 +/- 0.044 rms: 0.130 +/- 0.031
hostname:sdfmilan114 cpu:026 cmt:v112 proc time (sec) mean: 0.577 +/- 0.046 rms: 0.148 +/- 0.033
hostname:sdfmilan114 cpu:026 cmt:v112 proc time (sec) mean: 0.585 +/- 0.032 rms: 0.139 +/- 0.023
hostname:sdfmilan114 cpu:027 cmt:v112 proc time (sec) mean: 0.570 +/- 0.042 rms: 0.122 +/- 0.030
hostname:sdfmilan114 cpu:027 cmt:v112 proc time (sec) mean: 0.588 +/- 0.038 rms: 0.169 +/- 0.027
hostname:sdfmilan114 cpu:028 cmt:v112 proc time (sec) mean: 0.560 +/- 0.035 rms: 0.156 +/- 0.025
hostname:sdfmilan114 cpu:028 cmt:v112 proc time (sec) mean: 0.563 +/- 0.042 rms: 0.120 +/- 0.030
hostname:sdfmilan114 cpu:029 cmt:v112 proc time (sec) mean: 0.577 +/- 0.046 rms: 0.138 +/- 0.033
hostname:sdfmilan114 cpu:029 cmt:v112 proc time (sec) mean: 0.589 +/- 0.032 rms: 0.135 +/- 0.023
hostname:sdfmilan114 cpu:030 cmt:v112 proc time (sec) mean: 0.567 +/- 0.032 rms: 0.148 +/- 0.023
hostname:sdfmilan114 cpu:030 cmt:v112 proc time (sec) mean: 0.579 +/- 0.045 rms: 0.144 +/- 0.032
hostname:sdfmilan114 cpu:031 cmt:v112 proc time (sec) mean: 0.583 +/- 0.045 rms: 0.135 +/- 0.032
hostname:sdfmilan114 cpu:031 cmt:v112 proc time (sec) mean: 0.592 +/- 0.035 rms: 0.165 +/- 0.024
hostname:sdfmilan114 cpu:032 cmt:v112 proc time (sec) mean: 0.670 +/- 0.072 rms: 0.372 +/- 0.051
hostname:sdfmilan114 cpu:032 cmt:v112 proc time (sec) mean: 1.475 +/- 0.203 rms: 1.021 +/- 0.143
hostname:sdfmilan114 cpu:033 cmt:v112 proc time (sec) mean: 0.662 +/- 0.074 rms: 0.371 +/- 0.052
hostname:sdfmilan114 cpu:033 cmt:v112 proc time (sec) mean: 1.503 +/- 0.203 rms: 1.073 +/- 0.144
hostname:sdfmilan114 cpu:034 cmt:v112 proc time (sec) mean: 0.686 +/- 0.077 rms: 0.374 +/- 0.054
hostname:sdfmilan114 cpu:034 cmt:v112 proc time (sec) mean: 1.452 +/- 0.192 rms: 0.988 +/- 0.136
hostname:sdfmilan114 cpu:035 cmt:v112 proc time (sec) mean: 0.663 +/- 0.078 rms: 0.390 +/- 0.055
hostname:sdfmilan114 cpu:035 cmt:v112 proc time (sec) mean: 1.474 +/- 0.212 rms: 1.050 +/- 0.150
hostname:sdfmilan114 cpu:036 cmt:v112 proc time (sec) mean: 0.670 +/- 0.078 rms: 0.366 +/- 0.055
hostname:sdfmilan114 cpu:036 cmt:v112 proc time (sec) mean: 1.461 +/- 0.188 rms: 1.010 +/- 0.133
hostname:sdfmilan114 cpu:037 cmt:v112 proc time (sec) mean: 0.650 +/- 0.070 rms: 0.344 +/- 0.050
hostname:sdfmilan114 cpu:037 cmt:v112 proc time (sec) mean: 1.487 +/- 0.208 rms: 1.072 +/- 0.147
hostname:sdfmilan114 cpu:038 cmt:v112 proc time (sec) mean: 0.635 +/- 0.080 rms: 0.374 +/- 0.057
hostname:sdfmilan114 cpu:038 cmt:v112 proc time (sec) mean: 1.487 +/- 0.209 rms: 1.074 +/- 0.148
hostname:sdfmilan114 cpu:039 cmt:v112 proc time (sec) mean: 0.645 +/- 0.079 rms: 0.382 +/- 0.056
hostname:sdfmilan114 cpu:039 cmt:v112 proc time (sec) mean: 1.480 +/- 0.182 rms: 0.952 +/- 0.128
hostname:sdfmilan114 cpu:040 cmt:v112 proc time (sec) mean: 0.718 +/- 0.073 rms: 0.346 +/- 0.052
hostname:sdfmilan114 cpu:040 cmt:v112 proc time (sec) mean: 1.467 +/- 0.211 rms: 1.074 +/- 0.149
hostname:sdfmilan114 cpu:041 cmt:v112 proc time (sec) mean: 0.654 +/- 0.068 rms: 0.329 +/- 0.048
hostname:sdfmilan114 cpu:041 cmt:v112 proc time (sec) mean: 1.509 +/- 0.247 rms: 1.152 +/- 0.174
hostname:sdfmilan114 cpu:042 cmt:v112 proc time (sec) mean: 0.692 +/- 0.068 rms: 0.347 +/- 0.048
hostname:sdfmilan114 cpu:042 cmt:v112 proc time (sec) mean: 1.469 +/- 0.230 rms: 1.088 +/- 0.163
hostname:sdfmilan114 cpu:043 cmt:v112 proc time (sec) mean: 0.662 +/- 0.076 rms: 0.366 +/- 0.054
hostname:sdfmilan114 cpu:043 cmt:v112 proc time (sec) mean: 1.534 +/- 0.217 rms: 1.178 +/- 0.154
hostname:sdfmilan114 cpu:044 cmt:v112 proc time (sec) mean: 0.690 +/- 0.073 rms: 0.344 +/- 0.052
hostname:sdfmilan114 cpu:044 cmt:v112 proc time (sec) mean: 1.498 +/- 0.222 rms: 1.103 +/- 0.157
hostname:sdfmilan114 cpu:045 cmt:v112 proc time (sec) mean: 0.719 +/- 0.079 rms: 0.360 +/- 0.056
hostname:sdfmilan114 cpu:045 cmt:v112 proc time (sec) mean: 1.504 +/- 0.213 rms: 1.103 +/- 0.151
hostname:sdfmilan114 cpu:046 cmt:v112 proc time (sec) mean: 0.722 +/- 0.067 rms: 0.331 +/- 0.047
hostname:sdfmilan114 cpu:046 cmt:v112 proc time (sec) mean: 1.571 +/- 0.216 rms: 1.173 +/- 0.153
hostname:sdfmilan114 cpu:047 cmt:v112 proc time (sec) mean: 0.678 +/- 0.064 rms: 0.307 +/- 0.045
hostname:sdfmilan114 cpu:047 cmt:v112 proc time (sec) mean: 1.479 +/- 0.240 rms: 1.129 +/- 0.170
hostname:sdfmilan114 cpu:048 cmt:v112 proc time (sec) mean: 1.090 +/- 0.092 rms: 0.347 +/- 0.065
hostname:sdfmilan114 cpu:048 cmt:v112 proc time (sec) mean: 1.144 +/- 0.068 rms: 0.363 +/- 0.048
hostname:sdfmilan114 cpu:049 cmt:v112 proc time (sec) mean: 1.120 +/- 0.061 rms: 0.368 +/- 0.043
hostname:sdfmilan114 cpu:049 cmt:v112 proc time (sec) mean: 1.130 +/- 0.098 rms: 0.366 +/- 0.070
hostname:sdfmilan114 cpu:050 cmt:v112 proc time (sec) mean: 1.124 +/- 0.070 rms: 0.385 +/- 0.049
hostname:sdfmilan114 cpu:050 cmt:v112 proc time (sec) mean: 1.128 +/- 0.095 rms: 0.366 +/- 0.067
hostname:sdfmilan114 cpu:051 cmt:v112 proc time (sec) mean: 1.126 +/- 0.068 rms: 0.363 +/- 0.048
hostname:sdfmilan114 cpu:051 cmt:v112 proc time (sec) mean: 1.150 +/- 0.112 rms: 0.398 +/- 0.079
hostname:sdfmilan114 cpu:052 cmt:v112 proc time (sec) mean: 1.118 +/- 0.075 rms: 0.382 +/- 0.053
hostname:sdfmilan114 cpu:052 cmt:v112 proc time (sec) mean: 1.131 +/- 0.111 rms: 0.404 +/- 0.079
hostname:sdfmilan114 cpu:053 cmt:v112 proc time (sec) mean: 1.154 +/- 0.105 rms: 0.398 +/- 0.075
hostname:sdfmilan114 cpu:053 cmt:v112 proc time (sec) mean: 1.166 +/- 0.072 rms: 0.395 +/- 0.051
hostname:sdfmilan114 cpu:054 cmt:v112 proc time (sec) mean: 1.148 +/- 0.073 rms: 0.362 +/- 0.052
hostname:sdfmilan114 cpu:054 cmt:v112 proc time (sec) mean: 1.152 +/- 0.109 rms: 0.410 +/- 0.077
hostname:sdfmilan114 cpu:055 cmt:v112 proc time (sec) mean: 1.109 +/- 0.090 rms: 0.346 +/- 0.063
hostname:sdfmilan114 cpu:055 cmt:v112 proc time (sec) mean: 1.139 +/- 0.068 rms: 0.387 +/- 0.048
hostname:sdfmilan114 cpu:056 cmt:v112 proc time (sec) mean: 1.129 +/- 0.092 rms: 0.385 +/- 0.065
hostname:sdfmilan114 cpu:056 cmt:v112 proc time (sec) mean: 1.168 +/- 0.070 rms: 0.386 +/- 0.050
hostname:sdfmilan114 cpu:057 cmt:v112 proc time (sec) mean: 1.152 +/- 0.095 rms: 0.375 +/- 0.068
hostname:sdfmilan114 cpu:057 cmt:v112 proc time (sec) mean: 1.160 +/- 0.067 rms: 0.374 +/- 0.047
hostname:sdfmilan114 cpu:058 cmt:v112 proc time (sec) mean: 1.138 +/- 0.071 rms: 0.370 +/- 0.050
hostname:sdfmilan114 cpu:058 cmt:v112 proc time (sec) mean: 1.139 +/- 0.093 rms: 0.386 +/- 0.066
hostname:sdfmilan114 cpu:059 cmt:v112 proc time (sec) mean: 1.131 +/- 0.113 rms: 0.400 +/- 0.080
hostname:sdfmilan114 cpu:059 cmt:v112 proc time (sec) mean: 1.161 +/- 0.072 rms: 0.377 +/- 0.051
hostname:sdfmilan114 cpu:060 cmt:v112 proc time (sec) mean: 1.134 +/- 0.066 rms: 0.363 +/- 0.046
hostname:sdfmilan114 cpu:060 cmt:v112 proc time (sec) mean: 1.137 +/- 0.094 rms: 0.376 +/- 0.067
hostname:sdfmilan114 cpu:061 cmt:v112 proc time (sec) mean: 1.136 +/- 0.110 rms: 0.393 +/- 0.078
hostname:sdfmilan114 cpu:061 cmt:v112 proc time (sec) mean: 1.139 +/- 0.066 rms: 0.370 +/- 0.046
hostname:sdfmilan114 cpu:062 cmt:v112 proc time (sec) mean: 1.123 +/- 0.089 rms: 0.381 +/- 0.063
hostname:sdfmilan114 cpu:062 cmt:v112 proc time (sec) mean: 1.130 +/- 0.060 rms: 0.341 +/- 0.042
hostname:sdfmilan114 cpu:063 cmt:v112 proc time (sec) mean: 1.128 +/- 0.070 rms: 0.375 +/- 0.050
hostname:sdfmilan114 cpu:063 cmt:v112 proc time (sec) mean: 1.147 +/- 0.096 rms: 0.393 +/- 0.068
hostname:sdfmilan114 cpu:064 cmt:v112 proc time (sec) mean: 0.540 +/- 0.182 rms: 0.472 +/- 0.129
hostname:sdfmilan114 cpu:064 cmt:v112 proc time (sec) mean: 0.670 +/- 0.397 rms: 0.844 +/- 0.281
hostname:sdfmilan114 cpu:065 cmt:v112 proc time (sec) mean: 0.572 +/- 0.230 rms: 0.543 +/- 0.163
hostname:sdfmilan114 cpu:065 cmt:v112 proc time (sec) mean: 0.692 +/- 0.396 rms: 0.847 +/- 0.280
hostname:sdfmilan114 cpu:066 cmt:v112 proc time (sec) mean: 0.574 +/- 0.237 rms: 0.536 +/- 0.167
hostname:sdfmilan114 cpu:066 cmt:v112 proc time (sec) mean: 0.712 +/- 0.475 rms: 0.908 +/- 0.336
hostname:sdfmilan114 cpu:067 cmt:v112 proc time (sec) mean: 0.576 +/- 0.219 rms: 0.514 +/- 0.155
hostname:sdfmilan114 cpu:067 cmt:v112 proc time (sec) mean: 0.594 +/- 0.354 rms: 0.710 +/- 0.250
hostname:sdfmilan114 cpu:068 cmt:v112 proc time (sec) mean: 0.543 +/- 0.205 rms: 0.493 +/- 0.145
hostname:sdfmilan114 cpu:068 cmt:v112 proc time (sec) mean: 0.730 +/- 0.458 rms: 0.972 +/- 0.324
hostname:sdfmilan114 cpu:069 cmt:v112 proc time (sec) mean: 0.545 +/- 0.218 rms: 0.498 +/- 0.154
hostname:sdfmilan114 cpu:069 cmt:v112 proc time (sec) mean: 0.613 +/- 0.366 rms: 0.742 +/- 0.259
hostname:sdfmilan114 cpu:070 cmt:v112 proc time (sec) mean: 0.536 +/- 0.196 rms: 0.481 +/- 0.139
hostname:sdfmilan114 cpu:070 cmt:v112 proc time (sec) mean: 0.729 +/- 0.452 rms: 0.929 +/- 0.320
hostname:sdfmilan114 cpu:071 cmt:v112 proc time (sec) mean: 0.568 +/- 0.208 rms: 0.512 +/- 0.147
hostname:sdfmilan114 cpu:071 cmt:v112 proc time (sec) mean: 0.660 +/- 0.379 rms: 0.821 +/- 0.268
hostname:sdfmilan114 cpu:072 cmt:v112 proc time (sec) mean: 0.565 +/- 0.206 rms: 0.515 +/- 0.146
hostname:sdfmilan114 cpu:072 cmt:v112 proc time (sec) mean: 0.689 +/- 0.432 rms: 0.898 +/- 0.305
hostname:sdfmilan114 cpu:073 cmt:v112 proc time (sec) mean: 0.584 +/- 0.216 rms: 0.542 +/- 0.153
hostname:sdfmilan114 cpu:073 cmt:v112 proc time (sec) mean: 0.621 +/- 0.380 rms: 0.761 +/- 0.268
hostname:sdfmilan114 cpu:074 cmt:v112 proc time (sec) mean: 0.562 +/- 0.198 rms: 0.515 +/- 0.140
hostname:sdfmilan114 cpu:074 cmt:v112 proc time (sec) mean: 0.603 +/- 0.355 rms: 0.707 +/- 0.251
hostname:sdfmilan114 cpu:075 cmt:v112 proc time (sec) mean: 0.572 +/- 0.223 rms: 0.537 +/- 0.158
hostname:sdfmilan114 cpu:075 cmt:v112 proc time (sec) mean: 0.605 +/- 0.349 rms: 0.672 +/- 0.247
hostname:sdfmilan114 cpu:076 cmt:v112 proc time (sec) mean: 0.600 +/- 0.229 rms: 0.554 +/- 0.162
hostname:sdfmilan114 cpu:076 cmt:v112 proc time (sec) mean: 0.852 +/- 0.551 rms: 1.207 +/- 0.390
hostname:sdfmilan114 cpu:077 cmt:v112 proc time (sec) mean: 0.585 +/- 0.224 rms: 0.556 +/- 0.158
hostname:sdfmilan114 cpu:077 cmt:v112 proc time (sec) mean: 0.693 +/- 0.428 rms: 0.890 +/- 0.302
hostname:sdfmilan114 cpu:078 cmt:v112 proc time (sec) mean: 0.574 +/- 0.194 rms: 0.514 +/- 0.137
hostname:sdfmilan114 cpu:078 cmt:v112 proc time (sec) mean: 0.748 +/- 0.483 rms: 0.975 +/- 0.341
hostname:sdfmilan114 cpu:079 cmt:v112 proc time (sec) mean: 0.565 +/- 0.217 rms: 0.528 +/- 0.153
hostname:sdfmilan114 cpu:079 cmt:v112 proc time (sec) mean: 0.653 +/- 0.406 rms: 0.806 +/- 0.287
hostname:sdfmilan114 cpu:080 cmt:v112 proc time (sec) mean: 0.565 +/- 0.171 rms: 0.510 +/- 0.121
hostname:sdfmilan114 cpu:080 cmt:v112 proc time (sec) mean: 0.675 +/- 0.455 rms: 0.874 +/- 0.322
hostname:sdfmilan114 cpu:081 cmt:v112 proc time (sec) mean: 0.587 +/- 0.197 rms: 0.542 +/- 0.139
hostname:sdfmilan114 cpu:081 cmt:v112 proc time (sec) mean: 0.675 +/- 0.469 rms: 0.852 +/- 0.332
hostname:sdfmilan114 cpu:082 cmt:v112 proc time (sec) mean: 0.614 +/- 0.191 rms: 0.566 +/- 0.135
hostname:sdfmilan114 cpu:082 cmt:v112 proc time (sec) mean: 0.655 +/- 0.385 rms: 0.774 +/- 0.273
hostname:sdfmilan114 cpu:083 cmt:v112 proc time (sec) mean: 0.595 +/- 0.190 rms: 0.542 +/- 0.134
hostname:sdfmilan114 cpu:083 cmt:v112 proc time (sec) mean: 0.663 +/- 0.455 rms: 0.838 +/- 0.322
hostname:sdfmilan114 cpu:084 cmt:v112 proc time (sec) mean: 0.555 +/- 0.189 rms: 0.521 +/- 0.134
hostname:sdfmilan114 cpu:084 cmt:v112 proc time (sec) mean: 0.676 +/- 0.447 rms: 0.834 +/- 0.316
hostname:sdfmilan114 cpu:085 cmt:v112 proc time (sec) mean: 0.602 +/- 0.201 rms: 0.537 +/- 0.142
hostname:sdfmilan114 cpu:085 cmt:v112 proc time (sec) mean: 0.613 +/- 0.421 rms: 0.756 +/- 0.298
hostname:sdfmilan114 cpu:086 cmt:v112 proc time (sec) mean: 0.573 +/- 0.188 rms: 0.532 +/- 0.133
hostname:sdfmilan114 cpu:086 cmt:v112 proc time (sec) mean: 0.652 +/- 0.446 rms: 0.791 +/- 0.315
hostname:sdfmilan114 cpu:087 cmt:v112 proc time (sec) mean: 0.568 +/- 0.193 rms: 0.531 +/- 0.136
hostname:sdfmilan114 cpu:087 cmt:v112 proc time (sec) mean: 0.641 +/- 0.440 rms: 0.812 +/- 0.311
hostname:sdfmilan114 cpu:088 cmt:v112 proc time (sec) mean: 0.574 +/- 0.193 rms: 0.516 +/- 0.137
hostname:sdfmilan114 cpu:088 cmt:v112 proc time (sec) mean: 0.682 +/- 0.440 rms: 0.878 +/- 0.311
hostname:sdfmilan114 cpu:089 cmt:v112 proc time (sec) mean: 0.557 +/- 0.177 rms: 0.503 +/- 0.125
hostname:sdfmilan114 cpu:089 cmt:v112 proc time (sec) mean: 0.658 +/- 0.421 rms: 0.814 +/- 0.298
hostname:sdfmilan114 cpu:090 cmt:v112 proc time (sec) mean: 0.569 +/- 0.195 rms: 0.523 +/- 0.138
hostname:sdfmilan114 cpu:090 cmt:v112 proc time (sec) mean: 0.659 +/- 0.389 rms: 0.791 +/- 0.275
hostname:sdfmilan114 cpu:091 cmt:v112 proc time (sec) mean: 0.576 +/- 0.200 rms: 0.515 +/- 0.141
hostname:sdfmilan114 cpu:091 cmt:v112 proc time (sec) mean: 0.618 +/- 0.363 rms: 0.737 +/- 0.257
hostname:sdfmilan114 cpu:092 cmt:v112 proc time (sec) mean: 0.595 +/- 0.220 rms: 0.542 +/- 0.155
hostname:sdfmilan114 cpu:092 cmt:v112 proc time (sec) mean: 0.608 +/- 0.313 rms: 0.678 +/- 0.221
hostname:sdfmilan114 cpu:093 cmt:v112 proc time (sec) mean: 0.591 +/- 0.224 rms: 0.550 +/- 0.158
hostname:sdfmilan114 cpu:093 cmt:v112 proc time (sec) mean: 0.624 +/- 0.332 rms: 0.691 +/- 0.234
hostname:sdfmilan114 cpu:094 cmt:v112 proc time (sec) mean: 0.594 +/- 0.243 rms: 0.562 +/- 0.172
hostname:sdfmilan114 cpu:094 cmt:v112 proc time (sec) mean: 0.605 +/- 0.372 rms: 0.710 +/- 0.263
hostname:sdfmilan114 cpu:095 cmt:v112 proc time (sec) mean: 0.569 +/- 0.190 rms: 0.500 +/- 0.134
hostname:sdfmilan114 cpu:095 cmt:v112 proc time (sec) mean: 0.713 +/- 0.450 rms: 0.927 +/- 0.318
hostname:sdfmilan114 cpu:096 cmt:v112 proc time (sec) mean: 0.686 +/- 0.074 rms: 0.349 +/- 0.052
hostname:sdfmilan114 cpu:096 cmt:v112 proc time (sec) mean: 1.479 +/- 0.200 rms: 1.020 +/- 0.142
hostname:sdfmilan114 cpu:097 cmt:v112 proc time (sec) mean: 0.672 +/- 0.074 rms: 0.327 +/- 0.052
hostname:sdfmilan114 cpu:097 cmt:v112 proc time (sec) mean: 1.429 +/- 0.180 rms: 0.866 +/- 0.128
hostname:sdfmilan114 cpu:098 cmt:v112 proc time (sec) mean: 0.676 +/- 0.076 rms: 0.338 +/- 0.054
hostname:sdfmilan114 cpu:098 cmt:v112 proc time (sec) mean: 1.476 +/- 0.200 rms: 0.974 +/- 0.141
hostname:sdfmilan114 cpu:099 cmt:v112 proc time (sec) mean: 0.643 +/- 0.073 rms: 0.341 +/- 0.051
hostname:sdfmilan114 cpu:099 cmt:v112 proc time (sec) mean: 1.449 +/- 0.176 rms: 0.936 +/- 0.124
hostname:sdfmilan114 cpu:100 cmt:v112 proc time (sec) mean: 0.688 +/- 0.084 rms: 0.388 +/- 0.059
hostname:sdfmilan114 cpu:100 cmt:v112 proc time (sec) mean: 1.447 +/- 0.202 rms: 1.003 +/- 0.143
hostname:sdfmilan114 cpu:101 cmt:v112 proc time (sec) mean: 0.666 +/- 0.067 rms: 0.300 +/- 0.047
hostname:sdfmilan114 cpu:101 cmt:v112 proc time (sec) mean: 1.529 +/- 0.217 rms: 1.056 +/- 0.154
hostname:sdfmilan114 cpu:102 cmt:v112 proc time (sec) mean: 0.693 +/- 0.083 rms: 0.393 +/- 0.059
hostname:sdfmilan114 cpu:102 cmt:v112 proc time (sec) mean: 1.492 +/- 0.174 rms: 0.956 +/- 0.123
hostname:sdfmilan114 cpu:103 cmt:v112 proc time (sec) mean: 0.652 +/- 0.079 rms: 0.324 +/- 0.056
hostname:sdfmilan114 cpu:103 cmt:v112 proc time (sec) mean: 1.495 +/- 0.207 rms: 1.006 +/- 0.146
hostname:sdfmilan114 cpu:104 cmt:v112 proc time (sec) mean: 0.671 +/- 0.071 rms: 0.354 +/- 0.050
hostname:sdfmilan114 cpu:104 cmt:v112 proc time (sec) mean: 1.432 +/- 0.197 rms: 0.911 +/- 0.139
hostname:sdfmilan114 cpu:105 cmt:v112 proc time (sec) mean: 0.647 +/- 0.077 rms: 0.361 +/- 0.055
hostname:sdfmilan114 cpu:105 cmt:v112 proc time (sec) mean: 1.498 +/- 0.202 rms: 1.025 +/- 0.143
hostname:sdfmilan114 cpu:106 cmt:v112 proc time (sec) mean: 0.695 +/- 0.083 rms: 0.396 +/- 0.059
hostname:sdfmilan114 cpu:106 cmt:v112 proc time (sec) mean: 1.449 +/- 0.196 rms: 0.962 +/- 0.138
hostname:sdfmilan114 cpu:107 cmt:v112 proc time (sec) mean: 0.674 +/- 0.068 rms: 0.321 +/- 0.048
hostname:sdfmilan114 cpu:107 cmt:v112 proc time (sec) mean: 1.497 +/- 0.197 rms: 0.977 +/- 0.139
hostname:sdfmilan114 cpu:108 cmt:v112 proc time (sec) mean: 0.706 +/- 0.073 rms: 0.352 +/- 0.052
hostname:sdfmilan114 cpu:108 cmt:v112 proc time (sec) mean: 1.498 +/- 0.206 rms: 1.032 +/- 0.146
hostname:sdfmilan114 cpu:109 cmt:v112 proc time (sec) mean: 0.699 +/- 0.070 rms: 0.358 +/- 0.049
hostname:sdfmilan114 cpu:109 cmt:v112 proc time (sec) mean: 1.457 +/- 0.185 rms: 0.954 +/- 0.131
hostname:sdfmilan114 cpu:110 cmt:v112 proc time (sec) mean: 0.731 +/- 0.077 rms: 0.362 +/- 0.054
hostname:sdfmilan114 cpu:110 cmt:v112 proc time (sec) mean: 1.488 +/- 0.185 rms: 0.994 +/- 0.131
hostname:sdfmilan114 cpu:111 cmt:v112 proc time (sec) mean: 0.643 +/- 0.086 rms: 0.377 +/- 0.060
hostname:sdfmilan114 cpu:111 cmt:v112 proc time (sec) mean: 1.482 +/- 0.200 rms: 1.001 +/- 0.141
hostname:sdfmilan114 cpu:112 cmt:v112 proc time (sec) mean: 0.641 +/- 0.073 rms: 0.381 +/- 0.052
hostname:sdfmilan114 cpu:112 cmt:v112 proc time (sec) mean: 1.545 +/- 0.259 rms: 1.247 +/- 0.183
hostname:sdfmilan114 cpu:113 cmt:v112 proc time (sec) mean: 0.643 +/- 0.067 rms: 0.344 +/- 0.047
hostname:sdfmilan114 cpu:113 cmt:v112 proc time (sec) mean: 1.548 +/- 0.275 rms: 1.330 +/- 0.195
hostname:sdfmilan114 cpu:114 cmt:v112 proc time (sec) mean: 0.679 +/- 0.083 rms: 0.395 +/- 0.059
hostname:sdfmilan114 cpu:114 cmt:v112 proc time (sec) mean: 1.510 +/- 0.263 rms: 1.220 +/- 0.186
hostname:sdfmilan114 cpu:115 cmt:v112 proc time (sec) mean: 0.645 +/- 0.078 rms: 0.410 +/- 0.055
hostname:sdfmilan114 cpu:115 cmt:v112 proc time (sec) mean: 1.535 +/- 0.268 rms: 1.225 +/- 0.190
hostname:sdfmilan114 cpu:116 cmt:v112 proc time (sec) mean: 0.618 +/- 0.074 rms: 0.374 +/- 0.053
hostname:sdfmilan114 cpu:116 cmt:v112 proc time (sec) mean: 1.546 +/- 0.282 rms: 1.336 +/- 0.199
hostname:sdfmilan114 cpu:117 cmt:v112 proc time (sec) mean: 0.671 +/- 0.067 rms: 0.360 +/- 0.047
hostname:sdfmilan114 cpu:117 cmt:v112 proc time (sec) mean: 1.565 +/- 0.273 rms: 1.330 +/- 0.193
hostname:sdfmilan114 cpu:118 cmt:v112 proc time (sec) mean: 0.608 +/- 0.080 rms: 0.379 +/- 0.056
hostname:sdfmilan114 cpu:118 cmt:v112 proc time (sec) mean: 1.532 +/- 0.253 rms: 1.261 +/- 0.179
hostname:sdfmilan114 cpu:119 cmt:v112 proc time (sec) mean: 0.620 +/- 0.073 rms: 0.372 +/- 0.051
hostname:sdfmilan114 cpu:119 cmt:v112 proc time (sec) mean: 1.538 +/- 0.246 rms: 1.231 +/- 0.174
hostname:sdfmilan114 cpu:120 cmt:v112 proc time (sec) mean: 0.635 +/- 0.074 rms: 0.388 +/- 0.053
hostname:sdfmilan114 cpu:120 cmt:v112 proc time (sec) mean: 1.573 +/- 0.269 rms: 1.305 +/- 0.190
hostname:sdfmilan114 cpu:121 cmt:v112 proc time (sec) mean: 0.648 +/- 0.070 rms: 0.367 +/- 0.050
hostname:sdfmilan114 cpu:121 cmt:v112 proc time (sec) mean: 1.541 +/- 0.276 rms: 1.326 +/- 0.195
hostname:sdfmilan114 cpu:122 cmt:v112 proc time (sec) mean: 0.660 +/- 0.074 rms: 0.391 +/- 0.052
hostname:sdfmilan114 cpu:122 cmt:v112 proc time (sec) mean: 1.578 +/- 0.280 rms: 1.368 +/- 0.198
hostname:sdfmilan114 cpu:123 cmt:v112 proc time (sec) mean: 0.671 +/- 0.078 rms: 0.385 +/- 0.055
hostname:sdfmilan114 cpu:123 cmt:v112 proc time (sec) mean: 1.492 +/- 0.240 rms: 1.137 +/- 0.170
hostname:sdfmilan114 cpu:124 cmt:v112 proc time (sec) mean: 0.653 +/- 0.073 rms: 0.367 +/- 0.052
hostname:sdfmilan114 cpu:124 cmt:v112 proc time (sec) mean: 1.549 +/- 0.286 rms: 1.315 +/- 0.202
hostname:sdfmilan114 cpu:125 cmt:v112 proc time (sec) mean: 0.655 +/- 0.073 rms: 0.385 +/- 0.051
hostname:sdfmilan114 cpu:125 cmt:v112 proc time (sec) mean: 1.515 +/- 0.250 rms: 1.201 +/- 0.177
hostname:sdfmilan114 cpu:126 cmt:v112 proc time (sec) mean: 0.663 +/- 0.080 rms: 0.386 +/- 0.057
hostname:sdfmilan114 cpu:126 cmt:v112 proc time (sec) mean: 1.551 +/- 0.287 rms: 1.338 +/- 0.203
hostname:sdfmilan114 cpu:127 cmt:v112 proc time (sec) mean: 0.616 +/- 0.069 rms: 0.328 +/- 0.049
hostname:sdfmilan114 cpu:127 cmt:v112 proc time (sec) mean: 1.481 +/- 0.267 rms: 1.222 +/- 0.189
mean time (sec): 0.9326


References

  • No labels