Page History
...
- weka FS nodes do not show up in processing ranks
- decreasing array size from 4M to 1M decreases time ratio from ~1.5 to 1.15
- increasing array size from 4M to 14M does not increases time ratio...
2024-01-22 Q&A
cpu_num = psutil.Process().cpu_num() vs runk
- rank and cpu number are linked for all events
- cpu number assigned to rank differently for each job
- 16 ≤ cpu_num ≤ 23 - are not found in data processing
Code Block | ||||
---|---|---|---|---|
| ||||
rank:20 cpu_num:073 nevt:044 time:0.277427 rank:10 cpu_num:046 nevt:030 time:0.632612 rank:00 cpu_num:000 nevt:046 time:0.651162 rank:20 cpu_num:073 nevt:045 time:0.266946 rank:10 cpu_num:046 nevt:031 time:0.272130 rank:00 cpu_num:000 nevt:047 time:0.574547 rank:20 cpu_num:073 nevt:046 time:0.329882 rank:10 cpu_num:046 nevt:032 time:0.287877 rank:00 cpu_num:000 nevt:048 time:0.493901 rank:20 cpu_num:073 nevt:047 time:0.436152 rank:10 cpu_num:046 nevt:033 time:0.902722 rank:00 cpu_num:000 nevt:049 time:0.505073 rank:20 cpu_num:073 nevt:048 time:0.272120 rank:00 cpu_num:000 nevt:050 time:0.519510 rank:20 cpu_num:073 nevt:049 time:0.360761 rank:10 cpu_num:046 nevt:034 time:0.555629 rank:20 cpu_num:073 nevt:050 time:0.291751 rank:00 cpu_num:000 nevt:051 time:0.666105 rank:10 cpu_num:046 nevt:035 time:0.371877 rank:20 cpu_num:073 nevt:051 time:0.764429 rank:00 cpu_num:000 nevt:052 time:0.672750 rank:20 cpu_num:073 nevt:052 time:0.325827 rank:00 cpu_num:000 nevt:053 time:0.328918 rank:10 cpu_num:046 nevt:036 time:0.332080 rank:00 cpu_num:000 nevt:054 time:0.358017 rank:20 cpu_num:073 nevt:053 time:0.290833 rank:10 cpu_num:046 nevt:037 time:0.980106 rank:00 cpu_num:000 nevt:055 time:0.487292 rank:20 cpu_num:073 nevt:054 time:0.333488 |
...
host name | job # | core 0/1 | 0/80 | 10/80 | 20/80 | 30/80 | 40/80 | 50/80 | 60/80 | 70/80 |
---|---|---|---|---|---|---|---|---|---|---|
sdfmilan215 | 1 | 0 | 8 |
36 | 66 | 111 | 2 | 41 | 67 | 101 | ||||
sdfmilan215 | 2 | 0 | 11 | 39 | 71 | 97 | 1 | 42 | 66 | 103 |
sdfmilan215 | 3 | 0 | 4 | 40 | 69 | 101 | 10 | 33 | 77 | 107 |
References
Overview
Content Tools