This query will get the hostname and CPU per job in the Interleave task:

select S.Stream, S.StreamID, PIMC.ProcessInstance MC, SUBSTR(PIMC.ExecutionHost,1,3)||' ' Host, PIMC.CPUSecondsUsed "CPU(s)", PIRDS.ProcessInstance RDS from Stream S left outer join ProcessInstance PIMC on (PIMC.Stream = S.Stream and PIMC.Process = 347302 and PIMC.IsLatest = 1) left outer join ProcessInstance PIRDS on (PIRDS.Stream = S.Stream and PIRDS.Process = 347303 and PIRDS.IsLatest = 1) where task = 347300 and S.IsLatest = 1 order by S.StreamID;

This query gets the average cpu time (in seconds) per event.  The results for task "Interleave55d-GR-v11r12" are shown:

select Host, SUM("CPU(s)") "Total CPU(s)", SUM("# Evts") "Total # Evts", SUM("CPU(s)")/SUM("# Evts") "s/evt" from (select S.Stream, S.StreamID, PIMC.ProcessInstance MC, SUBSTR(REGEXP_SUBSTR(PIMC.ExecutionHost,'[a-z]*'),1,5) Host, PIMC.CPUSecondsUsed "CPU(s)", PIRDS.ProcessInstance RDS, DSMC.NumberEvents "# Evts" from Stream S left outer join ProcessInstance PIMC on (PIMC.Stream = S.Stream and PIMC.Process = 347302 and PIMC.IsLatest = 1) left outer join ProcessInstance PIRDS on (PIRDS.Stream = S.Stream and PIRDS.Process = 347303 and PIRDS.IsLatest = 1) left outer join Dataset DSMC on (DSMC.ProcessInstance = PIRDS.ProcessInstance and DSMC.DatasetDataType='MC') where task = 347300 and S.IsLatest = 1 order by S.StreamID) group by Host order by "s/evt";

HOST

Total CPU(s)

Total # Evts

s/evt

boer

9914615

22474705

.441145501

yili

2470269

4934903

.500570933

cob

3783975

7044111

.537182762

don

770660

1252519

.615288071

noma

1779321

1825807

.974539478

tori

1469253

1444175

1.01736493

(Table 1) 

Here's that data with some normalized indexes:

Host

Total CPU(s)

Total # Evts

s/evt

NORM(boer)

NORM -1 (boer)

boer

9914615

22474705

0.4411

1.0000

1.0000

yili

2470269

4934903

0.5006

1.1347

0.8813

cob

3783975

7044111

0.5372

1.2177

0.8212

don

770660

1252519

0.6153

1.3948

0.7170

noma

1779321

1825807

0.9745

2.2091

0.4527

tori

1469253

1444175

1.0174

2.3062

0.4336

(Table 2)

Running the same query while tossing jobs that processed no events seems to have little effect:

Host

Total CPU(s)

Total # Evts

s/evt

NORM(boer)

NORM-1(boer)

boer

9849720

22474705

0.438258033

1.0000

1.0000

yili

2452068

4934903

0.496882715

1.1338

0.8820

cob

3758387

7044111

0.533550224

1.2174

0.8214

don

765713

1252519

0.611338431

1.3949

0.7169

noma

1764264

1825807

0.966292713

2.2048

0.4535

tori

1460032

1444175

1.01097997

2.3068

0.4335

(Table 3) 

Here's the last table with the addition of some SCCS maintained quantities:

HOST

Total # Jobs

Total CPU(s)

Total # Evts

CPU(s)/evt

N(boer)

LSF cpuf

N(boer)

SI2k

N(boer)

boer

3,951

9,849,720

22,474,705

0.44

1.00

10

1.00

1615

1.00

yili

870

2,452,068

4,934,903

0.50

1.13

8.5

1.18

1374

1.18

cob

1,251

3,758,387

7,044,111

0.53

1.22

7.7

1.30

1270

1.27

don

226

765,713

1,252,519

0.61

1.39

5.5

1.82

 

 

noma

322

1,764,264

1,825,807

0.97

2.20

3.4

2.94

 

 

tori

256

1,460,032

1,444,175

1.01

2.31

2.8

3.57

 

 

Note: N( x ) denotes normalized quantity

(Table 4)

Here's a plot of the Normalized indexes from table 4:


 

  • No labels

1 Comment

  1. Daniel Flath

    Query for the table with SCCS values is (with calculations done in excel):

    select Host, COUNT(1) "Total # Jobs", SUM("CPU(s)") "Total CPU(s)", SUM("# Evts") "Total # Evts", SUM("CPU(s)")/SUM("# Evts") "s/evt" from (select S.Stream, S.StreamID, PIMC.ProcessInstance MC, SUBSTR(REGEXP_SUBSTR(PIMC.ExecutionHost,'[a-z]*'),1,5) Host, PIMC.CPUSecondsUsed "CPU(s)", PIRDS.ProcessInstance RDS, DSMC.NumberEvents "# Evts" from Stream S left outer join ProcessInstance PIMC on (PIMC.Stream = S.Stream and PIMC.Process = 347302 and PIMC.IsLatest = 1) left outer join ProcessInstance PIRDS on (PIRDS.Stream = S.Stream and PIRDS.Process = 347303 and PIRDS.IsLatest = 1) left outer join Dataset DSMC on (DSMC.ProcessInstance = PIRDS.ProcessInstance and DSMC.DatasetDataType='MC') where task = 347300 and S.IsLatest = 1 and DSMC.NumberEvents != 0 order by S.StreamID) group by Host order by "s/evt";