Versions Compared

Old Version 2

changes.mady.by.user Christopher O'Grady

Saved on

compared with

New Version 3

changes.mady.by.user Monarin Uervirojnangkoo

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • hsd-hsd outer product (symmetric, same hsd, save a factor of 2)
  • hsd-fzp outer product (fzp is piranha: 2048)
Code Block
languagebash
(ps-4.5.26) monarin@drp-srcf-eb003 (master *) tmolw8819 👁)$ mpirun -n 3 python run_outer_products.py 0 1 2048 59400
nevent: 1 vls: (2048,) inner: (59400,) outer: (59400,) dt:15.693s. load:0.037s calc:15.656s outer vls/wf:0.29s, wf/wf:6.68s add vls/wf:0.29s wf/wf:8.39s tt:15.693s. rate:0.06Hz
nevent: 2 vls: (2048,) inner: (59400,) outer: (59400,) dt:10.523s. load:0.004s calc:10.519s outer vls/wf:0.29s, wf/wf:7.69s add vls/wf:0.09s wf/wf:2.45s tt:26.216s. rate:0.08Hz
nevent: 3 vls: (2048,) inner: (59400,) outer: (59400,) dt:10.526s. load:0.003s calc:10.523s outer vls/wf:0.29s, wf/wf:7.70s add vls/wf:0.09s wf/wf:2.44s tt:36.742s. rate:0.08Hz
nevent: 4 vls: (2048,) inner: (59400,) outer: (59400,) dt:10.445s. load:0.003s calc:10.442s outer vls/wf:0.34s, wf/wf:7.57s add vls/wf:0.09s wf/wf:2.44s tt:47.187s. rate:0.08Hz
nevent: 5 vls: (2048,) inner: (59400,) outer: (59400,) dt:10.627s. load:0.003s calc:10.624s outer vls/wf:0.33s, wf/wf:7.74s add vls/wf:0.09s wf/wf:2.46s tt:57.814s. rate:0.09Hz
nevent: 6 vls: (2048,) inner: (59400,) outer: (59400,) dt:10.420s. load:0.003s calc:10.417s outer vls/wf:0.33s, wf/wf:7.56s add vls/wf:0.09s wf/wf:2.44s tt:68.234s. rate:0.09Hz
nevent: 7 vls: (2048,) inner: (59400,) outer: (59400,) dt:10.580s. load:0.003s calc:10.577s outer vls/wf:0.35s, wf/wf:7.69s add vls/wf:0.09s wf/wf:2.45s tt:78.814s. rate:0.09Hz
nevent: 8 vls: (2048,) inner: (59400,) outer: (59400,) dt:10.469s. load:0.005s calc:10.463s outer vls/wf:0.33s, wf/wf:7.59s add vls/wf:0.09s wf/wf:2.46s tt:89.283s. rate:0.09Hz
nevent: 8 tt:92.53516s. rate:0.011566894771298394kHz

mona should test:

  • the "sparse" outer product from fex
  • full 8000x8000 (plus 8000x2048 for fzp):
    • we can do 8000 samples from 2 hsd channels per drp node at 100kHz (3.2GB/s) from a data-volume perspective but need to check from a CPU perspective.

...