Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

actionissue foundstatremedy
test power cycle she-fee-daq01/2 10 timesbucket issues3/10power cycling the xpm10 (txlinkreset didn't fix)
RTM disconnected in increades timing 
5min 10 min 40 min 2hours 
bucket issue (2 hours)1/4power cycle of xpm10 (txlinkreset didn't fix)


in 2023/11/21

switching XPM firmware back to 3.5.4

from drp-neh-ctl002

~weaver/FirmwareLoader/rhel6/FirmwareLoader -a 10.0.5.104 /cds/home/w/weaver/mcs/xpm//xpm_noRTM-0x03050400-20230409095511-weaver-dirty.mcs
~weaver/FirmwareLoader/rhel6/FirmwareLoader -a 10.0.5.102 /cds/home/w/weaver/mcs/xpm//xpm-0x03050400-20230419122542-weaver-c6987c4.mcs

then fru-restart from psdev xpm 10 and xpm 11 in sequence, not together.


Conclusion


It appears that yanking the timing fiber can cause disturbances in the system, but they are not repeatable 100% of the time.
XPMs Power spikes can set the DAQ in a behavior similar to the XPM glitch, but only if pyxpms are running. To be repeated.

Upgrading XPM firmware seems to have mitigated all the issues (to 3.6.0 from 3.5.4). The bucket issue becomes more prominent, probably because other issues are not happening. This issue appears when power cycling the xpm11.

...