Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

with claus, weaver, cpo

Matt's proposal:-

  • timing on LC, but still handled by BOS

...

  • networking might be on LC as well (unless 40Gb or 100Gb, which is natively MPO). NOT handled by BOS (also XTCAV point-to-point)

...

  • pgp is on MPO and handled by the BOS

...

  • detectors are all LC going to the BOS

...

  • BOS-to-208-patch-panel is MPO (via breakout cable) and some LC as described above

...

  • don't need breakout cables in SRCF according to Matt's proposal

...

  • (wasteful of fibers between 208 and SRCF?)
  • try to use the SFP-to-QSFP-adapters (LC to MPO) as much as possible in SRCF

this is an argument for "specialized" cabling on the SRCF side:

  • if we had enough fibers for all SRCF nodes we would hook up MPO cables for all of them
  • but we only have 300 fibers pairs to SRCF where ideally we would like 56nodes*8=448 fiber pairs (also need networking fibers)
  • also, the bos can only handle 160 fiber pairs going to SRCF
  • also, some nodes only need 1 fiber (timing, hsd) so hooking up all fibers is a waste
  • it's hard to change what fibers a node needs because we have to change:
    • firmware
    • transceiver (LR4 (hsd), PLR4 (wave8, epixHR), SFP to QSFP converters (timing))order:

...

  • bos has 320 pairs, but only half of these are used for SRCF, the other half goes to detectors (LC).  Implies 40 breakout cables with 4 fiber-pairs per MPO for room 208?

...

  • 56 cmp, 11 eb, 19 mon nodes. currently only cmp have kcu's. maximum of 112 transceivers, but some should be sfp-to-qsfp. hsd's use lr4 (currently 12 channels in TMO and 4 channels in RIX). in feb. 2023 tmo needs 14 for hexanodes plus extra channels (spare and miscellaneous signals).  so guess 25 LR4. expect 36 in TMO eventually.  all others use plr4.  112-25 ~= 90 PLR4 max. Matt guess half will be sfp-to-qsfp.  So 45 PLR4, and 45 sfp-to-qsfp

...

  • 56 cmp nodes corresponds to 56*8=448 fiber pairs (more than the half of the bos devoted to srcf (other half is for detectors))
  • order our own patch fibers? (1 foot through 3m or 5m?)

...

  • in short-term need to cable test detectors incrementally

...

  • in long-term consider ripping out and having professionals do it (requires planning).  we do have a short window (2 or 3 weeks?) setup SRCF in advance using estimates of detector numbers. ideally so we can maintain it.

...

  • need to figure out fiber swaps (tx/rx) and how we do it in a neat way. more complex with MPO.  Maybe BOS could do this?  We think not: monitoring might not work.  proposal: best place is from BOS→SRCFpatchpanel. indicate the swap by removing the plastic piece that holds tx/rx in place.

3 sets of limited fiber resources:

  • bos: 320 pairs, 160 for detectors, 160 for srcf
  • nodes: 56*8=448 pairs
  • fibers between 208 and srcf: 300 fiber pairs (48 MPO, 48 LC?).  Total of 240?

SRCF Fiber Order

55
Image AddedFS QSFP-PLR4-40G Compatible 40GBASE-PLR4 QSFP+ 1310nm 10km DOM MTP/MPO-12 SMF Optical Transceiver Module

 (singlemode plr4 qsfp)
25 
Image AddedCisco QSFP-40GE-LR4 Compatible 40GBASE-LR4 QSFP+ 1310nm 10km DOM Duplex LC SMF Optical Transceiver Module (single mode lr4)
45 
Image AddedCisco CVR-QSFP-SFP10G Compatible 40G QSFP+ to 10G SFP+ Adapter Converter Module (sfp to qsfp adapter) CVR-QSFP-SFP10G
60 
Image AddedCisco SFP-10G-LR Compatible 10GBASE-LR SFP+ 1310nm 10km DOM Duplex LC SMF Optical Transceiver Module (singlemode sfp transceiver (for sfp-to-qsfp adapters))
25 
Image Added3m (10ft) MTP® Female to 4 LC UPC Duplex 8 Fibers Type B Plenum (OFNP) OS2 9/125 Single Mode Elite Breakout Cable, Yellow (3m singlemode breakout)
20 
Image Added1m (3ft) MTP® Female to 4 LC UPC Duplex 8 Fibers Type B Plenum (OFNP) OS2 9/125 Single Mode Elite Breakout Cable, Yellow (1m single mode breakout)
45 
Image AddedCustomized 8-144 Fibers Senko MPO-12 OS2 Single Mode Elite Trunk Cable, Yellow (3m mpo12 trunk cable)
20 
Image Added0.5m (1.6ft) LC UPC to LC UPC Duplex OS2 Single Mode PVC (OFNR) 2.0mm Fiber Optic Patch Cable (0.5m patch fiber)
20 
Image Added1m (3ft) LC UPC to LC UPC Duplex OS2 Single Mode PVC (OFNR) 2.0mm Fiber Optic Patch Cable (1m patch fiber)
20 
Image Added1.5m (5ft) LC UPC to LC UPC Duplex OS2 Single Mode PVC (OFNR) 2.0mm Fiber Optic Patch Cable (1.5m patch fiber)
20 
Image Added2m (7ft) LC UPC to LC UPC Duplex OS2 Single Mode PVC (OFNR) 2.0mm Fiber Optic Patch Cable (2m patch fiber)
20 
Image Added3m (10ft) LC UPC to LC UPC Duplex OS2 Single Mode PVC (OFNR) 2.0mm Fiber Optic Patch Cable (3m patch fiber)
10 
Image Added4m (13ft) LC UPC to LC UPC Duplex OS2 Single Mode PVC (OFNR) 2.0mm Fiber Optic Patch Cable (4m patch fiber)

Sept. 2022 Cabling Proposal

Executive summary: I think at 100kHz we can keep roughly the same number of nodes that we have in the FEE alcove.

Issues:

  • which fibers should be MPO vs LC?
    • only use MPO for fim's.
  • should we fanout timing at SRCF or put it through the bos?
    • use the fanouts at SRCF for simplicity
    • should we fanout in 208?
    • maybe put camlink data fibers through the bos?
  • routing mono-encoder udp network over to srcf
  • sharing xtcav between hutches with bos-switchable timing

100kHz data volumes:-

  • wave8: 8waveforms*256samples/sample*2bytes/sample*0.1MHz = 400MB/s

...

  • (need to add FEX data too)

...

  • piranha: 2048px*2bytes/px*0.1MHz=410MB/s

...

  • hsd full wf: 60000samples*2bytes/sample*0.1MHz = 12GB/s

      ...

        • max waveform length appears to be ~60000 samples looking at xtc2 file?

      ...

        • FEX needs to reduce it to 4GB/s (3x)

      ...

      • bld: 336bytes/event*0.1MHz = 33MB/

      ...

      • (from xtcreader -f /cds/data/psdm/prj/public01/xtc/tmoc00118-r0222-s008-c000.xtc2)

      ...

      • timing: 309bytes/event*0.1MHz = 31MB/s

      summary:

      • hook it up similarly to the way it is done in the FEE alcove, but more neatly
      • fanout the timing in 208 and put everything through the BOS

      recabling proposal:-

      • tmo timing (including pvadet, bld) (LC, SFP to QSFP)

      ...

      • rix timing (LC, SFP to QSFP)

      ...

      • (4) tmo camlink nodes (LC, needs timing)

      ...

      • (2) rix camlink nodes (LC, needs timing)

      ...

      • tmo/rix fim node (5 fims) (MPO, PLR4)

      ...

      • (2) rix hsd nodes

      ...

      • (2 LC per node, LR4)
      • (7) tmo hsd nodes

      ...

      • (2 LC per node, LR4)
      • peppex hsd node (LC LR4)

      ...

      • (2) tmo/rix ami

      ...

      • (2) tmo/rix teb

      ...

      • (2) tmo/rix mebuser

      ...

      • xtcav (LC, needs timing)

      ...

      • mono-encoder

      ...

      • (LC, needs timing)
      • in SRCF:
        • let's try MPO for everything (since we only have 48 LC)
        • tdet (12, timing): SFP fiber (from an MPO breakout cable) SFP to QSFP converter
          • 3 MPO breakout, 12 SFP to QSFP converters, 12 SFP transceivers
        • ilv (10, hsd): SFP fiber with LR4 transceiver (no MPO)
          • 5 MPO breakout, 20 LR4
        • wave8 (1, XilinxKcu1500Pgp4_6Gbps_ddr): MPO fiber with PLR4 transceiver
          • 1 MPO, 1 PLR4
        • camlink (4, ClinkKcu1500Pgp2b): data (transceiver 0, up to 4 lanes/cameras) MPO fiber with PLR4, timing (transceiver 1), try MPO fiber with PLR4 (neater, but wastes fibers)
          • 8 MPO, 8 PLR4

      current inventory (sept. 13, 2022):

      • 27 nodes needed
      • shutdown 30
      • 3 broken (cmp006, 13, 15)

      SRCF cabling

      Nodes

      drp-srcf-cmpNNNKCU firmwareCommentApplication (Oct 17, 2022)
      001DrpTDetTMO low rate, XTCAV nic (SXR, cpo believes)slow tmo tdet (+xtcav (SXR, cpo believes))
      002DrpTDetRIX low rate, encoder nicslow rix tdet (+mono)
      003DrpTDetTMO high ratetmo high rate tdet
      004XilinxKcu1500Pgp4_6Gbps_ddr
      rix/tmo wave8
      Collection host
      005DrpPgpIlv
      rix hsd's
      006ClinkKcu1500Pgp2b LCLSECSD-1844.  Possibly repaired spare camlink?spare camlink node?
      007ClinkKcu1500Pgp2b
      tmo fzp piranha
      008DrpTDetdidn't show up on xpmrix user meb
      009DrpPgpIlv
      rix hsd's
      010DrpTDetRIX high raterix fast tdet
      011ClinkKcu1500Pgp2b
      tmo fzp opal
      012ClinkKcu1500Pgp2b
      tmo opal1 rix piranha
      013ClinkKcu1500Pgp2b
      tmo atm piranha
      014Lcls2EpixHrXilinxKcu1500Pgp4_6Gbps
      epix hr
      015
      No mlx5; Bad Ethernet
      LCLSECSD-1305
      Unreliable machine: bad for TEB / MEB
      nothing
      016DrpTDetNo mlx5.  Error messages
      LCLSECSD-1305
      Unreliable machine: bad for TEB / MEB
      nothing
      017DrpPgpIlv
      tmo hsd_3
      018DrpPgpIlv
      tmo hsd_5,hsd_7
      019DrpPgpIlv
      tmo hsd_4,hsd_13
      020DrpPgpIlv
      tmo hsd_2
      021DrpPgpIlv
      tmo hsd_6
      022DrpPgpIlv
      tmo hsd_8,hsd_9
      023DrpPgpIlv
      peppex hsd's
      024DrpPgpIlv
      tmo hsd_10,hsd_11
      025DrpTDet
      rix slow tdet
      026ClinkKcu1500Pgp2b
      tmo atm opal
      027ClinkKcu1500Pgp2b
      rix atm opal
      028DrpTDetXPM:6tmo ami
      029DrpTDetXPM:5rix ami
      030DrpTDetNCtmo user meb
      031XilinxKcu1500Pgp4_6Gbps_ddrLCLSECSD-2030: BIOS not upgradabletmo user meb
      032DrpTDetXPM:7 (hacked with fiber from xpm0 that was in cmp037).  Web IPMI interface broken.  Update bios settings: only one pcie bus.LCLS1 HXR hutches
      033DrpTDetXPM:0.  update bios settings: only one pcie bus.
      034DrpTDetXPM:0mona slurm tests
      035DrpTDetXPM:0; LCLSECSD-2032: BIOS  not upgradable from v2.0 but is useable as-ismona slurm tests
      036DrpTDetepixM dataepixM
      037DrpTDetXPM:0 (hacked with fiber from xpm7)
      038DrpTDetXPM:7
      039DrpTDet LCLSECSD-2028: Broken IPMI
      040DrpTDetXPM:0
      041DrpTDetXPM:0
      042DrpTDetXPM:0
      043DrpTDetXPM:0EpixHrEmu
      044DrpTDetXPM:0Laser hall
      045Todo: XilinxKcu1500Pgp4_6GbpsXPM:0TXI Wave8
      mon001

      tcmp03mo meb and ami_manager

      neh-base.cnf, hsd.cnf, rix-hsd.cnf

      046DrpPgpIlv

      TMO HSD_15 and TMO HSD_16

      048DrpPgpIlv

      TMO HSD_17 and TMO HSD_18

      049DrpPgpIlvnot working, possibly defective KCU


      050DrpPgpIlv

      TMO HSD_01 and TMO HSD_19

      drp-srcf-gpuNNNKCU firmwareCommentApplication
      001in progressAdding kcu1500
      002n/a

      003n/a

      004n/a

      Cabling

      Top Patch Panel:

      NOTE: the rightmost MPO connections are MPO12 (2 rows, 4 columns).  The left ones are MPO8.  We should use MPO8 for KCU.  The MPO12 are reserved for "future expansion" (can be converted to MPO8, I think).

      (6-strand breakout cable)
      1: gpu001 (away from usb port)
      2: cmp040 (away from usb port)
      3: cmp041 (away from usb port)
      4: cmp042 (away from usb port)
      5: cmp043 (away from usb port)
      6: cmp044 (away from usb port)




      DON'USE FOR NOWDON'T USE FOR NOW



      (breakout cable)

      1: cmp022(away from USB port)

      2: cmp022(close to USB port)

      3: cmp023 (away from USB port)

      4: cmp023 (close to USB port)

      (breakout cable)

      1: cmp018(away from USB port)

      2: cmp018(close to USB port)

      3: cmp019 (away from USB port)

      4: cmp019 (close to USB port)

      (breakout cable)

      1: cmp009(away from USB port)

      2: cmp009(close to USB port)

      3: cmp017 (away from USB port)

      4: cmp017 (close to USB port)

      (breakout cable)

      1: cmp008

      2: cmp010

      3: cmp016

      4: cmp025

      (break cable)
      1: cmp033 (away from usb port)
      2: cmp035 (away from usb port)
      3: cmp036 (away from usb port)
      4: cmp032 (away from usb port)






      (breakout cable)

      2: cmp046 (away from usb)
      3: cmp048 (close to usb)
      4: cmp048 (away from usb)

      (breakout cable)

      1: cmp024(away from USB port)

      2: cmp024(close to USB port)

      3: -

      4: -

      (breakout cable)

      1: cmp020(away from USB port)

      2: cmp020(close to USB port)

      3: cmp021 (away from USB port)

      4: cmp021 (close to USB port)

      (breakout cable)

      1: cmp029

      2: cmp030

      3: cmp037

      4: cmp038

      (breakout cable)

      1: cmp028

      2: -

      3: -

      4: -








      (breakout cable)
      1: cmp050(close to usb)
      2: cmp050(away from the usb)
      3: cmp046 (close to usb)





      Bottom Patch Panel (MPO):

      cmp006 (timing) (close to the USB port)cmp011 (timing) (close to the USB port)cmp012 (timing) (close to the USB port)cmp004(close to usb port)cmp013(timing) (close to the USB port)cmp026(timing) (close to the USB port)cmp027(timing) (close to the USB port)cmp004(away from usb port)
      cmp006 (data) (away from USB port)cmp011 (data) (away from USB port)cmp012 (data) (away from USB port)cmp013 (data) (away from USB port)cmp045 (away from USB port)cmp026 (data) (away from USB port)cmp027 (data) (away from USB port)cmp014(away from usb port)

      Bottom Patch Panel (LC):

      IT
      ITcmp007 (close to the USB port)

      cmp001 (away from the USB port)


      ITcmp007 (away from the USB port)

      cmp002 (away from the USB port)


      IT


      cmp003 (away from the USB port)


      IT


      cmp005 (close to the USB port)



      IT


      cmp005 (awy from the USB port)


      IT



      LC

      Fibers 15-16: XTCAV (SXR, cpo believes) from Room 208 Rack 2 PH2 fibers 61-62 → cmp001.  61/62 means sixth cassette from the left, top fiber.

      Fibers 21-22: MonoEncoder from ATCA Switch in FEE → cmp002

      TMO Hutch Fiber Connections

      SourceDestinationNotes
      XPM 2 input on RTMRack 4 in TMO hutch, FODU2, Cassette 4, fibers 3-4 (a.k.a TMO2.4.3-4)Note that cassettes 3 and 4 are swapped between rack 3/4
      XPM 2 network connectionRack 3, Cassette 3, fibers 23-24, goes to Rack 4 FODU 5, Cassette 4, fibers 23-24, goes to Rack 4 FODU 2 cassette 4 fibers 5-6Note that cassettes 3 and 4 are swapped between rack 3/4

      RIX Hutch Fiber Connections

      SourceDestinationNotes
      XPM 3 network connectionRack 1 FODU Cassette 1 fibers 15-16Don't immediately know what the official fodu number is
      XPM 3 AMC1 port 5 counting from 0Room 208 RIX1 fodu, cassette 1 fibers 11-12Wasn't connected on the room 208 side on Oct. 26, 2022.  Maybe not necessary any more?

      MFX Hutch Fiber Connections

      SourceDestinationNotes
      BOS 1.8.1, 1.8.2 and XPM7 outputBuilding B950 RB02 in room 208: SM S04 To B999 MEZZ FODU 43 R11, Ports 1,2,43 fiber pairs for epixHR data (two pairs) and timing (one pair)

      XTCAV Fiber Route

      SXR

      From Matt: I tried to look up the exact path of the xtcav fiber, but couldn't trace it all the way through captar.  I know it comes from B921 Rack 73 to B921 BDF1;  Chris and I traced this fiber.  From there it goes to B005 Rack 611 and then to B950-R42 (now renumbered as R02) at elevation 36, I believe.  There are lots of fibers at that location, so we may need two people to locate it - hold a strobe to one end and look for it on the other end.

      And rougher notes that cpo doesn't currently understand:

      rack B921-BDF1
      SM slot 3 to B005 FODU 3 RK 611
      fibers 3 4 in fodu

      In building 921 rack 73 the DMPH (HXR) server is at height 24 and DMPS (SXR) server is at height 22.

      HXR

      TBD, but presumably similar to SXR.

      Pictures of B921 Rack 73

      Front and back

      Image AddedImage Added

      Room 208 Fiber Connections

      See FEE Alcove for description of which patch panel in 208 goes to which detector.  Note that the fiber numbering on that page is different from here.  On the FEE alcove page we number fibers left-to-right, then top-to-bottom.  Here we use a better scheme: using the actual fiber numbers marked on the cassettes.  We should convert the FEE-alcove page to use the better fiber-numbering scheme.

      SourceDestinationNotes
      ATCA FEE router port 0ATCA room 208 router port 1 10Gb network to SRCF node, the connection is done via the octopus fiber #4
      room 208 ATCA crate switch optical fiber port 0SRCF LC cassette 4 (counting from 1, left to right) fibers 11/1210Gb network to SRCF node (drp-srcf-cmp004?)
      TMO XPM 2 network connection (TMO FODU 1, Cassette 4 fibers 5-6)ATCA switch optical port 7 counting from 0needed to swap tx/rx fibers to get link-lock
      RIX XPM 3 network connection (RIX FODU, cassette 1, fibers 15-16)ATCA switch optical port 6 counting from 0
      Mono Encoder NetworkFrom FEE Fodu 1 cassette 3 fibers 1,2 to SRCF LC fodu fibers 21,22
      Timing output of XPM2 in 208TMO FODU 1, Cassette 3, Fibers 17-18: 1.3.17-18Cassette 1 is missing
      Timing output of XPM3 in 208RIX FODU 1, Cassette 1, Fibers 7-8: 1.1.7-8
      XPM0-AMC0-PORT0RIX 1.1.3-4This is XPM0 → XPM3 in RIX, FODU 1 for RIX is FODU 5 in 208
      XPM0-AMC0-PORT1TMO 2.4.3-4This is XPM0 → XPM2 in TMO, FODU 2 for TMO is FODU 7 in 208
      XPM0-AMC1-PORT2TMO 2.3.33-34 (tmo cassette 3 fiber 33-34)Backup connection for XPM0->XPM2
      XPM5-AMC0-PORT0RIX 1.1.3-4This is XPM3→ XPM5
      XPM6-AMC0-PORT0TMO 1.3.17-18This is XPM2→ XPM6
      XPM0-AMC1-PORT0FEE FODU 1, Cassette 4 fiber 11-12 (top right)LCLS2 timing for FEE Teststand
      TMO ATM CAMLINKTMO FODU 1 cassette 3 fiber 1-2 (a.k.a. TMO1.3.1-2)cassette 1 is missing, swapped tx/rx at bos
      RIX FIM MR4K2RIX FODU 1 cassette 1 fibers 25-26 (a.k.a RIX1.1.25-26)
      RIX FIM MR3K2RIX1.1.27-28
      RIX FIM CHEMRIXRIX1.1.29-30
      TMO FIM1TMO1.3.5-6Not sure which FIM this really corresponds to in TMO
      TMO FIM2TMO1.3.7-8Not sure which FIM this really corresponds to in TMO
      RIX HSD2RIX1.1.19-20I may be swapping hsd2/3 (this was FEE fodu 1.3.18, old numbering scheme)
      RIX HSD3RIX1.1.23-24I may be swapping hsd2/3 (this was FEE fodu 1.3.15, old numbering scheme)
      TMO CAMLINK OPAL1TMO1.4.1-2swapped tx/rx at bos
      TMO CAMLINK OPAL2TMO1.3.3-4swapped tx/rx at bos
      TMO CAMLINK FZPTMO1.2.11-12swapped tx/rx at bos
      RIX CAMLINK ATMRIX1.3.13-14
      TMO HSD3 or companionTMO1.4.13-14I may be swapping hsd3 with its companion (don't know the name: not in tmo.cnf?).  This one was in fee fodu1.1.11 (old numbering scheme).  Needed tx/rx swap at bos.
      TMO HSD3 or companionTMO1.4.15-16I may be swapping hsd3 with its companion (don't know the name: not in tmo.cnf?).  This one was in fee fodu1.1.9 (old numbering scheme).  Needed tx/rx swap at bos.
      TMO HSD5 or HSD7TMO1.4.31-32I may be swapping hsd5/hsd7.  This one was in fee fodu 1.1.1 (old numbering scheme).  Needed tx/rx swap at bos.
      TMO HSD5 or HSD7TMO1.4.29-30I may be swapping hsd5/hsd7.  This one was in fee fodu 1.1.5 (old numbering scheme).  Needed tx/rx swap at bos.
      TMO HSD4TMO1.4.27-28Was in fee fodu 1.1.4 (old numbering scheme). tx/rx swap at bos.
      TMO HSD4 companionTMO1.4.33-34Was in fee fodu 1.1.6 (old numbering scheme).  tx/rx swap at bos.
      TMO HSD1TMO1.4.17-18Was in fee fodu 1.1.12 (old numbering scheme).  tx/rx swap at bos.
      TMO HSD2TMO1.4.19-20Was in fee fodu 1.1.8 (old numbering scheme).  NO tx/rx swap at bos!
      TMO HSD6TMO1.4.35-36Was in fee fodu 1.1.3 (old numbering scheme).  tx/rx swap at bos.
      TMO HSD6 companionTMO1.4.25-26Was in fee fodu 1.1.2 (old numbering scheme).  tx/rx swap at bos.
      TMO HSD9TMO1.4.21-22Was in fee fodu 1.1.7 (old numbering scheme).  tx/rx swap at bos.
      TMO HSD8TMO1.4.23-24Was in fee fodu 1.1.10 (old numbering scheme).  tx/rx swap at bos.
      RIX HSD1RIX1.1.21-22Was in fee fodu 1.3.8 (old numbering scheme)
      RIX HSD0RIX1.1.17-18Was in fee fodu 1.3.9 (old numbering scheme)
      PEPPEX HSD1Room 208 Rack 2 PH4 "To B920 R90-S SLOT B" fibers 21-22 (second from bottom).  Also labelled "slot 4" on the slot itself.Was in fee fodu 2.4.3 (old numbering scheme)
      PEPPEX HSD0Room 208 Rack 2 PH4 "To B920 R90-S SLOT B" fibers 19-20 (third from bottom). Also labelled "slot 4" on the slot itself.Was in fee fodu 2.4.4 (old numbering scheme)
      PEPPEX OPALRoom 208 Rack 2 PH4 "To B920 R90-S SLOT B" fibers 23-24 (bottom pair). Also labelled "slot 4" on the slot itself.Was in fee fodu 2.4.5 (old numbering scheme)
      XTCAV (SXR, cpo believes)Room 208 Rack 2 PH2 fibers 61-62 from B005 (each cassette has 12 fibers, so top of sixth cassette from left)Was in fee fodu 1.2.2 (old numbering scheme)
      TXI FIM

      Room 208

      XPM 5 AMC 1 SFP 2 (20240112) XPM 6 AMC 1 SFP 6 To FODU 8 Cassete 2 Port 9-10

      Data To FODU 8 Cassete 2 Port 11-12 


      TMO LCLS1 timing

      XPM7 AMC1 port1 to TMO FODU 7 Cassette 3 (counting from 1 with 4 cassettes total, one currently unoccupied) fibers 11-12


      XPM0-AMC1-PORT4FEE FODU 6, Cassette 3 fiber 23-24 (lower right)LCLS2 timing for FEE Teststand XPM10 RTM
      TMO HSD 88 or 89BOS (2.1)1-2 or 5-6In TMO Hutch connected to FODU1 Cassette 1 position  8 (most left in the middle row might be broken) and  15  (lowest row int he middle) RACK 4
      in 208 FODU 7 RACK 4
      TMO HSD 89 or 88BOS(2.1) 5-6 or 1-2in TMO Hutch connected to FODU1 Cassette 1 position 9 and 10 RACK 4
      in 208 FODU 7 RACK 4
      N.B. position 9 (in the middle row third from the left) was already taken in 208 but not in TMO. Connected to  FODU4 (208) cassette 2 (second from the left) position 7 (first from the left in the middle), but removed because no fiber in TMO.
      TMO HSD 1 (1B:B)BOS 1.8.3In TMO hutch connected to FODU1 Cassette 1 position 3 (counting from top left from 1) RACK4
      TMO HSD 18 (B1:B)BOS 1.8.4In TMO hutch connected to FODU1 Cassette 1 position 4 (counting from top left from 1) RACK4
      RIX High-rate encoder in FEE (data and timing, in that order)

      From FEE: B940-008-R03-FODU-U1 PAIRS 2 and 3 COUNTING FROM 1

      Through FEE alcove: B940-009-R06-FOD3-U1 pairs 2 and 5 counting from 1

      To B950-208-r42-FOD3-U2 PAIRS 2 and 5 COUNTING FROM 1

      Swapped tx/rx at xpm5 amc1 port 2 (counting from 0).

      Data also needed to be swapped going into BOS (1.7.8).


      XPM Topology

      Code Block
      lcls2Timing -> xpm0 -> 2 (tmo) -> 4 (tmo)
                                     -> 6 (208) -> BOS
                          -> 3 (rix) -> 5 (208) -> BOS
                          -> 10(fee) -> 11(fee)
      lcls1Timing -> xpm7

      Problematic connections SRCF ↔ 208

      • DRP-SRCF-CMP018-QSFP1 → 5.3.6 (Shows -7.27, is an HSD)
      • DRP-SRCF-CMP008 (reported by ric):  Connecting DRP-SRCF-CMP008.0_TIMING (5.5.1) to XPM-6_AMC-0_SFP-1 (5.8.4) doesn’t bring up ‘TDetSim/cmp008’ in xpmpva and shows LinkRxErrs
      • move base processes to mon001

      Cleanup:

      • old neh cmp013 going to xpm3 amc0 port 5
      • old neh cmp015 going to xpm3 amc1 port 0
      • LC patch panel connections to SRCF
      • leftover long fibers in 208