2024-02-08 Meeting notes

Power restore expected Friday night update: Saturday

• SC turn on after PAMM
• Thursday evening (15th)
• Potential issue with 60 kV line and discussions of a brief power outage
  • Sebastian against it because it would take down the cryoplant

Damaged key for sector 0 key bank

• There are spare keys that are locked up

• AMRF did manual detuning on Sunday using the power boxes
• AMRF preparing more boxes
• It takes 3 min to move 50 kHz (one click) and some cavities needed 5 'clicks'
  • Time consuming
• The procedure is not uniform (each cavity requires a different amount of movement)
  • We had no nice way of giving this information to those doing the detuning
    • There was lots of text communication with Sebastian
  • Our records of cavity states were out of date which delayed us getting the information to AMRF
  • We can create a sheet of how much each cavity needs to be moved since this doesn't change
  • Which cavity needs to be moved needs to be updated each time
• According to Yuri we should be within 50 kHz of cold landing
  • It is not clear what is a safe margin
• What's the problem with going too far?
  • We will hit the limit switch
  • The limit switch might fail
  • The limit switch might be too far past cold landing
• Back up power for racks should be a facility level problem/solution
  • AMRF would just deploy a bunch of batteries which would be hard for them to maintain
• We should plan out how to make this easier
  • This was the first time it was done and it had to be done for all CM
• Improvement:
  • In-line connector that is easy to connect (current connectors need to be screwed on)
    • The cable connections slowed things down
• Rack system moves four cavities at a time
  • To move fewer cavities you disconnect cables
• Might be able to use a laptop running epics with an interface box to move the cavities independently per rack
  • Need to worry about keeping the laptop up to date and charged
  • Command line? Interface?
  • This might require more training
• We should think about training up more people to be able to help with detuning
  • We were lucky that Andy was on site and more people were available
  • Potentially train people in SRF
  • Is there potential to train ops to help with this?
    • Janice: its hard to predict if ops would have bandwidth during a power outage
      • Sometimes they are waiting, and sometimes they have lots of calls
• There were alarms going off in the gallery the whole time
• It was not clear how to detune the HLs
  • How much does the tune change and is it the same direction
  • It is the same button press to detune on the chassis

• Fallout from detune
  • Some screws on DB9 connectors would pull out
  • Some screws were broken off and damaged connections
  • They need to go and fix these
  • New limit switch faults might be caused by mechanical damage
    • Simple fix: replace screws

• Many people will be out next week
• Andy and Rick have a list of things they'd like to look at
• Fallout from

• Seen in 4 racks
• Two racks have updated firmware, but two don't
  
  • New firmware might fix issues
• If seen, just keep running rack checkout until it is fixed

• New alarm for spotting this