Would you like to help test Confluence and Jira updates? Please fill out the form here: https://forms.gle/5TbSqvYYCnTyyxSN7
2) Change the config_fk (mootkey) in MOOD's Acq_summary in the MOOD/FMX MySQL database.
To access the database, you need to login to fermilnx02 (in 2023) and issue the command
mysql -h glastMOOD -P8208 -u <username> -p. You will need to get a password from the secret/fpd/fermi/
isoc vault. Richard may need to put in a ticket for you to get permission. In 2023, we used Steve Tether's account (tether) since the "magician" account is overpowered for what we need (it's basically the super-user account).
3) In some receipts (e.g. in older emails) is written that a repipe is neccessary. Michael doesn't recall repipes for the 2017 key mismatch. At least no helpful repipes. In 2023 for sure no repipes were performed. Don't repipe unless really neccessary!
4) Rollback the affected deliveries
If they are in a Failed state, you can just do a standard rollback.
If findChunks is stuck, then bkill the process and wait for the reaper to get it. Most of them should then auto rollback without intervention.