T9/PS run Daily Briefings - 3PM
Daily briefing minutes
August 10 - 13-3-005
Communications |
News from PS/PS Users Meeting:
-intervention on QED2 scheduled to end 5PM; spare was found to be not working, a second spare was available but needs to be equipped with a new vacuum chamber that will be taken from the 1st non good spare
- beam loss in the separation magnet between east hall south and north branch; currently this is the reason why we have no beam; if replacement of QED2 cures the loss we should get beam back tonight, otherwise a technical intervention will be required, and cooling time is 4 days minimum (currently the radiation level at the separation magnet is 2mSv)
- supercycle changes: agreed changes for next week so that we get 3 spills in east hall during working hours and 4 during night and week-ends; the fourth spill will come around 4 sec later that the first three. new changes wil be discussed for week 34 (check weekly schedule here)
- Luca to investigate on the possibilty of an extension with the MICE group which is supposed to run after GLAST |
Online&DAQ Report |
Ric confirms that agreed modifications on spill structure for next week will not hamper DAQ sync and data merge online |
OfflineReport |
- Nicola reported on ancillary recon performance and tagger studies; taggeed electrons momentum resolution is 3.5% (beam+MS+tagger), better than expected. Current AD recon only available locally, working to make it available to everybody here w/o waiting pipeline to update; also speeding up release process and pipeline re-processing of tagged photon runs
- Monica B reported on preliminary studies of Tkr TOT
- Eric C reported on ACD calibrations; mapping of electronics is correct, geometry and recon in place but reconstructed tracks show small discrepancies with expected tiles positions (order 1 cm); MIP peak to determine VETO threshold relocated with CR after changing timing, tiles behave differently, will make sense to cross-check with beam (as done with Alex at the beginning of the run);
- Monica P reported that the last generated MC file has a BL=0.45 which is wrong; Luca B to udpate confluence with correct conversion plot for current vs bending power and tell Francesco |
Program |
- agreed program (still) here
will have to rediscuss program again if intervention is required on separation magnet |
Notes |
please provide Luca with updated presence of people at CERN to allow completion of shift list |
August 9 - 32-1-A24
Communications |
No beam since this morning at 9. CUrrent estimation is NO beam before tomorrow afternoon, shifts are suspended, we will restart tomorrow at 12 and update.
Tagger calibration done. 2.5 GeV e beam used to collect 100K tagged gammas, 2M events full-brem gammas |
Online&DAQ Report |
DAQ sync with AD ran smoothly since this morning at rates up to 1500 part/cycle, corresponsind to a peak rate of 1KHz (max is 2K), with a beam intensity of 60KHz |
OfflineReport |
- Latency for full-brem runs is large due to caltuple merge, Luca to investigate with Francesco if pipeline can be coinfigured to link to merit and SVAC tuples before merging caltuple; the other option is to give up the CAL tuple (to be discussed with CAL people)
Offline monitor report (Claudia) - must transfer correct geometry in AD recon and check filling of si det of downstream tagger
Tagger calibration onnline report (Carmelo) - all is under control
Preliminary analysis of 1 full-brem run (Eduardo,Benoit PSF and Erecon, Gary) |
Program |
- agreed program here |
Notes |
|
August 8 - 13-3-005
Communications |
Beam back from9. Standard beam with 3 spills from 11. Discovered that magnet settings were wrong and gave beam crossing cerenkov detectors therefore reducing e fraction and trigger efficiency. After loading the magnet settings file from Erik everything was fine and we could restart.
Tagger calibration program going on; usptream arm aligned with CU, BL scan in progress, dowstream arm to be aligned by tonight. |
Online&DAQ Report |
DAQ sync with AD ran smoothly since this morning at rates up to 1500 part/cycle, corresponsind to a peak rate of 1KHz (max is 2K), with a beam intensity of 60KHz |
OfflineReport |
- Local Offline coordination and daily reports: Claudia for TKR, Philippe for CAL, Eric C for ACD, Nicola M for ancillary and beam diagnostics |
Program |
- Finish tagger calibration by tonight
- Collect 100K in tagging mode, CU at 0 angle, center of tower 2
- Collect 2.4M evts in full-brem, CU at 0 angle, center of tower 2
See detailed program here |
Notes |
When changes to the beam line are to be made, please use the table provided here and not the table from EBCR |
.....................
July 31 - 32-1-A24
Communications |
UPS identified and ordered (3 UPS with 900W x 7min for DAQ PCs, 1 UPS with 450W x 7 min for 28V PS); should be delivered wednesday |
Online&DAQ Report |
CU DAQ maximum readout rate with full error parsing in the code is 300Hz average, corresponding to 4KHz instantenous rate during the spill (our spill structure is 3 x 0.4s spills every 16 s). Indeed runs were taken with instantenous rates up to 2KHz. This max value will be checked with a random trigger generator (low threshold scintillator) and with the beam as soon as it gets back.
Ric on TEM errors: come in a variety (TKR fifo full, phasing errors, parity errors ...); some are just fake errors connected to the so-called TEM-bug in the CU TEM (which are not flight). TKR fifo full errors probably connected to beam conditions producing showers in the last si det upstream the beam and before the CU (see also offline reports), in any case the almost full flags in the GTCC buffer was changed to 0X3E from 0x20 (from E Siskind) to allow for more hits in the tracker before back-pressure events and slow readout rate. Phasing errors found in 1 run only so far, so might be connected to wrong settings - a run with beam shooting across towers should be taken to check if phase errors appear in such conditions. In summary, if we keep trigger rate below 300Hz average we should run w/o errors and be limited by the AD DAQ deadtime (approx 1 ms)
DAQ sync: tested with external veto set to 3ms, which was set to avoid CU errors in the wrong assumption that the CU DAQ readout rate is limited to 300Hz instantaneous and not average ; need to retest it w/o such limitation and with the only veto given by the AD DAQ |
OfflineReport |
- Francesco: acdrecon and adrecon in new BTRelease; bug fix in the svac ntuple to avoid overwriting first 1000 evts
- Benoit reported on an anomalous high number of hits in run 811, but also in another run for which the si det al frame was not in the beam
- Philippe reported on a strange effect in the distribution of the transverse dimension of showers in the CAL for most e runs taken for CAL calibration (700-750), indicating 2 classes of events; he also reported on a raw energy distribution with 1% of the events exceeding the beam energy
- Claudia spotted an anomalous high number of tracks in the runs (700-724)
- Discussion: the above analysis and the online picture of the beam on the last si det indicate that the beam line is too congested and must be cleaned; the si det will be repositioned to remove the frame from the beam, and a subset of scintillators will be used for trigger (S3 will be removed, and after the beam is well understood we might rely on Sh in anticoincidence with S2 |
Progrm |
- CU DAQ max readout rate test with random generated pulses
- DAQ sync w/o external 3ms veto
- no beam foreseen for the night, restart shifts from tomorrow morning 8AM |
Notes |
Action items
- Luca: provide shift task list, revise shift log and transfer paper logbook info in there for reference for everyone
- online: add an all-particle type selection in the DAQ GUI
- carmelo and eduardo: verify ACD mapping, ROI definition and ACD timing |
July 30 10.30AM - T9 barrack
- List of runs (Eduardo)
- Updated shift list (luca)
- UPS for DAQ PCs and CU PS (luca and gloria)
July 29 8PM - T9 barrack
- Restart of activities
1) Ric: CU DAQ PCs restarted ok, need to switch on CU and acquire some test runs to verify DAQ hardware is ok
2) Philippe: verify XY table is working fine, initialize again to establish reference point
3) Fabio: AD DAQ is on again, test runs being taken and look ok
- List of tasks for 7/30 (no beam available)
- Online team + Sandro: provide online plots for tagger alignment and calibration
- Francesco: verify pipeline is fine and test ACD reconstruction on local PCs, test also ANC reconstruction, improvements on MC geometry in progress, measurements of beamline
- Claudia/Monica: verify offline monitor
- Eduardo: provide list of interesting runs taken so far and distribute it to analize
- Luca, Gloria: provide UPS for at least LAT-BTserver, enquiry about UPS for other DAQ machines and CU PS
- Luca, Gloria, Nicola, Eduardo: provide sketch of experimental setup, trigger setup
- Luca: new shift list with 8 hour shift and 3 people per shift (4 if possible)
July 29 - T9 barrack
Communications |
- POWER OUTAGE ON THE WHOLE CERN SITE SINCE 8AM - NO ESTIMATION ON POWER AND BEAM. After contacting the control room we decide to stop shifts until the power is back, and we meet at 8PM at T9 to check again with CR; if no changes happen we will meet again tomorrow at 8AM.
- Procedures for power back: even if chiller is not operational there are no issues with CU as gas is flowing and ambient temperature is below 30C. No danger for the CU when power comes back, just have to properly reset XY table before operaing. Experts will have to work on restart DAQs and network connection as soon as power comes back.
- First tagger arm aligned with beam, chambers orientation understood; 1 finger counter working, the other being fixed. Current scintillators installed are S0 (10x10), S1(finger), Sh (halo veto), S3 (10x10 before CU) |
Online&DAQ Report |
- The external trigger signal delivered to the CU had a wrong TTL polarity, resulting in the CU being triggered on the falling edge of the trigger occuring 800ns later than the rising edge; this was corrected and the external trigger signal was aligned with trigger requests from TKR and CAL. New test of DAQ sync will have to be performed to verify if we can work at higher rate (200 evts/spill was the max stable rate tested so far)
- Owl shift: all ACD tiles hit by the beam (5 GeV pione) and MIP peaks aligned
- absence of CAL-HI trigger understood: bug in configuration file disabled CAL-HI, now cured and good FHE file loaded; CAL HI triggers seen in the data
- CU: Ric investigating phasing errors |
Offline Report |
Francesco:
- recon runs resubmitted, few runs still fail at different pipeline stages
(@ digi for corrupted events?; @recon for G4 stuck; @svac to be investigated)
- new BTRelease installed on local PCs
Claudia:
- latest fixes to offline monitor, waiting to test with last night data as soon as power is back |
Program |
- Carmelo and Sandro working on the online monitor to align and calibrate the tagger
- define trigger configurations
- CAL runs with e
- Tagger calibration
- provide instruction for shifters to post on confluence (CU DAQ, AD DAQ, trigger setup, offline distributions to monitor) and in the barrack |
Notes |
- people are invited to start looking at data offline and report
- from monday will have 30hour for the daily reports and 30min for offline report |
July 28 - room 13-3-005
Communications |
- Magnet failure: MNP17 colling system failure at 1AM stopped data taking for several hours but no damage on hardware. Physics restarted after 2 hours w/o silicon tagger for CAL calibrations. Magnet repaired in the morning
- CU cooling system changes: CU/ISC cooling coil in the ISC base plate leaked: it was emptied and is now non available, we will rely on top cooling coil as no intervention is possible; the chiller was moved closer to the ISC to minimize thermalization of coolant with ambient through thermal exchange with the zone air, now chiller more efficient; fan added to cool XY table motors. Please look at the temperature during your shift |
Online Report |
- DAQ sync studies going on
- CU: Ric investigating phasing errors |
Offline Report |
Francesco:
- pipeline nicely running
- 1st 1000 evetns in SVAC ntuple duplicated
Claudia:
- offline monitor requires script to parse rcReport info and link to MC files (Navid working on that)
- MC and CU cooprdinate systems mismatch (check with Philippe)
Dave:
- no CAL-HI triggers in last night data as fhe values were saturated |
Program |
- Complete DAQ sync studies
- perform CU timing studies to optimize TACK (timing/script vs ext trigger manual delay)
- explore beam conditions
- ACD calibrations (ideally 5gev p, if NA 5gev e)
- CAL runs with e (Benoit)
- Tagger calibration start on 29 morning |
Notes |
- Fill elogbook
- Take your shifts and launch runs yourself
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="f06cc020-32c1-4832-93eb-1391fe2d405e"><ac:plain-text-body><![CDATA[- rcReport has wrong table positions for runs [701-736]; the right correlation table between position and run will be circulated. Please reset runcontrol before starting a new run when you change conditions (table position, beam configuration, trigger, CU conf) |
]]></ac:plain-text-body></ac:structured-macro> |