...
Institution | Names |
---|---|
ANL | Vallary Bhopatkar |
IHEP | Yubo Han |
LBNL | Alexandra DimitrieskaAleksandra Dimitrievska, Maurice Garcia-Sciveres, Timon Heim, Charilou Labitan, Ben Nachman, Cesar Gonzalez Renteria, Mark Standke |
Louisville | Swagato Banerjee |
SLAC | Nicole Hartman, Ke Li, Jannicke Pearkes, Murtaza Safdari, Su Dong |
UCSC | Zach Galloway, Carolyn Gee, Simone Mazza, Jason Nielsen, Yuzhan Zhao |
Schedule
Day/Week | Dates | Activities |
---|---|---|
Monday | May/21 | Installation of EUDAQ 1.7. Last chance to test inside tunnel. |
Tuesday | May/22 | Caladium to be removed from tunnel due to invasive beam experiment before us. |
May/23-28 | Caladium parked inside ESA outside beamline but powered on and connected to allow continued new DUT software integration. | |
Tuesday | May/29 | Dismantle of previous experiment by Test Facilities. Caladium reinstallation in beamline and DUT setup can start in ~afternoon. New user in person training 116PRA: 11:00am–12:00 noon, Building 28 Room 141 |
Wednesday | May/30 | Installation and integration. Potential first beam. |
May/31-Jun/5 | Formal run period | |
Tuesday | Jun/5 | Beam off at 9am |
Data taking run shift list
Data Run Summary List
Event Log
May/7
Test period formally allocated for May/31-Jun/4, which is the very last period before LCLS beam summer shutdown (until Sep/2018) to give as much time as possible to prepare the setup for the RD53A module. 3 other experiments are scheduled before us and some of them are rather invasive so that the Caladium telescope will be removed from the tunnel which we have to reinstall just before our period.
...
Run Number | Start time | End time | Number of Events | Window coordinates (DUT) | Comments |
---|---|---|---|---|---|
90 | 02/06/18 11pm | 02/06/18 11:25 pm | 8655 | x=100~300 | |
91 | 02/06/18 11:27 pm | ||||
92 | 02/06/18 11:27 pm | 03/06/18 00:27 am | 19007 | We hadn't saved the histogram at the end of run 91, so the run histogram just has twice as much data. But the beam conditions were stable between these two runs. | |
93 | 03/06/18 00:30 am | 03/06/18 01:03 am | 9021 | ||
94 | 03/06/18 01:05 am | 03/06/18 01:36 am | 9284 | ||
95 | 03/06/18 01:39 am | 03/06/18 02:07 am | 9013 | ||
96 | moving the RD53: up 1cm (Motor 3: Y fine : > 1cm) | ||||
97 | 03/06/18 02:24 am | 03/06/18 02:54 am | 9113 | ||
98 | 03/06/18 02:57 am | 03/06/18 | 6845 | Changed shift to Ke and Jannicke Stopped early because we were looking at Sensor 0 for measuring the number of events, will be using number of events from Sensor 2 from now on - it does not have hot pixels! | |
99 | 03/06/18 3:14 am | 03/06/18 3:40am | 9210 | ||
100 | 03/06/18 3:40am | 03/06/18 4:06am | 9406 | ||
101 | 03/06/18 4:06am | 03/06/18 4:34am | 9425 | ||
102 | 03/06/18 4:34am | 03/06/18 5:04 | 9173 | ||
103 | 03/06/18 5:04am | 03/06/18 5:31am | 9150 | X: (0,~100) | Moved RD53 (Motor 3 Y:fine < 2 cm) RBV from step at 10.00mm now. Aiming for coverage of 0-100 in X |
104 | 03/06/18 5:31am | 03/06/18 | 9245 | Moved RD53 (Motor 3 Y:fine > 2 mm) RBV from step at 12.00mm now, adjustment was made to get slightly better coverage in the 50-100 range. Looks good now! | |
105 | 03/06/18 | 03/06/18 6:12am | 1197 | Run stopped early - noticed histograms stopped filling ERROR IN DUT DATA PRODUCER vent: tag(0) l1id(14 bcid(11398) hits (0) ERROR IN TLU PRODUCER: Error sending data: While copying this error message pressed control C in TLU Producer ------------------------------------ restarted ./STARTRUN reran ./TLUProducer.exe -r 172.27.100.8:44000 reconfigured EUDAQ in EUDAQ RD using ni_coins_YARR because it seems like it was the most recently updated starting run 933 Histograms not popping up; killing all jobs and restarting ------------------------------------------------ went through steps 1-3 Called Su Dong: suggested we look at size of files df -k Filesystem 1K-blocks Used Available Use% Mounted on /dev/sda1 20030100 18989568 16392 100% /
moved data files to /home/tfuser/data_20180603/ Now down to 81% full Filesystem 1K-blocks Used Available Use% Mounted on /dev/sda1 20030100 15243540 3762420 81% / Okay, so source of the problem was the disk full. -------------------------------------- Step 3 shows errors in finding libraries [tfuser@ar-eudaq eudaq-1.7]$ ./OnlineMon.exe: /usr/lib64/libstdc++.so.6: version `CXXABI_1.3.8' not found (required by ./OnlineMon.exe) ./OnlineMon.exe: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.20' not found (required by ./OnlineMon.exe) NEEDED TO SOURCE SETUP_EUDAQ.SH. Edited twiki to reflect this. ----------------------------
./TLUProducer.exe -r 172.27.100.8:44000 bin/YarrProducer -h configs/controller/specCfgExtTrigger.json -c configs/connectivity/example_rd53a_setup.json -s configs/scans/rd53a/std_exttrigger.json -r 172.27.100.8 Step 4 Cannot connect to pixel@172.27.104.52 ssh_exchange_identification: Connection closed by remote host We can ping 172.27.104.52 but cannot log into it? Why? ------------------------------------------ From our end we are able to ssh into other places, so the issue appears to be with the 172.27.104.52 computer. We also tried just sshing with no username and this just hangs. Looked through ssh keys, no username associated with IP address although a key exists. We think we might need to reset the computer, but the beam is on.
| |
03/06/18 | Timon and Alexandra have arrived, Timon made an access and they are now resetting the computer. We stopped the HGTD run before the access request was made. | ||||
106 | 03/06/18 | 03/06/18 9:05 | 9334 | Beam is back, restarted a new run. Also restarted a new run for HGTD | |
107 | 03/06/18 9:08 | 03/06/18 9:40 | 9384 | Transferred to Alexandra | |
108-119 | 03/06/18 09:41 | 03/06/18 | empty | The beam was turned off at 9:51. 108-119 are runs without beam used for testing the YarrProducer setup. No root files saved. RD53a config file changed. | |
120 | 03/06/18 10:50 | 03/06/18 10:53 | few events | To test the config files. | |
121 | 03/06/18 10:54 | 03/06/18 11:09 | 4439 | First run for analyzing with a new config. Restarted a new run for HGTD. The EUDAQ online monitor crashed; root file not saved. | |
122-126 | 03/06/18 11:13 | 03/06/18 11:40 | Testing Yarr and EUDAQ; no good data for analyzing. Root files not saved.
| ||
127 | 03/06/18 11:41 | 03/06/18 12:15 | 10000 | EUDAQ online histograms not reset or saved. | |
128 | 03/06/18 12:15 | 03/06/18 12:49 | 9812 | Automatic new run. Reset EUDAQ online histograms. | |
129 | 03/06/18 12:51 | 03/06/18 12:59 | 2300 | No root file saved. | |
130 | 03/06/18 12:59 | 03/06/18 13:08 | 2518 | No root file saved. | |
131 | 03/06/18 13:10 | 03/06/18 13:12 | 702 | No root file saved. FIXED in this run: Example producer was sending fake data every 20ms. | 132 | 03/06/18 13:12 | 03/06/18
Datataking came to a halt due to data disk /dev/sda1 full and YARR computer USB errors prevented login. More detail in Event log. Ended Run early. | |||||
106 | 03/06/18 | 03/06/18 9:05 | 9334 | Beam is back, restarted a new run. Also restarted a new run for HGTD | |
107 | 03/06/18 9:08 | 03/06/18 9:40 | 9384 | Shift Transferred to Alexandra & Charilou | |
108-119 | 03/06/18 09:41 | 03/06/18 | empty | The beam was turned off at 9:51. 108-119 are runs without beam used for testing the YarrProducer setup. No root files saved. RD53a config file changed. | |
120 | 03/06/18 10:50 | 03/06/18 10:53 | few events | To test the config files. | |
121 | 03/06/18 10:54 | 03/06/18 11:09 | 4439 | First run for analyzing with a new config. Restarted a new run for HGTD. The EUDAQ online monitor crashed; root file not saved. | |
122-126 | 03/06/18 11:13 | 03/06/18 11:40 | Testing Yarr and EUDAQ; no good data for analyzing. Root files not saved.
| ||
127 | 03/06/18 11:41 | 03/06/18 12:15 | 10000 | EUDAQ online histograms not reset or saved. | |
128 | 03/06/18 12:15 | 03/06/18 12:49 | 9812 | Automatic new run. Reset EUDAQ online histograms. | |
129 | 03/06/18 12:51 | 03/06/18 12:59 | 2300 | No root file saved. | |
130 | 03/06/18 12:59 | 03/06/18 13:08 | 2518 | No root file saved. | |
131 | 03/06/18 13:10 | 03/06/18 13:12 | 702 | No root file saved. FIXED in this run: Example producer was sending fake data every 20ms. | |
132 | 03/06/18 13:12 | 03/06/18 13:47 | 10000 | Automatic new run. EUDAQ online histograms were not reset. | |
133 | 03/06/18 13:47 | 03/06/18 14:20 | 9915 | EUDAQ online histograms with previous run. | |
134-137 | 03/06/18 | 03/06/18 | Path for data changed. Monitor didn't work after path changed, so took extra runs trying to fix it. Disregard files with 'Run 1' (0x0B57_000001.*); this was from eudaq not pointing to the run number .dat file. | ||
138 | 03/06/18 14:51 | 03/06/18 15:25 | 9861 | Monitor works now.
| |
139 | 03/06/18 15:37 | 03/06/18 15:47 | Used for moving RD53A | ||
140 | 03/06/18 15:48 | 03/06/18 16:22 | 9866 | X: (~150,~350) | Moved RD53 (Motor 3 Y:fine > 10 mm) RBV from step at 22.00mm now. (Previous RBV from step: 12.00mm.) Aiming for X~300. |
141 | 03/06/18 16:22 | 03/06/18 16:56 | 9875 |
Jun/3
6:00 Event data taking came to a halt during Run 105:
Run stopped early - noticed histograms stopped filling
ERROR IN DUT DATA PRODUCER
vent: tag(0) l1id(14 bcid(11398) hits (0)
Event: tag(0) l1id(15 bcid(11399) hits (0)
####################
### Stopping Run ###
####################
Got 1791events!
Caught interrupt, stopping data taking!
Abort will leave buffers full of data!
Caught interrupt, stopping data taking!
Abort will leave buffers full of data!
Waiting for run thread ...
-> Processor done, waiting for histogrammer ...
virtual void Fei4Histogrammer::process(): processorDone!
-> Processor done, waiting for analysis ...
virtual void Fei4Analysis::process(): histogrammerDone!
void Fei4Analysis::end()
-> All rogue threads joined!
-> Cleanup
Plotting : EnMask-0
Warning: empty cb range [1:1], adjusting to [0.99:1.01]
Plotting : OccupancyMap-0
Plotting : L1Dist-0
Empty data containers.
-> send EORE
Command Thread exiting due to exception:
Error sending data:
From /local/pixel/YarrEudaqProducer/EUDAQ/src/EUDAQ/main/lib/src/TransportTCP.cc:229
In void eudaq::{anonymous}::do_send_data(SOCKET, const unsigned char*, size_t)
ERROR IN TLU PRODUCER:
Error sending data:
From /local/pixel/eudaq/eudaq-1.7/main/lib/src/TransportTCP.cc:229
In void eudaq::{anonymous}::do_send_data(SOCKET, const unsigned char*, size_t)
While copying this error message pressed control C in TLU Producer ------------------------------------
restarted ./STARTRUN
reran ./TLUProducer.exe -r 172.27.100.8:44000
reconfigured EUDAQ in EUDAQ RD using ni_coins_YARR because it seems like it was the most recently updated
starting run 933
Histograms not popping up; killing all jobs and restarting ------------------------------------------------
went through steps 1-3
Called Su Dong: suggested we look at size of files
df -k
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sda1 20030100 18989568 16392 100% /
moved data files to
/home/tfuser/data_20180603/
Now down to 81% full
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sda1 20030100 15243540 3762420 81% /
Okay, so source of the problem was the disk full. --------------------------------------
Step 3 shows errors in finding libraries
[tfuser@ar-eudaq eudaq-1.7]$ ./OnlineMon.exe: /usr/lib64/libstdc++.so.6: version `CXXABI_1.3.8' not found (required by ./OnlineMon.exe)
./OnlineMon.exe: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.20' not found (required by ./OnlineMon.exe)
NEEDED TO SOURCE SETUP_EUDAQ.SH. Edited twiki to reflect this. ----------------------------
./TLUProducer.exe -r 172.27.100.8:44000
bin/YarrProducer -h configs/controller/specCfgExtTrigger.json -c configs/connectivity/example_rd53a_setup.json -s configs/scans/rd53a/std_exttrigger.json -r 172.27.100.8
Step 4 Cannot connect to pixel@172.27.104.52
ssh_exchange_identification: Connection closed by remote host
We can ping 172.27.104.52 but cannot log into it? Why? ------------------------------------------
From our end we are able to ssh into other places, so the issue appears to be with the 172.27.104.52 computer. We also tried just sshing with no username and this just hangs. Looked through ssh keys, no username associated with IP address although a key exists.
We think we might need to reset the computer, but the beam is on.
8:00 Timon and Alexandra have arrived, Timon made an access and they are now resetting the computer. We stopped the HGTD run before the access request was made.17:00 Controlled access to rotate the RD53A module.
10:30 Offline analysis for Caladium X vs RD53A Y (due to transposed placement) showed clear correlation, but there are some puzzling extra spurious events.
12:00 RD53A data from last day had spurious extra events, which are tracked down as generated dummy events in the DUTproducer example template that was not removed after the actual DUT code implementation.
17:00 Access to remount RD53A DUT. HGTD added another sensor in front of the 4th Caladium plane (now two sensors attached to both front and back).
18:19 Access complete. RD53A rotated so display cables plugged in from the top.
18:21 Beam back on
Run Number | Start time | End time | Number of Events | Window coordinates (DUT) | Comments |
---|---|---|---|---|---|
142 | 03/06/18 18:24 | 03/06/18 18:28 | 0 | No events seen with RD53A, and few event correlations (<10 for MIMOSA 1 &2) between MIMOSA planes. | |
143 | 03/06/18 18:31 | 03/06/18 18:57 | Before Run: Terminated and restarted EUDAQ Run Control. Now seeing events with RD53A and more event correlations for MIMOSA. Only hitting diff FE; moving RD53A. Did not save root file. | ||
144-145 | 03/06/18 18:58 | 03/06/18 19:48 | Still moving RD53A. Asked Control Room to change rate from [First Mode 5Hz] . Increased rate by opening the collimators. Decreased rate right after @ 19:49. | ||
146 | 03/06/18 19:53 | 03/06/18 20:27 | 9917 | Y Fine: RBV from step: 16.00mm. X Fine: RBV from step: -25.00mm. EUDAQ online monitors saved. | |
147 | 03/06/18 20:28 | 03/06/18 21:01 | 9982 | no changes | |
148 | 03/06/18 21:02 | 03/06/18 21:38 | 9991 | no changes See monitoring plots showing correlations between RD53A and Mimosa26 2. |
21:00 Jason Nielsen & Murtaza Safdari on shift. Aleksandra stays to monitor data-taking and supervise rotation of the RD53A module.
21:48 The most recent run, 148, shows nice correlation between the RD53A and Mimosa hit locations.
21:50 The Main Control Room called to say there will be no beam for the next 10 minutes. We took the opportunity to perform a calibration scan.
22:00 Full shift program for remaining period signup complete. Thanks to everyone contributing.
22:10 Beam is restarting in ESA. The Main Control Room mentioned that they will be programmed for 6 keV X-rays. We do not think it will affect our beam much.
Run | Start Time | End Time | Number of Events | Window Coordinates (DUT) | Notes | Mounting Orientation | Rotation (angle of sensor normal to beam) |
---|---|---|---|---|---|---|---|
149 | 03/06/18 22:24 | 03/06/18 22:36 | ~3000 | no change | very low hit rate in RD53A, perhaps due to remnant configuration from calibration scan | columns running up & down | 0 |
150 | 03/06/18 22:38 | 03/06/18 23:11 | 9997 | no change | after stopping DAQ and restarting through init and configure | no change | no change |
151 | 03/06/18 23:12 | 03/06/18 23:46 | 9981 | no change | Hit rates seem about 10% lower than in previous run. Reason unknown. | no change | no change |
152 | 03/06/18 23:48 | 04/06/18 00:01 | 5021 | Rotation: from 78.17 to 153.13. | used for rotation of the chip | no change | 75 degrees |
We confirmed that the cluster size is roughly 7-8 pixels in this last run.
00:01 Beam is off for calibration
00:10 Beam is back on.
After we saw a very weak correlation between RD53A and Mimosas in the previous run, we decided to pass through the configure step before starting the next run. It may be a good idea to do this before each run, just to be safe.
Run | Start Time | End Time | Number of Events | Window Coordinates (DUT) | Notes | Mounting Orientation | Rotation (angle of sensor normal to beam) |
---|---|---|---|---|---|---|---|
153 | 04/06/18 00:18 | 04/06/18 00:51 | 9992 | unchanged | unchanged | still 75 degrees | |
154 | 04/06/18 00:52 | problems getting through config | |||||
155 | 04/06/18 00:57 | 04/06/18 01:11 | 3392 | unchanged | bad run, beam status was changing, and rate was low | unchanged | still 75 degrees |
00:58 Control Room called to let us know that they will be going up a couple of GeV in energy. This may cause increased rate for us.
156 | 04/06/18 01:13 | 04/06/18 01:46 | 9991 | unchanged | this lower rate seems very good for us | unchanged | still 75 degrees |
157 | 04/06/18 01:47 | 04/06/18 01:58 | 3237 | unchanged | Did not pass through Config before Start. No correlation between RD53A and Mimosas. | unchanged | still 75 degrees |
158 | 04/06/18 01:59 | 04/06/18 02:33 | 9995 | unchanged | Passed through Config before Start | unchanged | still 75 degrees |
159 | 04/06/18 02:34 | 04/06/18 03:07 | 9687 | unchanged | Passed through Config before Start | unchanged | still 75 degrees |
2:55 Early morning crew arrived (Vallary, Carolyn)
03:07 Control Room called to let us know that the energy will be increased again for the primary, starting in 10 minutes.
160 | 04/06/18 03:08 | 04/06/18 03:13 | 866 | unchanged | unstable beam to ESA | unchanged | still 75 degrees |
161 | 04/06/18 03:15 | 04/06/18 03:48 | 9969 | unchanged | stable beam (primary beam E 13.26GeV) | unchanged | still 75 degrees |
162 | 04/06/18 3:52 | 04/06/18 04:24 | 9991 | unchanged | unchanged | still 75 degrees | |
163 | When started new run all producer and data collector state changed to dead. Error message on the YARREudaqProducer: terminate called after throwing an instance of 'eudaq::Exception' Kill the eudaq run control and started again | ||||||
164 | 04/06/18 04:33 | 04/06/18 05:07 | 9998 | unchanged | This is the run after crash and it doesn't show the correlation between the telescope planes and RD53 module | unchanged | still 75 degrees |
165 | 04/06/18 05:09 | 04/06/18 05:43 | 9993 | unchanged | Correlation plots look good | unchanged | still 75 degrees |
05:44 Control Room called to let us know that the energy will be increased again for the primary. Will start the new run once beam is stable.
166 | 04/06/18 05:52 | 04/06/18 05:59 | 2076 | unchanged | Primary beam E 14.08GeV control room called to let us know that the beam will be off for few minutes for gas detector calibration | unchanged | still 75 degrees |
167 | 04/06/18 06:03 | 04/06/18 06:37 | 9998 | unchanged | unchanged | still 75 degrees | |
168 | 04/06/18 06:39 | 04/06/18 06:50 | 3910 | unchanged | control room called as they are changing the beam energy for primary experiment. No beam for few minutes | unchanged | still 75 degrees |
169 | 04/06/18 06:59 | 04/06/18 07:35 | 9988 | unchanged | Primary beam E 12.4GeV Toni from control room called to inform that they are calibrating their gas detectors so turning off the beam for minute. Beam condition is unchanged so didn't stopped the run | unchanged | still 75 degrees |
170 | 04/06/18 07:36 | 04/06/18 08:08 | 9997 | unchanged | unchanged | still 75 degrees | |
171 | 04/06/18 08:11 | DAQ crashed | |||||
172 | 04/06/18 08:15 | 04/06/18 08:48 | 9978 | unchanged | This is the run after crash and it doesn't show the correlation between the telescope planes and RD53 module | unchanged | still 75 degrees |
173 | 04/06/18 08:50 | 04/06/18 09:25 | 9944 | unchanged | correlation plots look good | unchanged | still 75 degrees |
174 | 04/06/18 09:28 | 04/06/18
| ~1500 | Rotate: 153.13 to 159.13 | used for rotation | unchanged | 81 degrees |
175 | 04/06/18 09:40 | 04/06/18 10:05 | 6075 | unchanged | all good, we had to stop the run because the beam is down | unchanged | 81 |
10:05 Control Room called to let us know that the beam is down, they are changing the energy. Restart when the beam is back.
10:32 Beam is back, beam position changed a bit
176 | 04/06/18 10:33 | 04/06/18 11:06 | 9993 | unchanged | good, beam focused to the diff FE | unchanged | 81 |
177 | 04/06/18 11:07 | 04/06/18 11:10 | 910 | X fine: -25.00 mm to -24.00 | adjusting horizontally to the new beam position | unchanged | 81 |
178 | 04/06/18 11:12 | 04/06/18 11:45 | 9947 | unchanged | good, beam focused on lin and diff FE | unchanged | 81 |
179 | 04/06/18 11:46 | 04/06/18 12:13 | 7308 | X fine: -24.00 mm to -23.00 | good | unchanged | 81 |
12:13 Beam lost, should be back in 30 minutes
12:59 Beam is back, rate to high
180 | 04/06/18 12:59 | 04/06/18 13:06 | 2251 | unchanged | beam rate too high (almost 3 times higher), called control room to reduce it | unchanged | 81 |
181 | 04/06/18 13:06 | 04/06/18 13:45 | 9904 | unchanged | good | unchanged | 81 |
182 | 04/06/18 13:53 | 04/06/18 14:28
| 9815 | Rotation: 159.13 to 150.07 | good, rotation done before the start of the run DAQ restarted after the end of the run! | unchanged | 70 |
183 | 04/06/18 14:30 | 04/06/18 15:04 | 9930 | unchanged | good, with correlations | unchanged | 70 |
15:15 Requested access to make reference for the angle of the chip. Please take a screenshot after changing position!
16:07 Beam is back on
184 | 04/06/18 16:17 | 04/06/18 16:17 | 0 | Rotation: 150.07 to 161.24 | restarted DAQ | unchanged | to calculate |
185 | 04/06/18 16:20 | 04/06/18 15:04 | 9973 | unchanged | good | unchanged | 161.24 |
186 | 04/06/18 17:11 | 04/06/18 17:45 | 9976 | unchanged | good | unchanged | same |
17:34 Plan:
- take two runs for each position of the chip
- 150
- 140
- 130
- 120
- 115
- 110
- 105
- 100
- 95
- 90
- take a snapshot for each position, save the picture on the desktop, note the name of the picture in the table
- note the position of the motor in the table
- when reached perpendicular to the beam take the data for the end of the beam
- when the beam is off (and all angles are covered) notify Ben/Timon so we can tune the chip to a different threshold and wait for futher instructions
- before each start of the run, load the config files
- restart the DAQ system
- check the correlation plots Telescope - RD53a
18:00 Ke and SD on shift
18:20 Adjusted DUT rotation to RBV=151.24 (step -10). Rotation stage stuttered a bit but got there eventually.
18:30 Runs 187-189 had some suspiciously low rate of DUT hits, online mon crash because hitting reset during start. Finally got Run 190 going with reconfig.
18:35 Run summary info now recorded in Google Doc Run List directly.
19:30 Noticing the mean hit rate per event rather low seems to be due to beam going on and off. So the total number of events may not be a reliable number to use for the actual track statistics.
19:41 Run 191 reached 10000 events but very low entries in correlation plots so we just let the Run roll over to 192 without saving/reseting monitoring histograms.
20:15 Run 192 reached max events then rolled over to 193 which we stopped after small number of events to conclude this measurements for this angle, with combined mon histograms from Run 191-193 saves as run193.root. DUT rotation -10 RBV=141.24.
20:30 We did a simple calculation from the DUT X vs MIMOSA26_2 X correlation plot from the previous angle's Run190.root histo which showed a slope of (50um/18.4um)*dX(DUT)/dx(MIMOSA)=1/sin(theta) which implied 180-theta=155.3 degrees, which is not far off from RBV=151.24 which is supposedly quite close to the actual angle in degrees. This method is also immune to small telescope tilt which cancels in the slope. The X correlation should be also mostly independent of the active Si depth knowledge. The cluster sized based estimate from tan(theta)=150um/(Cluster-size) gave 150 degrees while the cluster size measurement is somewhat less precise and needs to be sure of the 150um Si depth.
21:22 Run 195 looks like has lost the DUT vs MIMOSA correlation. Stopped run, terminated Run Control and restarted everything for Run 196.
21:40 Run 196 still showing only very faint DUT correlation so we stopped it to reconfig, but looked like we lost beam upon the start of Run 197 so we stopped that short run also.
21:45 Beam back. Started Run 198 and correlations looked much more healthy.
21:50 Primary beam energy went up to 12.48 briefly and then back to 12.12 GeV. Starting a new run for HGTD anyway.
22:18 Stopped Run 198 to change DUT rotation angle to 130 deg. DUT rotation -10 RBV=131.24. Reconfigured twice to be sure to start Run 199. Correlations look good.
22:23 Noticed that each time we rotate and correlated hit region of DUT keeps on marching to higher X and the top edge is getting closer to the right edge. Since the top tip of the correlation diagonal line is running behind the histogram stat box, we tried to move the display stat box but that crashed the online Mon. Had to restart everything for new Run 200.
23:00 After the end of Run 200, we moved the DUT by -2.5mm (towards ESA gate - camera confirmed) to get away from the +x edge.
23:02 Started Run 201. X correlation moved left by the desired amount as expected.
23:14 The DUT correlation looked rather faint/low stat. Ending Run 201 early to reconfigure.
23:15 Started new Run 215 after double reconfig. Correlations looked better.
23:42 MCC called to change primary beam energy to 12.40 GeV. Ending Run 202.
23:45 Rotated DUT -10 to RBV=121.24.
23:46 Started Run 203, but noticed no beam, so stopped it with 0 event.
0:39 Moved DUT dx=-2mm to avoid +x edge
0:39 Run 207 started. Seemed to have more background hits and correlation faint. Ending Run to reconfig.
0:53 Started Run 208. Rate and correlation looked better.
1:30 Rotated DUT -5 RBV=116.24.
1:32 Started Run 209.
2:00 Yubo and Jannicke are on shift
2:19 Stopped Run 210 because of faint correlation plots, reconfigured
2:20 Start Run 211 correlation looks better now
7:45 Run 222 Rate went funny in online monitor (down from 5.1 (4.97) Hz to 4.8 (inf) Hz. Stopped the run (also on HGTD). On restart Yarr producer dead. After restarting Yarr producer, Data collector dead.
8:07 After terminating in eudaq Run Control and restarting, we are up and running again! Restarted HGTD as well.
8:55 Run 227 at hard rotation limit (RBV from step: 98.71), not pushing further to 95, but instead taking data at 98.71.
10:04 Ended Run 228 to access so that we can get around the rotation hard limit to reach 0 degree setting. Simone replaced HGTD sensors with 3-pack in front of 4th plane while removed the one behind that plane. Timon doing calibrations to get a low threshold tune.
10:30 While one can turn the rotation stage knob to make it pass the 0 degree point. The behavior of the software control limit is mysterious. We settled to a position that is 0 degree with the best we can do by measuring distance from 3rd MIMOSA plane to the DUT support frame to be equal on both left and right sides with within 1mm. This doesn't set the sensor angle to beam exactly to zero but makes the DUT parallel to MIMOSA plane. Rotation (new scale) RBV=146.51 for this 0 deg setting. Unfortunately, we can only increase RBV by remote control from this point and it cannot go back. We also took measurements of the plane positions while there.
11:40 moved -4mm in x to center diff FE more in beam. Stopped run and started new one. Only diff FE is enabled with new 800e threshold cal.
11:50 were not seeing correlations with Mimosa 26-2 either in x or y. So decided to stop run, configure twice, and start new run. Forgot to save monitoring plots (the ones showing no correlation). Now in new run we can see correlations.
12:24 stopped run just shy of 9800 events. Just over 1000 hits in diff FE recorded. Started new run, same angle (0)
12:37 for final run plan to rotate in such a way as to match the angle seen in file RD53_Rotation_131_25_dx2p5.png. Want to allow for a 45 minute run + 10 minute rotation and verification of hit rate. Therefore must stop this tun at 13:05 even if it has not reached 10k events yet.
12:50 looks like we lost the correlation at some point. Correlation plots looked bad. Stopped run, configured twice, and started new one. Still at 0 angle
13:05 stopped run. Rotated (file:RD53_Rotation_188_51_new-scale.png). Started a run to see hits. Then moved +4mm in x to get better illumination (saved new image). Noticed no correlation. Stopped, configured twice, and started new run.
13:16 no correlation seen. Stopped run (forgot to same mon. plots). configured. started new one.Looks good. But I don't like this angle (45 deg.) Clusters are too short (size 3). Will take stop at 13:30 and take one more angle (high).
13:29 stopped run. Rotated to very shallow angle (RD53_Rotation_213_51_new-scale-moved-in-x.png). Started new run. Cluster size is now 7.
13:41 correlation seems lost. Stopping, configuring, starting new run.
14:02 14:00 has come and gone and MCR has not called yet. Beam is still going. Keep running
14:08 the beam is gone. Stopped run. Going into access. The end.
Post Beam Session Upgrades
Two main goals:
- Find a more permanent host machine for the TPUProducer (which was running on the YARR DUT machine temporarily during May-Jun beam session). The TLUProducer used to run on the NI Windows system, but the difficulties in building Windows applications during the upgrade process to EUDAQ 1.7 led to the conclusion that it is better to host TLUProducer on a Linux node with easier build framework.
- Bring RCEproducer forward to be compatible with EUDAQ 1.7 for FE-I4 devices
The Sun server for DUT readout is retired and removed from ESA. A new Kingdel fanless PC box running Centos 7 is setup by Matthias and moved into the Caladium rack to replace the old Sun server and also assumed the role of the host for the TLUProducer which communicates with the TLU through a local USB link in the rack. The new Kingdel box retained esadutdaq1 node name and the IP address of 172.27.104.45 on the ESA_RESTRICTED network.
The test associated with this was plagued by events not built errors when FE-I4 DUT were added to the DAQ. This was traced (Sep/11) to the missing ground connection between HSIO2 and TLU. The CAT6 cable cage between TLU DUT port and HSIO2 RTM was insufficient. HSIO2 RTM design consciously grounded the RJ45 cage to the cable cage contact, but the TLU DUT port probably didn't. So the kluge of a LEMO cable between any of the socket in the HSIO2 main board LEMO bank and the TLU DUT trigger LEMO port (e.g. the TTL trig0) is necessary to establish the DC reference level between HSIO2 and TLU.