Here are some notes for the june 10 tagup

Philippe's email report

I won't be able to attend the meeting today. Here is my short written report, based on the results I already posted (https://confluence.slac.stanford.edu/display/SCIGRPS/2010/06/02/First+look+to+periodic+trigger+events+responsible+for+the+loss+of+effective+area)

  • The production of OVRLY and FAKEOVRLY is very helpful to understand the reasons why overlay events prevent simulated events to pass the selection;
  • The tracker activity in a PT event is not the main problem : the cal and acd activities are more often the cause of the loss of the MC events
  • One of the main issue is the fact that the cal direction is is very badly reconstructed because of the PT additional crystals. As a consequence, the track is badly reconstructed as well.
  • This problem can only be solved by a smart clustering, able to find ghost clusters. This is not easy because the ghost clusters are very often large and not so clustered.
  • On top of that, when there is a ghost track, the ghost track and the ghost cluster are very often unrelated. It means that, in most cases, we can't use the ghost track to tag the ghost cluster.
  • All this should help us in defining/optimizing the cal clustering.

Some considerations about the clustering :

  • If there is a ghost track, we know how to find it and remove the ghost hits. It means that for all events, we can end up with a clean tracker information, i.e. hits only due to the main event. This clean tracker information points to the main cluster.
  • When there is a ghost cluster, we want to find two clusters, that can be more or less extended. The goal is to separate the two clusters well enough so that the cal direction is not too bad. It seems to me that this separation is better seen when using the direction of the main event : when projecting the crystals onto the plane perpendicular to the direction, we should end up with two blobs (more or less compact). When using a different axis, the projected cal clusters should be more blurred.
  • The issue is that we don't know the main event direction before performing the track finding, which needs the cal direction as an input.
  • One possible solution is to perform a cal+tkr cluster : find the direction that makes the projected tkr ckuster and cal clusters less blurred. Since the ghost cluster is not related to the track information, the projected ghost cluster is likely more blurred than the main event projected cal cluster. The main event cal cluster is related to the track information, so the projected tkr cluster and the main event projected cal cluster should be on top of each other. So the goal is in fact to find the axis that makes the projected tkr cluster and the related projected cal cluster (which is on top of the projected tkr cluster) less blurred.
  • After the axis is found, it can be used to refine the main event cal cluster. Then, the cal direction can be computed and sent to the track finder.
  • Another possibility is to use the found axis to perform the track finding, without using the cal direction.

Some comments from Luca L

I started looking at some events from Philippe's skim (i.e. those PT that make the overlaid gamma to fail the rejection cuts), which Leon put in users/lsrea/overlay4/MC/.

I basically confirm Philippe's comments for the PT evts that are clearly bound to kill an overlaid gamma:

  • many have lots of activity in the CAL, in some cases with very large clusters extending to several modules
  • several have ACD tiles corresponding to tracks
  • a good number have only TKR activity, unrelated to CAL activity

But I also noticed quite some evts which apparently have no visible signal at all in the ED, and the only non-zero quantity in the merit is from some ACD tile; it is hard to believe that these will kill a good gamma event. This is a non negligible fraction of the evts, but I cannot make a more quantitative statement right now.
Carmelo warned me that in some cases FRED looses sync between digis and merit when moving back and fwd between evts, so I should recheck this

Live notes from the actual tagup

Bill: working with Tracy on a new sim of CAL xtal adding 2 effects

  • add edge effect taking into account solid angle effects and reflection
  • getting details of the xtal edge and materials into the sim, with info from NRL people (Eric Grove on chat: n = 1.46 (for one of DC's other elastomers)
    qualitatively it explains what we see in the data, I think we are on the right track
    Eric G: we tried modeling this long ago, qualitatively you can get it, but actual roughening of this joints, which vsary from xtal to xtal has a huge effect on the actual light taper, so I think you can get close but don't think you can get it right as we don't know what the roughness is; remember there was an engineer from France who claimed to be able to get the light taper curve exactly, but in fact came out with an inverted curve.
    Turn-down is a measure of the transverse location of the deposit across the xtal
    Bill: agree, but I am more optmistic here

Luca L: Johan is simulating evts with the latest asimetry calibration from Sasha and reconstructing with the calibration from L1proc; it seems CTBCORE is screwed to the extent we see in real data
Bill: would be good to quantify how much these CAL calibs are screwed; make a distribution of ? one can envision making a set of MIPs and run with old and new calibs and measure longitudinal residual positions vs tTKR track, take RMS and difference between old and new calibs for all xtals
Eric G: what strucks me is that the shower RMS did not change when doing this, DOCA moves from 2mm to 4 mm, while CTBCORE has a tremendous effect in shape
Bill: not surprising to me, given the weight of the directionality from the CAL at high energy; this effect on CalTrackDOCA may be a big part in the PSF issue, you can easily comeup with deviations of several mrads
Leon: and just to add to this, the lever-arm for back events is much shorter, so with the same effect and a shorter lever arm you could get the larger effect we actually see in the data

Bill: recent issue on availability of HIP for caibration (see C&A list), Eric can you comment about on-going investigations?
Eric C: distinction between FSW bits, which are fine, then the OBF instance that re-run on the ground; when we turned on the DIAG the OBF basically stopped agreeing with FSW HIP bits as they used to. Currently searching root cause. These evts were put into a special GCRCalib stream and they are available in the digis, Sasha should be able to use it if re-starting from there, so we did not loose them, it's a techincal issue to setup the CAL calib to use digis to access evts. But this needs someone to work on GCRCalib code
17:18:33 Richard Dubois and Tracy will investigate when he gets back from San Diego
Eric G: as I understand that is a non trivial effort, but we need to find out; whereas I presume fixing GCRCalib files is easier, but will take a while

Tracy: focusing on getting stuff on McIntegratingHits, not worked much on the Tree based pat-rec

Bill: anybody looked at the new G4 sims after you ran that?
Tracy: Johann working on runing that to Linux, with Heather; Francesco will become available to work on this next week

Leon: conversation with Sandro about mass model, he is setup to review all the numbers and check what has been included, he sent out a note last night which I have not reviewed yet. I will also work on the 200 micron vertical displacement.

AlexD: have a list of updates on TMine with Eric as requested during the meeting; having it to work on windows is priority for next 2 weeks

Leon on ED: requires input from Heather, and she is now tied to ongoing developments, so on-hold for now; we need to put together a set of more specific requirements
Elliott: I read from the workshop that WIRED will finally replace FRED, is this really going to happen? I personally use WIRED
Leon: we do not really have a choice, FRED is not supported anymore, to be honest FRED is more convenient on windows and I will use it until it works, but it will stop working eventually
17:37:52 Richard Dubois the support for WIRED will improve when we get 3 new FTEs into the data handling group.
17:38:02 Richard Dubois until then, support will not be great
17:38:17 Richard Dubois reqs are going out for those FTEs shortly
Richard: it will be at least 2 months, not weeks, but we ahve budget for this

Sidenote from Luca L: electrical power at INFN Pisa is cutoff for a fire in the nearby electrical cabine; not sure when we are back online, so we will not get emails for some time

3 Comments

  1. Johan Bregeon's work on MC generation and recon using differing xtal light taper maps.

    On 9 Jun 2010 (Day 160), at 4:37 AM EDT, Johan Bregeon wrote:

    Hi Sasha and all,

    I did a test locally.

    First thing, I noticed that we're not using the same calibrations for simulations and data processing:
    + simulations
    $LATCalibRoot/CAL/OktoberFest/LAT-flight_gain/digitization-licos-v3r9p3_077014313_digi_DIGI.FLIGHT_GAIN.muonOptical.calAsym.xml
    + data processing
    $LATCalibRoot/CAL/LAT-flight_gain/pre_launch_calib_0608/digitization-licos-v3r9p3_077014313_digi_DIGI.FLIGHT_GAIN.muonOptical.calAsym.xdiodeXtalk.xml

    I have setup an allGamma task with GR-v18r5p1 and 1 GeV < E < 100 GeV.
    I have overwritten the calibration file (the OktoberFest one above) on my local machine so as to
    + Use Sasha's brand new calib asym file "fit_gcrhists_240m_274m_bigsum.gcr_asym_hist.xml" to create mc and digi (and I also save the merit tuple)
    + Use "pre_launch_calib_0608" (the one we use for data processing, see above) to run the recon from mc and digi.
    -> I create this way a new merittuple with "not so good" asymmetry calibrations, as we do for our data.

    See the plot attached for the comparison between original and badasymmetry merit for few quantities.
    The effect on CTBCORE is somewhat stronger than I expected, i.e. compared to the effect of using better asymmetry calibrations for the data--see Luca's post on longitudinal position measurement.

    I have put the merit tuples here:
    /nfs/farm/g/glast/u37/MC-tasks/TmpJohan/Pass8/Datasets/allGamma_Asym_bad/

    I am sure Philippe will study this in more details, and post a summary on confluence to inform C&A... we may decide to to things properly and create IRFs with bad asymmetry calibration constants for current pass7 data.

    I'll try to see today if we can do the same thing with jobOptions and without hacking calibration files or the calibdb...

    Cheers,
    Johan

    Here are the plots.

    1. It looks to me like the change in the DOCA distribution, namely changing from peaking at ~2 mm (in the ideal case of using the same xtal map for MC gen and recon) with mean ~5 mm to peaking at ~4 mm (in the more realistic case of different maps for gen and recon) with mean ~6 mm, has caused a dramatic change in the shape (i.e. the population) of CTBCORE.

      Have we in effect levied an a-posteriori requirement on CAL performance that we (or it) cannot possibly meet?  Does this really mean that the systematic error in the mapping of all xtal segments must be small enough to generate positions correct to about 2 mm?  I need to think about this more....

  2. I'd like to comment on Bill's request to look at the precision of actual calibration procedure with MIP (GCR's): I'm actually doing this. I'll provide the comparison of old calibrations (ground and 2008 on-orbit) with new one based on full statistics and  comparison of 2 independent parts of full statisrics - this will give us an estimation of calibration errors which we could then take into account in simulation. I'd like to notice also that each crystal segment is calibrated independently, so we have not ~1500, but ~15000 quantities.