Blog from April, 2005

2-tower calibs - CAL

EM changes

EngineeringModel v4r060302p19

Update to calibGenCAL to handline two-tower calibrations.

Zach has tested the new version against EM ...p18 for pedestals and verifies that is ok.

Note: no system tests will be run since this code is entirely separate from that tested by the systests, though it is contained in the EM package to ensure compatibility.

svac changes

SVAC pipeline tasks and scripts are now at v3r1p10. The only change relative to p6 is using EM v4r060302p19.

Code Versions

Engineering Model (sim/recon) v4r060302p19 **changed**

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p1

svac pipeline code and tasks:

code/tasks v3r1p10 **changed**

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p3
ConfigTables: v3r1p3
TestReport: v3r2p6 (digi & recon reports)
EngineeringModelRoot: v1r3p15 (SVAC tuple)

Approved: unanimous Fri Apr 29

svac reruns

To keep track of changes in the pipeline - these are runs that were just done again.

From Warren:

I deleted the following runs:
398000878 398000879 398000880 398000881 398000882 of the following tasks:
recon-v3r1p6 reconReport-v3r1p6 svacTuple-v3r1p6 from GINO's DB, and relaunched the recon task (which should launch the other 2) for all the runs.

This was necessary due to the fact that recon did not work correctly (no calibration constants) but was not detected as failed by GINO.

The calibration database has been updated, and they seem to be working now.

Warren Focke

eLogFeeder mod

svac changes

eLogFeeder v2r2p3

bug fixing (JIRA issue: http://jira.slac.stanford.edu/browse/SVAC-40). Tkr and Cal serial numbers are reset in the loop to parse each node in the rcReport xml file. The fix is to move initialization codes out of the loop

Code Versions

Engineering Model (sim/recon) v4r060302p18

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p1

svac pipeline code and tasks:

code/tasks v3r1p5

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p3 **changed**
ConfigTables: v3r1p3
TestReport: v3r2p6 (digi & recon reports)
EngineeringModelRoot: v1r3p15 (SVAC tuple)

Approved: emergency approval - Richard - 26 Apr 2005

EM changes

Engineering Model changes

TkrUtil
Leon Rochester
Fix use of row and column in bad strips and FailureMode services, Addresses JIRA http://jira.slac.stanford.edu/browse/TKR-13

xmlGeoDbs v1r22p3
Anders Borgland and Joanne Bogart
Update the geometry files for the VDG geometries to use the correct grid positions.
Addresses JIRA http://jira.slac.stanford.edu/browse/SVAC-31

commonRootData v2r1
mcRootData v2r16
Heather Kelly
In effect no change - the intervening tags had included a new commonRootData namespace which had to be backed out due to ROOT's inability to currently handle introduction of a namespace in a std::vector. No version of EM, ever included a tag to these packages that included this namespace.

digiRootData vr8r3
Heather Kelly
Back out commonRootData namespace and provide storage for Event Size and fix up the Gem::getMissed method for the dead zone word in the GEM.

reconRootData v5r6p0
Heather Kelly
Back out commonRootData namespace.
Update the TkrRecon::Clear method to implement the same "fix" that Ursula introduced in DigiEvent::Clear, where TObjArray are cleared using the same type of algorithm implemented for TClonesArray. This avoids wasting time during deletions for every event, greatly reducing slowdowns during reading.
Private Communication with Johann.

RootIo v15r6
Heather Kelly
Bug fix on windows - misuse of const
Private communication with Toby Burnett.
Handle GEM missed (dead zone) word and event size in both reading and writing the digis.
Private communication with Anders Borgland

calibUtil v1r3p6
Joanne Bogart
make some attributes less restrictive in calCalib DTD

CalibSvc v0r21
Joanne Bogart
Backed out the commonRootData namespace.

calibGenCAL v3r5p4
Zach Fewrell and Heather Kelly
back out commonRootData namespace

ldfReader v2r3
Heather Kelly
Store event size and fix handling of missed (dead zone) word in GEM

LdfConverter v1r9
Heather Kelly
Remove warning message when there are no skipped events when searching for the first sweep event.
Updated GEM and EventSummary converters to properly handle the missed (dead
zone) word in GEM and event size respectively.
Private communication with Anders Borgland.

LdfEvent v2r11
Heather Kelly
Store Event size and fix storage of missed (dead zone) word in GEM Private communication with Anders Borgland.

LatIntegration v2r20
Anders Borgland
Update jobOptions files for VDG tests to use the new updated geometry files using the correct grid positions. This is especially necessary now that calibrations are included.
Addresses JIRA http://jira.slac.stanford.edu/browse/SVAC-31

RootAnalysis v8r1
Heather Kelly
In essence, no change, introduced and backed out commonRootData namespace.

rootTestData v3r2
Heather Kelly and David Chamont
Back out commonRootData namespace and include ROOT test files for CalRecon

calibRootData v1r7
Joanne Bogart
In essence no change, introduced and then backed out

svac code changes

svacTuple switch to EngineeringModelRoot v1r3p15:

Added TrgReqTriRowBits made from trigger primitives. Renamed current TriRowBits to DigiTriRowBits. Updated documentation.

Add CalXtalPos to describe fit position in each crystal Add TkrTotalHits to describe total number of hits in each tower JIRA issue (http://jira.slac.stanford.edu/browse/SVAC-17)

Add TkrTotalClusters to describe total number of clusters in each tower JIRA issue (http://jira.slac.stanford.edu/browse/SVAC-30)

Added Eventsize (in bytes) and GEM dead zone counter.

updateELogDB switch to eLogFeeder v2r2p1:

> modify code to use #!/usr/bin/env python2.4 (http://jira.slac.stanford.edu/browse/SVAC-29) modify code to
> use http instead of ftp to store online report URL
(http://jira.slac.stanford.edu/browse/SVAC-28)

update eLogFeeder to v2r2p2

modify code to cope situation when a run is a test run and there are no serial numbers in the rcReport.out. JIRA issue: http://jira.slac.stanford.edu/browse/SVAC-33

I think this will bring pipeline scripts to v3r1p5.

online changes

online task will switch to v2r1p1. This is a change to task configuration only, no code changes. Fixes an error in the last version's launching of SVAC tasks.

Code Versions

Engineering Model (sim/recon) v4r060302p18 *** changed ***

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p1 **changed**

svac pipeline code and tasks:

code/tasks v3r1p5 **changed**

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p2 **changed**
ConfigTables: v3r1p3
TestReport: v3r2p6 (digi & recon reports)
EngineeringModelRoot: v1r3p15 (SVAC tuple) **changed**

Approved: unanimous 22 Apr 2005

svac disk issues

This is triggered by the current nfs disk being written filling up.

svac updates

EngineeringModelRoot updated to account for changed TriRowBits variable.

Pipeline tasks & code @ v3r1p3. Unifying tags & versions required broad but shallow changes to code.

Move to u14 ( http://jira.slac.stanford.edu/browse/SVAC-21 ).

Upgrade to whatever EM tag is appropriate (p10 is the latest available as of this writing, I hear we will be using p11).

Change access method for reports from FTP to HTTP ( http://jira.slac.stanford.edu/browse/PIT-3 and http://jira.slac.stanford.edu/browse/SVAC-20 ).

Fix SVAC-8 (this is just code cleanup, but http://jira.slac.stanford.edu/browse/SVAC-20 gave a good opportunity to fix this).

Change LSF queue for digiReport ( http://jira.slac.stanford.edu/browse/SVAC-15 ).

Change LSF queue for reconReport ( http://jira.slac.stanford.edu/browse/SVAC-12 ). This was approved at the last round, but I goofed when installing the code.

online updates

Tested the code for online-v2r1 on the Dev server, using run 136000679. With the OK of both the Offline and Online CCBs, we can deploy this upgrade.

This upgrade includes the following changes:
Upgrade LDF to 5.6.1
Upgrade LATTE to 4.8.0
Add creation of .tgz file for archiving.

Code Versions

Engineering Model (sim/recon) v4r060302p8

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1 **changed**

svac pipeline code and tasks:

code/tasks v3r1p3 **changed** with explanatory note.

Apps that run in pipeline:

eLog: v2r2
ConfigTables: v3r1p3
TestReport: v3r2p6 (digi & recon reports)
EngineeringModelRoot: v1r3p12 (SVAC tuple) **changed**

Approved : unanimous 14 Apr 2005

EM p10 mods

Draft Action

Modifications

EngineeringModel

IExternal/ldfExt v0r561p0
Heather Kelly
Upgrade to the new LDF v05-06-01 which provides an accessor to the event sequence number that is immune to rollover.
Which was done in response to http://jira.slac.stanford.edu/browse/LTE-222
This version supports LATTE 4.8 which will come into use starting next week. Please note that this version of LDF is backward compatible, so we can still handle LDF/Fits files that do not include this 32-bit event number.
This upgrade addresses JIRA http://jira.slac.stanford.edu/browse/LDF-18

RootIo v15r2p2
Heather Kelly
Read and write the new 32 bit event sequence number.
Addresses JIRA http://jira.slac.stanford.edu/browse/LDF-18
Add new jobOptions parameter to set MaxTreeSize and set default to 25 GB. This was necessary to prevent large data runs from splitting output recon ROOT files into multiple files - which the pipeline cannot handle at this time.
Addresses JIRA http://jira.slac.stanford.edu/browse/ROOT-11

digiRootData v8r1
Heather Kelly
Add new data member in EventSummaryData for 32 bit event sequence number. Reused the original eventSequence method, which will return a 32 bit event sequence number from either new LDF/FITS or old LDF/FITS files.
Addresses JIRA http://jira.slac.stanford.edu/browse/LDF-18

Add another version of TriRowBits that uses the trigger request for its computation.

Trigger v4r0
Johann Cohen-Tanugi
Provide another type of TriRowBits that uses the trigger request for computation.
Upgrade was presented at the Instrument Analysis Meeting on February 25, 2005: http://www-glast.slac.stanford.edu/IntegrationTest/SVAC/Instrument_Analysis/Meetings/02252005/slides.pdf

ldfReader v2r1
Heather Kelly
Upgrade to LDF v05-06-01 - include new handleError callbacks and OSW_time callback that includes new 32 bit event sequence number which addresses JIRA LDF-18 Read one event at a time for LDF files - this consumes less memory but runs a little bit slower than the previous version.

LdfConverter v2r10
Heather Kelly
Update to handle 32 bit event sequence number in LdfEventSummaryCnv and store it on the TDS.
Address JIRA http://jira.slac.stanford.edu/browse/LDF-18

LdfEvent v2r10
Heather Kelly
Add a new data member to store 32 bit event sequence number.
Addresses JIRA http://jira.slac.stanford.edu/browse/LDF-18

CalibData v0r12
Joanne Bogart
Provide support of TKR charge scale calibration by specifically adding new calibration types.
Addresses JIRA http://jira.slac.stanford.edu/browse/CALIB-10

CalibSvc v0r19
Joanne Bogart
Provide support for TKR charge scale calibration by adding a new converter to handle it.
Always fetch event time from event header.
Addresses JIRA http://jira.slac.stanford.edu/browse/CALIB-10

calibRootData v1r5
Joanne Bogart
Add classes for TKR charge scale calibration.
Addresses JIRA http://jira.slac.stanford.edu/browse/CALIB-10

calibGenTKR v2r2
Joanne Bogart
Include xml2rOOT translator application
Address JIRA http://jira.slac.stanford.edu/browse/CALIB-11

AnalysisNtuple v2r2p7
Leon Rochester
Properly write out the full GEM Condition Summary by using the appropriate mask on the trigger word on the TDS.
Fix GltXTower and GltYTower Addresses JIRA http://jira.slac.stanford.edu/browse/TRG-8

enums v0r2
Leon Rochester
Add GEM_mask to TriggerBits to help fix the bug in AnalysisNtuple when writing out the GEM word in the ntuple.

LatIntegration v2r13
Anders Borgland
Removes old jobOptions files in favor of the newer pipeline examples.
Update unit test to use a more recent FITS data file and the ldf2digi.txt JO file from the pipeline.
Addresses JIRA http://jira.slac.stanford.edu/browse/SVAC-13 remove TriggerAlg from readigi_runrecon.txt

Additions for p13!

TkrUtil v3r3p7
Leon Rochester
Add muon scale database processing, make flight-like default constants, remove "random" internally-generated option

TkrDigi v2r4p2
Leon Rochester
Add call to ToTSvc to do ToT calculation

calibGenTKR v2r3
Johann
Add multi-tower capabilities

CalUtil v2r1
Zach Fewtrell
Support multi-tower

CalXtalResponse v0r3p1
Zach Fewtrell
Support multiple towers. Fixed bad asymetry for mixed diode size events updated ideal_flight parameters to handle higher energies b4 saturation

CalDigi v2r1
Zach Fewtrell
Support multiple towers.
Skip bad crystals rather than causing the Gaudi job to terminate.

CalRecon v5r22p5em2
Zach Fewtrell
Support multiple towers.
Do not terminate the Gaudi job due to bad crystal response.

CalibSvc v0r19p2
Joanne Bogart
Eliminate call to RootBaseCnv::doClean in constructor which can crash in finalize and JIRA http://jira.slac.stanford.edu/browse/CALIB-13 Provide jobOptions parameter to determine action (exit or
not) if a request calibration
is found or not.

calibGenCAL v3r5p2
Sasha Chehtman and Zach Fewtrell
Added the output of fle/fhe bias file to runMuTrigEff, fixed the event numbering problem in runCIFit, added new application runMuThreshEvol to follow the evolution of fle thresholds in a long muon run Fixed case of filename in requirements file. Corrected wrong ifile.dtd path in front of xml files. python files are now inluded in CVS package, but are not yet 'officially supported'.... soon they will be.

RootIo v15r4
Heather Kelly
Bug fix to reading in new 32 bit event sequence in digiRootReaderAlg JIRA http://jira.slac.stanford.edu/browse/ROOT-12 Update to RootIoSvc to get the jobOptions parameter StartingIndex to function, allowing the user to start reading an arbitrary event from an input ROOT file.

digiRootData v8r1p2
Heather Kelly
Initialize EventSummaryData::eventSequence

commonRootData v1r3
Heather Kelly
Add methods to FileHeader class to return TMapIter to allow iterating and searching the maps of ints, doubles, and strings

AnalysisNtuple v2r2p9
Leon Rochester
JIRA GRINF-23
Fixes to GltValTools and EventFlags output to ntuple

LdfConverter v1r8p0
Heather Kelly
JIRA GRINF-24
Moved two debug statements after event counter is incremented so that the event number printed out matches what is reported by the RootIo output algorithms.

facilities v2r11
Joanne Bogart
Add utility Util::keyValueTokenize; add optional timezone arguments to some constructors of TimeStamp

xmlUtil v3r1p1
Joanne Bogart
Comment out trouble-making (on Windows) unnecessary test applications

rdbModel v1r7
Joanne Bogart
Add machinery for mutiple-insertions. And clean out obsolete files in xml directory

LatIntegration v2r16
Anders Borgland
Fixed JO mc.txt so it actually reads in the TKR calibrations.
Changed system test JO for MC to use pipeline/mc.txt (and thus use calibration constants and geometry files with the correct bay positions (not for VDG, yet).
Updated piepline JO to ask for all TKR calibration objects, all with flavor vanilla.
Removed 'ideal' from general calibration flavor list.
Changed default instrument name to LAT.
Added "FhSetAlg" to the output sequences to have ROOT headers containing EM version in the Root files.

ISOC code

Acommodate change of nfs output disk.

Addresses JIRA http://jira.slac.stanford.edu/browse/IOT-1

Code Versions

Engineering Model (sim/recon) v4r060302p13 *** changed ***

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1

svac pipeline code and tasks:

code/tasks v3r1p3

ISOC code and tasks:

v0r5p0 **newly baselined**

Apps that run in pipeline:

eLog: v2r2
ConfigTables: v3r1p3
TestReport: v3r2p6 (digi & recon reports)
EngineeringModelRoot: v1r3p12 (SVAC tuple)

Approved: Eduardo, Steve, Richard and maybe Bill at IA meeting 15 Apr 2005