Blog

CCB Action 20050623

EngineeringModel v5r0608p2

calibGenCAL v3r6p13
Zach Fewtrell

Improves FLE dac settings generation for online as well as FLE threshold
measurements for offline.
The problem was such:
LEX8 ADC scale is used to characterize & measure FLE thresholds.
Hardware LEX8 channel doesn't have the dynamic range to handle the upper
ranges of the FLE trigger.

The solution was to continue to use LEX8 ADC units, but to extrapolate past
the hardware limit when needed..

Also includes a new validation tool, tholdCIVal.
Changes are only to python scripts not to C++ applications

Code Versions

Engineering Model (sim/recon) v5r0608p2 **changed**

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p7
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p2

svac pipeline code and tasks:

code/tasks v3r1p18

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p6
ConfigTables: v3r1p4
TestReport: v3r2p7 (digi & recon reports)
EngineeringModelRoot: v1r3p17 (SVAC tuple)

Approval: unanimous 23 June; Steve wondering about the saturation fix.

CAS upgrade 20050612

CAS handles the web login to the pipeline configuration pages.

From Matt:

The upgrade of CAS to Tomcat seems to have gone without a hitch. Pipeline Front End and System Tests should not notice any difference. Please let me know id you notice any problems.

For reference (and CCB purposes?) the new CAS server is tagged in CVS as v1r0p3, and is running on glast05 under Tomcat 5.5.9.

CCB Action 20050610

EngineeringModel v5r0608p1

GlastPolicy v6r4
astro v1r9p1
Trigger v4r0p1
flux v8r18
celestialSources v1r0p4
FluxSvc v6r23p4
CalDigi v2r1p2
CalibSvc v0r21p3
ntupleWriterSvc v3r6p1
merit v6r20
Gleam v5r13p1
userAlg v6r4p5
CRflux v1r3p1
HepRepCorba v1r5p2
All of the above were picked up from GlastRelease v6r8.

Removed FluxDisplay just as GlastRelease has since FRED does not use it.

calibUtil v1r4
Joanne Bogart
Adds new application, calibCoverage, which is used to verify that the metadata database has a sensible set of calibrations.

TkrRecon v10r5p8em0
Tracy Usher
Branch created to include fix for kal theta multiple-scattering angle which had an artificial cutoff which had been necessary to keep the Kalman energy from being computed as an infinite value if the angle turned out to be zero. Now both a "raw" and "modified" value are used such that the "real" multiple-scattering angle with no cutoff is now reported.

GlastPolicy/RootcintPolicy v5r0p0
Heather Kelly
Added new pattern to allow more than just one shared library to be built in a ROOT package. This was done to fulfill a request by Johann that RootAnalysis build a LeaningTower shared library.

commonRootData v2r1p0
Heather Kelly
Uses new version of RootcintPolicy that includes new pattern for creating multiple shared libraries.

mcRootData v2r16p0
Heather Kelly
Uses new version of RootcintPolicy that includes new pattern for creating multiple shared libraries.

digiRootData v8r4
Heather Kelly
Uses new version of RootcintPolicy that includes new pattern for creating multiple shared libraries.
Also adds in new error summary class to store LDF errors.

reconRootData v5r6p3
Heather Kelly
Uses new version of RootcintPolicy that includes new pattern for creating multiple shared libraries.

calibRootData v1r7p1
Joanne Bogart
Uses new RootcintPolicy that includes new pattern for creating multiple shared libraries.

IExternal v4r1p2
Navid Golpayegani
Pick up more recent IExternal/ROOT which was updated to load the TreePlayer shared library along with the other ROOT GUI libraries.

calibGenTKR v2r6
Hiro Tajima and Joanne Bogart

Updates muonCalibTot which now reads hot and dead strips xml files
and remove them from disconnected strips. Hot strips are read from data directory since they are used to mask hot strips during data taking. The dead strips xml file can be specified via job options. This tag requires the latest facilities tag v2r12.
(Hiro) and enhance xml2root application so that it can append to or replace information in a pre-existing ROOT file. (Joanne)

facilities v2r12
Joanne Bogart
Adds new utility Util::expandEnvVarOS.

calibGenCAL v3r6p11
Zach Fewtrell
Addresses JIRA http://jira.slac.stanford.edu/browse/CAL-10, http://jira.slac.stanford.edu/browse/CAL-11, http://jira.slac.stanford.edu/browse/CAL-12

RootAnalysis v8r5
Heather Kelly and Michael Kuss
Creates a shared library for Leaning Tower at Johann's request.
RootTreeAnalysis was fixed to be ACLIC-able and includes a new macro that demonstrates how to compile RootTreeAnalysis using ACLIC at the ROOT command line.
Addresses JIRA http://jira.slac.stanford.edu/browse/SVAC-59 by removing code in LeaningTower that slowed down alignment.

xmlGeoDbs v1r22p4
Anders Borgland
Add 4, 6 and 8 tower geometries to the latAssembly.

xmlBase v5r2
Joanne Bogart
Adds parser set up method to support xml files using Schema as well as those using the old-style DTD

ldfReader
Heather Kelly
Handle Error Summary which may appear in TEM data in the LDF.

LdfConverter v1r13
Heather Kelly
Address JIRA http://jira.slac.stanford.edu/browse/SVAC-57
Handle Error Summary which may appear in TEM data in the LDF

LdfEvent v2r13
Heather Kelly
Create a new class to store the error summary which may appear in the TEM data in the LDF.

RootIo v15r8p1em1
Heather Kelly
Reads and writes error summary data to/from the TDS to/from ROOT.

LatIntegration v2r29
Anders Borgland
Introduced new jobOptions parameter that allows a warning to be printed in the GEM condition summary is zero. This addresses JIRA http://jira.slac.stanford.edu/browse/SVAC-57.

CalXtalResponse v0r5p1
Zach Fewtrell

Fix in response to apparent CAL ADC shift reported by Anders Borgland (SVAC). Repairs included fixes to retrieving constants from the GlastDetSvc for the geometry, where the fSement variable was left un initialized. This caused the ADC shift, since fSegment specifies the volId index for a crystal segment. This information is vital for determining the
asym->pos calculation in CalDigi.

Code Versions

Engineering Model (sim/recon) v5r0608p1 **changed**

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p7
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p2

svac pipeline code and tasks:

code/tasks v3r1p18

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p6
ConfigTables: v3r1p4
TestReport: v3r2p7 (digi & recon reports)
EngineeringModelRoot: v1r3p17 (SVAC tuple)

Approval: unanimous 21 June, 2005

Due to hardware problems on glast04, the scheduler cron job has been de-activated on glast04 and initiated on glast02. A demo task has been run to demonstrate successful transfer.

ConfigTables v3r1p4 was not installed correctly. The code has been moved to the proper location and the following runs (all test runs, 151 of 'em) of configReport-v3r1p7 were deleted and resubmitted:

135002253
135002254
135002255
135002256
135002257
135002258
135002260
135002261
135002262
135002263
135002264
135002265
135002266
135002267
135002269
135002270
135002271
135002272
135002273
135002274
135002275
135002276
135002277
135002278
135002279
135002281
135002282
135002283
135002284
135002285
135002286
135002287
135002288
135002289
135002290
135002291
135002292
135002293
135002294
135002295
135002296
135002297
135002298
135002299
135002300
135002301
135002302
135002303
135002304
135002305
135002306
135002307
135002308
135002309
135002310
135002311
135002312
135002313
135002314
135002315
135002316
135002317
135002318
135002319
135002320
135002321
135002322
135002323
135002324
135002325
135002326
135002327
135002328
135002329
135002330
135002331
135002332
135002333
135002334
135002335
135002336
135002337
135002338
135002339
135002340
135002341
135002342
135002343
135002344
135002345
135002346
135002347
135002348
135002349
135002350
135002351
135002352
135002353
135002354
135002355
135002356
135002357
135002358
135002359
135002360
135002361
135002362
135002363
135002364
135002365
135002366
135002367
135002368
135002369
135002370
135002371
135002372
135002373
135002374
135002375
135002376
135002377
135002378
135002379
135002380
135002382
135002383
135002384
135002385
135002386
135002387
135002388
135002389
135002390
135002391
135002392
135002393
135002394
135002395
135002396
135002397
135002398
135002399
135002400
135002401
135002402
135002403
135002404
135002405
135002406
135002407

Warren Focke

Changed svac/online task output to u16 partition from u14.

Code Versions

Engineering Model (sim/recon) v4r060302p23

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p7
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p2

svac pipeline code and tasks:

code/tasks v3r1p18 **changed**

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p6
ConfigTables: v3r1p4
TestReport: v3r2p7 (digi & recon reports)
EngineeringModelRoot: v1r3p17 (SVAC tuple)

CCB Action 20050527

Pipeline front end changes

PFE v0r3p7

From Matt:

A part of the released version of the Pipeline Front End (v0r3p4) broke after a Microsoft server patch to glast05. The problem surfaced due to the HTTP session being destroyed and re-created on each HTTP request. I'm not sure which patch was responsible, as several are applied each week. A user first noticed this issue, which is documented in JIRA as http://jira.slac.stanford.edu/browse/PFE-49.

The part of PFE that broke was remembering the user's selected pipeline server, being one of "prod", "dev" or "test". Since the user's session was always being destroyed, the default value of "prod" was always being used, making it impossible for users to upload pipeline configurations to the "dev" and "test" servers.

The problem did not appear on my development computer, which runs a different version of Windows and IIS than glast05. My development computer uses Windows XP SP2 with IIS 5, while glast05 uses Windows Server 2003 with IIS 6. I found that a newer version of my ColdFusion-based Pipeline Front End "fixed" the problem on glast05. Since it was important to fix this problem ASAP, and since initial attempts to understand the "session being destroyed" problem were fruitless, I pushed a new version of the Pipeline Front End to glast05, v0r3p7.

I recommend to the CCB that GLAST use version v0r3p7 as the production Pipeline Front End, which is the version that I pushed to glast05 45 minutes ago. If this is not acceptable, then I can restore the previous version (v0r3p4), which would still have the "session destroyed" bug. All version of PFE are tagged in CVS, making it trivial to switch between versions...

This has been verified by Warren.

Code Versions

Engineering Model (sim/recon) v4r060302p23

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p7 *** changed ***
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p2

svac pipeline code and tasks:

code/tasks v3r1p17

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p6
ConfigTables: v3r1p4
TestReport: v3r2p7 (digi & recon reports)
EngineeringModelRoot: v1r3p17 (SVAC tuple)

Approved: 31 May 2005 unanimous

CCB Action 20050525

svac changes

SVAC tasks at v3r1p17.

TEM ids were appended to the module serial numbers in the eLog DB in eLog v2r2p6. The script that builds recon jobOption files was not modified to strip the TEM id off again before writing the serial number to to jo file. It has been fixed to do so now. Recon has been tested with this change.

See http://jira.slac.stanford.edu/browse/SVAC-56 .

This is fixed in svacPipeline v3r1p17.

Code Versions

Engineering Model (sim/recon) v4r060302p23

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p2

svac pipeline code and tasks:

code/tasks v3r1p17 **changed**

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p6
ConfigTables: v3r1p4
TestReport: v3r2p7 (digi & recon reports)
EngineeringModelRoot: v1r3p17 (SVAC tuple)

Approved: 25 May 2005 Emergency: Eduardo & Richard.

CCB Action 20050524

svac changes

SVAC tasks at v3r1p16.

recon jobOptions updated to stop CAL modules from asking for TKR calib constants.

eLog at v2r2p6 to address some sort of issue with tower/bay naming: change code to include TEM id in tkr_ser_no and cal_ser_no.
JIRA issue(http://jira.slac.stanford.edu/browse/ELB-69)

ConfigTables at v3r1p4 to address JIRAs http://jira.slac.stanford.edu/browse/SVAC-54 and http://jira.slac.stanford.edu/browse/SVAC-55 .

Code Versions

Engineering Model (sim/recon) v4r060302p23

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p2

svac pipeline code and tasks:

code/tasks v3r1p16 **changed**

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p6 **changed**
ConfigTables: v3r1p4 **changed**
TestReport: v3r2p7 (digi & recon reports)
EngineeringModelRoot: v1r3p17 (SVAC tuple)

Approved: 24 May 2005 Bill, Eduardo & Richard. Steve unavailable on short notice, but approves by phone.

CCB Action 20050512

draft action

svac changes

eLog at v2r2p5

AdditionalInputFiles and suiteRunList column in the elogReport table are changed from varchar2 to CLOB so that they can hold more than 4000 characters of data. update.py is modfified accordingly. (JIRA issue: http://jira.slac.stanford.edu/browse/SVAC-53)

SVAC workset at v3r1p14.

Changes to fix http://jira.slac.stanford.edu/browse/SVAC-6 (the job was only halfway done before, as noted in comments on that iisue).

Some code cleanup and fixes to scripts to start reprocessing runs.

Code Versions

Engineering Model (sim/recon) v4r060302p23

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p2

svac pipeline code and tasks:

code/tasks v3r1p14 **changed**

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p5 **changed**
ConfigTables: v3r1p3
TestReport: v3r2p7 (digi & recon reports)
EngineeringModelRoot: v1r3p17 (SVAC tuple)

Approved: unanimous 13 May 2005

svac reruns 20050505

The following runs:

135001832 135001834 135001838 135001840 135001844 135001846

of the following tasks:

recon-v3r1p12 reconReport-v3r1p12 svacTuple-v3r1p12

were deleted from GINO's DB, and recon-v3r1p12 (which should launch the other two) resubmitted.

This was necessary to take advantage of new CAL calibrations.

Warren Focke

I updated GINO's DB to set the LSF queue for online-v2r1p1/ldf2fits to medium (was short). This was to address JIRA issue PIT-5 .

Warren Focke

svac reruns 20050504

> The following runs of online-v2r1p1 were deleted from GINO's DB

AGAIN

> and resubmitted

AGAIN, because the original, corrupt FITS files did not get overwritten the first time I did it, so this time I had to delete the FITS files, too.

>
> 135001500
> 135001501
> 135001503
> 135001504
> 135001721
> 135001722
>
> Warren Focke
> 2005/05/04
>
>

The following runs of online-v2r1p1 were deleted from GINO's DB and resubmitted to address JIRA issue PIT-5 .

135001381
135001500
135001501
135001503
135001504
135001506
135001507
135001718
135001719
135001721
135001722

Warren Focke
2005/05/04

svac reruns 20050503

The following runs were deleted from GINO's DB:

135001500 135001501 135001503 135001504 135001461 135001466 135001467

for tasks:

configReport-v3r1p10 digiReport-v3r1p10 digitization-v3r1p10 online-v2r1p1 recon-v3r1p10 reconReport-v3r1p10 svacTuple-v3r1p10 updateELogDB-v3r1p10 (some run/tasks combinations in that table are actually empty)

and online-v2r1p1 was resubmitted for all of them. This was necessary because the ldf.fits file had not been correctly picked up the first time they were run thru.

CCB action 20050503

EM changes

EngineeringModel v4r060302p23

calibGenCAL v3r6p4
Zach Fewtrell
Most significant is the ENABLE_GRP ciFit jobOption which allows the user to disable smoothing and grouping in intNonlin splines, this is necessary for charge injection data which is taken with the incorrect calib_gain setting. Sasha's previous patch had the same result, but this solution is more elegant. Tested that both tags produce the same output. There was a minor xml formatting issue in ciFit which needed to be fixed for multi-tower use. Basically the instrument dimensions (nCol & nRow) in the xml header info were incorrect. Minor updates include improved progress print outs & better comments in the
ciFit smoothing code.

RootAnalysis v8r3
Heather Kelly
Added examples for GEM and Diagnostic processing.

TkrRecon v10r5p8
Tracy Usher and Leon Rochester
The new default values for maxGaps and maxConsecutiveGaps are set to (2,1) which should be appropriate for I&T and not adversely affect simulation studies and includes fix for first-hit energy which was being incorrectly set in one-track events. Addresses JIRA http://jira.slac.stanford.edu/browse/TKR-14 and http://jira.slac.stanford.edu/browse/TKR-15

LatIntegration v2r26
Anders Borgland
Minor fix to VDG JobOptions files.

RootAnalysis v8r2
Heather Kelly
Fixes crash when reading new recon ROOT files, there was an error in how the TkrRecon data was being processed.
Addresses JIRA http://jira.slac.stanford.edu/browse/ROOT-9

svac changes

SVAC scripts & tasks are at v3r1p11. This includes some changes to
scripts:

TestReport v3r2p7

The title of the Gem delta event time histogram says: "Time interval between adj acent event in millsecond with a cut of 1 ms." It should be: "Time interval betw een adjacent events in milliseconds." There is no cut of 1 ms.

http://jira.slac.stanford.edu/browse/Jira-SVAC-14

EngineeringModelRoot v1r3p18

  • awb Removed 'EventSequence' as it now will be identical to EventID.
  • awb Removed 'GoodEvent'. Users should require 'EventFlags==0' to have
    events without any errors.
  • awb Renamed mergeRoot_debug to mergeRoot_mc. The 'bug' it fixed is no
    longer in Root V4. However, merging mc.root files does not work with
    mergeRoot for some reason. The memory usage goes through the roof
    and it essentially comes to a stand still.
  • awb Changed default file size to 25 GB in mergeRoot, mergeRoot_mc and
    mergeNtuple.
  • awb Updated the documentation.
  • wbf Added EvtTicks.

EngineeringModelRoot is v1r3p18. The only change from p17 is fixing a bug in the evtTicks variable that was introduced in that release.

online

Anders and Warren found a minor bug in the online pipeline. The LDF file choosing mechanism was flawed and sometimes grabbed the errXXXXXXXXX.ldf file. This was run through ldf2digi which discarded all the error events. As this file is an error skim, all events in the file were discarded.

I've fixed the code, and I'd like to run it through your CCB. The CVS tag is onlinePipeline V02-01-02. There is no change to the pipeline xml.

http://jira.slac.stanford.edu/browse/PIT-4

Code Versions

Engineering Model (sim/recon) v4r060302p23 **changed**

System Tests for this version

System Tests Result

FRED version

0.98

Pipeline tag

v1r0p2

GRITS tag (web browsing and task configuration)

glast-ground v0r3p4
grits-gino-web version 0.55 (v0r5p5)
grits-gino version 0.95 (v0r9p5)
grits-gino-xml version 1.42 (v1r4p2)
grits-common version 0.32 (v0r3p2)

online/svac (task defs, scripts):

pipeline tasks:

online: v2r1p2 **changed**

svac pipeline code and tasks:

code/tasks v3r1p12 **changed**

ISOC code and tasks:

v0r5p0

Apps that run in pipeline:

eLog: v2r2p4
ConfigTables: v3r1p3
TestReport: v3r2p7 (digi & recon reports)**changed**
EngineeringModelRoot: v1r3p17 (SVAC tuple)

Approved: Eduardo, Richard, Bill 4 May 2005