Something is wrong with the p-II logfile browser when reading files on S3DF. This file: 

/sdf/data/fermi/n/u41/L1/logs/DEV/L1Proc/6.0/doRun/doChunk/digitization/021/682xxxxxx/587xxx/162/106xxx/956/logFile.txt

Seems to have a malformed query, as displayed by the logfile browser for the pipeline:

# About to issue SELECT:
SELECT ser_no FROM metadata_v2r1  WHERE ((completion="OK") AND (instrument="LAT") AND (calib_type="CAL_Ped") AND (flavor="L1current") AND ("2022-08-19 07:32:45">=vstart) AND ("2022-08-19 07:32:45"<vend) and="" ("prod"="PROC_LEVEL))" order="" by="" update_time="" desc="" #="" about="" to="" issue="" select:="" select="" data_fmt,fmt_version,data_ident="" from="" metadata_v2r1="" where="" (ser_no="1305" )="" detectorpersist...="" info="" added="" successfully="" conversion="" service:calibxmlcnvsvc="" xmlbasecnv="" parsed="" document="" $(latcalibroot)="" cal="" p7repro="" pedavr_676m_680m.xml="" aka="" sdf="" data="" fermi="" a="" ground="" releases="" calibrations="" vstart,vend="" calcalibsvc="" updating="" calib="" cal_ped="" l1current="" ser_no="" ((completion="OK" (instrument="LAT" (calib_type="CAL_TholdCI" (flavor="L1current" ("2022-08-19="" 07:32:45"="">=vstart) AND ("2022-08-19 07:32:45"<vend) and="" ("prod"="PROC_LEVEL))" order="" by="" update_time="" desc="" #="" about="" to="" issue="" select:="" select="" data_fmt,fmt_version,data_ident="" from="" metadata_v2r1="" where="" (ser_no="998" )="" xmlbasecnv="" info="" successfully="" parsed="" document="" $(latcalibroot)="" cal="" lat-flight_gain="" pre_launch_calib_0608="" 0407.flight_gain.tholdci.cold_lpa_lac.xml="" aka="" sdf="" data="" fermi="" a="" ground="" releases="" calibrations="" vstart,vend="" calcalibsvc="" updating="" calib="" cal_tholdci="" l1current="" ser_no="" ((completion="OK" (instrument="LAT" (calib_type="CAL_IntNonlin" (flavor="L1current" ("2022-08-19="" 07:32:45"="">=vstart) AND ("2022-08-19 07:32:45"<vend) and="" ("prod"="PROC_LEVEL))" order="" by="" update_time="" desc="" #="" about="" to="" issue="" select:="" select="" data_fmt,fmt_version,data_ident="" from="" metadata_v2r1="" where="" (ser_no="999" )="" xmlbasecnv="" info="" successfully="" parsed="" document="" $(latcalibroot)="" cal="" lat-flight_gain="" pre_launch_calib_0608="" digitization-v4r0p2_077016861_digi_digi01.flight_gain.cidac2adc.xml="" aka="" sdf="" data="" fermi="" a="" ground="" releases="" calibrations="" vstart,vend="" calcalibsvc="" updating="" calib="" cal_intnonlin="" l1current="" ser_no="" ((completion="OK" (instrument="LAT" (calib_type="CAL_MevPerDac" (flavor="L1current" ("2022-08-19="" 07:32:45"="">=vstart) AND ("2022-08-19 07:32:45"<vend) and="" ("prod"="PROC_LEVEL))" order="" by="" update_time="" desc="" #="" about="" to="" issue="" select:="" select="" data_fmt,fmt_version,data_ident="" from="" metadata_v2r1="" where="" (ser_no="1304" )="" xmlbasecnv="" info="" successfully="" parsed="" document="" $(latcalibroot)="" cal="" p7repro="" fit_proton_calib_676m_680m_bigsum.calmpd.xml="" aka="" sdf="" data="" fermi="" a="" ground="" releases="" calibrations="" vstart,vend="" calcalibsvc="" updating="" calib="" cal_mevperdac="" l1current="" ser_no="" ((completion="OK" (instrument="LAT" (calib_type="CAL_Asym" (flavor="L1current" ("2022-08-19="" 07:32:45"="">=vstart) AND ("2022-08-19 07:32:45"<vend) and="" ("prod"="PROC_LEVEL))" order="" by="" update_time="" desc="" #="" about="" to="" issue="" select:="" select="" data_fmt,fmt_version,data_ident="" from="" metadata_v2r1="" where="" (ser_no="1303" )="" xmlbasecnv="" info="" successfully="" parsed="" document="" $(latcalibroot)="" cal="" p7repro="" fit_gcrhists_lkhd_676m_680m_bigsum.gcr_asym_hist.xml="" aka="" sdf="" data="" fermi="" a="" ground="" releases="" calibrations="" vstart,vend="" calcalibsvc="" updating="" calib="" cal_asym="" l1current="" triggeralg="" trigger="" tables:="" engine="" external="" solicited="" periodic="" cno="" cal-hi="" cal-lo="" tkr="" roi="" zero-supp="" ranges="" prescale="" marker="" inhibit="" 0="" 1="" x="" enabled="" 1-rng="" no="" 2="" 3="" disabled="" 4-rgn="" 4="" 5="" 249="" 6="" 7="" 8="" 9="" 10="" 49="" 11="" 12="" 13="" 14="" 15="" configsvc="" selected,="" but="" factors="" inhibits="" are="" not="" active:="" set="" 'applyprescales'="" activate="" them.="" read="" filter="" configuration="" for="" mode:="" 0;="" handler:="" 1;="" file:="" afs="" slac="" g="" glast="" moot="" archive-mood="" constit="" 2012-07="" gfc_db="" 00000248-gamma_normal.xml="" input="" prescale:="" output="" prescales:="" line="" 0:="" off="" 1:="" 2:="" 3:="" 4:="" 5:="" 6:="" 7:="" 8:="" 9:="" 10:="" 11:="" 12:="" 13:="" 14:="" 15:="" 16:="" 17:="" 18:="" 19:="" 20:="" 21:="" 22:="" 23:="" 24:="" 25:="" 26:="" 27:="" 28:="" 29:="" 30:="" 31:="" sampler="" file="" 5;="" xfc_db="" 00000267-dgn_gem.xml="" 250="" 4;="" 0000026d-hip_normal.xml="" initializing="" settings="" has="" gamma_normal="" as="" active="" hip_normal="" dgn_gem="" loading:="" ggfc="" (failed)="" gamma_master="" (succeeded)="" gamma_normal_leak="" gamma_lowe_veto="" gamma_normal_10gev="" gamma_calib="" gamma_calib_leak="" gamma_calib_a="" gamma_calib_a_leak="" gamma_eff="" gamma_eff_taper="" moot:="" mode="" associated="" with="" configuration:="" received="" request="" change="" efc_db_mode_k_normal="" gamma="" setup="" -="" fsw="" release="" b3-1-1="" using="" gamma_db_instance_k_normal="" gmfc="" mip_master="" mip_off_axis="" mip_eff_off_axis="" mip_eff_taper_off_axis="" mip_all_axis="" mip="" mip_db_instance_k_all_axis="" ghfc="" hip_master="" hip_leo="" hip_eff="" hip_eff_taper="" hip="" hip_db_instance_k_normal="" gdfc="" dgn_master="" dgn_primitive="" dgn_tkr="" dgn_ground_hi="" dgn_gem_500="" dgn_gem_1000="" diagnostic="" dgn_db_instance_k_gem="" detected="" metaevent="" datagram,="" changing="" -1="" mootsvc="" closed="" connection="" db="" ldf="" ebfeventparser="" reported="" bad="" status="" 0x2c2="706" event:="" 107216="" apid:="" 956="" event="" summary="" error="" flag="" set,="" index:="" 58="" warning:="" acd="" pmt="" that="" is="" tile="" or="" ribbon="" messages="" will="" be="" suppressed="" this="" point="" 113543="" 1351="" 114470="" 1519="" 115158="" 1665="" 115652="" 1765="" 119190="" 957="" 2475="" 119578="" 2565="" 123170="" 3241="" 125776="" 3802="" 126817="" 4007="" 129502="" 4559="" 130660="" 4806="" 131093="" 4903="" 132078="" 5118="" 135108="" 5717="" 136173="" 5902="" 144388="" 7557="" 148628="" 8427="" 151565="" 9001="" 151870="" 9065="" 155460="" 9776="" 155931="" 9873="" 158304="" 10365="" 162226="" 11165="" 162265="" 11170="" 163917="" 11489="" 163958="" 11501="" 168605="" 12448="" 169983="" 12701="" 177236="" 14175="" 179417="" 14646="" 180691="" 14898="" 181876="" 15149="" 184317="" 15604="" 188004="" 16352="" 192323="" 17170="" 192955="" 17299="" 193220="" 17348="" 199004="" 18493="" 199005="" 18494="" 201147="" 18896="" 201610="" 19001="" 205895="" 19892="" 206911="" 20093="" 207698="" 20256="" 209846="" 20683="" 218013="" 22309="" 223128="" 23343="" 224441="" 23631="" 232021="" 25129="" 242403="" 27207="" 244946="" 27739="" 249220="" 28628="" 249365="" 28664="" 254019="" 29588="" 255346="" 29845="" 258281="" 30453="" 261743="" 31137="" 263767="" 31555="" 268610="" 32544="" 269265="" 32668="" 272275="" 33284="" 273317="" 33490="" 273955="" 33623="" 275320="" 33896="" 282303="" 35282="" 286115="" 36075="" 287413="" 36331="" 292070="" 37261="" 295931="" 38023="" 295951="" 38028="" 299767="" 38794="" 304288="" 39682="" 305666="" 39961="" 306975="" 40211="" 311585="" 41169="" 313202="" 41513="" 315978="" 42067="" eventselector="" last="" found:="" source="" exhausted="" processed="" 42335="" containing="" events="" eventloopmgr="" more="" in="" selection="" applicationmgr="" application="" manager="" stopped="" totals="" triggered="" processed:="" bit="" frequency:="" all="" value="" count="" calhi="" callo="" ------="" -----="" 512="" 29823="" 1299="" 3944="" 978="" 46="" 658="" 3668="" 18="" 19="" 23="" 163="" 31="" 1194="" tot:="" 1404="" 5566="" 10654="" 41774="" 7348="" ebfwriter="" wrote="" total="" --="" word="" frequency="" table="" gfc_v3_status_m_gem_throttle="7085" gfc_v3_status_m_gem_tkr="42059" gfc_v3_status_m_gem_callo="10632" gfc_v3_status_m_gem_calhi="5716" gfc_v3_status_m_gem_cno="1404" gfc_v3_status_m_acd_top="6876" gfc_v3_status_m_acd_side="13944" gfc_v3_status_m_acd_side_filter="7125" gfc_v3_status_m_tkr_eq_1="9760" gfc_v3_status_m_tkr_ge_2="12223" gfc_v3_status_m_rsvd_10="0" gfc_v3_status_m_tkr_lt_2_elo="2963" gfc_v3_status_m_tkr_skirt="9" gfc_v3_status_m_tkr_eq_0="14" gfc_v3_status_m_tkr_row2="22" gfc_v3_status_m_tkr_row01="27" gfc_v3_status_m_tkr_top="90" gfc_v3_status_m_side="51" gfc_v3_status_m_top="60" gfc_v3_status_m_zbottom="20" gfc_v3_status_m_err_ctb="78" gfc_v3_status_m_splash_1="1537" gfc_v3_status_m_e350_filter_tile="12" gfc_v3_status_m_e0_tile="55" gfc_v3_status_m_el0_etot_hi="2648" gfc_v3_status_m_el0_etot_lo="5842" gfc_v3_status_m_lo_energy="14634" gfc_v3_status_m_hi_energy="3276" gfc_v3_status_m_splash_0="329" gfc_v3_status_m_nocallo_filter_tile="1299" gfc_v3_status_m_non_physics="168" gfc_v3_status_m_vetoed="2234" mfc_status_m_stage_gem="42335" mfc_status_m_stage_acd="0" mfc_status_m_stage_dir="9154" mfc_status_m_stage_cal="9111" mfc_status_m_stage_xcal="9111" mfc_status_m_multi_pkt="1011" mfc_status_m_err_cal="0" mfc_status_m_err_ctb="43" mfc_status_m_err_dir="0" mfc_status_m_rsvd_09="0" mfc_status_m_rsvd_10="0" mfc_status_m_rsvd_11="0" mfc_status_m_rsvd_12="0" mfc_status_m_rsvd_13="0" mfc_status_m_rsvd_14="0" mfc_status_m_rsvd_15="0" mfc_status_m_rsvd_16="0" mfc_status_m_rsvd_17="0" mfc_status_m_rsvd_18="0" mfc_status_m_rsvd_19="0" mfc_status_m_rsvd_20="0" mfc_status_m_rsvd_21="0" mfc_status_m_rsvd_22="0" mfc_status_m_rsvd_23="0" mfc_status_m_rsvd_24="0" mfc_status_m_rsvd_25="0" mfc_status_m_no_tkr_adj="4168" mfc_status_m_lyr_counts="7982" mfc_status_m_no_acd_tkr="31501" mfc_status_m_gem_notkr="276" mfc_status_m_gem_cno="1404" mfc_status_m_vetoed="41206" hfc_status_m_stage_gem="42335" hfc_status_m_stage_dir="1359" hfc_status_m_stage_cal="1359" hfc_status_m_stage_cal_echk="1359" hfc_status_m_stage_cal_lchk="401" hfc_status_m_multi_pkt="1128" hfc_status_m_err_cal="0" hfc_status_m_err_ctb="0" hfc_status_m_err_dir="0" hfc_status_m_rsvd_09="0" hfc_status_m_rsvd_10="0" hfc_status_m_rsvd_11="0" hfc_status_m_rsvd_12="0" hfc_status_m_rsvd_13="0" hfc_status_m_rsvd_14="0" hfc_status_m_rsvd_15="0" hfc_status_m_rsvd_16="0" hfc_status_m_rsvd_17="0" hfc_status_m_rsvd_18="0" hfc_status_m_rsvd_19="0" hfc_status_m_rsvd_20="0" hfc_status_m_rsvd_21="0" hfc_status_m_rsvd_22="0" hfc_status_m_rsvd_23="0" hfc_status_m_rsvd_24="0" hfc_status_m_rsvd_25="0" hfc_status_m_lyr_energy="939" hfc_status_m_lyr_counts="209" hfc_status_m_gem_notkr="0" hfc_status_m_gem_nocallo="45" hfc_status_m_gem_nocno="40931" hfc_status_m_vetoed="42124" dfc="" dfc_status_m_stage_gem="" veto="" name="" dfc_status_m_gem_classes="" dfc_status_m_vetoed="" encountered="" ebf="" toolsvc="" removing="" tools="" created="" *****chrono*****="" ****************************************************************************************************="" the="" final="" cpu="" consumption="" (="" chrono="" (ordered)="" chronostatsvc="" time="" user="" :="" tot="58.7" [s]="" system="" timeelapsed:="" chronostatsvc.f...="" service="" finalized="" terminated="" current="" time:="" sat="" mar="" 17:53:15="" 2024="" 60="" s="" elapsed)="" ----------------="" end="" log="" ended="" at="" raw="" exit="" code="0" cpu:="" 0.000000="" wall:="" 61.156700="" commentary="" failed!="" traceback="" (most="" recent="" call="" last):="" "="" pipelineconfig="" l1proc="" 6.0="" genericscript.py",="" 140,="" trytocall="" **kwargs)="" digitize.py",="" 54,="" digitize="" chunkevents="rootFiles.getFileEvents(stagedDigiFile)" nameerror:="" global="" 'rootfiles'="" defined="" %debug:="" 20240309:17:53:15="" stagefiles(finish)="" line-333="" entering="" stage.finish(wipe)="" line-341="" *******************************************="" %info:="" line-345="" deleting="" staging="" directory="" without="" retrieving="" files.="" %warning:="" stagefiles(_removedir)="" line-389="" empty="" after="" cleanup!!="" line-390="" content="" of="" scratch="" 329289="" 173700="" -rw-r--r--="" glastraw="" glast-pipeline="" 113368436="" 17:52="" r0682587162_e00000000000000106956_v3140180_event.evt="" 64499452="" 17:53="" r0682587162_e00000000000000106956_v3142804_digi.root="" line-392="" ***="" files="" &="" directories="" deleted!="" start="" run="" [rm="" -rf="" 329289]="" 0.007522="" cleanup="=======================" filesystem="" size="" used="" avail="" use%="" mounted="" dev="" sda1="" 16m="" 12k="" 1%="" dirs="Nothing" remove.="=======================" finish="" <="" pre="">
    </vend)></vend)></vend)></vend)></vend)>

However, looking at the file directly, we see that the correct query is being issued:

SELECT ser_no FROM metadata_v2r1  WHERE ((completion="OK") AND (instrument="LAT") AND (calib_type="CAL_Ped") AND (flavor="L1current") AND ("2022-08-19 07:32:45">=vstart) AND ("2022-08-19 07:32:45"<vend) AND ("PROD"=PROC_LEVEL))  ORDER BY update_time desc

This is preventing us from debugging L1Proc on s3df in an efficient manner. We've just wasted a couple of weeks chasing down a non-existent issue with Gleam 😱


  • No labels