...
JetTrackVertexAnalysis-00-03-0608
After 15.0.0 there were changes in the L1 Calo jetEtSum computation and related tools that are not compatible with with releases <= 15.0.0
...
Also includes the a block for track jets and job options to construct them.
00-03-08 includes commented-out JVF changes which will work in the next release (JVF branches do NOT work in 00-03-08), various bugfixes and naming convention updates, and updates to jet moment handling. 00-03-06 will still work if 00-03-08 gives problems for any reason. 00-03-07 does not compile in 15.1.0.
Structure and usage
General structure
...
Note that the CMTCVSOFFSET is thus different and should be explicitly defined when checking in or out of this CVS location
| No Format |
|---|
cmt co -r JetTrackVertexAnalysis-00-02-12 -o groups/slac JetTrackVertexAnalysis
|
...
Log in to lxplus.
| No Format |
|---|
phansson@phansson-laptop~/% ssh <nop>phansson@lxplus.cern.ch
|
Create the working directories.
| No Format |
|---|
phansson@lxplus253~/% mkdir work
phansson@lxplus253~/% mkdir work/jetmetbtag
phansson@lxplus253~/% mkdir work/jetmetbtag/mytest
phansson@lxplus253~/% cd work/jetmetbtag/mytest
phansson@lxplus253~/work/jetmetbtag/mytest% mkdir 14.2.25
|
...
Source the CMT setup script.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% source /afs/cern.ch/sw/contrib/CMT/v1r20p20080222/mgr/setup.sh
|
Create an empty home requirements file.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% touch requirementsMore information on what the requirements file is doing can be found in AtlasLogin
|
...
Create analysis environment including the CMT setup scripts.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% cmt config
------------------------------------------
Configuring environment for standalone package.
CMT version v1r20p20080222.
System is amd64_linux26
------------------------------------------
Creating setup scripts.
Creating cleanup scripts.
|
Setup your release (ask your closest expert which one to use).
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% source setup.sh -tag=14.2.25
#CMT> Warning: template <src_dir> not expected in pattern install_scripts (from TDAQCPolicy)
#CMT> Warning: template <files> not expected in pattern install_scripts (from TDAQCPolicy)
|
...
Check out the package.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% cd 14.2.25
[phansson@lxplus253]~/work/jetmetbtag/mytest/14.2.25% cmt co -r JetTrackVertexAnalysis-00-02-12 -o groups/slac JetTrackVertexAnalysis
# ================= working on package JetTrackVertexAnalysis version JetTrackVertexAnalysis-00-02-12 in /afs/cern.ch/user/p/
phansson/work/jetmetbtag/mytest/14.2.25/JetTrackVertexAnalysis
# get top files
cvs update: Updating .
Creating setup scripts.
Creating cleanup scripts.
Installing the run directory
|
Setup the package in the analysis environment.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest/14.2.25% source JetTrackVertexAnalysis/cmt/setup.sh
|
Compile the package.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest/14.2.25% cd JetTrackVertexAnalysis/cmt
[phansson@lxplus253]~/work/jetmetbtag/mytest/14.2.25/JetTrackVertexAnalysis/cmt% make
...
...
...
#CMT---> all ok.
|
...
Log in to lxplus.
| No Format |
|---|
[phansson@phansson-laptop]~/% ssh <nop>phansson@lxplus.cern.ch
|
Go directly to the working directory and setup the release.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% source setup.sh -tag=14.2.25
#CMT> Warning: template <src_dir> not expected in pattern install_scripts (from TDAQCPolicy)
#CMT> Warning: template <files> not expected in pattern install_scripts (from TDAQCPolicy)
|
...
Setup the JetTrackVertexAnalysis? package.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% cd 14.2.25
[phansson@lxplus253]~/work/jetmetbtag/mytest/14.2.25% source JetTrackVertexAnalysis/cmt/setup.sh
#CMT> Warning: template <src_dir> not expected in pattern install_scripts (from TDAQCPolicy)
#CMT> Warning: template <files> not expected in pattern install_scripts (from TDAQCPolicy)
|
...
FInd an AOD file that can be used. If you have access to pcphuat disks a file that should work with this example can be found here
/u1/phansson/data/WbbNp1.250evt.0skip.no_trig.AOD.pool.root
...
Go to run directory:
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest/14.2.25/JetTrackVertexAnalysis/cmt% cd ../run
|
...
In order to run the program, edit this file with your favorite text editor.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest/14.2.25/JetTrackVertexAnalysis/run% cp ../share/CommonNtuple_defaultOptions.py .
[phansson@lxplus253]~/work/jetmetbtag/mytest/14.2.25/JetTrackVertexAnalysis/run% emacs CommonNtuple_defaultOptions.py
|
...
Run over the local file.
| No Format |
|---|
[phansson@lxplus253]\~/work/jetmetbtag/mytest/14.2.25/JetTrackVertexAnalysis/run% athena CommonNtuple_defaultOptions.py
|
...
Note that the events may be large and thus choose your output directory accordingly. The number of events can be changed in CommonNtuple_defaultOptions.py by modifying the line
| No Format |
|---|
theApp.EvtMax = 10
|
Run the common nTupleMaker on the GRID using PANDA using a CERN lxplus account
...
Go directly to the working directory and setup the release:
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% source setup.sh -tag=14.2.25
[phansson@lxplus253]~/work/jetmetbtag/mytest% cd 14.2.25
|
Check-out the HEAD of PandaTools?.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% cmt co PhysicsAnalysis/DistributedAnalysis/PandaTools
|
Setup the package in the environment.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% source PhysicsAnalysis/DistributedAnalysis/PandaTools/cmt/setup.sh
|
Go to the cmt directory of the package and compile.
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% cd PhysicsAnalysis/DistributedAnalysis/PandaTools/cmt/
[phansson@lxplus216]~/work/jetmetbtag/mytest/14.2.25/PhysicsAnalysis/DistributedAnalysis/PandaTools/cmt% make
...
...
...
#CMT---> all ok.
|
...
Go directly to the working directory and setup the release:
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% source setup.sh -tag=14.2.25
|
Set up the package in the environment
| No Format |
|---|
[phansson@lxplus253]~/work/jetmetbtag/mytest% source PhysicsAnalysis/DistributedAnalysis/PandaTools/cmt/setup.sh
|
...
Set up your grid environment (note that there is no obligation to be in the working directory when setting up the grid environment).
| No Format |
|---|
[phansson@lxplus209]~/% source /afs/cern.ch/project/gd/LCG-share/sl4/etc/profile.d/grid_env.sh
[phansson@lxplus209]~/% voms-proxy-init -voms atlas
Cannot find file or dir: /afs/cern.ch/user/p/phansson/.glite/vomses
Enter GRID pass phrase:
Your identity: /O=Grid/O=NorduGrid/OU=kth.se/CN=Per Hansson
Creating temporary proxy .................................. Done
Contacting voms.cern.ch:15001 [/DC=ch/DC=cern/OU=computers/CN=voms.cern.ch] "atlas" Done
Creating proxy ............................... Done
Your proxy is valid until Tue Jan 13 23:28:24 2009
|
DQ2 is a good tool to find and browse datasets. To set this tool up use the following command.
| No Format |
|---|
[phansson@lxplus209]~/% source /afs/cern.ch/atlas/offline/external/GRID/ddm/DQ2Clients/setup.sh
|
...
Find a dataset that you want to run over. Note that this dataset have to be registered to the grid. In this example I use a Wbb sample.
| No Format |
|---|
[phansson@lxplus209]~/% dq2-ls 'user*David*Miller*WbbNp1*AOD*'
user.DavidWilkinsMiller.misal1_mc12.006281.AlpgenJimmyWbbNp1.v12000605.no_trigger.AOD
|
Go to the working directory and setup the release
| No Format |
|---|
[phansson@lxplus253]~/% cd work/jetmetbtag/mytest
[phansson@lxplus253]~/work/jetmetbtag/mytest% source setup.sh -tag=14.2.25
|
Set up the JetTrackVertexAnalysis package in your environment.
| No Format |
|---|
[phansson@pcphuat27]~/work/jetmetbtag/mytest% cd 14.2.25
[phansson@pcphuat27]~/work/jetmetbtag/mytest/14.2.25% source JetTrackVertexAnalysis/cmt/setup.sh
#CMT> Warning: template <src_dir> not expected in pattern install_scripts (from TDAQCPolicy)
#CMT> Warning: template <files> not expected in pattern install_scripts (from TDAQCPolicy)
|
Setup Panda in your environmen.
| No Format |
|---|
[phansson@pcphuat27]~/work/jetmetbtag/mytest/14.2.25% source PhysicsAnalysis/DistributedAnalysis/PandaTools/cmt/setup.sh
#CMT> Warning: template <src_dir> not expected in pattern install_scripts (from TDAQCPolicy)
#CMT> Warning: template <files> not expected in pattern install_scripts (from TDAQCPolicy)
|
...
The panda job is sent by executing the pathena script which should now be found in the /InstallArea (at least the a link to it).
| No Format |
|---|
[phansson@pcphuat27]~/work/jetmetbtag/mytest/14.2.25% more InstallArea/share/bin/pathena
|
To see what parameters that can be used by the script.
| No Format |
|---|
[phansson@lxplus209]~/work/jetmetbtag/mytest/14.2.25% pathena --help
|
In order to help sending (multiple) jobs over (possibly) multiple datasets a simple python script is used. This file is located in the /share directory of the JetTrackVertexAnalysis package. Copy it to the /run directory and open with your text editor.
| No Format |
|---|
[phansson@lxplus209]~/work/jetmetbtag/mytest/14.2.25% cp JetTrackVertexAnalysis/share/submitDefaultPathenaJob.py JetTrackVertexAnalysis/run/
[phansson@lxplus209]~/work/jetmetbtag/mytest/14.2.25% cd JetTrackVertexAnalysis/run
[phansson@lxplus209]~/work/jetmetbtag/mytest/14.2.25% emacs submitDefaultPathenaJob.py
|
The main characteristics of this file is described below.
| Panel |
|---|
'user': the name of the user output dataset |
| No Format |
|---|
--libDs LAST
|
It is also possible to specify the exact name of a library as long as it is registered on the grid.
A good cross-check before executing the pathena script is to run the common nTupleMaker on one of the files in (at least) one of the datasets locally and make sure everything behaves as expected. It is also possible to run over only a few files with panda as a test before sending large jobs, this is possible by specifying in the option
| No Format |
|---|
--split 1
|
to submit only 1 job. After editing the submission script with the dataset of your choice and (possibly) changing options, execute the script.
| No Format |
|---|
[phansson@lxplus209]~/work/jetmetbtag/mytest/14.2.25/JetTrackVertexAnalysis/run% python ../share/submitDefaultPathenaJob.py
pathena --nFilesPerJob 2 --individualOutDS --split 20 --outDS user09.PerHansson.default.user.DavidWilkinsMiller.misal1_mc12.0
06281.AlpgenJimmyWbbNp1.v12000605.no_trigger.AOD --inDS user.DavidWilkinsMiller.misal1_mc12.006281.AlpgenJimmyWbbNp1.v1200060
5.no_trigger.AOD CommonNtuple_defaultOptions.py
extracting run configuration
ConfigExtractor > Input=POOL
ConfigExtractor > Output=AANT AANTupleStream AANT
archive sources
archive InstallArea
check symbolic links
post sources/jobO
query files in dataset:user.DavidWilkinsMiller.misal1_mc12.006280.AlpgenJimmyWbbNp1.v12000605.no_trigger.AOD
submit
===================
JobID : 707
Status : 0
> build
PandaID=23151069
> run
PandaID=23151070-23151086
|
Tip: If the dataset files are not found, one solution could be to locate the files with DQ2 and specify this site specifically in the pathena script.
| No Format |
|---|
[phansson@lxplus209]~/work/jetmetbtag/mytest/14.2.25/JetTrackVertexAnalysis/run% dq2-ls -r user.DavidWilkinsMiller.misal1_mc1
2.006281.AlpgenJimmyWbbNp1.v12000605.no_trigger.AOD
user.DavidWilkinsMiller.misal1_mc12.006281.AlpgenJimmyWbbNp1.v12000605.no_trigger.AOD
INCOMPLETE:
COMPLETE:
SLACXRD
|
In this example the files are at SLACXRD and thus a site option can be added to the pathena script options.
| No Format |
|---|
--site=SLACXRD
|
Details on analysis using Panda can be found at DAonPanda.
...