Difference between revisions of "Offline Monitoring Archived Data"

From GlueXWiki
Jump to: navigation, search
(Prepare the Launch)
(Prepare the Launch)
Line 15: Line 15:
 
= Prepare the Launch =
 
= Prepare the Launch =
  
'''1)''' Update jobs_analysis_bggen.config. Definitely be sure to update the location for the '''<span style="color:red">SCRIPTFILE</span>''', '''<span style="color:red">JANA_CONFIG</span>''', and '''<span style="color:red">ENVFILE</span>''' where appropriate. The xml file that was used for the analysis launch for data should be chosen:
+
'''1)''' Update jobs_analysis_bggen.config. Be sure to update the location for the '''<span style="color:red">SCRIPTFILE</span>''', '''<span style="color:red">JANA_CONFIG</span>''', and '''<span style="color:red">ENVFILE</span>''' where appropriate. The xml file that was used for the analysis launch for data should be chosen:
 
<pre>
 
<pre>
 
ENVFILE                analysis-2017_01-ver46.xml
 
ENVFILE                analysis-2017_01-ver46.xml
 
</pre>
 
</pre>
  
'''2)''' Make a new jana_analysis.config with your channel:
+
'''2)''' Also update the '''<span style="color:red">INDATA_TOPDIR</span>''', '''<span style="color:red">OUTDIR_LARGE</span>''', and '''<span style="color:red">OUTDIR_SMALL</span>''' directories:
 +
<pre>
 +
INDATA_TOPDIR    /cache/halld/gluex_simulations/REQUESTED_MC/F2018_ver02_21_bggen_batch01_20211104064237pm/hddm
 +
OUTDIR_LARGE    /volatile/halld/home/$USER/bggen
 +
OUTDIR_SMALL    /farm_out/$USER/bggen
 +
</pre>
 +
 
 +
'''3)''' Make a new jana_analysis.config with your channel:
 
<pre>
 
<pre>
 
PLUGINS monitoring_hists,ReactionFilter
 
PLUGINS monitoring_hists,ReactionFilter
Line 30: Line 37:
  
  
'''3)''' Create the SWIF workflow.  The workflow must match the workflow name in the job config file:  
+
'''4)''' Create the SWIF workflow.  The workflow must match the workflow name in the job config file:  
 
<pre>
 
<pre>
 
swif create -workflow <my_workflow>
 
swif create -workflow <my_workflow>
Line 36: Line 43:
  
  
'''4)''' Register jobs for the workflow, where '''<span style="color:red"><job_config_file></span>''' is (e.g.) '''<span style="color:red">"~/monitoring/launch/jobs_offmon.config"</span>''':
+
'''5)''' Register jobs for the workflow:
 
<pre>
 
<pre>
~/monitoring/launch/launch.py <job_config_file> <run_min> <run_max>
+
~/monitoring/launch/launch.py jobs_analysis_bggen.config <run_min> <run_max>
</pre>
+
You can optionally specify specific file numbers to use. For example, to submit jobs for the first 5 files of each run:
+
<pre>
+
~/monitoring/launch/launch.py <job_config_file> <run_min> <run_max> -f '00[0-4]'
+
 
</pre>
 
</pre>
  
'''5)''' Run the workflow:
+
 
 +
'''6)''' Run the workflow:
 
<pre>
 
<pre>
 
swif run -workflow <my_workflow>
 
swif run -workflow <my_workflow>
 
</pre>
 
</pre>

Revision as of 18:13, 12 November 2021

Setup the Software & Environment

1) Checkout (or svn update) the launch scripts if needed:

svn co https://halldsvn.jlab.org/repos/trunk/scripts/monitoring/launch

2) You will need only the following 3 files:

launch.py
script.sh
jobs_analysis_bggen.config

Prepare the Launch

1) Update jobs_analysis_bggen.config. Be sure to update the location for the SCRIPTFILE, JANA_CONFIG, and ENVFILE where appropriate. The xml file that was used for the analysis launch for data should be chosen:

ENVFILE                analysis-2017_01-ver46.xml

2) Also update the INDATA_TOPDIR, OUTDIR_LARGE, and OUTDIR_SMALL directories:

INDATA_TOPDIR    /cache/halld/gluex_simulations/REQUESTED_MC/F2018_ver02_21_bggen_batch01_20211104064237pm/hddm
OUTDIR_LARGE     /volatile/halld/home/$USER/bggen
OUTDIR_SMALL     /farm_out/$USER/bggen

3) Make a new jana_analysis.config with your channel:

PLUGINS monitoring_hists,ReactionFilter
NTHREADS 16
COMBO:MAX_NEUTRALS 15
Reaction1  1_14__8_9_14                 # pi+ pi- p
Reaction1:Flags B4


4) Create the SWIF workflow. The workflow must match the workflow name in the job config file:

swif create -workflow <my_workflow>


5) Register jobs for the workflow:

~/monitoring/launch/launch.py jobs_analysis_bggen.config <run_min> <run_max>


6) Run the workflow:

swif run -workflow <my_workflow>