Difference between revisions of "Offline Monitoring Archived Data"

From GlueXWiki
Jump to: navigation, search
(Undo revision 108855 by Aaustreg (talk))
(Undo revision 108854 by Aaustreg (talk))
Line 15: Line 15:
 
= Prepare the Launch =
 
= Prepare the Launch =
  
'''1)''' Update jobs_analysis_bggen.config. Be sure to update the location for the '''<span style="color:red">SCRIPTFILE</span>''', '''<span style="color:red">JANA_CONFIG</span>''', and '''<span style="color:red">ENVFILE</span>''' where appropriate. The xml file that was used for the analysis launch for data should be chosen:
+
'''1)''' Update jobs_analysis_bggen.config. Definitely be sure to update the location for the '''<span style="color:red">SCRIPTFILE</span>''', '''<span style="color:red">JANA_CONFIG</span>''', and '''<span style="color:red">ENVFILE</span>''' where appropriate. The xml file that was used for the analysis launch for data should be chosen:
 
<pre>
 
<pre>
 
ENVFILE                analysis-2017_01-ver46.xml
 
ENVFILE                analysis-2017_01-ver46.xml
 
</pre>
 
</pre>
  
'''2)''' Also update the '''<span style="color:red">INDATA_TOPDIR</span>''', '''<span style="color:red">OUTDIR_LARGE</span>''', and '''<span style="color:red">OUTDIR_SMALL</span>''' directories:
+
'''2)''' Make a new jana_analysis.config with your channel:
<pre>
+
INDATA_TOPDIR    /cache/halld/gluex_simulations/REQUESTED_MC/F2018_ver02_21_bggen_batch01_20211104064237pm/hddm
+
OUTDIR_LARGE    /volatile/halld/home/$USER/bggen
+
OUTDIR_SMALL    /farm_out/$USER/bggen
+
</pre>
+
 
+
'''3)''' Make a new jana_analysis.config with your channel:
+
 
<pre>
 
<pre>
 
PLUGINS monitoring_hists,ReactionFilter
 
PLUGINS monitoring_hists,ReactionFilter
Line 37: Line 30:
  
  
'''4)''' Create the SWIF workflow.  The workflow must match the workflow name in the job config file:  
+
'''3)''' Create the SWIF workflow.  The workflow must match the workflow name in the job config file:  
 
<pre>
 
<pre>
 
swif create -workflow <my_workflow>
 
swif create -workflow <my_workflow>
Line 43: Line 36:
  
  
'''5)''' Register jobs for the workflow:
+
'''4)''' Register jobs for the workflow, where '''<span style="color:red"><job_config_file></span>''' is (e.g.) '''<span style="color:red">"~/monitoring/launch/jobs_offmon.config"</span>''':
 
<pre>
 
<pre>
~/monitoring/launch/launch.py jobs_analysis_bggen.config <run_min> <run_max>
+
~/monitoring/launch/launch.py <job_config_file> <run_min> <run_max>
 +
</pre>
 +
You can optionally specify specific file numbers to use. For example, to submit jobs for the first 5 files of each run:
 +
<pre>
 +
~/monitoring/launch/launch.py <job_config_file> <run_min> <run_max> -f '00[0-4]'
 
</pre>
 
</pre>
  
 
+
'''5)''' Run the workflow:
'''6)''' Run the workflow:
+
 
<pre>
 
<pre>
 
swif run -workflow <my_workflow>
 
swif run -workflow <my_workflow>
 
</pre>
 
</pre>

Revision as of 18:20, 12 November 2021

Setup the Software & Environment

1) Checkout (or svn update) the launch scripts if needed:

svn co https://halldsvn.jlab.org/repos/trunk/scripts/monitoring/launch

2) You will need only the following 3 files:

launch.py
script.sh
jobs_analysis_bggen.config

Prepare the Launch

1) Update jobs_analysis_bggen.config. Definitely be sure to update the location for the SCRIPTFILE, JANA_CONFIG, and ENVFILE where appropriate. The xml file that was used for the analysis launch for data should be chosen:

ENVFILE                analysis-2017_01-ver46.xml

2) Make a new jana_analysis.config with your channel:

PLUGINS monitoring_hists,ReactionFilter
NTHREADS 16
COMBO:MAX_NEUTRALS 15
Reaction1  1_14__8_9_14                 # pi+ pi- p
Reaction1:Flags B4


3) Create the SWIF workflow. The workflow must match the workflow name in the job config file:

swif create -workflow <my_workflow>


4) Register jobs for the workflow, where <job_config_file> is (e.g.) "~/monitoring/launch/jobs_offmon.config":

~/monitoring/launch/launch.py <job_config_file> <run_min> <run_max>

You can optionally specify specific file numbers to use. For example, to submit jobs for the first 5 files of each run:

~/monitoring/launch/launch.py <job_config_file> <run_min> <run_max> -f '00[0-4]'

5) Run the workflow:

swif run -workflow <my_workflow>