Difference between revisions of "Offline Analysis Commissioning"
From Hall D Ops Wiki
Line 68: | Line 68: | ||
** Writing the calibration scripts/programs/plugins for their systems. | ** Writing the calibration scripts/programs/plugins for their systems. | ||
** Determining which plots are the primary plots and which are diagnostic plots. | ** Determining which plots are the primary plots and which are diagnostic plots. | ||
+ | |||
+ | * Kei: | ||
+ | ** Will write and (periodically) submit jobs to the farm that run over a few tape files in each run and produce updated calibration & reconstruction histograms. | ||
+ | |||
+ | * Sean: | ||
+ | ** Will store these data in the database. | ||
+ | |||
+ | * Justin: | ||
+ | ** Will build webpage(s) for viewing reconstruction & calibration quality plots for each run, & trends for all runs. | ||
+ | ** Will work with Sean to write scripts to ping database and grab histogram png(s) to update the webpages. | ||
== Analysis Quality Monitoring == | == Analysis Quality Monitoring == |
Revision as of 21:58, 23 September 2014
Contents
Introduction
This document describes the goals of the data monitoring that will be carried out during the fall 2014 commissioning run of Hall D.
Raw Data
- These questions are for every detector system: TAGH, TAGM, CDC, FDC, SC, TOF, BCAL, FCAL, PS (Pair Spectrometer)
Commissioning Tests
- Are the detectors working?
- Do all of the channels have hits?
- What are the hit counts/rates per channel?
- Are the energies & times OK, garbage, or out of range? (by channel)
- Can we read data from tape?
- Can we reproduce the online histograms with offline data?
Offline Monitoring Plan
- Pull key data/histograms from online histograms, put data in database, make history & plots viewable on webpage
- Periodically test that we can reproduce online histograms using on-tape EVIO data.
Action Items
- David: Online data monitoring environment (RootSpy, hdview2, etc.)
- David is updating RootSpy and its documentation/instructions.
- When he's finished, he'll contact the different detector groups and remind them to write their online monitoring plugins.
- Make sure online monitoring histograms are (at least temporarily) on the ifarm work disk somewhere for quick offline access.
- Detector groups:
- Writing the monitoring plugins for their systems.
- Determining which plots are the primary plots (most important for shift-takers) and which are diagnostic plots.
- Integrating their histograms into RootSpy.
- Paul (Mark/Simon?):
- Will setup and maintain software for offline monitoring.
- Kei:
- Will write and (periodically) submit jobs to the farm that run over small samples of the EVIO tape data and test re-making of the online monitoring histograms.
- Sean:
- Will build (sqlite) database for storing key data monitoring information (new entry for each EVIO file).
- Will write and launch job scripts that pull key data from the online monitoring histograms (after each run ends) and stores them in the database.
- These scripts should also grab key plots for the webpage and save the png(s) to disk.
- Justin:
- Will build webpage(s) for viewing raw data for: Recent runs (last 24/48 hours, primary plots), past run history (trends of key data from database)
- Will work with Sean to write scripts to ping database and grab histogram png(s) to update the webpages.
Reconstruction Quality Monitoring
Commissioning Tests
- What is the calibration quality of each system?
- Can we perform reconstruction for each system? (Tracks, showers, etc.)
- Are there any regions of the detector where reconstruction is inefficient?
- Are tracks being properly matched to hits in the other detectors?
- What is the quality of the particle ID?
Offline Monitoring Plan
- Periodically submit jobs to monitor calibration & reconstruction quality of data on tape.
- Just a file or two from each run.
- Submit either at some fixed-time interval (every 2 weeks?) or perhaps after big changes.
- Save key data in database, make history & key plots viewable on webpage
- When ready to do full reconstruction, run calibration & reconstruction quality plugins on all files, save key data to database & make viewable on webpage.
Action Items
- Paul: Will integrate the monitoring_hists plugin (reconstruction) plots into RootSpy.
- Will run full reconstruction over a small % of online data.
- Detector groups:
- Writing the calibration scripts/programs/plugins for their systems.
- Determining which plots are the primary plots and which are diagnostic plots.
- Kei:
- Will write and (periodically) submit jobs to the farm that run over a few tape files in each run and produce updated calibration & reconstruction histograms.
- Sean:
- Will store these data in the database.
- Justin:
- Will build webpage(s) for viewing reconstruction & calibration quality plots for each run, & trends for all runs.
- Will work with Sean to write scripts to ping database and grab histogram png(s) to update the webpages.
Analysis Quality Monitoring
Commissioning Tests
- Can we see π0 peaks
- Can we see simple final states
- γ p → p π+ π-
- γ p → p π+ π- π0
- γ p → p π+ π- η
Offline Monitoring Plan
- Kei:
- Periodically submit analysis jobs to study π0's and simple final states, show results at meetings.