Difference between revisions of "Data Monitoring Database"

From GlueXWiki
Jump to: navigation, search
(Parameters)
(Database Parameters)
 
(19 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
Draft Requirements for data quality monitoring database & plots.  
 
Draft Requirements for data quality monitoring database & plots.  
  
The main purpose of the database is to display time series summaries of variables useful for data quality monitoring
+
== Histograms ==
  
== Tables ==
+
=== Raw Data ===
 
+
* Per Channel (2D preferred): Counts, Pedestals, Energy, Times
=== Metadata tables ===
+
* Runs - run id (internal), run number, run start time/date, run stop time/date, # of events, nominal beam current, nominal beam energy, target type, target location (?), trigger configuration (e.g. a file name), solenoid field current, radiator, photon beam coherent peak.
+
* Versions - version id (internal), release, CCDB version, timestamp, data type
+
 
+
=== Raw Data Tables ===
+
* Common info: run id, version id, # of events recorded in detector
+
* Pedestals, hit counts
+
 
** For: TAGH, TAGM, SC, CDC, FDC, TOF, BCAL, FCAL, PS
 
** For: TAGH, TAGM, SC, CDC, FDC, TOF, BCAL, FCAL, PS
** Group by detector region: CDC rings, FDC planes (handle on r?), BCAL modules, SC paddles, FCAL ~θ(?), TOF paddle group(?)
+
** Examples for CDC:
  
=== Calibration Data Tables ===
+
[[File:Cdc_int.png|200px|thumb|right|integrated pulse]]
* Common info: run id, version id, # of events
+
* Drift chamber residuals (mean & sigma)
+
* Timing Resolutions (mean & sigma): SC, TOF, BCAL, FCAL, TAGM, TAGH
+
  
=== Reconstruction Data Tables ===
+
[[File:Cdc_o.png|200px|thumb|right|occupancy]]
* Common info: run id, version id, # of events
+
* Tracking: # good/all tracks (q+, q-, p, pi-, pi+, K+)
+
* Neutral Showers: # good/all neutral showers
+
* # BCAL showers, FCAL showers, TOF points, SC hits, TAGM hits, TAGH hits
+
* # track matches to: BCAL, FCAL, TOF, SC
+
  
== Database Parameters ==
+
[[File:Cdc_ped.png|200px|thumb|right|pedestals]]
  
* Data types - types of monitoring data that we are saving (online, offline, MC) [better terms?]
+
Click on each image to see full size.
* Data version
+
 
+
== Histograms ==
+
 
+
=== Raw Data ===
+
* Per Channel: Counts, Pedestals, Energy, Times
+
  
 
=== Calibration Data ===
 
=== Calibration Data ===
 
* Drift chamber residuals (mean & sigma)
 
* Drift chamber residuals (mean & sigma)
* Timing resolutions (SC, TOF, BCAL, FCAL, TAGM, TAGH)
+
* Timing resolutions vs. detector region (SC, TOF, BCAL, FCAL, TAGM, TAGH)
 +
* Other calibration spectra
  
 
=== Reconstruction Data ===
 
=== Reconstruction Data ===
 
* Event Vertex: Z, Y vs X
 
* Event Vertex: Z, Y vs X
 
* Detectors:
 
* Detectors:
** TAGM/TAGH: Photon Beam Energy
+
** TAGM/TAGH Hits: # per event, Photon Beam Energy
** FCAL Showers: Energy, Time, Y vs X
+
** FCAL Showers: # per event, Energy, Δt, Y vs X
** BCAL Showers: Energy, Time, φ vs Z
+
** BCAL Showers: # per event, Energy, Δt, φ vs Z
** TOF Points: Energy, Time, Y vs X
+
** TOF Points: # per event, Energy, Δt, Y vs X
** SC Hits: Sector, Time vs. Sector, Energy vs. Sector
+
** SC Hits: # per event, Sector, Δt, Energy vs. Sector
  
 
* Tracks:
 
* Tracks:
 +
** # Good, all tracks (q+, q-, p, pi-, pi+, K+)
 +
** # Track matches to: BCAL, FCAL, TOF, SC
 
** Tracking chisq/ndf (p, pi+, pi-)
 
** Tracking chisq/ndf (p, pi+, pi-)
 
** Kinematics (Good p, pi+, pi-): Particle p vs θ, φ vs θ
 
** Kinematics (Good p, pi+, pi-): Particle p vs θ, φ vs θ
Line 56: Line 38:
 
** PID dE/dx vs p (q+, q-): CDC, FDC, TOF, SC
 
** PID dE/dx vs p (q+, q-): CDC, FDC, TOF, SC
 
** PID (q+, q-): β vs p
 
** PID (q+, q-): β vs p
** PID (p, pi+, pi-): Confidence Level
 
  
 
* Neutrals:
 
* Neutrals:
** β vs p
+
** # Good, all neutral showers
** Kinematics (γ): Particle p vs θ, φ vs θ
+
** Kinematics (Good γ): Particle p vs θ, φ vs θ
** PID (γ): Confidence Level
+
 
 +
== Database Tables ==
 +
* The main purpose of the database is to display time series summaries of variables useful for data quality monitoring
 +
 
 +
=== Metadata tables ===
 +
* Runs
 +
** Run id (internal), run number, run start time/date, run stop time/date
 +
** # of events
 +
** Nominal beam current, nominal beam energy, radiator, photon beam coherent peak
 +
** Target type, target location (?)
 +
** Trigger configuration (e.g. a file name)
 +
** Solenoid field current
 +
 
 +
* Versions
 +
** Version id (internal), release, CCDB version, timestamp, data type
 +
 
 +
=== Raw Data Tables ===
 +
* Common info: run id, file #, version id, # of events recorded in detector
 +
* Hit counts
 +
** For: TAGH, TAGM, SC, CDC, FDC, TOF, BCAL, FCAL, PS
 +
** Group by detector region: CDC rings, FDC planes (handle on r?), BCAL modules, SC paddles, FCAL ~θ(?), TOF paddle group(?)
 +
 
 +
=== Calibration Data Tables ===
 +
* Common info: run id, file #, version id, # of events
 +
* Drift chamber residuals (mean & sigma)
 +
* Timing Resolutions (mean & sigma): SC, TOF, BCAL, FCAL, TAGM, TAGH
 +
 
 +
=== Reconstruction Data Tables ===
 +
* Common info: run id, file #, version id, # of events
 +
* Tracking: # good/all tracks (q+, q-, p, pi-, pi+, K+)
 +
* Neutral Showers: # good/all neutral showers
 +
* # BCAL showers, FCAL showers, TOF points, SC hits, TAGM hits, TAGH hits
 +
* # Track matches to: BCAL, FCAL, TOF, SC
 +
 
 +
== Database Parameters ==
 +
 
 +
* Data version
 +
** Data type - rawdata, recon, mc-*
 +
** Release - name of software version used to process data- gluex_soft-comm-1.20
 +
** Timestamp - date when data processing began, i.e. when jobs were submitted - 20141110
 +
** dataVersionString = rawdata_gluex_soft-comm-1.20_20141110_whateveryouwant

Latest revision as of 14:11, 9 October 2014

Draft Requirements for data quality monitoring database & plots.

Histograms

Raw Data

  • Per Channel (2D preferred): Counts, Pedestals, Energy, Times
    • For: TAGH, TAGM, SC, CDC, FDC, TOF, BCAL, FCAL, PS
    • Examples for CDC:
integrated pulse
occupancy
pedestals

Click on each image to see full size.

Calibration Data

  • Drift chamber residuals (mean & sigma)
  • Timing resolutions vs. detector region (SC, TOF, BCAL, FCAL, TAGM, TAGH)
  • Other calibration spectra

Reconstruction Data

  • Event Vertex: Z, Y vs X
  • Detectors:
    • TAGM/TAGH Hits: # per event, Photon Beam Energy
    • FCAL Showers: # per event, Energy, Δt, Y vs X
    • BCAL Showers: # per event, Energy, Δt, φ vs Z
    • TOF Points: # per event, Energy, Δt, Y vs X
    • SC Hits: # per event, Sector, Δt, Energy vs. Sector
  • Tracks:
    • # Good, all tracks (q+, q-, p, pi-, pi+, K+)
    • # Track matches to: BCAL, FCAL, TOF, SC
    • Tracking chisq/ndf (p, pi+, pi-)
    • Kinematics (Good p, pi+, pi-): Particle p vs θ, φ vs θ
    • Deposited Energy (Good p, pi+, pi-): BCAL, FCAL
    • PID dE/dx vs p (q+, q-): CDC, FDC, TOF, SC
    • PID (q+, q-): β vs p
  • Neutrals:
    • # Good, all neutral showers
    • Kinematics (Good γ): Particle p vs θ, φ vs θ

Database Tables

  • The main purpose of the database is to display time series summaries of variables useful for data quality monitoring

Metadata tables

  • Runs
    • Run id (internal), run number, run start time/date, run stop time/date
    • # of events
    • Nominal beam current, nominal beam energy, radiator, photon beam coherent peak
    • Target type, target location (?)
    • Trigger configuration (e.g. a file name)
    • Solenoid field current
  • Versions
    • Version id (internal), release, CCDB version, timestamp, data type

Raw Data Tables

  • Common info: run id, file #, version id, # of events recorded in detector
  • Hit counts
    • For: TAGH, TAGM, SC, CDC, FDC, TOF, BCAL, FCAL, PS
    • Group by detector region: CDC rings, FDC planes (handle on r?), BCAL modules, SC paddles, FCAL ~θ(?), TOF paddle group(?)

Calibration Data Tables

  • Common info: run id, file #, version id, # of events
  • Drift chamber residuals (mean & sigma)
  • Timing Resolutions (mean & sigma): SC, TOF, BCAL, FCAL, TAGM, TAGH

Reconstruction Data Tables

  • Common info: run id, file #, version id, # of events
  • Tracking: # good/all tracks (q+, q-, p, pi-, pi+, K+)
  • Neutral Showers: # good/all neutral showers
  • # BCAL showers, FCAL showers, TOF points, SC hits, TAGM hits, TAGH hits
  • # Track matches to: BCAL, FCAL, TOF, SC

Database Parameters

  • Data version
    • Data type - rawdata, recon, mc-*
    • Release - name of software version used to process data- gluex_soft-comm-1.20
    • Timestamp - date when data processing began, i.e. when jobs were submitted - 20141110
    • dataVersionString = rawdata_gluex_soft-comm-1.20_20141110_whateveryouwant