Offline Monitoring Data Validation

From GlueXWiki
Revision as of 07:09, 21 October 2021 by Susansch (Talk | contribs)

Jump to: navigation, search

This page contains the procedure for checking if production runs are of good quality and can be used for physics analysis.

Run Periods


Procedure

For each production run, do the following:

  • Go to the Offline Run Browser page.
  • Follow the steps outlined in the checklist below.
  • Workers should check each plot for their assigned subsystem and leave notes in the corresponding spreadsheet if any significant deviations are seen
  • On the spreadsheet, enter "Y" in the "Overall Quality" field if all monitoring histograms are acceptable, otherwise enter "N"
  • We will iterate this procedure until the process converges

Expert Actions

  • Certify that each subsystem is okay
  • Set run status in RCDB based on monitoring results
    • (script provided)

Run Statuses

  • -1 - unchecked
  • 0 - rejected (not physics-quality)
  • 1 - approved
  • 2 - approved long/"mode 8" data
  • 3 - calibration / systematic studies

Checklist

Example Monitoring Spreadsheet

Reference run for 2017-01: 30780

Reference run for 2018-01: 40933/4

Reference run for 2018-08: 51388

Reference run for 2019-11: 71463 (150 nA), 71469 (250 nA), 71724 (350 nA) [for now!]

General Notes

350 nA runs

BCAL

  • Check Occupancy - Reference: [ link ]
  • Check Hit Efficiency - Reference: [ link ]
  • Check Recon. BCAL 1 - Reference: [ link ]
  • Check Recon. BCAL 2 - Reference: [ link ]
  • Check BCAL Matching - Reference: [ link ]

BCAL Reference Plots

BCAL Notes

The BCAL is used to measure the energy and time of showers. The energy is vital for the neutrals. But it’s also used for charged particles to do PID.
BCAL Matching: These plots are for charged particles that are tracked in the drift chambers and projected to the BCAL. The z position along the BCAL can be calculated using the time difference between upstream and downstream hits and compared to the extrapolated position using the drift chambers.
BCAL/Track Delta z = (z determined from time of up - down hits in BCAL) - (z determined from the extrapolation of tracks in the drift chambers) projected BCAL Hit-Z = z determined by extrapolating tracks in the drift chambers to the BCAL. The match rate is the ratio of (number of hits in the BCAL that match the extrapolation of tracks in the drift chamber) / (number of tracks in the drift chamber that point at the BCAL).

CDC

  • Check Occupancy - Reference: [ link ]
  • Check Time-to-distance - Reference: [ link ]
  • Check dE/dx - Reference: [ link ]
  • Check Efficiency- Reference: [ link ]

CDC Reference Plots

CDC Notes

CDC Occupancy: There should be a uniform decrease in intensity from the center of the detector outward. Random white cells scattered throughout occur when not enough data were collected, eg empty target runs, trigger tests or no beam. Several contiguous white, dark blue or bright yellow cells which don't match the neighboring cells are a problem.
Time-to-distance: 𝛿, the change in length of the LOCA caused by the straw deformation, is plotted against the measured drift time, t drift . The color scale indicates the distance of closest approach between the track and the wire, obtained from the tracking software. The red lines are contours of the time-to-distance function for constant drift distances from 1.5 mm to 8 mm, in steps of 0.5 mm. They should lie over the top of the dark blue contour lines separating the colour blocks. For the plot of residuals vs drift time, the mean should be less than 15um and the sigma should be less than 150um.
dE/dx: At 1.5GeV/c the fitted peak mean should be within 1% of 2.02 keV/cm.
Efficiency: The efficiency should be 0.98 or higher at 0cm DOCA, gradually fall to 0.97 at approximately 0.5mm and then more steeply through 0.9 at approximately 0.64cm.

FCAL

  • Check Occupancy - Reference: [ link ]
  • Check FCAL Hits 1 - Reference: [ link ]
  • Check FCAL Hits 2 - Reference: [ link ]
  • Check FCAL Clusters 1 - Reference: [ link ]
  • Check FCAL Recon. 1 - Reference: [ link ]
  • Check FCAL Recon. 2 - Reference: [ link ]
  • Check Recon. FCAL Matching - Reference: [ link ]

FCAL Reference Plots

FCAL Notes

Is used for neutral particle detection and pion identification.


FDC

  • Check Package 1 Occupancy - Reference: [ link ]
  • Check Package 2 Occupancy - Reference: [ link ]
  • Check Package 3 Occupancy - Reference: [ link ]
  • Check Package 4 Occupancy - Reference: [ link ]

FDC Reference Plots

FDC Notes


PS

  • Check Occupancy - Reference: [ link ]
  • Check Timing Alignment - Reference: [ link ]

PS Reference Plots

PS Notes


SC

  • Check Occupancy - Reference: [ link ]
  • Check Recon. SC 1 - Reference: [ link ]
  • Check Recon. SC 2 - Reference: [ link ]
  • Check Recon. SC Matching - Reference: [ link ]

SC Reference Plots

SC Notes


TAGH

  • Check Tagger Occupancy - Reference: [ link ]
  • Check TAGH Hits 2 - Reference: [ link ]

TAGH Reference Plots

TAGH Notes


TAGM

  • Check Timing ADC-RF - Reference: [ link ]
  • Check Timing T-ADC - Reference: [ link ]

TAGM Reference Plots

TAGM Notes


TOF

  • Check Occupancy - Reference: [ link ]
  • Check TOF Matching 1 - Reference: [ link ]
  • Check TOF Matching 2 - Reference: [ link ]

TOF Reference Plots

TOF Notes


RF

  • Check timing offsets - Reference: [ link ]
    • Should be centered around zero

RF Reference Plots


Timing

  • Check HLDT Calorimeter Timing - Reference: [ link ]
  • Check HLDT Drift Chamber Timing - Reference: [ link ]
  • Check HLDT PID System Timing - Reference: [ link ]
  • Check HLDT Tagger Timing - Reference: [ link ]
  • Check HLDT Tagger/RF Align 2 - Reference: [ link ]
  • Check HLDT Tagger/SC Align - Reference: [ link ]
  • Check HLDT Track-Matched Timing - Reference: [ link ]

Timing Reference Plots

Timing Notes

  • Calorimeter Timing - The right two plots aren't aligned at zero because not all corrections are currently applied. If there is a 32 ns shift in part of this data, please note this.
  • Drift Chamber Timing - In each case, the main peaks should line up at zero, but often have other structures. Ignore the first few bins of the lower left plot (they mostly say something about the noise in the detector). There can be 32 ns shifts in the lower right plot.
  • PID System Timing - Nothing to note yet.
  • Tagger Timing - The signal to background levels of the left two plots depend on the electron beam current.
  • Track Matched Timing - Some overlap here with the tracking timing. The new plots should be centered at zero.
  • Tagger/RF Timing - Look for the nice "picket fences" on the right two plots, and that in the bottom left plot each channel peaks at zero.
  • Tagger/SC Timing - Should be similar to Tagger/RF Timing but with larger resolution.


Analysis

  • Tracking 1 - [ link ]
  • Tracking 3 - [ link ]
  • Check BCAL pi0 - Reference: [ link ]
  • Check BCAL/FCAL pi0 - Reference: [ link ]
  • Check p+2pi - Reference: [ link ]
  • Check p+3pi - Reference: [ link ]
  • Check p+pi0g - Reference: [ link ]

Analysis Reference Plots

Analysis Notes

Generally in these plots, there will be a difference between diamond and amorphous radiator running. Should probably add some references for non-diamond plots.

  • Tracking 1 - There should be some mild dependence on beam current and radiator. Note the spikes in the upper right plot are because we have 4 hypotheses fit to a track by default. The lower left plot does have a peak at zero.
  • Tracking 3 -
  • Check BCAL pi0 - The fitted peak should near at the correct pi0 mass of 135 MeV.
  • Check BCAL/FCAL pi0 - The fitted peak should be lower than the correct pi0 mass, I think because the wrong vertex is used.
  • Check p+2pi - The top middle plot should have a sin(2phi) shape for diamond runs. Note that the yields in the top right plot vary from run to run on the order of 10-20%.
  • Check p+3pi -Note that the yields in the top right plot vary from run to run on the order of 10-20%.
  • Check p+pi0g - Note that the yields in the top right plot vary from run to run on the order of 10-20%.
    • Note that these yields are sensitive to the tagger range used! This changes for different beam current settings.


150nA / 250 nA runs

BCAL

  • Check Occupancy - Reference: [ link ]
  • Check Hit Efficiency - Reference: [ link ]
  • Check Recon. BCAL 1 - Reference: [ link ]
  • Check Recon. BCAL 2 - Reference: [ link ]
  • Check BCAL Matching - Reference: [ link ]

BCAL Reference Plots

BCAL Notes

The BCAL is used to measure the energy and time of showers. The energy is vital for the neutrals. But it’s also used for charged particles to do PID.
BCAL Matching: These plots are for charged particles that are tracked in the drift chambers and projected to the BCAL. The z position along the BCAL can be calculated using the time difference between upstream and downstream hits and compared to the extrapolated position using the drift chambers.
BCAL/Track Delta z = (z determined from time of up - down hits in BCAL) - (z determined from the extrapolation of tracks in the drift chambers) projected BCAL Hit-Z = z determined by extrapolating tracks in the drift chambers to the BCAL. The match rate is the ratio of (number of hits in the BCAL that match the extrapolation of tracks in the drift chamber) / (number of tracks in the drift chamber that point at the BCAL).

CDC

  • Check Occupancy - Reference: [ link ]
  • Check Time-to-distance - Reference: [ link ]
  • Check dE/dx - Reference: [ link ]
  • Check Efficiency- Reference: [ link ]

CDC Reference Plots

CDC Notes

CDC Occupancy: There should be a uniform decrease in intensity from the center of the detector outward. Random white cells scattered throughout occur when not enough data were collected, eg empty target runs, trigger tests or no beam. Several contiguous white, dark blue or bright yellow cells which don't match the neighboring cells are a problem.
Time-to-distance: 𝛿, the change in length of the LOCA caused by the straw deformation, is plotted against the measured drift time, t drift . The color scale indicates the distance of closest approach between the track and the wire, obtained from the tracking software. The red lines are contours of the time-to-distance function for constant drift distances from 1.5 mm to 8 mm, in steps of 0.5 mm. They should lie over the top of the dark blue contour lines separating the colour blocks. For the plot of residuals vs drift time, the mean should be less than 5um and the sigma should be less than 180um.
dE/dx: At 1.5GeV/c the fitted peak mean should be within 1% of 2.02 keV/cm.
Efficiency: The efficiency should be 0.98 or higher at 0cm DOCA, gradually fall to 0.97 at approximately 0.5mm and then more steeply through 0.9 at approximately 0.64cm.

FCAL

  • Check Occupancy - Reference: [ link ]
  • Check FCAL Hits 1 - Reference: [ link ]
  • Check FCAL Hits 2 - Reference: [ link ]
  • Check FCAL Clusters 1 - Reference: [ link ]
  • Check FCAL Recon. 1 - Reference: [ link ]
  • Check FCAL Recon. 2 - Reference: [ link ]
  • Check Recon. FCAL Matching - Reference: [ link ]

FCAL Reference Plots

FCAL Notes

Is used for neutral particle detection and pion identification.


FDC

  • Check Package 1 Occupancy - Reference: [ link ]
  • Check Package 2 Occupancy - Reference: [ link ]
  • Check Package 3 Occupancy - Reference: [ link ]
  • Check Package 4 Occupancy - Reference: [ link ]

FDC Reference Plots

FDC Notes


PS

  • Check Occupancy - Reference: [ link ]
  • Check Timing Alignment - Reference: [ link ]

PS Reference Plots

PS Notes


SC

  • Check Occupancy - Reference: [ link ]
  • Check Recon. SC 1 - Reference: [ link ]
  • Check Recon. SC 2 - Reference: [ link ]
  • Check Recon. SC Matching - Reference: [ link ]

SC Reference Plots

SC Notes


TAGH

  • Check Tagger Occupancy - Reference: [ link ]
  • Check TAGH Hits 2 - Reference: [ link ]

TAGH Reference Plots

TAGH Notes


TAGM

  • Check Timing ADC-RF - Reference: [ link ]
  • Check Timing T-ADC - Reference: [ link ]

TAGM Reference Plots

TAGM Notes


TOF

  • Check Occupancy - Reference: [ link ]
  • Check TOF Matching 1 - Reference: [ link ]
  • Check TOF Matching 2 - Reference: [ link ]

TOF Reference Plots

TOF Notes


RF

  • Check timing offsets - Reference: [ link ]
    • Should be centered around zero

RF Reference Plots


Timing

  • Check HLDT Calorimeter Timing - Reference: [ link ]
  • Check HLDT Drift Chamber Timing - Reference: [ link ]
  • Check HLDT PID System Timing - Reference: [ link ]
  • Check HLDT Tagger Timing - Reference: [ link ]
  • Check HLDT Tagger/RF Align 2 - Reference: [ link ]
  • Check HLDT Tagger/SC Align - Reference: [ link ]
  • Check HLDT Track-Matched Timing - Reference: [ link ]

Timing Reference Plots

Timing Notes

  • Calorimeter Timing - The right two plots aren't aligned at zero because not all corrections are currently applied. If there is a 32 ns shift in part of this data, please note this.
  • Drift Chamber Timing - In each case, the main peaks should line up at zero, but often have other structures. Ignore the first few bins of the lower left plot (they mostly say something about the noise in the detector). There can be 32 ns shifts in the lower right plot.
  • PID System Timing - Nothing to note yet.
  • Tagger Timing - The signal to background levels of the left two plots depend on the electron beam current.
  • Track Matched Timing - Some overlap here with the tracking timing. The new plots should be centered at zero.
  • Tagger/RF Timing - Look for the nice "picket fences" on the right two plots, and that in the bottom left plot each channel peaks at zero.
  • Tagger/SC Timing - Should be similar to Tagger/RF Timing but with larger resolution.


Analysis

  • Tracking 1 - [ link ]
  • Tracking 3 - [ link ]
  • Check BCAL pi0 - Reference: [ link ]
  • Check BCAL/FCAL pi0 - Reference: [ link ]
  • Check p+2pi - Reference: [ link ]
  • Check p+3pi - Reference: [ link ]
  • Check p+pi0g - Reference: [ link ]

Analysis Reference Plots

Analysis Notes

Generally in these plots, there will be a difference between diamond and amorphous radiator running. Should probably add some references for non-diamond plots.

  • Tracking 1 - There should be some mild dependence on beam current and radiator. Note the spikes in the upper right plot are because we have 4 hypotheses fit to a track by default. The lower left plot does have a peak at zero.
  • Tracking 3 -
  • Check BCAL pi0 - The fitted peak should near at the correct pi0 mass of 135 MeV.
  • Check BCAL/FCAL pi0 - The fitted peak should be lower than the correct pi0 mass, I think because the wrong vertex is used.
  • Check p+2pi - The top middle plot should have a sin(2phi) shape for diamond runs. Note that the yields in the top right plot vary from run to run on the order of 10-20%.
  • Check p+3pi -Note that the yields in the top right plot vary from run to run on the order of 10-20%.
  • Check p+pi0g - Note that the yields in the top right plot vary from run to run on the order of 10-20%.
    • Note that these yields are sensitive to the tagger range used! This changes for different beam current settings.