Difference between revisions of "GlueX-2022-05 data reconstruction"

From GlueXWiki
Jump to: navigation, search
(Created page with "[https://halldweb.jlab.org/wiki/index.php/Eta_Decay_Width_Measurements_via_Primakoff_Effect Back to the analysis page] == Reconstruction launch overview== *Reconstruction of t...")
 
(→‎Version)
 
(20 intermediate revisions by the same user not shown)
Line 3: Line 3:
 
*Reconstruction of the physics objects from raw data using the danarest plugin
 
*Reconstruction of the physics objects from raw data using the danarest plugin
 
*Configuration of the launches:
 
*Configuration of the launches:
−
** /group/halld/data_monitoring/run_conditions/RunPeriod-2023-01
+
** /group/halld/data_monitoring/run_conditions/RunPeriod-2022-05
 
*Input raw data (.evio):  
 
*Input raw data (.evio):  
−
** /mss/halld/RunPeriod-2023-01/rawdata
+
** /mss/halld/RunPeriod-2022-05/rawdata
 
*Output reconstructed files (.hddm):
 
*Output reconstructed files (.hddm):
−
** /mss/halld/RunPeriod-2023-01/recon
+
** /mss/halld/RunPeriod-2022-05/recon
  
 
==Version ==
 
==Version ==
 
* Software stack:  
 
* Software stack:  
−
** ver01: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], circular/linear polarization proposal
+
** ver99: [https://halldweb.jlab.org/halld_versions/version_5.18.0.xml version_5.18.0.xml], test
−
** ver02: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml], cost of rendering per hour using NERSC cpu test
+
** ver88: [https://halldweb.jlab.org/halld_versions/version_5.18.2.xml version_5.18.2.xml], test
−
** ver03: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], high-intensity studies
+
** ver01: [https://halldweb.jlab.org/halld_versions/version_5.18.2.xml version_5.18.2.xml], production
 
* Calibration time stamp:  
 
* Calibration time stamp:  
−
** ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01
+
** ver99: test - variation=default calibtime=2024-06-24-00-00-01
−
** ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01
+
** ver88: test - variation=default calibtime=2024-06-30-00-00-01
−
** ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001
+
** ver01: production - variation=default calibtime=2024-06-30-00-00-01
 
* Started on
 
* Started on
−
** ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023.
+
** ver99: test - 24/06/2024. Finished on 26/06/2024.
−
** ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023.
+
** ver88: test - 30/06/2024. Finished on 02/07/2024.
−
** ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024.
+
** ver01: production - 02/07/2024. Finished on 18/10/2024.
 
* Summary:  
 
* Summary:  
 
{| class="wikitable"
 
{| class="wikitable"
Line 37: Line 37:
 
! Details
 
! Details
 
|-
 
|-
−
| 2023-01
+
| 2022-05
 +
| 99
 
| 01
 
| 01
−
| 01
+
| 101586
−
| 120395
+
| 101586
−
| 120438
+
| 1
−
| 30
+
| 126 (125)
−
| 5850 (5657)
+
| ? TB
−
| 28 TB
+
 
| NERSC*
 
| NERSC*
 
| 1
 
| 1
−
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver01-perl_batchNERSC-multi/]
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2022-05_ver99-perl_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2022-05_ver99-perl_batchNERSC-multi]
 
|-
 
|-
−
| 2023-01
+
| 2022-05
−
| 02
+
| 88
 
| 01
 
| 01
−
| 120437
+
| 101586
−
| 120438
+
| 101586
−
| 2
+
| 1
−
| 520 (500)
+
| 126 (125)
−
| 2.5 TB
+
| ? TB
 
| NERSC*
 
| NERSC*
 
| 1
 
| 1
−
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver02-perl_batchNERSC-multi/]
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2022-05_ver88-perl_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2022-05_ver88-perl_batchNERSC-multi]
 
|-
 
|-
−
| 2023-01
+
| 2022-05
−
| 03
+
| 01
−
| 02
+
| 01
−
| 120582
+
| 100000
−
| 120602
+
| 109999
−
| 11
+
| 627+93
−
| 856 (850)
+
| 40536+4653 (43177)
−
| 4.1TB
+
| 130 TB / ? TB
−
| NERSC*
+
| NERSC*/BigRed200
 
| 1
 
| 1
−
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver03-perl_batchNERSC-multi/]
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2022-05_ver01-perl_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2022-05_ver01-perl_batchNERSC-multi][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj9&workflow=recon_2022-05_ver01_batch01-iu_IU]
 
|-
 
|-
 
|}
 
|}
−
* Comparison between [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml]
 
−
** Success rate:
 
−
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 30 runs
 
−
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] and 2 runs. Both [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] fail for the same evio files for these 2 runs.
 
−
*** 99% for ver03 & [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 11 runs
 
−
** Cost of rendering per hour using NERSC cpu test results: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] equal to [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml]
 
 
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."
 
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."

Latest revision as of 07:11, 23 October 2024

Back to the analysis page

Reconstruction launch overview

  • Reconstruction of the physics objects from raw data using the danarest plugin
  • Configuration of the launches:
    • /group/halld/data_monitoring/run_conditions/RunPeriod-2022-05
  • Input raw data (.evio):
    • /mss/halld/RunPeriod-2022-05/rawdata
  • Output reconstructed files (.hddm):
    • /mss/halld/RunPeriod-2022-05/recon

Version

  • Software stack:
  • Calibration time stamp:
    • ver99: test - variation=default calibtime=2024-06-24-00-00-01
    • ver88: test - variation=default calibtime=2024-06-30-00-00-01
    • ver01: production - variation=default calibtime=2024-06-30-00-00-01
  • Started on
    • ver99: test - 24/06/2024. Finished on 26/06/2024.
    • ver88: test - 30/06/2024. Finished on 02/07/2024.
    • ver01: production - 02/07/2024. Finished on 18/10/2024.
  • Summary:
Runperiod Version Batch Min Run Max Run # Runs # REST Files (succeeded) Total Size of REST Files Site Priority Details
2022-05 99 01 101586 101586 1 126 (125)  ? TB NERSC* 1 [1][2]
2022-05 88 01 101586 101586 1 126 (125)  ? TB NERSC* 1 [3][4]
2022-05 01 01 100000 109999 627+93 40536+4653 (43177) 130 TB / ? TB NERSC*/BigRed200 1 [5][6][7]

(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."

Retrieved from "https://halldweb.jlab.org/wiki/index.php?title=GlueX-2022-05_data_reconstruction&oldid=127330"