Difference between revisions of "GlueX-2023-01 data reconstruction"
From GlueXWiki
(→Version) |
(→Version) |
||
(20 intermediate revisions by the same user not shown) | |||
Line 12: | Line 12: | ||
* Software stack: | * Software stack: | ||
** ver01: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], circular/linear polarization proposal | ** ver01: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], circular/linear polarization proposal | ||
− | ** ver02: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml], cost of rendering per hour using NERSC | + | ** ver02: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml], cost of rendering per hour using NERSC cpu test |
+ | ** ver03: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], high-intensity studies | ||
* Calibration time stamp: | * Calibration time stamp: | ||
** ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01 | ** ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01 | ||
** ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01 | ** ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01 | ||
+ | ** ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001 | ||
* Started on | * Started on | ||
− | ** ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023 | + | ** ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023. |
− | ** ver02: | + | ** ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023. |
+ | ** ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024. | ||
* Summary: | * Summary: | ||
{| class="wikitable" | {| class="wikitable" | ||
Line 40: | Line 43: | ||
| 120438 | | 120438 | ||
| 30 | | 30 | ||
− | | 5850 ( | + | | 5850 (5657) |
− | | TB | + | | 28 TB |
| NERSC* | | NERSC* | ||
| 1 | | 1 | ||
Line 52: | Line 55: | ||
| 120438 | | 120438 | ||
| 2 | | 2 | ||
− | | 520 ( | + | | 520 (500) |
− | | TB | + | | 2.5 TB |
| NERSC* | | NERSC* | ||
| 1 | | 1 | ||
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver02-perl_batchNERSC-multi/] | | [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver02-perl_batchNERSC-multi/] | ||
|- | |- | ||
− | + | | 2023-01 | |
+ | | 03 | ||
+ | | 02 | ||
+ | | 120582 | ||
+ | | 120602 | ||
+ | | 11 | ||
+ | | 856 (850) | ||
+ | | 4.1TB | ||
+ | | NERSC* | ||
+ | | 1 | ||
+ | | [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver03-perl_batchNERSC-multi/] | ||
+ | |- | ||
|} | |} | ||
− | * Cost of rendering per hour using NERSC | + | * Comparison between [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] |
+ | ** Success rate: | ||
+ | *** 96% for [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 30 runs | ||
+ | *** 96% for [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] and 2 runs. Both [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] fail for the same evio files for these 2 runs. | ||
+ | *** 99% for ver03 & [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 11 runs | ||
+ | ** Cost of rendering per hour using NERSC cpu test results: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] equal to [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] | ||
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231." | (*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231." |
Latest revision as of 15:19, 23 January 2024
Reconstruction launch overview
- Reconstruction of the physics objects from raw data using the danarest plugin
- Configuration of the launches:
- /group/halld/data_monitoring/run_conditions/RunPeriod-2023-01
- Input raw data (.evio):
- /mss/halld/RunPeriod-2023-01/rawdata
- Output reconstructed files (.hddm):
- /mss/halld/RunPeriod-2023-01/recon
Version
- Software stack:
- ver01: version_5.8.0.xml, circular/linear polarization proposal
- ver02: version_5.13.0.xml, cost of rendering per hour using NERSC cpu test
- ver03: version_5.8.0.xml, high-intensity studies
- Calibration time stamp:
- ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01
- ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01
- ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001
- Started on
- ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023.
- ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023.
- ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024.
- Summary:
Runperiod | Version | Batch | Min Run | Max Run | # Runs | # REST Files (succeeded) | Total Size of REST Files | Site | Priority | Details |
---|---|---|---|---|---|---|---|---|---|---|
2023-01 | 01 | 01 | 120395 | 120438 | 30 | 5850 (5657) | 28 TB | NERSC* | 1 | [1] |
2023-01 | 02 | 01 | 120437 | 120438 | 2 | 520 (500) | 2.5 TB | NERSC* | 1 | [2] |
2023-01 | 03 | 02 | 120582 | 120602 | 11 | 856 (850) | 4.1TB | NERSC* | 1 | [3] |
- Comparison between version_5.8.0.xml and version_5.13.0.xml
- Success rate:
- 96% for version_5.8.0.xml and 30 runs
- 96% for version_5.13.0.xml and 2 runs. Both version_5.8.0.xml and version_5.13.0.xml fail for the same evio files for these 2 runs.
- 99% for ver03 & version_5.8.0.xml and 11 runs
- Cost of rendering per hour using NERSC cpu test results: version_5.13.0.xml equal to version_5.8.0.xml
- Success rate:
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."