Difference between revisions of "GlueX-2023-01 data reconstruction"
From GlueXWiki
(→Version) |
(→Version) |
||
(7 intermediate revisions by the same user not shown) | |||
Line 17: | Line 17: | ||
** ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01 | ** ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01 | ||
** ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01 | ** ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01 | ||
− | ** ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 | + | ** ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001 |
* Started on | * Started on | ||
** ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023. | ** ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023. | ||
** ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023. | ** ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023. | ||
− | ** ver03: high-intensity studies - 09/01/2024. Finished on | + | ** ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024. |
* Summary: | * Summary: | ||
{| class="wikitable" | {| class="wikitable" | ||
Line 63: | Line 63: | ||
| 2023-01 | | 2023-01 | ||
| 03 | | 03 | ||
− | | | + | | 02 |
| 120582 | | 120582 | ||
| 120602 | | 120602 | ||
− | | | + | | 11 |
− | | () | + | | 856 (850) |
− | | | + | | 4.1TB |
| NERSC* | | NERSC* | ||
− | | | + | | 1 |
− | | [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023- | + | | [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver03-perl_batchNERSC-multi/] |
|- | |- | ||
|} | |} | ||
Line 78: | Line 78: | ||
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 30 runs | *** 96% for [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 30 runs | ||
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] and 2 runs. Both [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] fail for the same evio files for these 2 runs. | *** 96% for [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] and 2 runs. Both [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] fail for the same evio files for these 2 runs. | ||
+ | *** 99% for ver03 & [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 11 runs | ||
** Cost of rendering per hour using NERSC cpu test results: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] equal to [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] | ** Cost of rendering per hour using NERSC cpu test results: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] equal to [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] | ||
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231." | (*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231." |
Latest revision as of 15:19, 23 January 2024
Reconstruction launch overview
- Reconstruction of the physics objects from raw data using the danarest plugin
- Configuration of the launches:
- /group/halld/data_monitoring/run_conditions/RunPeriod-2023-01
- Input raw data (.evio):
- /mss/halld/RunPeriod-2023-01/rawdata
- Output reconstructed files (.hddm):
- /mss/halld/RunPeriod-2023-01/recon
Version
- Software stack:
- ver01: version_5.8.0.xml, circular/linear polarization proposal
- ver02: version_5.13.0.xml, cost of rendering per hour using NERSC cpu test
- ver03: version_5.8.0.xml, high-intensity studies
- Calibration time stamp:
- ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01
- ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01
- ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001
- Started on
- ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023.
- ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023.
- ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024.
- Summary:
Runperiod | Version | Batch | Min Run | Max Run | # Runs | # REST Files (succeeded) | Total Size of REST Files | Site | Priority | Details |
---|---|---|---|---|---|---|---|---|---|---|
2023-01 | 01 | 01 | 120395 | 120438 | 30 | 5850 (5657) | 28 TB | NERSC* | 1 | [1] |
2023-01 | 02 | 01 | 120437 | 120438 | 2 | 520 (500) | 2.5 TB | NERSC* | 1 | [2] |
2023-01 | 03 | 02 | 120582 | 120602 | 11 | 856 (850) | 4.1TB | NERSC* | 1 | [3] |
- Comparison between version_5.8.0.xml and version_5.13.0.xml
- Success rate:
- 96% for version_5.8.0.xml and 30 runs
- 96% for version_5.13.0.xml and 2 runs. Both version_5.8.0.xml and version_5.13.0.xml fail for the same evio files for these 2 runs.
- 99% for ver03 & version_5.8.0.xml and 11 runs
- Cost of rendering per hour using NERSC cpu test results: version_5.13.0.xml equal to version_5.8.0.xml
- Success rate:
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."