Difference between revisions of "GlueX Offline Software"
From GlueXWiki
(→Testing and Debugging) |
|||
(40 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
+ | {| border | ||
+ | |- | ||
+ | | | ||
'''News:''' | '''News:''' | ||
− | + | * February 10, 2018: [[GlueX_Offline_Meeting,_February_9,_2018#Minutes|Minutes of the February 9 Offline Meeting are available]] | |
− | * | + | * February 7, 2018: [https://mailman.jlab.org/pipermail/halld-offline/2018-February/003106.html New sim-recon release: version 2.23.0] |
− | * | + | * February 2, 2018: [https://mailman.jlab.org/pipermail/halld-offline/2018-February/003090.html New releases: build_scripts 1.26, rcdb 0.03, sqlitecpp 2.2.0, sim-recon 2.26.0, hdgeant4 1.6.0] |
− | + | * January 26, 2018: [[GlueX_Offline_Meeting,_January_26,_2018#Minutes|Minutes of the January 26 Offline Meeting are available]] | |
− | + | ||
− | * | + | |
* [[Offline Software News Archive|Previous news items...]] | * [[Offline Software News Archive|Previous news items...]] | ||
+ | | | ||
+ | '''Quick Links:''' | ||
+ | * [https://github.com/orgs/JeffersonLab/teams/gluex/repositories Repositories on GitHub] | ||
+ | * [[GlueX Offline FAQ|Frequently Asked Questions]] | ||
+ | * [https://mailman.jlab.org/pipermail/halld-offline/ halld-offline@jlab.org Email List Archive] | ||
+ | * [https://groups.google.com/forum/#!forum/gluex-software GlueX Software Help Google Group] | ||
+ | * [[GlueX Offline Software Meetings]] | ||
+ | |} | ||
The legacy version of this page is [[Offline Software|here]]. | The legacy version of this page is [[Offline Software|here]]. | ||
Line 12: | Line 21: | ||
==General Information== | ==General Information== | ||
− | [https://halldweb.jlab.org/docs/gluex_build_web/ A Version Management System for GlueX] describes a standard directory structure for GlueX software, how to create complete or partial builds, and how to specify versions of individual packages, both for building and for use. It is also available as [ | + | [https://halldweb.jlab.org/docs/gluex_build_web/ A Version Management System for GlueX] describes a standard directory structure for GlueX software, how to create complete or partial builds, and how to specify versions of individual packages, both for building and for use. It is also available as [https://halldweb.jlab.org/doc-public/DocDB/ShowDocument?docid=2793 GlueX Note 2793]. |
See below for other helpful links. | See below for other helpful links. | ||
Line 22: | Line 31: | ||
===Building GlueX Software=== | ===Building GlueX Software=== | ||
+ | * [[Building_Private_Versions_of_GlueX_Software:_my_sim-recon.sh|Building private versions of GlueX software]] | ||
* [https://halldweb.jlab.org/docs/gluex_build_web/node34.html Scripts for Installing GlueX Software]: Do a complete build of all standard components of GlueX software or add new versions to an existing build tree. | * [https://halldweb.jlab.org/docs/gluex_build_web/node34.html Scripts for Installing GlueX Software]: Do a complete build of all standard components of GlueX software or add new versions to an existing build tree. | ||
* [[Hall D Package Manager|hdpm - Hall D Package Manager]]: A package manager for Hall-D software, which provides an alternative method for installing GlueX software. | * [[Hall D Package Manager|hdpm - Hall D Package Manager]]: A package manager for Hall-D software, which provides an alternative method for installing GlueX software. | ||
* [[Legacy Build Instructions]]: Guides to various aspects of the build process. Up-to-date-ness may vary. | * [[Legacy Build Instructions]]: Guides to various aspects of the build process. Up-to-date-ness may vary. | ||
+ | * [https://halldweb.jlab.org/wiki/index.php/Building_Private_Versions_of_GlueX_Software:_my_sim-recon.sh Building private versions of GlueX software] | ||
==Software Documentation== | ==Software Documentation== | ||
Line 42: | Line 53: | ||
* HDDS: Detector geometry specification | * HDDS: Detector geometry specification | ||
** [https://halldsvn.jlab.org/repos/trunk/hdds/HDDS-1_1.xsd HDDS Schema]: Includes description of the HDDS mark-up language. | ** [https://halldsvn.jlab.org/repos/trunk/hdds/HDDS-1_1.xsd HDDS Schema]: Includes description of the HDDS mark-up language. | ||
− | ** [ | + | ** [https://halldweb.jlab.org/doc-public/DocDB/ShowDocument?docid=64 Geometry Specification for Hall D]: General Description and Philosophy, September 2003 |
− | ** [ | + | ** [https://halldweb.jlab.org/doc-public/DocDB/ShowDocument?docid=654 Detector Models for GlueX Monte Carlo Simulation: A Status Report], June 2006 |
− | ** [ | + | ** [https://halldweb.jlab.org/doc-public/DocDB/ShowDocument?docid=732 Detector Models for GlueX Monte Carlo Simulation: the CD2 Baseline], January 2007 |
** [[HDDS Tagged Releases]] | ** [[HDDS Tagged Releases]] | ||
* [[HDDM Programmer's Interface|HDDM]]: The Hall D Data Model, a compact xml-based format for event-based data. | * [[HDDM Programmer's Interface|HDDM]]: The Hall D Data Model, a compact xml-based format for event-based data. | ||
Line 51: | Line 62: | ||
** [[Policy on CCDB Variations for Reconstructing Simulated Data]] | ** [[Policy on CCDB Variations for Reconstructing Simulated Data]] | ||
* [https://github.com/JeffersonLab/rcdb/wiki RCDB]: Run Conditions Database | * [https://github.com/JeffersonLab/rcdb/wiki RCDB]: Run Conditions Database | ||
+ | ** [[GlueX Implementation of the RCDB]] | ||
* [http://amptools.sourceforge.net/index.php/Main_Page AmpTools]: Amplitude analysis package (aka partial wave analysis) | * [http://amptools.sourceforge.net/index.php/Main_Page AmpTools]: Amplitude analysis package (aka partial wave analysis) | ||
* [https://github.com/sdobbs/HDEventStore EventStore]: a package for managing and deploying data files and event lists | * [https://github.com/sdobbs/HDEventStore EventStore]: a package for managing and deploying data files and event lists | ||
Line 114: | Line 126: | ||
** [https://scicomp.jlab.org/scicomp/#/disk/work Work] | ** [https://scicomp.jlab.org/scicomp/#/disk/work Work] | ||
*** [https://halldweb.jlab.org/disk_management/work_report.html /work/halld leader board] | *** [https://halldweb.jlab.org/disk_management/work_report.html /work/halld leader board] | ||
− | |||
* [[GlueX-related shared accounts on the JLab CUE]] | * [[GlueX-related shared accounts on the JLab CUE]] | ||
* [[Hall D MySQL/MariaDB Servers and Replication Relationship]]: a list of database servers | * [[Hall D MySQL/MariaDB Servers and Replication Relationship]]: a list of database servers | ||
Line 121: | Line 132: | ||
* [http://www.opensciencegrid.org/ Open Science Grid] | * [http://www.opensciencegrid.org/ Open Science Grid] | ||
+ | ** [https://mailman.jlab.org/pipermail/halld-offline/2017-June/002827.html Using the Grid with Containers] | ||
** [[Using the Grid]] | ** [[Using the Grid]] | ||
** [https://halldweb.jlab.org/talks/2011-2Q/gridmake-6-2011.ppt Gridmake] | ** [https://halldweb.jlab.org/talks/2011-2Q/gridmake-6-2011.ppt Gridmake] | ||
Line 154: | Line 166: | ||
* [[GlueX Cron Jobs]] | * [[GlueX Cron Jobs]] | ||
* [[Data Challenges]]: Large-scale tests of computing infrastructure | * [[Data Challenges]]: Large-scale tests of computing infrastructure | ||
− | * [ | + | * [https://halldweb.jlab.org/doc-public/DocDB/ShowDocument?docid=2808 Data Management Plan for Hall D]: Long-term preservation of data and data-analysis tools |
* [https://data.jlab.org/drupal/?q=system/files/Offline%20Plan%20FY10.pdf JLab Offline Computing Plan, FY2010] | * [https://data.jlab.org/drupal/?q=system/files/Offline%20Plan%20FY10.pdf JLab Offline Computing Plan, FY2010] | ||
* [[Role of the Software Coordinator]] | * [[Role of the Software Coordinator]] | ||
Line 203: | Line 215: | ||
## [[Geometry]] | ## [[Geometry]] | ||
## [[Magnetic Field Maps for Solenoid]] | ## [[Magnetic Field Maps for Solenoid]] | ||
− | ## [ | + | ## [https://halldweb.jlab.org/doc-public/DocDB/ShowDocument?docid=473 The Build Management System (BMS)] |
## [[Reconstruction Software]] | ## [[Reconstruction Software]] | ||
## [[Deprecated Software Links]] | ## [[Deprecated Software Links]] | ||
Line 213: | Line 225: | ||
# [[2013 Software Review]] | # [[2013 Software Review]] | ||
# [[2012 Software Review]] | # [[2012 Software Review]] | ||
− | # [ | + | # [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=1782 IT in the 12-GeV Era: close-out slides] |
# [[Geometries for 2008 DC Review]] | # [[Geometries for 2008 DC Review]] | ||
# [[Tracking resolution estimator (REZEST)]] | # [[Tracking resolution estimator (REZEST)]] |
Revision as of 14:27, 13 February 2018
News:
|
Quick Links: |
The legacy version of this page is here.
Contents
General Information
A Version Management System for GlueX describes a standard directory structure for GlueX software, how to create complete or partial builds, and how to specify versions of individual packages, both for building and for use. It is also available as GlueX Note 2793.
See below for other helpful links.
Shell Environment Set-Up
Building GlueX Software
- Building private versions of GlueX software
- Scripts for Installing GlueX Software: Do a complete build of all standard components of GlueX software or add new versions to an existing build tree.
- hdpm - Hall D Package Manager: A package manager for Hall-D software, which provides an alternative method for installing GlueX software.
- Legacy Build Instructions: Guides to various aspects of the build process. Up-to-date-ness may vary.
- Building private versions of GlueX software
Software Documentation
GlueX Software
Documentation for software systems closely related to GlueX.
Software Packages
- sim-recon
- Doxygen Documentation: Descriptions of sim-recon C++ classes and their relationships.
- Sim-Recon Tagged Releases
- Analysis Software in sim-recon
- SCons Build System (SBMS)
- How HDGeant defines time-zero for physics events
- JANA
- HDDS: Detector geometry specification
- HDDS Schema: Includes description of the HDDS mark-up language.
- Geometry Specification for Hall D: General Description and Philosophy, September 2003
- Detector Models for GlueX Monte Carlo Simulation: A Status Report, June 2006
- Detector Models for GlueX Monte Carlo Simulation: the CD2 Baseline, January 2007
- HDDS Tagged Releases
- HDDM: The Hall D Data Model, a compact xml-based format for event-based data.
- EVIO: The CODA event format.
- CCDB: Calibration Database
- RCDB: Run Conditions Database
- AmpTools: Amplitude analysis package (aka partial wave analysis)
- EventStore: a package for managing and deploying data files and event lists
- HDGeant4: Geant4-based simulation of the GlueX Detector and Hall D beamline
Special Topics
- Offline HOWTO List: Guides to performing various specific tasks.
- Beam Simulations: Geant simulations of the Hall D Tagger Hall
- Sensitivity to Magnetic Field Strength
Documentation for External Software Packages
Documentation on additional software packages used by GlueX. Development and maintenance of these are not directly related to GlueX.
Data Sets
- Simulations: a guide to simulated data sets.
Offline Data Monitoring
- Data_Monitoring_Procedures: Information on offline monitoring of recently-taken data
Computing Facilities
JLab
- Computer Center
- Scientific Computing
- Farm Job Status Auger job status from SciComp
- jproj Job Status Status of jobs using the jproj system
- Tape Request Status
- Farm Job Status Auger job status from SciComp
- Disk space usage
- GlueX-related shared accounts on the JLab CUE
- Hall D MySQL/MariaDB Servers and Replication Relationship: a list of database servers
Grid
Other Computing Resources
- Computer Farms: Clusters at GlueX-collaborating institutions.
Software Management
Source Code Management
Testing and Debugging
- Automatic Builds of GlueX Software: nightly build, pull-request-initiated test build, scan-build
- Automatic Tests of GlueX Software
- Diagnosing segmentation faults in reconstruction software
Governance, Conventions, Standard Practices
- Offline Issue Tracking using GitHub Issue Tracking
- Offline Issue Tracking using the Mantis Bug Tracker
- GlueX Coding Standards
- Version Management
- GlueX Cron Jobs
- Data Challenges: Large-scale tests of computing infrastructure
- Data Management Plan for Hall D: Long-term preservation of data and data-analysis tools
- JLab Offline Computing Plan, FY2010
- Role of the Software Coordinator
Meetings and Reviews
- GlueX Offline Software Meetings: Agendas and minutes
- Software Review 3 JLab, February 10-11, 2015
- Software Review (JLab November 25-26, 2013)
- Follow-up to the Software Review
- Software Review (JLab June 2012)
Communication and Help
- Google Group for GlueX Software
- GlueX Software Help Email List: Ask a question!
- Offline Software Email List: announcements and discussion
- Send email to the list
- Message archive
- Google search of archive
- Information page (subscribe, unsubscribe, list members, etc.)
- Simple Email Lists: get notifications from automated tests
- Communication Instructions: Guides to communication systems used by GlueX
FAQ
Legacy Links
- Offline Computing Project Management
- Versioning of Calibration Constants
- Releases of GlueX Software
- Reconstruction Tasks and Topics for Further Development
- Running jobs on the grid
- Calibration Constants, Tagged Versions
Uncategorized Links
- Offline Software Topics
- Offline Projects
- Material on Splitoffs
- EVO
- GlueX Communications More on ESNET,EVO ...
- Private:Using VNC
- 2013 Software Review
- 2012 Software Review
- IT in the 12-GeV Era: close-out slides
- Geometries for 2008 DC Review
- Tracking resolution estimator (REZEST)
- Installing HDDS-to-GEANT4 converter
- Duties of the GlueX Software Coordinator
- ded
- Action Items
- Action Items Archive
- Hall D and JLab Servers: Web servers, database servers, etc.