GlueX Offline Software

News: December 10, 2019: New version set: version_4.12.0.xml December 10, 2019: Minutes of the December 10 Software Meeting are available. December 3, 2019: Minutes of the December 3 HDGeant4 Meeting are available. November 29, 2019: Minutes of the November 26 Software Meeting are available. November 25, 2019: Minutes of the November 19 HDGeant4 Meeting are available. November 19, 2019: New version set: version_4.11.0.xml Previous news items...

Quick Links: Repositories on GitHub Frequently Asked Questions halld-offline@jlab.org Email List Archive GlueX Software Help Google Group GlueX Offline Software Meetings

The legacy version of this page is here.

General Information

Build Scripts: A Version Management System for GlueX describes a standard directory structure for GlueX software, how to create complete or partial builds, and how to specify versions of individual packages, both for building and for use. It is also available as GlueX Note 2793.

See below for other helpful links.

Shell Environment Set-Up

• Setting Up the GlueX Environment

Building GlueX Software

• Building private versions of GlueX software at JLab
• Scripts for Installing GlueX Software: Do a complete build of all standard components of GlueX software or add new versions to an existing build tree.
• hdpm - Hall D Package Manager: A package manager for Hall-D software, which provides an alternative method for installing GlueX software.
• Legacy Build Instructions: Guides to various aspects of the build process. Up-to-date-ness may vary.

GlueX and Containers

• GlueX Software on Oasis

Software Documentation

Packages used in the GlueX software stack with links to package-specific documentation.

GlueX Software

Documentation for software packages specific to GlueX or to JLab.

Software Packages

• halld_recon
• halld_sim
• JANA
• HDDS: Detector geometry specification
  • HDDS Schema: Includes description of the HDDS mark-up language.
  • Geometry Specification for Hall D: General Description and Philosophy, September 2003
  • Detector Models for GlueX Monte Carlo Simulation: A Status Report, June 2006
  • Detector Models for GlueX Monte Carlo Simulation: the CD2 Baseline, January 2007
  • HDDS Tagged Releases
• HDDM: The Hall D Data Model, a compact xml-based format for event-based data.
• EVIO: The CODA event format.
• CCDB: Calibration Database
  • Policy on CCDB Variations for Reconstructing Simulated Data
• RCDB: Run Conditions Database
  • Web Interface
  • GlueX Implementation of the RCDB
• AmpTools: Amplitude analysis package (aka partial wave analysis)
• EventStore: a package for managing and deploying data files and event lists
• HDGeant4: Geant4-based simulation of the GlueX Detector and Hall D beamline
• Git: see Source Code Management below.
• Subversion: see Source Code Management below.
• sim-recon (deprecated, July 2018)
  • Doxygen Documentation: Descriptions of sim-recon C++ classes and their relationships.
  • Sim-Recon Tagged Releases
  • Analysis Software in sim-recon
  • SCons Build System (SBMS)
• MCwrapper
  • Active Sample Dashboard
  • MC Submission Form

Special Topics

• Offline HOWTO List: Guides to performing various specific tasks.
• Beam Simulations: Geant simulations of the Hall D Tagger Hall
• Magnetic Field Maps for Solenoid
• Sensitivity to Magnetic Field Strength
• How HDGeant defines time-zero for physics events
• Guide to Monte Carlo event timing and detached vertices in HDGeant/4
• Guide to roll-your-own python hddm transforms
• Geometry
• Reconstruction Software
• Kinematic Fitting

1. Material on Splitoffs

Documentation for External Software Packages

Documentation on additional software packages used by GlueX. Development and maintenance of these are not directly related to GlueX.

CERNLIB CLHEP C++

Doxygen GEANT 3 (manual) GEANT4 Git

GNU Make MySQL Python

ROOT SCons SQLite

Subversion Xerces XSD

Data Sets

• Simulations: a guide to simulated data sets.

Offline Data Monitoring

• Data_Monitoring_Procedures: Information on offline monitoring of recently-taken data

Computing Facilities

JLab

• Hall D Offline System Status Plots
• Hall D and JLab Servers: Web servers, database servers, etc.
• Computer Center
• Scientific Computing
  • Farm Job Status Auger job status from SciComp
    • jproj Job Status Status of jobs using the jproj system
  • Tape Request Status
• Disk space usage
  • Group
    • /group/halld leader board
  • Cache
    • oldest files under /cache/halld
  • Volatile
    • oldest files under /volatile/halld
  • Work
    • /work/halld leader board
• GlueX-related shared accounts on the JLab CUE
• Hall D MySQL/MariaDB Servers and Replication Relationship: a list of database servers

Grid

• Open Science Grid
  • Using the Grid with Containers
  • Using the Grid
  • Gridmake

Other Computing Resources

• Computer Farms: Clusters at GlueX-collaborating institutions.

Software Management

Source Code Management

• Git
  • GlueX Git Repositories
  • Instructions for Working with GlueX Git Repositories. Workflow description.
  • Instructions for joining the GlueX team on GitHub
  • Git Help Resources, July 14
  • Guide to Using Git. General usage tips.
  • Git questions and answers in the Offline FAQ
  • Splitting sim-recon
  • Conversion from Subversion to Git (Summer 2015)
• Subversion
  • Browse the Hall D Subversion Repository
    • Legacy version

Testing and Debugging

• Automatic Builds of GlueX Software: nightly build, pull-request-initiated test build, scan-build
• Automatic Tests of GlueX Software
• Diagnosing segmentation faults in reconstruction software

Governance, Conventions, Standard Practices

• Offline Issue Tracking using GitHub Issue Tracking
• Offline Issue Tracking using the Mantis Bug Tracker
• GlueX Coding Standards
• Version Management
• GlueX Cron Jobs
• Data Challenges: Large-scale tests of computing infrastructure
• Data Management Plan for Hall D: Long-term preservation of data and data-analysis tools
• JLab Offline Computing Plan, FY2010
• Role of the Software Coordinator

Meetings and Reviews

• GlueX Offline Software Meetings: Agendas and minutes
• HDGeant4 Meetings
• GlueX Containers Meetings
• Software and Computing Reviews

Communication and Help

• Google Group for GlueX Software
  • Help on GlueX-related Google Groups
• GlueX Software Help Email List: Ask a question!
• Offline Software Email List: announcements and discussion
  • Send email to the list
  • Message archive
  • Google search of archive
  • Information page (subscribe, unsubscribe, list members, etc.)
• Simple Email Lists: get notifications from automated tests
• Communication Instructions: Guides to communication systems used by GlueX

FAQ

• The GlueX Offline Frequently Asked Questions List

Legacy Links

• Offline Computing Project Management
• Versioning of Calibration Constants
• Releases of GlueX Software
• Reconstruction Tasks and Topics for Further Development
• Running jobs on the grid
• Calibration Constants, Tagged Versions
• Action Items Archive (May 4, 2010 and before)
• Software Task List

Uncategorized Links

1. GlueX Communications More on ESNET,EVO ...
2. Private:Using VNC
3. 2013 Software Review
4. 2012 Software Review
5. IT in the 12-GeV Era: close-out slides
6. Geometries for 2008 DC Review
7. Tracking resolution estimator (REZEST)
8. Installing HDDS-to-GEANT4 converter
9. Duties of the GlueX Software Coordinator
10. ded
11. Action Items