Difference between revisions of "GlueX Offline Meeting, April 13, 2016"

From GlueXWiki
Jump to: navigation, search
(→‎Agenda)
m (Text replacement - "http://argus.phys.uregina.ca/cgi-bin/private" to "https://halldweb.jlab.org/doc-private")
 
(6 intermediate revisions by 3 users not shown)
Line 10: Line 10:
 
## [[GlueX-Collaboration-May-2016|Collaboration Meeting]]  May 9-11, 2016
 
## [[GlueX-Collaboration-May-2016|Collaboration Meeting]]  May 9-11, 2016
 
## Other announcements?
 
## Other announcements?
−
# Review of [[GlueX Offline Meeting, March 30, 2016#Minutes|minutes from March 30]] (all)
+
# Improved ROOT JANA Locks (Paul, David):
−
# Plugin-specific ROOT JANA Locks (Paul, David)
+
## Plugin-specific, action specific, factory specific
 
## [https://www.jlab.org/JANA/downloads.php New JANA release: 0.7.5]
 
## [https://www.jlab.org/JANA/downloads.php New JANA release: 0.7.5]
 
## [https://github.com/JeffersonLab/sim-recon/pull/331 Pull request #331]
 
## [https://github.com/JeffersonLab/sim-recon/pull/331 Pull request #331]
Line 17: Line 17:
 
## [https://mailman.jlab.org/pipermail/halld-offline/2016-April/002303.html sim-recon version 1.11.0 released]
 
## [https://mailman.jlab.org/pipermail/halld-offline/2016-April/002303.html sim-recon version 1.11.0 released]
 
## [[Locking_in_JANA | Locking in JANA]]
 
## [[Locking_in_JANA | Locking in JANA]]
−
## [http://argus.phys.uregina.ca/cgi-bin/private/DocDB/ShowDocument?docid=2992 New Scaling Study (Paul)]
+
## [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=2992 New Scaling Study (Paul)]
−
# Calibration Challenge/Processing (Sean)
+
# Review of [[GlueX Offline Meeting, March 30, 2016#Minutes|minutes from March 30]] (all)
 +
# [https://halldweb.jlab.org/wiki/images/d/d4/Sdobbs_OfflineMtg_13Apr16.pdf Calibration Challenge/Processing (Sean)]
 
<!-- # Geant4 Update (Richard, David) -->
 
<!-- # Geant4 Update (Richard, David) -->
 
# sim-recon scripts
 
# sim-recon scripts
Line 37: Line 38:
  
 
Talks can be deposited in the directory <code>/group/halld/www/halldweb/html/talks/2016</code> on the JLab CUE. This directory is accessible from the web at https://halldweb.jlab.org/talks/2016/ .
 
Talks can be deposited in the directory <code>/group/halld/www/halldweb/html/talks/2016</code> on the JLab CUE. This directory is accessible from the web at https://halldweb.jlab.org/talks/2016/ .
 +
 +
== Minutes ==
 +
{|
 +
| There is a [https://bluejeans.com/s/9spN/ recording of this meeting] on the BlueJeans site.
 +
 +
Present:
 +
* '''CMU''': Naomi Jarvis, Curtis Meyer, Mike Staib
 +
* '''FIU''': Mahmoud Kamel
 +
* '''JLab''': Mark Ito (chair), Paul Mattione, Sandy Philpott, Dmitry Romanov, Nathan Sparks, Justin Stevens, Simon Taylor
 +
* '''NU''': Sean Dobbs
 +
|| [[File:Offline_meeting_2016-04-13.png|200px|thumb|left|Software Meeting]]
 +
|}
 +
 +
=== Announcements ===
 +
 +
# RCDB News
 +
#* The C++ API is ready. Dmitry pointed us to the [https://github.com/JeffersonLab/rcdb/wiki/Cpp relevant section of the RCDB wiki]. It requires C++11 to compile.
 +
#* SQLite versions of the RCDB are now generated nightly. You can download the latest version from https://halldweb.jlab.org/dist/rcdb.sqlite .
 +
# Collaboration Meeting,  May 9-11, 2016. The [[GlueX-Collaboration-May-2016|Collaboration Meeting Agenda]] gives the offline almost two hours.
 +
#* Paul will give a talk on monitoring.
 +
#* Sean will give a talk on calibration.
 +
#* We will collectively think about other talks.
 +
 +
===Improved JANA Locks===
 +
 +
Paul explained the situation.
 +
 +
# The locks that have been modified are specific to different "areas" of the code; there is now differentiation between a special purpose locks and the global thread lock. The areas are:
 +
## plugins
 +
## actions
 +
## factories
 +
# The new scheme requires use of a [https://www.jlab.org/JANA/downloads.php new JANA release: 0.7.5].
 +
# The crucial change came in with [https://github.com/JeffersonLab/sim-recon/pull/331 Pull request #331].
 +
# Paul sent an [https://mailman.jlab.org/pipermail/halld-offline/2016-April/002300.html email] on Monday warning us about the need for use of the new JANA release.
 +
# Mark released a [https://mailman.jlab.org/pipermail/halld-offline/2016-April/002303.html new version of sim-recon], version 1.11.0, that incorporates these changes.
 +
# Paul put together a [[Locking_in_JANA |wiki page]] giving best practices for using locks with JANA, inspired by the code he discovered during his review of the locks in our code.
 +
# Paul also showed [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=2992 some slides] contrasting the new lock discipline versus the lack thereof showing much improved multi-thread scaling.
 +
 +
===Review of minutes from March 30===
 +
 +
We went over the [[GlueX Offline Meeting, March 30, 2016#Minutes|minutes from March 30]].
 +
 +
* '''Future Trends in Nuclear Physics Computing Workshop'''. Amber and Mark had a conference call with Richard Jones, our virtual organization representative, to plan out the next step in enhancing JLab involvement with the [http://www.opensciencegrid.org/ Open Science Grid].
 +
* '''Access to Fairshare Information from JLab Farm'''. We asked Sandy about getting the current fairshare statistics posted somewhere. She told us that it will be there on the new webpages that SciComp is working on. Mark suggested that at some point someone from SciComp should give presentation to this group about the new site.
 +
 +
===Calibration Challenge/Processing===
 +
 +
Sean presented a [https://halldweb.jlab.org/wiki/images/d/d4/Sdobbs_OfflineMtg_13Apr16.pdf slide] bringing us up-to-date with calibration activity.
 +
 +
* He described the parameters of the three launches started so far. One set of statistics not on the slide:
 +
{| border
 +
|-
 +
! Launch Number !! Number of Farm Jobs
 +
|-
 +
|1||6,000
 +
|-
 +
|2||3,000
 +
|-
 +
|3||3,500
 +
|}
 +
* The CCDB improvements he has discussed with Dmitry address ease of handling of calibration constants and possible calibration visualization ideas.
 +
* The benchmark jobs are to explore performance as a function of the number of threads. Sean is hoping that Paul's recent improvements will help the situation here as well.
 +
 +
=== sim-recon scripts ===
 +
 +
Paul has [[Letter from Paul to Mark|proposed]] moving the scripts that generate analysis plugin templates from the scripts directory in the Subversion repository to a new directory of the sim-recon repository (Git). That way these scripts will be versioned along with releases of sim-recon. That, in turn, would disambiguate which version of the scripts should be used with which version of sim-recon.
 +
 +
We all agreed that this is a good idea, but Nathan wanted to think about whether there might be a more appropriate location than that proposed by Paul. We agreed to let him make an alternate proposal before we make the move.
 +
 +
===FADC Emulation Partial Re-Write===
 +
 +
We looked at [https://github.com/JeffersonLab/sim-recon/pull/318 Richard's recent pull request]. The situation seems to be well in hand.
 +
 +
===SWIF for GlueX Users===
 +
 +
Mahmoud reminded that [https://mailman.jlab.org/pipermail/halld-offline/2016-February/002244.html Paul's guide to SWIF for GlueX Analysis Users] had been discussed previously. He is using the system himself.

Latest revision as of 17:00, 24 February 2017

GlueX Offline Software Meeting
Wednesday, April 13, 2016
1:30 pm EDT
JLab: CEBAF Center L207

Agenda

  1. Announcements
    1. RCDB News
    2. Collaboration Meeting May 9-11, 2016
    3. Other announcements?
  2. Improved ROOT JANA Locks (Paul, David):
    1. Plugin-specific, action specific, factory specific
    2. New JANA release: 0.7.5
    3. Pull request #331
    4. Upgrade your JANA
    5. sim-recon version 1.11.0 released
    6. Locking in JANA
    7. New Scaling Study (Paul)
  3. Review of minutes from March 30 (all)
  4. Calibration Challenge/Processing (Sean)
  5. sim-recon scripts
  6. FADC Emulation Partial Re-Write (Richard)
  7. SWIF for GlueX Users
  8. Review of recent pull requests (all)
  9. Action Item Review

Communication Information

Remote Connection

Slides

Talks can be deposited in the directory /group/halld/www/halldweb/html/talks/2016 on the JLab CUE. This directory is accessible from the web at https://halldweb.jlab.org/talks/2016/ .

Minutes

There is a recording of this meeting on the BlueJeans site.

Present:

  • CMU: Naomi Jarvis, Curtis Meyer, Mike Staib
  • FIU: Mahmoud Kamel
  • JLab: Mark Ito (chair), Paul Mattione, Sandy Philpott, Dmitry Romanov, Nathan Sparks, Justin Stevens, Simon Taylor
  • NU: Sean Dobbs
Software Meeting

Announcements

  1. RCDB News
  2. Collaboration Meeting, May 9-11, 2016. The Collaboration Meeting Agenda gives the offline almost two hours.
    • Paul will give a talk on monitoring.
    • Sean will give a talk on calibration.
    • We will collectively think about other talks.

Improved JANA Locks

Paul explained the situation.

  1. The locks that have been modified are specific to different "areas" of the code; there is now differentiation between a special purpose locks and the global thread lock. The areas are:
    1. plugins
    2. actions
    3. factories
  2. The new scheme requires use of a new JANA release: 0.7.5.
  3. The crucial change came in with Pull request #331.
  4. Paul sent an email on Monday warning us about the need for use of the new JANA release.
  5. Mark released a new version of sim-recon, version 1.11.0, that incorporates these changes.
  6. Paul put together a wiki page giving best practices for using locks with JANA, inspired by the code he discovered during his review of the locks in our code.
  7. Paul also showed some slides contrasting the new lock discipline versus the lack thereof showing much improved multi-thread scaling.

Review of minutes from March 30

We went over the minutes from March 30.

  • Future Trends in Nuclear Physics Computing Workshop. Amber and Mark had a conference call with Richard Jones, our virtual organization representative, to plan out the next step in enhancing JLab involvement with the Open Science Grid.
  • Access to Fairshare Information from JLab Farm. We asked Sandy about getting the current fairshare statistics posted somewhere. She told us that it will be there on the new webpages that SciComp is working on. Mark suggested that at some point someone from SciComp should give presentation to this group about the new site.

Calibration Challenge/Processing

Sean presented a slide bringing us up-to-date with calibration activity.

  • He described the parameters of the three launches started so far. One set of statistics not on the slide:
Launch Number Number of Farm Jobs
1 6,000
2 3,000
3 3,500
  • The CCDB improvements he has discussed with Dmitry address ease of handling of calibration constants and possible calibration visualization ideas.
  • The benchmark jobs are to explore performance as a function of the number of threads. Sean is hoping that Paul's recent improvements will help the situation here as well.

sim-recon scripts

Paul has proposed moving the scripts that generate analysis plugin templates from the scripts directory in the Subversion repository to a new directory of the sim-recon repository (Git). That way these scripts will be versioned along with releases of sim-recon. That, in turn, would disambiguate which version of the scripts should be used with which version of sim-recon.

We all agreed that this is a good idea, but Nathan wanted to think about whether there might be a more appropriate location than that proposed by Paul. We agreed to let him make an alternate proposal before we make the move.

FADC Emulation Partial Re-Write

We looked at Richard's recent pull request. The situation seems to be well in hand.

SWIF for GlueX Users

Mahmoud reminded that Paul's guide to SWIF for GlueX Analysis Users had been discussed previously. He is using the system himself.

Retrieved from "https://halldweb.jlab.org/wiki/index.php?title=GlueX_Offline_Meeting,_April_13,_2016&oldid=80391"