Difference between revisions of "GlueX Offline Meeting, February 9, 2011"

From GlueXWiki
Jump to: navigation, search
(copy of last time)
 
m (Text replacement - "/halldweb1.jlab.org/" to "/halldweb.jlab.org/")
 
(12 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
GlueX Offline Software Meeting<br>
 
GlueX Offline Software Meeting<br>
−
Wednesday, January 26, 2011<br>
+
Wednesday, February 9, 2011<br>
 
1:30 pm EST<br>
 
1:30 pm EST<br>
 
JLab: CEBAF Center F326/7
 
JLab: CEBAF Center F326/7
Line 7: Line 7:
  
 
# Announcements
 
# Announcements
−
#* [[GlueX-Collaboration-Jan-2011|Collaboration Meeting]] Offline Agenda
+
## New JANA release: David
−
# Review of [[GlueX Offline Meeting, January 12, 2011#Minutes|minutes from the last meeting]]: all
+
## New sim-recon release: sim-recon-2011-02-02: Mark
−
# Solenoid text file conversion approach: Mark
+
# Review of [[GlueX Offline Meeting, January 26, 2011#Minutes|minutes from the last meeting]]: all
−
# Examination of the reconstruction algorithm as inherited from KLOE: Zisis
+
# Review of [[GlueX-Collaboration-Jan-2011|Collaboration Meeting]]: all
−
# Tracking Issues: [https://halldweb1.jlab.org/talks/2011-1Q/offline-software.Kei-Moriya.2011-01-26.pdf Kei]
+
# Reconstruction Parameters vs. Calibration Constants: Mark
 +
# [https://mailman.jlab.org/pipermail/halld-offline/2011-February/000491.html Compiler Warnings]: Beni
 +
# Calibration Database Update: Dmitry
 +
# Timing Resolution: [https://halldweb.jlab.org/talks/2011-1Q/offline-software.Kei-Moriya.2011-02-09.pdf Kei]
 
# Action Item Review: all
 
# Action Item Review: all
 
## [http://tinyurl.com/2beqwlk Resolved issues]
 
## [http://tinyurl.com/2beqwlk Resolved issues]
Line 32: Line 35:
 
* ESNet: 8542553
 
* ESNet: 8542553
 
* [http://evo.caltech.edu/ EVO]:
 
* [http://evo.caltech.edu/ EVO]:
−
** Meeting URL: http://evo.caltech.edu/evoNext/koala.jnlp?meeting=e8eteDvnveaBaDa9I8 <!--good through Jan. 12-->
+
** Meeting URL: http://evo.caltech.edu/evoNext/koala.jnlp?meeting=eueneevIv9aiavavIu <!--good through June 15-->
−
** Phone Bridge ID: 7 7042
+
** Phone Bridge ID: 8 6750
  
 
==Slides==
 
==Slides==
  
−
Talks can be deposited in the directory <code>/group/halld/www/halldweb1/html/talks/2011-1Q</code> on the JLab CUE. This directory is accessible from the web at https://halldweb1.jlab.org/talks/2011-1Q/ . You have to be a member of the "halld" Unix group to do this.
+
Talks can be deposited in the directory <code>/group/halld/www/halldweb/html/talks/2011-1Q</code> on the JLab CUE. This directory is accessible from the web at https://halldweb.jlab.org/talks/2011-1Q/ . You have to be a member of the "halld" Unix group to do this.
  
 
=Minutes=
 
=Minutes=
  
 
Present:
 
Present:
−
* '''IU''': Jake Bennett, Mihajlo Kornicer, Ryan Mitchell, Kei Moriya
+
* '''CMU''': Curtis Meyer
−
* '''JLab''': Mark Ito (chair), David Lawrence, Yi Qiang, Dmitry Romanov, Elton Smith, Simon Taylor, Elliott Wolin, Beni Zihlmann
+
* '''IU''': Ryan Mitchell, Kei Moriya
 +
* '''JLab''': Hovanes Egiyan, Mark Ito (chair), David Lawrence, Yi Qiang, Elton Smith, Simon Taylor, Elliott Wolin, Beni Zihlmann
  
 
==Announcements==
 
==Announcements==
  
−
The agenda for the offline session at the collaboration meeting is set. See [[GlueX-Collaboration-Jan-2011|the collaboration meeting page]] for the line-up.
+
# '''New JANA release.''' David is about to release a new version of JANA. It will include new features and bug fixes accumulated since the last release. He will give us more details at the next meeting.
 +
# '''New sim-recon release: sim-recon-2011-02-02.''' Mark is preparing another release. The last one was at the end of November, so we are due.
  
−
==Review of Minutes from Last Meeting==
+
==Review of minutes from the last meeting==
  
−
We reviewed [[GlueX Offline Meeting, December 15, 2010#Minutes|the minutes of the January 12 meeting]].
+
We went over [[GlueX Offline Meeting, January 26, 2011#Minutes|minutes from the January 26 meeting]].
  
−
* Beni told us that the changes we discussed last to separate TOF MC data and measured data are done and have been checked in. He will give a follow-up talk at a future meeting.
+
David asked the Regina folks about the status of work on the '''BCAL reconstruction code'''. Both Andrei Semenov and Zisis Papandreou responded. Andrei and Irina Semenova are working on it. Their first code is to understand the present algorithm. Eugene Chudakov has commented that if there is a problem with split-off, we need to know about it sooner rather than later and Elton's understanding is that the current focus is on deciding the summing scheme in the BCAL rather than in suppressing extraneous showers. David will follow up on the split-off issue.
−
* Beni has started modifying mcsmear and the reconstruction to collect parameters for the TOF into one place and obtain them from the database rather that have them hard-wired in various places in the code.
+
−
* Dave reported that Graham Heyes has looked in the Purify license we had at the lab. It seems to have long since expired.
+
  
−
==Solenoid text file conversion approach==
+
==Collaboration Meeting Review==
  
−
Mark raised the question of whether we want to treat magnetic field maps as standard entries in the calibration database. The issue is that the various versions of the maps are not strictly calibration constants; the user can generally use any map he or she wants. After a little discussion, we decided to leave well enough alone and retain the maps in the database.
+
We discussed an item that came up at last week's collaboration meeting: the IT Review and our computing estimates. Simon has done some work estimating the time it takes to reconstruct bggen events with our current code. Mark is working on the estimates. He will circulate a version soon. There will be an IT Steering committee meeting Thursday to outline the topics to be addressed at the the review. Elton pointed out that we need a note on the estimate, explaining where the numbers come from and what assumptions were made. In particular, we need to revisit the issue of storing Monte Carlo generated data. If that data volume is comparable to (or exceeds) that of raw data then our computing model would have to be changed significantly.
  
−
==Examination of the reconstruction algorithm as inherited from KLOE==
+
==Reconstruction Parameters vs. Calibration Constants==
  
−
Mark mentioned that he had seen this phrase in the minutes of one of the calorimeter meetings (attributed to Zisis) and he wondered if this was an issue the offline group should be tracking or discussing or hearing about. Ryan commented that Dan Bennett and Matt Shepherd had made improvements to the code, but there are still some mysteries in the code that someone in the collaboration should figure out. Elton mentioned that Regina was starting to look at maintaining the BCAL code. David will check with Regina folks on the status of the effort.
+
We had a discussion of how to manage reconstruction parameters versus calibration constants. An example of the former (parameters) would be the minimum number of hits in a charged track, an example of the latter (constants) would be the minimum drift time for those hits. Some parameters are currently stored in the calibration files (SVN: trunk/calib) and thus will migrate to the calibration database. Mark thought that they should be managed as configuration parameters to JANA, since different parameters might be used for different analysis of the same data and calibration constants had more of the character of "best for all occasions". Others thought that putting them in the database had the advantage of "everything in one place".
  
−
==Tracking Issues==
+
We did not come to a conclusion, but David agreed to give a talk on the JANA configuration scheme at a future meeting so we could have a more informed discussion.
  
−
Kei gave us an update on the problems he presented at the last meeting. He recently updated his copy of sim-recon and repeated many of his studies with the new code base. One major change between the two versions compared is the substitution of the Kalman filter fitter for the ALT1 fitter. Some of his problems disappeared, some remain. See [https://halldweb1.jlab.org/talks/2011-1Q/offline-software.Kei-Moriya.2011-01-12.pdf his slides] for details.
+
==Compiler Warnings==
  
−
Elton asked about the peak at zero in the chi-squared probability for individual charged tracks that has been observed in the past. Simon remarked that some of that may have been due to decays-in-flight or large single scatters. He continues to study the problem.
+
Beni discussed [https://mailman.jlab.org/pipermail/halld-offline/2011-February/000491.html his recent email] pointing out that sim-recon gives warnings with the latest version of the GNU compilers. He has given Richard Jones an account on his machine so that Richard can have a look at the HDGRANT-related warnings. There are some warnings from the BCAL that should be looked at as well.
 +
 
 +
==Using Profiling Tools to Guide Optimization==
 +
 
 +
Dmitry walked us through a recent exercise he went through to speed up the CCDB code. He used profiling tools in two contexts: the C++ code and the MySQL server. Profiling the C++ code attemting to read a large volume of constants revealed that the bulk of the time was being taken in database queries. Subsequently, the MySQL profiling tool allowed him to identify an appropriate index to create in the database. He also implemented some pre-stored queries. This resulted in almost a factor of seven improvement in performance. He noted that using the tools allowed him to focus on improvements that really made a difference, not just on those that may sound good. See [https://halldweb.jlab.org/talks/2011-1Q/ccdb_profile_optimization.pptx his slides] for details.
 +
 
 +
==Timing Resolution: Kei==
 +
 
 +
Kei presented work on looking at timing resolution in the BCAL and TOF and how it affects particle identification. He found that using the "T0" that comes from tracking as a starting time degrades performance; one does better by leaving it out altogether. See [https://halldweb.jlab.org/talks/2011-1Q/offline-software.Kei-Moriya.2011-02-09.pdf his slides] for details. T0 is a start counter time; the true starting time should come from picking out the correct RF bucket of the electron beam. David suggested that perhaps we should add a time to the DVertex class that could serve as a place-holder for this quantity. It could be set to zero for now and filled in with the appropriate value as that analysis code becomes available.  
  
 
==Action Item Review==
 
==Action Item Review==
  
−
We looked at recently-resolved and still-outstanding issues in the [https://halldnew.jlab.org/mantisbt Offline Bug Tracker]
+
We skipped a detailed review. Doesn't mean there aren't some items out there.
  
 
===New Action Items===
 
===New Action Items===
  
−
# Ask people at Regina about the status of the BCAL reconstruction code. -> David
+
# Circulate a computing resources estimate to the collaboration. -> Mark
−
# Schedule a discussion of parameters for code resident in the calibration database. -> Mark
+
# Give a talk on the JANA configuration scheme. -> David
 +
# Deal with warnings in sim-recon from the latest GNU compilers. -> Beni

Latest revision as of 18:23, 31 March 2015

GlueX Offline Software Meeting
Wednesday, February 9, 2011
1:30 pm EST
JLab: CEBAF Center F326/7

Agenda

  1. Announcements
    1. New JANA release: David
    2. New sim-recon release: sim-recon-2011-02-02: Mark
  2. Review of minutes from the last meeting: all
  3. Review of Collaboration Meeting: all
  4. Reconstruction Parameters vs. Calibration Constants: Mark
  5. Compiler Warnings: Beni
  6. Calibration Database Update: Dmitry
  7. Timing Resolution: Kei
  8. Action Item Review: all
    1. Resolved issues
    2. Outstanding issues
    • To view these links, login first. Anonymous login is available.
  9. Review of recent repository activity: all

Communication Information

Telephone

To connect by telephone:

  1. dial:
  2. enter access code followed by the # sign: 3421244#

Video Conferencing

Slides

Talks can be deposited in the directory /group/halld/www/halldweb/html/talks/2011-1Q on the JLab CUE. This directory is accessible from the web at https://halldweb.jlab.org/talks/2011-1Q/ . You have to be a member of the "halld" Unix group to do this.

Minutes

Present:

  • CMU: Curtis Meyer
  • IU: Ryan Mitchell, Kei Moriya
  • JLab: Hovanes Egiyan, Mark Ito (chair), David Lawrence, Yi Qiang, Elton Smith, Simon Taylor, Elliott Wolin, Beni Zihlmann

Announcements

  1. New JANA release. David is about to release a new version of JANA. It will include new features and bug fixes accumulated since the last release. He will give us more details at the next meeting.
  2. New sim-recon release: sim-recon-2011-02-02. Mark is preparing another release. The last one was at the end of November, so we are due.

Review of minutes from the last meeting

We went over minutes from the January 26 meeting.

David asked the Regina folks about the status of work on the BCAL reconstruction code. Both Andrei Semenov and Zisis Papandreou responded. Andrei and Irina Semenova are working on it. Their first code is to understand the present algorithm. Eugene Chudakov has commented that if there is a problem with split-off, we need to know about it sooner rather than later and Elton's understanding is that the current focus is on deciding the summing scheme in the BCAL rather than in suppressing extraneous showers. David will follow up on the split-off issue.

Collaboration Meeting Review

We discussed an item that came up at last week's collaboration meeting: the IT Review and our computing estimates. Simon has done some work estimating the time it takes to reconstruct bggen events with our current code. Mark is working on the estimates. He will circulate a version soon. There will be an IT Steering committee meeting Thursday to outline the topics to be addressed at the the review. Elton pointed out that we need a note on the estimate, explaining where the numbers come from and what assumptions were made. In particular, we need to revisit the issue of storing Monte Carlo generated data. If that data volume is comparable to (or exceeds) that of raw data then our computing model would have to be changed significantly.

Reconstruction Parameters vs. Calibration Constants

We had a discussion of how to manage reconstruction parameters versus calibration constants. An example of the former (parameters) would be the minimum number of hits in a charged track, an example of the latter (constants) would be the minimum drift time for those hits. Some parameters are currently stored in the calibration files (SVN: trunk/calib) and thus will migrate to the calibration database. Mark thought that they should be managed as configuration parameters to JANA, since different parameters might be used for different analysis of the same data and calibration constants had more of the character of "best for all occasions". Others thought that putting them in the database had the advantage of "everything in one place".

We did not come to a conclusion, but David agreed to give a talk on the JANA configuration scheme at a future meeting so we could have a more informed discussion.

Compiler Warnings

Beni discussed his recent email pointing out that sim-recon gives warnings with the latest version of the GNU compilers. He has given Richard Jones an account on his machine so that Richard can have a look at the HDGRANT-related warnings. There are some warnings from the BCAL that should be looked at as well.

Using Profiling Tools to Guide Optimization

Dmitry walked us through a recent exercise he went through to speed up the CCDB code. He used profiling tools in two contexts: the C++ code and the MySQL server. Profiling the C++ code attemting to read a large volume of constants revealed that the bulk of the time was being taken in database queries. Subsequently, the MySQL profiling tool allowed him to identify an appropriate index to create in the database. He also implemented some pre-stored queries. This resulted in almost a factor of seven improvement in performance. He noted that using the tools allowed him to focus on improvements that really made a difference, not just on those that may sound good. See his slides for details.

Timing Resolution: Kei

Kei presented work on looking at timing resolution in the BCAL and TOF and how it affects particle identification. He found that using the "T0" that comes from tracking as a starting time degrades performance; one does better by leaving it out altogether. See his slides for details. T0 is a start counter time; the true starting time should come from picking out the correct RF bucket of the electron beam. David suggested that perhaps we should add a time to the DVertex class that could serve as a place-holder for this quantity. It could be set to zero for now and filled in with the appropriate value as that analysis code becomes available.

Action Item Review

We skipped a detailed review. Doesn't mean there aren't some items out there.

New Action Items

  1. Circulate a computing resources estimate to the collaboration. -> Mark
  2. Give a talk on the JANA configuration scheme. -> David
  3. Deal with warnings in sim-recon from the latest GNU compilers. -> Beni
Retrieved from "https://halldweb.jlab.org/wiki/index.php?title=GlueX_Offline_Meeting,_February_9,_2011&oldid=65109"