Difference between revisions of "2012 Software Review"

From GlueXWiki
Jump to: navigation, search
(Schedules and Resources)
m (Text replacement - "http://argus.phys.uregina.ca/cgi-bin/private" to "https://halldweb.jlab.org/doc-private")
 
(65 intermediate revisions by 4 users not shown)
Line 6: Line 6:
 
* [https://mailman.jlab.org/pipermail/halld-offline/2012-January/000835.html e-mail sent by Eugene to HallD-Offline on Jan. 18, 2012]
 
* [https://mailman.jlab.org/pipermail/halld-offline/2012-January/000835.html e-mail sent by Eugene to HallD-Offline on Jan. 18, 2012]
 
* [[Rolf_email_20120126|e-mail sent by Rolf summarizing Jan. 26, 2012 brainstorming session]]
 
* [[Rolf_email_20120126|e-mail sent by Rolf summarizing Jan. 26, 2012 brainstorming session]]
* [http://argus.phys.uregina.ca/cgi-bin/private/DocDB/ShowDocument?docid=1897 January 26 IT Committee Meeting] (See the last slide on the review.)
+
* [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=1897 January 26 IT Committee Meeting] (See the last slide on the review.)
== Charge ==
+
 
''The official charge has yet to be determined''
+
 
 +
== Charge and Final Report==
 +
 
 +
[[Media:20120426_JLab_review_Charge_v3.pdf|Software Review Charge v3]](PDF)
 +
 
 +
[[Media:JLab12GeVSoftwareComputingReviewFinal20120912.pdf|Final Report From Review Committee]](PDF)
 +
 
 +
== Agenda ==
 +
* [https://www.jlab.org/indico/conferenceDisplay.py?confId=4 JLab Indico conference site]
 +
* [[Media:20120410_12GeV_Software_Review.pdf| First draft schedule from April 10, 2012]]
 +
 
 +
= Preparations =
 +
 
 +
== Multi-Hall Preparations ==
 +
 
 +
General Info.
 +
* [[Chip Watson E-mail from April 11,2012]] ''(requesting updated computing requirements)''
 +
 
 +
 
 +
'''----- Meetings ------'''
 +
 
 +
===SRP Meeting on May 14, 2012===
 +
* There is a  [[Software Review Preparations Meeting May 14, 2012|special meeting page]] set up for this meeting.
 +
 
 +
 
 +
===SRP Meeting on May 1, 2012===
 +
 
 +
* [[Media:20120501_12GeV_Software_Review_w_speakers.pdf|Schedule]]
 +
* DAQ
 +
** [[Media:20120501_Online_Talk_Outline.pdf|Online Talk Outline]]
 +
* Hall-A
 +
** [[Media:20120501_12GeV-Software-Review-outlines_HallA.pdf|Slide outlines]]
 +
* Hall-C
 +
** [[Media:20120501_HallC_12gev_software_review_june2012.pdf|Draft Slides]]
 +
* Hall-D
 +
** [[Media:20120501_HallD_Morning_outline.pdf|Morning Slides Outline]]
 +
** [[Media:20120501_HallD_Afternoon_outline.pdf|Afternoon Slides Outline]]
 +
** [[Media:20120501_JLab_review_Charge_v3_annotated.pdf|Charge v3]] ''(annotated to indicate which slides address each charge item)''
 +
** [https://halldsvn.jlab.org/repos/trunk/docs/offline/ProjectProgress/Milestones.pdf Milestones]
 +
 
 +
===SRP Meeting on April 10, 2012===
 +
* [[Media:20120410_CC_Procurement_Plans_Sheet1.pdf|IT Division Procurement Plans]] ''(shown by Chip)''
 +
* Hall Computing Requirements:
 +
** [[Media:20110811_Summary_table.pdf|Summary of Hall Requirements]] ''(produced by Graham in August 2011 and circulated after meeting)''
 +
** Presented at May 2011 review ''(extracted and sent to me by Graham)''
 +
*** [[Media:20110520_Hall-A_Hansen.pdf|Hall-A]], [[Media:20110520_Hall-B_Gilfoyle.pdf|Hall-B]], [[Media:20110520_Hall-C_Wood.pdf|Hall-C]], [[Media:20110520_Hall-D_Ito.pdf|Hall-D]]
 +
*** [[Media:20110520_Req_Summary.pdf|Summary]] ''(shown by Graham)''
 +
 
 +
* [[Media:20120410_12GeV_Software_Review.pdf| First draft agenda for the review]]
 +
* Management Structure + Tight Spots & Weakness
 +
** [[Media:Hall_A_software_-_weaknesses_&_management.pdf|Hall-A Management Structure and Tight spots/weaknesses]]
 +
** [[Media:HallB_TightSpots_and_Weakness.pdf|Hall-B Management Structure and Tight spots/weaknesses]]
 +
** [[Media:20120409_HallC_management.pdf|Hall-C Management Structure]] and [[Hall-C Tight Spots/Weaknesses|Tight spots/Weaknesses]]
 +
** [[Media:20120410_halld_management_structure.pdf|Hall-D Management Structure]] and [[Media:20120410_halld_software_concerns.pdf|Tight spots/Weaknesses]]
 +
* [[Notes taken at April 10,2012 meeting by Dave]]
 +
 
 +
 
 +
===Brainstorming Follow-up Meeting on March 14, 2012===
 +
* [[Media:20120314_HallD.pdf|Summary statements shown at March 14th follow-up meeting]]
 +
* [[Media:20120314_12GeVSoftware_sharing_HallsAC.pdf|Hall A/C report at followup meeting]]
 +
* [[Media:20120307_Grahams_Discussion_topics.pdf|Grahams Discussion Topics]]
 +
* [[Summary of March 14, 2012 meeting from Rolf]]
 +
* [[Notes taken at March 14,2012 meeting by Dave]]
 +
 
 +
 
 +
Results of meetings involving Hall-D:
 +
* [[Media:20120213_JANA_CLARA.pdf|JANA and CLARA]]
 +
* [[Notes from Feb. 7th, 2012 Tracking Discussion with Hall-B]]
 +
 
 +
 
 +
===Brainstorming meeting on Jan. 26, 2012===
 +
* This was an initiative by Rolf to try and ensure the halls are not needlessly duplicating effort when it comes to software development.
 +
* The initial meeting was [[Rolf_email_20120126|summarized in an e-mail Rolf sent on Jan. 26, 2012]].
 +
* Several sub-meetings with topics were suggested. The intent was to have
 +
the sub-meetings and then meet again as a group to discuss the results.
 +
 
 +
== Hall-D Preparations ==
 +
Specific plans for Hall-D's preparations for the review are gathered in this section.
 +
 
 +
=== Planning Meetings ===
 +
* [[2012 Software Review Planning Meeting: June 1, 2012|June 1, 2012]]
 +
* [[GlueX Offline Meeting, May 16, 2012|May 30, 2012 Dry Runs (Offline Software Meeting)]]
 +
* [[GlueX-Collaboration-Jun-2012|May 23, 2012 Dry Runs (Collaboration Meeting)]]
 +
* [[2012 Software Review Planning Meeting: May 11, 2012|May 11, 2012]]
 +
* [[2012 Software Review Planning Meeting: May 4, 2012|May 4, 2012]]
 +
* [[2012 Software Review Planning Meeting: Apr. 27, 2012|Apr. 27, 2012]]
 +
* [[2012 Software Review Planning Meeting: Apr. 20, 2012|Apr. 20, 2012]]
 +
* [[2012 Software Review Planning Meeting: Apr. 13, 2012|Apr. 13, 2012]]
 +
* [[2012 Software Review Planning Meeting: Apr. 6, 2012|Apr. 6, 2012]]
 +
* [[2012 Software Review Planning Meeting: Mar. 23, 2012|Mar. 23, 2012]]
 +
* [[2012 Software Review Planning Meeting: Mar. 16, 2012|Mar. 16, 2012]]
 +
* [[2012 Software Review Planning Meeting: Mar. 9, 2012|Mar. 9, 2012]]
 +
* [[2012 Software Review Planning Meeting: Mar. 2, 2012|Mar. 2, 2012]]
 +
* [[2012 Software Review Planning Meeting: Feb. 24, 2012|Feb. 24, 2012]]
 +
* [[2012 Software Review Planning Meeting: Feb. 10, 2012|Feb. 10, 2012]]
 +
* [[2012 Software Review Planning Meeting: Feb. 3, 2012|Feb. 3, 2012]]
 +
* [[2012 Software Review Planning Meeting: Jan. 27, 2012|Jan. 27, 2012]]
 +
* [[2012 Software Review Planning Meeting: Jan. 20, 2012|Jan. 20, 2012]]
 +
 
 +
=== Schedules and Resources ===
 +
Here are links to some pages dedicated to schedules and resource lists put together for the review.
 +
* [[2012 Offline Computing Schedule]]
 +
 
 +
 
 +
== Presentations ==
 +
Here are links to the presentations and documents being prepared for the review. The format was described in an [[Email sent by David on April 13, 2012|email]] sent out on April 13th,2012.
 +
 
 +
=== Hall-C ===
 +
* Morning Session
 +
** [https://userweb.jlab.org/~saw/software/HallC_softreview_am_saw_updated_may22.pptx Introductory Talk] (Steve Wood)
 +
** [https://userweb.jlab.org/~jones/HallC_softreview_am_mkj_updated_may27th.pptx Hall-C Software Status] (Mark Jones)
 +
*:
 +
* Afternoon parallel session
 +
** [https://userweb.jlab.org/~saw/software/HallC_softreview_pm_gn_may25.ppt Hall-C Software Details] (Gabriel Niculescu)
 +
 
 +
 
 +
* Additional documentation
 +
** The Research Management Plan: https://userweb.jlab.org/~jones/RMP_HallC_software.docx
 +
 
 +
 
 +
=== Hall-D ===
 +
* Morning session ([[Media:20120501_HallD_Morning_outline.pdf|Morning Slides Outline]])
 +
** [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=1949 Overview Talk] (Curtis Meyer)
 +
** [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=1980 Software Planning and Numbers Talk] (Mark Ito)
 +
*:
 +
* Afternoon parallel session ([[Media:20120501_HallD_Afternoon_outline.pdf|Afternoon Slides Outline]])
 +
** [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=1979 Technical Details Talk] (David Lawrence)
  
 
= Material =
 
= Material =
 +
 +
 
== From 2011 mini-Review ==
 
== From 2011 mini-Review ==
 
In Spring of 2011 an internal software review was conducted partially as preparation for the external review planned in 2012. Below are links to some of the relevant material from that review.
 
In Spring of 2011 an internal software review was conducted partially as preparation for the external review planned in 2012. Below are links to some of the relevant material from that review.
  
* [http://argus.phys.uregina.ca/cgi-bin/private/DocDB/ShowDocument?docid=1778 Hall-D and IT: Mark Ito's slides for Hall-D]
+
* [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=1778 Hall-D and IT: Mark Ito's slides for Hall-D]
 
** [https://halldsvn.jlab.org/repos/trunk/home/marki/gluex/docs/comp_mod/computing_model.xls Spreadsheet] used for estimates in Mark's talk. Cells shaded blue indicate input data. Other cells are derived from these.
 
** [https://halldsvn.jlab.org/repos/trunk/home/marki/gluex/docs/comp_mod/computing_model.xls Spreadsheet] used for estimates in Mark's talk. Cells shaded blue indicate input data. Other cells are derived from these.
* [http://argus.phys.uregina.ca/cgi-bin/private/DocDB/ShowDocument?docid=1782 IT in the 12-GeV Era: Chip Watsons's close-out slides]
+
* [https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=1782 IT in the 12-GeV Era: Chip Watsons's close-out slides]
 +
* [https://mailman.jlab.org/pipermail/halld-offline/attachments/20120117/858818b8/attachment-0001.pdf Unpublished Committee Report]
 
* [[Media:Halld_offline_management_2011_Ito.pdf|Mark's response to first draft committee report]]
 
* [[Media:Halld_offline_management_2011_Ito.pdf|Mark's response to first draft committee report]]
  
Line 80: Line 209:
 
</pre>
 
</pre>
  
= Hall-D Preparations =
 
Specific plans for Hall-D's preparations for the review are gathered in this section.
 
  
== Planning Meetings ==
+
== Other Potentially Useful Information ==
* [[2012 Software Review Planning Meeting: Feb. 3, 2012|Feb. 3, 2012]]
+
* [[2012 Software Review Planning Meeting: Jan. 27, 2012|Jan. 27, 2012]]
+
* [[2012 Software Review Planning Meeting: Jan. 20, 2012|Jan. 20, 2012]]
+
  
== Schedules and Resources ==
+
Some Documentation from CLEO
Here are links to some pages dedicated to schedules and resource lists put together for the review.
+
* [[2012 Offline Computing Schedule]]
+
 
+
Related info from Cornell
+
  
 
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP03/OnDemand.pdf On Demand Data Analysis (proceedings)]
 
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP03/OnDemand.pdf On Demand Data Analysis (proceedings)]
 
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP00/UserCentric.pdf CLEO Analysis Framework Design Summary (proceedings)]
 
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP00/UserCentric.pdf CLEO Analysis Framework Design Summary (proceedings)]
 +
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP98/DChain.pdf DChain:  A tool for combinatorics in reconstruction (proceedings)]
 
* [http://www.lepp.cornell.edu/~wsun/tracking/overview.html CLEO Tracking Overview (webpage)]
 
* [http://www.lepp.cornell.edu/~wsun/tracking/overview.html CLEO Tracking Overview (webpage)]
 +
* [http://www.cithep.caltech.edu/~ajw/cleoiii-tracking.html Alan Weinstein's Tracking Page (some old and broken links)]
 
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP04/EventStore.pdf CLEO Event Store for Data Storage and Access (proceedings)]
 
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP04/EventStore.pdf CLEO Event Store for Data Storage and Access (proceedings)]
 
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP03/EventAsDatabase.pdf Managing Dependencies Amongst Objects (proceedings)]
 
* [http://www.lepp.cornell.edu/~cdj/publications/conferences/CHEP03/EventAsDatabase.pdf Managing Dependencies Amongst Objects (proceedings)]
Line 103: Line 225:
 
* [http://www.lepp.cornell.edu/~cdj/ Chris Jones' web page at Cornell (contains many of the above files)]
 
* [http://www.lepp.cornell.edu/~cdj/ Chris Jones' web page at Cornell (contains many of the above files)]
  
== Presentations ==
+
Miscellaneous
 +
 
 +
* [http://mindprod.com/jgloss/unmain.html How to Write Unmaintainable Code]
  
== Milestones/Data challenges ==
 
  
 
== Contact Info ==
 
== Contact Info ==

Latest revision as of 16:12, 24 February 2017

Scope

The review is intended to assess the overall ability of the software to analyze the data at the time data taking begins. This was a goal that was largely considered to have been sought and achieved by the LHC experiments at CERN. This has not been done previously at JLab while commissioning a new experimental hall.

Original e-mails sent by Rolf and Eugene initially describing the scope can be found here:


Charge and Final Report

Software Review Charge v3(PDF)

Final Report From Review Committee(PDF)

Agenda

Preparations

Multi-Hall Preparations

General Info.


----- Meetings ------

SRP Meeting on May 14, 2012


SRP Meeting on May 1, 2012

SRP Meeting on April 10, 2012


Brainstorming Follow-up Meeting on March 14, 2012


Results of meetings involving Hall-D:


Brainstorming meeting on Jan. 26, 2012

  • This was an initiative by Rolf to try and ensure the halls are not needlessly duplicating effort when it comes to software development.
  • The initial meeting was summarized in an e-mail Rolf sent on Jan. 26, 2012.
  • Several sub-meetings with topics were suggested. The intent was to have

the sub-meetings and then meet again as a group to discuss the results.

Hall-D Preparations

Specific plans for Hall-D's preparations for the review are gathered in this section.

Planning Meetings

Schedules and Resources

Here are links to some pages dedicated to schedules and resource lists put together for the review.


Presentations

Here are links to the presentations and documents being prepared for the review. The format was described in an email sent out on April 13th,2012.

Hall-C



Hall-D

Material

From 2011 mini-Review

In Spring of 2011 an internal software review was conducted partially as preparation for the external review planned in 2012. Below are links to some of the relevant material from that review.

From 6GeV BIA Schedule

The 6GeV BIA (Baseline Improvement Schedule) was made to allow development on certain projects that while critical to 12GeV, could be used by the 6GeV program were it to continue and the upgrade never happen. Thus, these items were to be paid for by the 6GeV operations budget and not out of the 12GeV project budget.

The Offline Computing schedule was placed in the BIA and the intention was to track it there. At some point (2009?) the BIA tracking was dropped and the Offline Computing has not maintained tracking of it since. It does, however, serve as the most recent detailed project plan for the offline computing. The most recent version (extracted by Phil Kessler on Jan. 17, 2012) can be found here:

BIA_Last_Baseline_with_Offline_Computing_17_January_12_PMK.pdf

From 12GeV Project Schedule

The 12 GeV Project schedule contains only the Online Computing activities. Primarily DAQ system and Control Systems software. There is some overlap between the offline and online and where the reviewers will draw the boundary. Nonetheless, a recent (Oct. 2011) extraction of the Computing part of the project schedule can be found here:

12GeVProject_OnlineComputing_Oct2011.pdf

BNL Review and Hall-A Research Management Plan

The following attachments were sent with the e-mail below regarding a 2006 BNL review that this may be similar to:

Live links to those referred to under a), b), c) below are here:

---------- Forwarded message ----------
Date: Tue, 17 Jan 2012 14:50:04 -0500 (EST)
From: Rolf Ent <ent@jlab.org>
To: Robert Michaels <rom@jlab.org>, John LeRose <lerose@jlab.org>, Volker Burkert <burkert@jlab.org>, Latifa Elouadrhiri <latifa@jlab.org>,
    Stephen A. Wood <saw@jlab.org>, Howard Fenker <hcf@jlab.org>, Eugene Chudakov <gen@jlab.org>, Elton Smith <elton@jlab.org>,
    Glenn Young <gyoung@jlab.org>, Graham Heyes <heyes@jlab.org>, Javier Gomez <gomez@jlab.org>, Chip Watson <watson@jlab.org>
Cc: Robert McKeown <bmck@jlab.org>, Roy Whitney <whitney@jlab.org>
Subject: Re: 12 GeV Software review planning - electronic

Dear all,

    Apologies for the delay, but here a few attachments with:
1) charge and agenda for an internal BNL Atlas review in December of
2006, that Chip chaired and had a fairly large emphasis upon software and computing, as opposed to construction.
2) for completeness, the document on what to expect/prepare for a
review, from the earlier meeting.
3) the research management plan for the SBS.

    Also, FYI here a few sites with presentations/further info that
may be useful, per Chip:
a) a link to a software talk from a DOE review
http://www.bnl.gov/npp/docs/doehep07/raja_BNL-DOE.pdf
with a pretty broad scope, and lots of details.  Should be useful.

b) a DOE talk of 1 1/2 years old:
http://science.energy.gov/~/media/hep/pdf/files/pdfs/lhcops_hepap_1.pdf

c) the annual review report from 2009 for US LHC:
http://gate.hep.anl.gov/lprice/USLHC_Operations_2009-final.doc
(where Operations includes software and computing).

                Best regards,    Rolf


Other Potentially Useful Information

Some Documentation from CLEO

Miscellaneous


Contact Info

Hall-D preparations for the review are being organized by:

David Lawrence

Matt Shepherd

Mark Ito