Message to Sandy on Schedule for DC2

Date: Wed, 18 Dec 2013 17:55:29 -0500
From: Mark Ito <marki@jlab.org>
To: Sandy Philpott <philpott@jlab.org>
CC: Lawrence David <davidl@jlab.org>, Graham Heyes <heyes@jlab.org>,
        Chip Watson <watson@jlab.org>
Subject: Re: Data challenge requirements

Sandy,

Sorry for the delay in responding.

I would say that now we are looking at something like the beginning of 
February for the 25% scale data challenge. There is still significant 
work to get there, but we have made some progress in the time since the 
review. Usual caveats about schedule uncertainty apply.

   -- Mark

On 12/04/2013 02:35 PM, Sandy Philpott wrote:
> Dear Mark, David, Graham,
>
> Now that we've gotten past the 12GeV computing review, we'd like to 
> get more specifics on your expected timeframe for running the upcoming 
> Hall D data challenges. The 25% scale of 1250 cores is next on the 
> list, and then 50% scale of 2500 cores for Q2 2014, according to the 
> scope and schedule agreed upon. We would like to have at least a 
> month's advance notice (more would be even better) so that there's a 
> chance to build up credit with LQCD using farm nodes, and plan 
> accordingly with LQCD the flip to then move LQCD nodes and farm nodes 
> back to the farm for the data challenge.
>
> Can you give us any more specific target dates for your data 
> challenges at this point?
>
> Regards,
> Sandy
>
> -------- Original Message --------
> Subject: 	Data challenge requirements
> Date: 	Wed, 30 Oct 2013 13:05:59 -0400
> From: 	Heyes Graham <heyes@jlab.org>
> To: 	Ito Mark <marki@jlab.org>, Lawrence David <davidl@jlab.org>, 
> Weygand Dennis <weygand@jlab.org>, Veronique Ziegler <ziegler@jlab.org>
> CC: 	Rolf Ent <ent@jlab.org>, Rossi Patrizia <rossi@jlab.org>, Watson 
> Chip <watson@jlab.org>
>
> Dear Offline folks,
> Chip and I had a discussion this morning about what is an acceptable 
> scope and schedule for data challenge tests of your analysis 
> frameworks. The definitive tests should be done at JLab using the 
> systems on which the final analysis will be done, i.e. the ENP 
> analysis cluster (Farm). The suggested scope and schedule is based 
> upon the dates that you have given for the first major bumps in 
> computing requirements, 5000 cores for GLUEX in Q2 of 2015 and 2400 
> for CLAS12 in Q2 of 2016:
>
>   * 10% of final scale 24 months in advance.
>   * 25% of final scale 18 months in advance.
>   * 50% of final scale 12 months in advance.
>
> Each test should last for 2-4 days depending upon how many problems 
> are encountered. The larger scale tests will require significant 
> resources which Chip proposes that he will loan to us from the LQCD 
> clusters so as not to significantly disturb other Farm users. He 
> proposes moving the resources to us on a Monday then moving them back 
> to LQCD on a Friday giving us up to four work days for testing.
>
> I spoke with Mark this morning and he agreed that this is a reasonable 
> schedule and that GLUEX have already met the 24 month test 
> requirement. However the 25% scale test will be due in the next few 
> months.
>
> Chip and I both think that this is a reasonable schedule and not 
> difficult to meet. We would like you to consider it as you prepare 
> presentations for the review.
>
> Regards to all,
> Graham