See overall network traffic to/from JLab at https://my.es.net/sites/view/JLAB
(Click image for full resolution)
NOTE: The values in BAD_RCDB_QUERY_RUNS is informative about what is missing from
the RCDB. An attempt to recover the information from the /mss filesystem
was also made. Values in BAD_FILE_COUNT_RUNS are ones for which that failed.
Thus, only runs listed in BAD_FILE_COUNT_RUNS will not have any jobs submitted
BAD_RCDB_QUERY_RUNS=[81113, 81114, 81118, 81119, 81120, 81123, 81124, 81126, 81127, 81128, 81129, 81130, 81131, 81132, 81133, 81134, 81135, 81136, 81137, 81138, 81139, 81140, 81141, 81143, 81144, 81145, 81146, 81147, 81148, 81149, 81150, 81151, 81152, 81153, 81154, 81155, 81156, 81157, 81158, 81159, 81164, 81165, 81166, 81183, 81221, 81222, 81223, 81227, 81228, 81229, 81261, 81262, 81263, 81264, 81265, 81266, 81267, 81330, 81331, 81334, 81337, 81338, 81341, 81342, 81344, 81347, 81348, 81349, 81350, 81351, 81352, 81353, 81356, 81358, 81359, 81360, 81364, 81366, 81367, 81369, 81370, 81372, 81374, 81375, 81376, 81377, 81378, 81379, 81380, 81381, 81383, 81384, 81385, 81386, 81387, 81388, 81389, 81390, 81391, 81392, 81393, 81396, 81397, 81398, 81399, 81400, 81401, 81402, 81403, 81404, 81405, 81406, 81407, 81411, 81412, 81413, 81414, 81415, 81416, 81418, 81419, 81420, 81421, 81422, 81423, 81424, 81425, 81426, 81427, 81428, 81429, 81430, 81431, 81432, 81433, 81434, 81435, 81436, 81437, 81438, 81439, 81440, 81442, 81443, 81444, 81445, 81446, 81447, 81448, 81449, 81450, 81451, 81452, 81453, 81454, 81455, 81456, 81457, 81459, 81460, 81461, 81462, 81463, 81464, 81465, 81466, 81467, 81468, 81469, 81470, 81473, 81474, 81475, 81476, 81477, 81478, 81479, 81480, 81487, 81488, 81489, 81490, 81491, 81492, 81495, 81496, 81497, 81498, 81499, 81500, 81501, 81502, 81503, 81505, 81506, 81507, 81508, 81509, 81510, 81511, 81512, 81513, 81514, 81518, 81519, 81520, 81524, 81525, 81526, 81527, 81528, 81529, 81530, 81531, 81533, 81534, 81535, 81536, 81537, 81538, 81539, 81540, 81541, 81542, 81543, 81544, 81545, 81547, 81548, 81549, 81550, 81551, 81552, 81553, 81554, 81555, 81556, 81557, 81558, 81559, 81560, 81561, 81562, 81563, 81564, 81565, 81566, 81567, 81569, 81570, 81571, 81572, 81573, 81576, 81578, 81579, 81580, 81581, 81590, 81591, 81592, 81593, 81594, 81595, 81596, 81597, 81598, 81599, 81601, 81602, 81603, 81604, 81605, 81606, 81608, 81609, 81610, 81611, 81612, 81613, 81614, 81615, 81616, 81617, 81618, 81619, 81620, 81621, 81622, 81623, 81624, 81625, 81626, 81627, 81628, 81629, 81630, 81631, 81632, 81633, 81634, 81635, 81636, 81637, 81638, 81639, 81640, 81641, 81642, 81643, 81644, 81645, 81646, 81647, 81648, 81649, 81650, 81651, 81652, 81655, 81656, 81657, 81658, 81659, 81661, 81662, 81663, 81664, 81665, 81666, 81667, 81668, 81669, 81670, 81674, 81675, 81676, 81677, 81678, 81679, 81680, 81681, 81682, 81683, 81684, 81685, 81686, 81687, 81688, 81689, 81690, 81691, 81692, 81693, 81694, 81695, 81696, 81700, 81701, 81702, 81703, 81704, 81705, 81706, 81709, 81710, 81711, 81712, 81713, 81714, 81715, 81716]
BAD_FILE_COUNT_RUNS=[]
BAD_MSS_FILE_RUNS={}
=================================================
Launch Summary
-----------------------------------------------
RunPeriod: 2021-08
Launch type: recon
Version: 01-cori
batch: NERSC-multi
WORKFLOW: recon_2021-08_ver01-cori_batchNERSC-multi
Origin of run list: RCDB 81113-81716 (query="@is_primex_production")
Number of runs: 372
Number of files: 7196 (maximum 1000 files/run)
Min. file no.: 0
Max. file no.: 999
QOS: regular
Time limit per job: 12:00:00
JANA config file: /launch/jana_recon_nersc.config
NERSC project: m3120
Shifter image: docker:jeffersonlab/gluex_devel
halld_recon version: halld_recon/halld_recon-4.38.0 (from CVMFS)
launch directory: /global/project/projectdirs/m3120/launch (at NERSC)
Output directory: /lustre/expphy/volatile/halld/offsite_prod/RunPeriod-2021-08/recon/ver01-cori
=================================================
WORKFLOW: recon_2021-08_ver01-cori_batchNERSC-multi
------------------------------------
Number of runs: 372 (only good runs)
7196/7196 total files submitted (0 files missing from mss)
372/372 total jobs submitted
7196 directories created for output