recon_2018-08_ver02_batch02
Click on each figure to show larger version
Status
Info retrieved: 2019-09-11 14:43:46.0
Job Limit: 0 Total attempts: 12238
Status from SWIF Summary
Numbers are for individual registered jobs, final status.
| Undispatched |
Dispatched |
Succeeded |
Failed |
Problems |
Canceled |
Total |
| 0 |
9 |
12143 |
0 |
6 |
0 |
12158 |
Auger Status
| Dependency |
Pending |
Staging In |
Active |
Staging Out |
Finishing |
Dispatched Total |
| 0 |
0 |
0 |
9 |
0 |
0 |
9 |
Status by Resources
Counts are for each attempt of running a job, if an attempt fails and the job is resubmitted
the same job will appear in other places as other attempts.
| Resources |
Results |
TOTAL |
| RAM (GB) |
time limit (hrs) |
SUCCESS |
USER ERROR |
FAILED |
TIMEOUT |
OVER_RLIMIT |
UNDISPATCHED |
ACTIVE |
CANCELLED |
| 12.0 |
24.0 |
12168 |
28 |
32 |
1 |
0 |
0 |
9 |
0 |
12238 |
| TOTAL |
12168 |
28 |
32 |
1 |
0 |
0 |
9 |
0 |
12238 |
Number of Attempts For Each Job
Number of jobs in each stage since launch
Time Spent in Dependency
Time Spent in Pending
Number of Jobs in Each Stage
Duration of Each Stage
Wall Time, CPU Time, CPU Time vs Wall Time
MAX Memory reported by AUGER
Problem Jobs
| Run |
File |
RAM (GB) |
Attempt |
Problem |
Resolution |
SWIF Job ID |
Auger Job ID |
Submit Time |
Complete Time |
| 051037 |
014 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151180 |
4141954 |
2019-08-28 17:42:55.0 |
2019-08-28 18:38:41.0 |
| 051037 |
015 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151181 |
4141955 |
2019-08-28 17:42:55.0 |
2019-08-28 18:38:43.0 |
| 051037 |
016 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151182 |
4141956 |
2019-08-28 17:42:55.0 |
2019-08-28 18:38:45.0 |
| 051037 |
017 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151183 |
4141957 |
2019-08-28 17:42:55.0 |
2019-08-28 18:38:47.0 |
| 051037 |
018 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151184 |
4141958 |
2019-08-28 17:42:55.0 |
2019-08-28 18:38:53.0 |
| 051037 |
019 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151185 |
4141959 |
2019-08-28 17:42:55.0 |
2019-08-28 18:39:21.0 |
| 051037 |
021 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151187 |
4141961 |
2019-08-28 17:42:55.0 |
2019-08-28 18:39:47.0 |
| 051037 |
022 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151188 |
4141962 |
2019-08-28 17:42:55.0 |
2019-08-28 18:39:46.0 |
| 051037 |
023 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151189 |
4141963 |
2019-08-28 17:42:55.0 |
2019-08-28 18:39:46.0 |
| 051037 |
029 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151195 |
4141969 |
2019-08-28 17:42:56.0 |
2019-08-28 18:39:49.0 |
| 051038 |
069 |
12 |
1 / 2 |
AUGER-INPUT-FAIL |
retry |
23151328 |
4142102 |
2019-08-28 17:43:04.0 |
2019-08-28 22:23:43.0 |
| 051038 |
126 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151383 |
4142157 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:05.0 |
| 051038 |
128 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151384 |
4142158 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:15.0 |
| 051038 |
129 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151385 |
4142159 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:22.0 |
| 051038 |
130 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151386 |
4142160 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:25.0 |
| 051038 |
131 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151388 |
4142162 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:30.0 |
| 051038 |
134 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151389 |
4142163 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:33.0 |
| 051038 |
133 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151390 |
4142164 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:35.0 |
| 051038 |
135 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151392 |
4142166 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:37.0 |
| 051038 |
136 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151394 |
4142168 |
2019-08-28 17:43:07.0 |
2019-08-28 18:38:39.0 |
| 051038 |
137 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151396 |
4142170 |
2019-08-28 17:43:08.0 |
2019-08-28 18:39:49.0 |
| 051038 |
183 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151434 |
4142208 |
2019-08-28 17:43:10.0 |
2019-08-28 18:39:54.0 |
| 051038 |
184 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23151436 |
4142210 |
2019-08-28 17:43:10.0 |
2019-08-28 18:39:51.0 |
| 051039 |
181 |
12 |
1 / 2 |
AUGER-TIMEOUT |
retry |
23151622 |
4142396 |
2019-08-28 17:43:21.0 |
2019-08-30 03:54:38.0 |
| 051046 |
003 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23152078 |
4142852 |
2019-08-28 17:43:53.0 |
2019-09-07 07:01:25.0 |
| 051046 |
012 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23152089 |
4142863 |
2019-08-28 17:43:53.0 |
2019-09-07 04:35:21.0 |
| 051046 |
014 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23152090 |
4142864 |
2019-08-28 17:43:53.0 |
2019-09-07 04:31:51.0 |
| 051046 |
074 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23152149 |
4142923 |
2019-08-28 17:43:57.0 |
2019-09-03 20:07:50.0 |
| 051046 |
090 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23152166 |
4142940 |
2019-08-28 17:44:03.0 |
2019-09-07 04:58:31.0 |
| 051048 |
077 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23152322 |
4143096 |
2019-08-28 17:44:11.0 |
2019-09-04 01:38:30.0 |
| 051048 |
083 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23152332 |
4143106 |
2019-08-28 17:44:12.0 |
2019-09-07 05:55:31.0 |
| 051056 |
166 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23153434 |
4144208 |
2019-08-28 17:45:20.0 |
2019-09-03 21:54:35.0 |
| 051057 |
044 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23153494 |
4144268 |
2019-08-28 17:45:23.0 |
2019-09-03 22:57:38.0 |
| 051057 |
055 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23153508 |
4144282 |
2019-08-28 17:45:24.0 |
2019-09-03 22:23:35.0 |
| 051065 |
053 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23153896 |
4144670 |
2019-08-28 17:46:27.0 |
2019-09-05 11:25:56.0 |
| 051065 |
087 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23153939 |
4144713 |
2019-08-28 17:46:30.0 |
2019-09-07 04:04:34.0 |
| 051065 |
128 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23153974 |
4144748 |
2019-08-28 17:46:32.0 |
2019-09-07 03:56:48.0 |
| 051067 |
120 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
23154343 |
4145139 |
2019-08-28 17:46:58.0 |
2019-08-31 12:35:52.0 |
| 051076 |
089 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23155213 |
4146009 |
2019-08-28 17:47:56.0 |
2019-09-03 23:48:11.0 |
| 051076 |
099 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23155220 |
4146016 |
2019-08-28 17:47:56.0 |
2019-09-03 22:43:56.0 |
| 051100 |
159 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23156479 |
4147275 |
2019-08-28 17:49:16.0 |
2019-09-04 01:08:34.0 |
| 051116 |
011 |
12 |
1 / 4 |
AUGER-FAILED |
retry |
23156871 |
4147667 |
2019-08-28 17:50:19.0 |
2019-08-29 12:32:40.0 |
| 051116 |
011 |
12 |
2 / 4 |
SWIF-USER-NON-ZERO |
retry |
23156871 |
4298083 |
2019-09-03 16:57:46.0 |
2019-09-05 09:40:23.0 |
| 051116 |
011 |
12 |
3 / 4 |
SWIF-USER-NON-ZERO |
retry |
23156871 |
4389107 |
2019-09-06 09:49:31.0 |
2019-09-07 10:46:47.0 |
| 051116 |
011 |
12 |
4 / 4 |
AUGER-FAILED |
|
23156871 |
4594943 |
2019-09-11 05:53:00.0 |
2019-09-11 06:05:54.0 |
| 051140 |
082 |
12 |
1 / 5 |
SWIF-USER-NON-ZERO |
retry |
23157369 |
4148165 |
2019-08-28 17:50:50.0 |
2019-09-03 07:36:15.0 |
| 051140 |
082 |
12 |
2 / 5 |
SWIF-USER-NON-ZERO |
retry |
23157369 |
4298084 |
2019-09-03 16:57:46.0 |
2019-09-05 01:19:53.0 |
| 051140 |
082 |
12 |
3 / 5 |
SWIF-USER-NON-ZERO |
retry |
23157369 |
4342402 |
2019-09-05 08:01:27.0 |
2019-09-05 22:27:26.0 |
| 051140 |
082 |
12 |
4 / 5 |
SWIF-USER-NON-ZERO |
retry |
23157369 |
4389108 |
2019-09-06 09:49:32.0 |
2019-09-06 17:48:16.0 |
| 051140 |
082 |
12 |
5 / 5 |
SWIF-USER-NON-ZERO |
|
23157369 |
4594944 |
2019-09-11 05:53:00.0 |
2019-09-11 10:12:24.0 |
| 051150 |
149 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23157889 |
4148685 |
2019-08-28 17:51:23.0 |
2019-09-04 02:13:57.0 |
| 051154 |
042 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
23158243 |
4149039 |
2019-08-28 17:51:47.0 |
2019-08-30 11:37:35.0 |
| 051163 |
056 |
12 |
1 / 4 |
SWIF-USER-NON-ZERO |
retry |
23159678 |
4150474 |
2019-08-28 17:53:54.0 |
2019-08-31 07:17:57.0 |
| 051163 |
056 |
12 |
2 / 4 |
SWIF-USER-NON-ZERO |
retry |
23159678 |
4298086 |
2019-09-03 16:57:46.0 |
2019-09-05 11:11:11.0 |
| 051163 |
056 |
12 |
3 / 4 |
SWIF-USER-NON-ZERO |
retry |
23159678 |
4389109 |
2019-09-06 09:49:32.0 |
2019-09-06 16:32:03.0 |
| 051163 |
056 |
12 |
4 / 4 |
SWIF-USER-NON-ZERO |
|
23159678 |
4594945 |
2019-09-11 05:53:00.0 |
2019-09-11 08:09:22.0 |
| 051165 |
023 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23159848 |
4150644 |
2019-08-28 17:54:03.0 |
2019-09-04 00:17:51.0 |
| 051165 |
037 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23159862 |
4150658 |
2019-08-28 17:54:04.0 |
2019-09-04 00:06:47.0 |
| 051167 |
041 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23160151 |
4150947 |
2019-08-28 17:54:21.0 |
2019-09-07 04:05:27.0 |
| 051169 |
013 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23160309 |
4151105 |
2019-08-28 17:54:34.0 |
2019-09-04 00:07:08.0 |
| 051174 |
091 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
23160869 |
4151665 |
2019-08-28 17:55:12.0 |
2019-09-01 11:20:54.0 |
| 051176 |
059 |
12 |
1 / 5 |
AUGER-FAILED |
retry |
23161211 |
4152007 |
2019-08-28 17:55:34.0 |
2019-08-29 15:53:10.0 |
| 051176 |
059 |
12 |
2 / 5 |
SWIF-USER-NON-ZERO |
retry |
23161211 |
4298088 |
2019-09-03 16:57:46.0 |
2019-09-05 06:05:43.0 |
| 051176 |
059 |
12 |
3 / 5 |
SWIF-USER-NON-ZERO |
retry |
23161211 |
4342408 |
2019-09-05 08:01:27.0 |
2019-09-05 21:03:22.0 |
| 051176 |
059 |
12 |
4 / 5 |
SWIF-USER-NON-ZERO |
retry |
23161211 |
4389110 |
2019-09-06 09:49:32.0 |
2019-09-06 21:59:42.0 |
| 051176 |
059 |
12 |
5 / 5 |
AUGER-FAILED |
|
23161211 |
4594947 |
2019-09-11 05:53:00.0 |
2019-09-11 06:18:31.0 |
| 051177 |
132 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23161485 |
4152281 |
2019-08-28 17:55:51.0 |
2019-08-30 01:37:09.0 |
| 051192 |
117 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23161930 |
4152726 |
2019-08-28 17:56:19.0 |
2019-09-07 03:49:08.0 |
| 051193 |
000 |
12 |
1 / 5 |
SWIF-USER-NON-ZERO |
retry |
23162000 |
4152796 |
2019-08-28 17:56:23.0 |
2019-09-01 05:37:41.0 |
| 051193 |
000 |
12 |
2 / 5 |
SWIF-USER-NON-ZERO |
retry |
23162000 |
4298090 |
2019-09-03 16:57:47.0 |
2019-09-05 02:36:14.0 |
| 051193 |
000 |
12 |
3 / 5 |
SWIF-USER-NON-ZERO |
retry |
23162000 |
4342409 |
2019-09-05 08:01:27.0 |
2019-09-05 12:12:42.0 |
| 051193 |
000 |
12 |
4 / 5 |
SWIF-USER-NON-ZERO |
retry |
23162000 |
4389111 |
2019-09-06 09:49:32.0 |
2019-09-06 14:47:29.0 |
| 051193 |
000 |
12 |
5 / 5 |
SWIF-USER-NON-ZERO |
|
23162000 |
4594949 |
2019-09-11 05:53:00.0 |
2019-09-11 05:55:03.0 |
| 051193 |
085 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
23162088 |
4152884 |
2019-08-28 17:56:28.0 |
2019-09-01 10:24:26.0 |
| 051194 |
128 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
23162319 |
4153115 |
2019-08-28 17:56:45.0 |
2019-09-03 15:44:27.0 |
| 051196 |
014 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23162460 |
4153256 |
2019-08-28 17:56:53.0 |
2019-09-03 23:36:59.0 |
| 051196 |
017 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23162465 |
4153261 |
2019-08-28 17:56:53.0 |
2019-09-03 23:40:18.0 |
| 051198 |
004 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23162479 |
4153275 |
2019-08-28 17:56:54.0 |
2019-09-04 00:05:30.0 |
| 051198 |
010 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23162485 |
4153281 |
2019-08-28 17:56:54.0 |
2019-09-04 01:57:55.0 |
| 051198 |
143 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23162617 |
4153410 |
2019-08-28 17:57:02.0 |
2019-09-03 12:23:17.0 |
| 051199 |
050 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
23162720 |
4153513 |
2019-08-28 17:57:50.0 |
2019-09-04 01:40:36.0 |
| 051201 |
030 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
23163072 |
4153865 |
2019-08-28 17:58:12.0 |
2019-08-30 01:37:09.0 |
| 051201 |
031 |
12 |
1 / 4 |
SWIF-USER-NON-ZERO |
retry |
23163076 |
4153869 |
2019-08-28 17:58:12.0 |
2019-09-02 02:12:35.0 |
| 051201 |
031 |
12 |
2 / 4 |
SWIF-USER-NON-ZERO |
retry |
23163076 |
4298095 |
2019-09-03 16:57:47.0 |
2019-09-05 13:23:39.0 |
| 051201 |
031 |
12 |
3 / 4 |
SWIF-USER-NON-ZERO |
retry |
23163076 |
4389112 |
2019-09-06 09:49:32.0 |
2019-09-06 21:38:39.0 |
| 051201 |
031 |
12 |
4 / 4 |
SWIF-USER-NON-ZERO |
|
23163076 |
4594950 |
2019-09-11 05:53:00.0 |
2019-09-11 13:10:51.0 |