recon_2016-02_ver04_batch04


Click on each figure to show larger version

Status

Info retrieved: 2017-08-28 11:25:01.0

Job Limit: 0 Total attempts: 6078

Status from SWIF Summary

Numbers are for individual registered jobs, final status.

Undispatched Dispatched Succeeded Failed Problems Canceled Total
0 12 5933 0 0 0 5945


Auger Status

Dependency Pending Staging In Active Staging Out Finishing Dispatched Total
4 0 0 8 0 0 12

Status by Resources

Counts are for each attempt of running a job, if an attempt fails and the job is resubmitted

the same job will appear in other places as other attempts.

Resources Results TOTAL
RAM (GB) time limit (hrs) SUCCESS USER ERROR FAILED TIMEOUT OVER_RLIMIT UNDISPATCHED ACTIVE CANCELLED
20.0 12.0 5934 118 9 2 3 4 8 0 6078
TOTAL 5934 118 9 2 3 4 8 0 6078

Number of Attempts For Each Job


Number of jobs in each stage since launch


Time Spent in Dependency


Time Spent in Pending


Number of Jobs in Each Stage


Duration of Each Stage


Wall Time, CPU Time, CPU Time vs Wall Time


MAX Memory reported by AUGER


Problem Jobs

Run File RAM (GB) Attempt Problem Resolution SWIF Job ID Auger Job ID Submit Time Complete Time
011059 143 20 1 / 3 AUGER-OVER_RLIMIT retry 7634804 42228537 2017-08-18 14:54:41.0 2017-08-18 20:33:26.0
011059 143 20 2 / 3 SWIF-USER-NON-ZERO retry 7634804 42515960 2017-08-25 09:40:38.0 2017-08-25 11:27:16.0
011060 036 20 1 / 2 SWIF-USER-NON-ZERO retry 7634970 42228713 2017-08-18 14:55:07.0 2017-08-18 21:45:52.0
011078 002 20 1 / 3 SWIF-USER-NON-ZERO retry 7635231 42228990 2017-08-18 14:55:50.0 2017-08-19 13:46:58.0
011078 002 20 2 / 3 SWIF-USER-NON-ZERO retry 7635231 42515962 2017-08-25 09:40:38.0 2017-08-25 11:46:30.0
011088 074 20 1 / 2 SWIF-USER-NON-ZERO retry 7635620 42229404 2017-08-18 14:56:54.0 2017-08-19 05:15:26.0
011104 139 20 1 / 2 SWIF-USER-NON-ZERO retry 7635861 42229669 2017-08-18 14:57:33.0 2017-08-20 05:06:36.0
011109 021 20 1 / 3 SWIF-USER-NON-ZERO retry 7636327 42230167 2017-08-18 14:58:55.0 2017-08-20 09:31:56.0
011109 021 20 2 / 3 SWIF-USER-NON-ZERO retry 7636327 42515965 2017-08-25 09:40:39.0 2017-08-25 10:45:07.0
011140 067 20 1 / 2 SWIF-USER-NON-ZERO retry 7636781 42230651 2017-08-18 15:00:11.0 2017-08-20 06:57:00.0
011141 008 20 1 / 2 SWIF-USER-NON-ZERO retry 7636893 42230771 2017-08-18 15:00:31.0 2017-08-19 16:21:43.0
011145 047 20 1 / 3 SWIF-USER-NON-ZERO retry 7637077 42230967 2017-08-18 15:01:01.0 2017-08-19 14:05:41.0
011145 047 20 2 / 3 SWIF-USER-NON-ZERO retry 7637077 42515968 2017-08-25 09:40:39.0 2017-08-25 10:12:31.0
011156 112 20 1 / 2 SWIF-USER-NON-ZERO retry 7637269 42231172 2017-08-18 15:01:33.0 2017-08-19 22:14:14.0
011157 153 20 1 / 3 SWIF-USER-NON-ZERO retry 7637571 42231498 2017-08-18 15:02:30.0 2017-08-20 09:28:25.0
011157 153 20 2 / 3 AUGER-OVER_RLIMIT retry 7637571 42515970 2017-08-25 09:40:39.0 2017-08-25 13:11:11.0
011160 025 20 1 / 2 SWIF-USER-NON-ZERO retry 7637808 42231751 2017-08-18 15:03:14.0 2017-08-19 23:17:05.0
011160 124 20 1 / 3 SWIF-USER-NON-ZERO retry 7637902 42231852 2017-08-18 15:03:31.0 2017-08-20 00:05:43.0
011160 124 20 2 / 3 SWIF-USER-NON-ZERO retry 7637902 42515972 2017-08-25 09:40:40.0 2017-08-25 10:01:49.0
011162 142 20 1 / 2 SWIF-USER-NON-ZERO retry 7638109 42232071 2017-08-18 15:04:05.0 2017-08-19 22:13:47.0
011217 067 20 1 / 2 SWIF-USER-NON-ZERO retry 7638318 42232308 2017-08-18 15:05:14.0 2017-08-19 22:59:35.0
011218 137 20 1 / 2 SWIF-USER-NON-ZERO retry 7638465 42232464 2017-08-18 15:05:37.0 2017-08-20 05:01:18.0
011219 049 20 1 / 2 SWIF-USER-NON-ZERO retry 7638577 42232582 2017-08-18 15:05:54.0 2017-08-20 16:26:27.0
011261 005 20 1 / 2 SWIF-USER-NON-ZERO retry 7638601 42232608 2017-08-18 15:05:58.0 2017-08-20 10:18:46.0
011263 074 20 1 / 3 SWIF-USER-NON-ZERO retry 7638749 42232766 2017-08-18 15:06:23.0 2017-08-19 01:07:27.0
011263 074 20 2 / 3 SWIF-USER-NON-ZERO retry 7638749 42515978 2017-08-25 09:40:41.0 2017-08-25 12:32:25.0
011264 166 20 1 / 3 SWIF-USER-NON-ZERO retry 7638962 42232994 2017-08-18 15:07:05.0 2017-08-20 16:08:48.0
011264 166 20 2 / 3 SWIF-USER-NON-ZERO retry 7638962 42515979 2017-08-25 09:40:41.0 2017-08-25 12:30:33.0
011264 139 20 1 / 2 SWIF-USER-NON-ZERO retry 7638981 42233015 2017-08-18 15:07:08.0 2017-08-21 03:11:16.0
011264 135 20 1 / 2 SWIF-USER-NON-ZERO retry 7638982 42233016 2017-08-18 15:07:09.0 2017-08-21 03:20:56.0
011265 128 20 1 / 2 AUGER-FAILED retry 7639042 42233080 2017-08-18 15:07:21.0 2017-08-20 10:48:20.0
011265 047 20 1 / 2 SWIF-USER-NON-ZERO retry 7639044 42233082 2017-08-18 15:07:21.0 2017-08-20 12:01:32.0
011265 066 20 1 / 2 AUGER-FAILED retry 7639081 42233122 2017-08-18 15:07:28.0 2017-08-20 10:48:20.0
011265 044 20 1 / 2 AUGER-FAILED retry 7639082 42233123 2017-08-18 15:07:29.0 2017-08-20 10:48:20.0
011265 121 20 1 / 2 SWIF-USER-NON-ZERO retry 7639121 42233166 2017-08-18 15:07:37.0 2017-08-21 00:39:55.0
011265 125 20 1 / 2 SWIF-USER-NON-ZERO retry 7639150 42233197 2017-08-18 15:07:41.0 2017-08-21 01:05:42.0
011266 016 20 1 / 2 SWIF-USER-NON-ZERO retry 7639175 42233224 2017-08-18 15:07:46.0 2017-08-21 01:18:09.0
011266 083 20 1 / 2 SWIF-USER-NON-ZERO retry 7639191 42233241 2017-08-18 15:07:48.0 2017-08-21 03:06:47.0
011266 031 20 1 / 2 SWIF-USER-NON-ZERO retry 7639193 42233243 2017-08-18 15:07:48.0 2017-08-21 03:07:38.0
011267 000 20 1 / 2 SWIF-USER-NON-ZERO retry 7639275 42233330 2017-08-18 15:08:01.0 2017-08-20 20:00:27.0
011267 059 20 1 / 2 SWIF-USER-NON-ZERO retry 7639291 42233347 2017-08-18 15:08:04.0 2017-08-20 22:41:45.0
011267 031 20 1 / 2 SWIF-USER-NON-ZERO retry 7639293 42233349 2017-08-18 15:08:04.0 2017-08-20 14:08:23.0
011267 149 20 1 / 2 SWIF-USER-NON-ZERO retry 7639314 42233371 2017-08-18 15:08:07.0 2017-08-21 03:39:38.0
011267 104 20 1 / 2 SWIF-USER-NON-ZERO retry 7639316 42233373 2017-08-18 15:08:07.0 2017-08-20 17:51:27.0
011267 099 20 1 / 2 SWIF-USER-NON-ZERO retry 7639346 42233405 2017-08-18 15:08:11.0 2017-08-21 03:43:16.0
011267 153 20 1 / 2 SWIF-USER-NON-ZERO retry 7639349 42233408 2017-08-18 15:08:12.0 2017-08-21 05:10:16.0
011270 014 20 1 / 2 SWIF-USER-NON-ZERO retry 7639478 42233545 2017-08-18 15:08:34.0 2017-08-20 03:03:53.0
011270 075 20 1 / 2 SWIF-USER-NON-ZERO retry 7639508 42233577 2017-08-18 15:08:39.0 2017-08-20 18:38:37.0
011270 041 20 1 / 2 SWIF-USER-NON-ZERO retry 7639510 42233579 2017-08-18 15:08:39.0 2017-08-20 18:44:00.0
011270 034 20 1 / 2 SWIF-USER-NON-ZERO retry 7639530 42233600 2017-08-18 15:08:43.0 2017-08-21 00:40:43.0
011270 029 20 1 / 2 SWIF-USER-NON-ZERO retry 7639536 42233607 2017-08-18 15:08:44.0 2017-08-21 00:44:15.0
011270 047 20 1 / 2 SWIF-USER-NON-ZERO retry 7639538 42233609 2017-08-18 15:08:44.0 2017-08-21 00:40:05.0
011270 085 20 1 / 2 SWIF-USER-NON-ZERO retry 7639545 42233616 2017-08-18 15:08:45.0 2017-08-21 01:10:26.0
011270 086 20 1 / 2 SWIF-USER-NON-ZERO retry 7639558 42233630 2017-08-18 15:08:47.0 2017-08-21 01:25:20.0
011270 113 20 1 / 2 SWIF-USER-NON-ZERO retry 7639571 42233644 2017-08-18 15:08:49.0 2017-08-21 02:09:57.0
011272 021 20 1 / 3 SWIF-USER-NON-ZERO retry 7639594 42233668 2017-08-18 15:08:53.0 2017-08-21 01:54:06.0
011272 021 20 2 / 3 SWIF-USER-NON-ZERO retry 7639594 42516007 2017-08-25 09:40:45.0 2017-08-25 11:51:16.0
011272 016 20 1 / 2 SWIF-USER-NON-ZERO retry 7639598 42233672 2017-08-18 15:08:54.0 2017-08-21 01:46:30.0
011272 034 20 1 / 2 SWIF-USER-NON-ZERO retry 7639610 42233685 2017-08-18 15:08:56.0 2017-08-21 04:43:14.0
011272 033 20 1 / 2 SWIF-USER-NON-ZERO retry 7639614 42233689 2017-08-18 15:08:57.0 2017-08-21 08:14:14.0
011272 046 20 1 / 2 AUGER-TIMEOUT retry 7639622 42233698 2017-08-18 15:08:58.0 2017-08-21 13:53:44.0
011273 022 20 1 / 2 SWIF-USER-NON-ZERO retry 7639647 42233724 2017-08-18 15:09:02.0 2017-08-21 05:05:41.0
011273 023 20 1 / 2 SWIF-USER-NON-ZERO retry 7639663 42233741 2017-08-18 15:09:04.0 2017-08-20 18:05:07.0
011273 041 20 1 / 2 SWIF-USER-NON-ZERO retry 7639675 42233754 2017-08-18 15:09:06.0 2017-08-21 04:51:47.0
011273 069 20 1 / 2 SWIF-USER-NON-ZERO retry 7639697 42233778 2017-08-18 15:09:11.0 2017-08-20 10:38:23.0
011273 081 20 1 / 2 SWIF-USER-NON-ZERO retry 7639699 42233780 2017-08-18 15:09:12.0 2017-08-21 07:14:45.0
011275 034 20 1 / 2 SWIF-SYSTEM-ERROR retry 7639738 42233822 2017-08-18 15:09:18.0 2017-08-20 10:14:39.0
011276 014 20 1 / 2 SWIF-USER-NON-ZERO retry 7639766 42233852 2017-08-18 15:09:23.0 2017-08-21 08:18:38.0
011276 026 20 1 / 2 AUGER-OVER_RLIMIT retry 7639775 42233861 2017-08-18 15:09:24.0 2017-08-20 14:45:53.0
011276 000 20 1 / 2 SWIF-USER-NON-ZERO retry 7639780 42233867 2017-08-18 15:09:25.0 2017-08-21 01:13:19.0
011276 039 20 1 / 2 SWIF-USER-NON-ZERO retry 7639785 42233872 2017-08-18 15:09:26.0 2017-08-21 01:40:30.0
011276 001 20 1 / 2 SWIF-USER-NON-ZERO retry 7639789 42233876 2017-08-18 15:09:27.0 2017-08-21 01:10:41.0
011276 015 20 1 / 3 SWIF-USER-NON-ZERO retry 7639791 42233878 2017-08-18 15:09:27.0 2017-08-21 01:04:18.0
011276 015 20 2 / 3 SWIF-USER-NON-ZERO retry 7639791 42516023 2017-08-25 09:40:48.0 2017-08-25 12:38:34.0
011276 022 20 1 / 2 AUGER-TIMEOUT retry 7639792 42233879 2017-08-18 15:09:27.0 2017-08-21 10:54:01.0
011276 004 20 1 / 2 SWIF-USER-NON-ZERO retry 7639795 42233883 2017-08-18 15:09:28.0 2017-08-21 01:13:07.0
011276 042 20 1 / 2 SWIF-USER-NON-ZERO retry 7639797 42233885 2017-08-18 15:09:28.0 2017-08-21 01:05:15.0
011276 019 20 1 / 2 SWIF-USER-NON-ZERO retry 7639799 42233887 2017-08-18 15:09:28.0 2017-08-21 01:17:07.0
011276 006 20 1 / 2 SWIF-USER-NON-ZERO retry 7639800 42233888 2017-08-18 15:09:28.0 2017-08-21 00:39:54.0
011276 053 20 1 / 2 SWIF-USER-NON-ZERO retry 7639815 42233904 2017-08-18 15:09:31.0 2017-08-21 03:50:36.0
011276 119 20 1 / 2 SWIF-USER-NON-ZERO retry 7639817 42233906 2017-08-18 15:09:31.0 2017-08-21 04:25:40.0
011276 067 20 1 / 2 SWIF-USER-NON-ZERO retry 7639830 42233920 2017-08-18 15:09:33.0 2017-08-21 06:28:02.0
011276 072 20 1 / 2 SWIF-USER-NON-ZERO retry 7639836 42233926 2017-08-18 15:09:34.0 2017-08-21 07:29:57.0
011276 079 20 1 / 2 SWIF-USER-NON-ZERO retry 7639847 42233938 2017-08-18 15:09:36.0 2017-08-21 07:32:09.0
011276 099 20 1 / 2 SWIF-USER-NON-ZERO retry 7639851 42233942 2017-08-18 15:09:37.0 2017-08-21 06:18:08.0
011276 076 20 1 / 2 SWIF-USER-NON-ZERO retry 7639854 42233945 2017-08-18 15:09:38.0 2017-08-21 06:27:37.0
011277 043 20 1 / 2 SWIF-USER-NON-ZERO retry 7639921 42234017 2017-08-18 15:09:51.0 2017-08-21 07:11:56.0
011277 087 20 1 / 2 SWIF-USER-NON-ZERO retry 7639932 42234029 2017-08-18 15:09:53.0 2017-08-21 07:11:52.0
011277 011 20 1 / 2 SWIF-USER-NON-ZERO retry 7639957 42234056 2017-08-18 15:09:58.0 2017-08-21 08:22:02.0
011277 062 20 1 / 2 SWIF-USER-NON-ZERO retry 7639979 42234080 2017-08-18 15:10:02.0 2017-08-21 08:34:36.0
011277 090 20 1 / 2 SWIF-USER-NON-ZERO retry 7639992 42234094 2017-08-18 15:10:05.0 2017-08-21 08:35:55.0
011277 010 20 1 / 2 SWIF-USER-NON-ZERO retry 7639995 42234097 2017-08-18 15:10:05.0 2017-08-21 08:24:51.0
011277 118 20 1 / 2 SWIF-USER-NON-ZERO retry 7640012 42234115 2017-08-18 15:10:08.0 2017-08-21 08:41:28.0
011277 109 20 1 / 2 SWIF-USER-NON-ZERO retry 7640017 42234121 2017-08-18 15:10:09.0 2017-08-21 10:12:04.0
011277 108 20 1 / 2 SWIF-USER-NON-ZERO retry 7640069 42234176 2017-08-18 15:10:17.0 2017-08-21 08:59:10.0
011295 000 20 1 / 2 SWIF-USER-NON-ZERO retry 7640079 42234186 2017-08-18 15:10:19.0 2017-08-21 09:04:07.0
011295 017 20 1 / 3 SWIF-USER-NON-ZERO retry 7640094 42234202 2017-08-18 15:10:21.0 2017-08-21 09:06:37.0
011295 017 20 2 / 3 SWIF-USER-NON-ZERO retry 7640094 42516046 2017-08-25 09:40:52.0 2017-08-25 12:26:09.0
011295 051 20 1 / 2 SWIF-USER-NON-ZERO retry 7640111 42234220 2017-08-18 15:10:24.0 2017-08-21 09:41:28.0
011300 008 20 1 / 2 SWIF-USER-NON-ZERO retry 7640164 42234276 2017-08-18 15:10:32.0 2017-08-21 13:43:26.0
011300 122 20 1 / 2 SWIF-USER-NON-ZERO retry 7640212 42234328 2017-08-18 15:10:41.0 2017-08-21 00:44:30.0
011300 096 20 1 / 2 SWIF-USER-NON-ZERO retry 7640234 42234351 2017-08-18 15:10:44.0 2017-08-21 01:31:58.0
011300 103 20 1 / 2 SWIF-USER-NON-ZERO retry 7640242 42234359 2017-08-18 15:10:45.0 2017-08-21 01:08:57.0
011300 087 20 1 / 2 SWIF-USER-NON-ZERO retry 7640255 42234373 2017-08-18 15:10:46.0 2017-08-21 04:10:20.0
011300 085 20 1 / 2 SWIF-USER-NON-ZERO retry 7640265 42234384 2017-08-18 15:10:48.0 2017-08-21 21:28:53.0
011300 088 20 1 / 2 SWIF-USER-NON-ZERO retry 7640277 42234396 2017-08-18 15:10:50.0 2017-08-21 22:26:58.0
011300 141 20 1 / 2 SWIF-USER-NON-ZERO retry 7640298 42234419 2017-08-18 15:10:53.0 2017-08-21 23:19:16.0
011300 166 20 1 / 2 SWIF-USER-NON-ZERO retry 7640344 42234467 2017-08-18 15:11:00.0 2017-08-21 10:11:58.0
011300 138 20 1 / 2 SWIF-USER-NON-ZERO retry 7640351 42234475 2017-08-18 15:11:02.0 2017-08-22 07:16:41.0
011300 207 20 1 / 2 SWIF-USER-NON-ZERO retry 7640366 42234491 2017-08-18 15:11:04.0 2017-08-21 01:28:41.0
011301 091 20 1 / 2 SWIF-USER-NON-ZERO retry 7640400 42234527 2017-08-18 15:11:10.0 2017-08-21 10:03:49.0
011301 050 20 1 / 2 SWIF-USER-NON-ZERO retry 7640407 42234534 2017-08-18 15:11:11.0 2017-08-21 07:28:03.0
011301 061 20 1 / 2 SWIF-USER-NON-ZERO retry 7640428 42234557 2017-08-18 15:11:15.0 2017-08-21 15:02:15.0
011301 063 20 1 / 2 SWIF-USER-NON-ZERO retry 7640468 42234600 2017-08-18 15:11:23.0 2017-08-21 14:17:40.0
011301 111 20 1 / 2 SWIF-USER-NON-ZERO retry 7640482 42234615 2017-08-18 15:11:25.0 2017-08-21 16:47:53.0
011301 185 20 1 / 2 AUGER-FAILED retry 7640517 42234652 2017-08-18 15:11:30.0 2017-08-21 09:37:12.0
011301 146 20 1 / 2 AUGER-FAILED retry 7640518 42234653 2017-08-18 15:11:30.0 2017-08-21 09:37:13.0
011301 141 20 1 / 2 AUGER-FAILED retry 7640519 42234654 2017-08-18 15:11:30.0 2017-08-21 09:37:13.0
011301 209 20 1 / 2 AUGER-FAILED retry 7640520 42234655 2017-08-18 15:11:30.0 2017-08-21 09:39:23.0
011301 189 20 1 / 2 AUGER-FAILED retry 7640521 42234656 2017-08-18 15:11:30.0 2017-08-21 09:39:24.0
011301 210 20 1 / 2 AUGER-FAILED retry 7640522 42234657 2017-08-18 15:11:30.0 2017-08-21 09:39:24.0
011301 157 20 1 / 2 SWIF-USER-NON-ZERO retry 7640524 42234659 2017-08-18 15:11:31.0 2017-08-21 20:47:39.0
011301 188 20 1 / 2 SWIF-USER-NON-ZERO retry 7640525 42234660 2017-08-18 15:11:31.0 2017-08-21 19:42:39.0
011301 170 20 1 / 2 SWIF-USER-NON-ZERO retry 7640539 42234675 2017-08-18 15:11:33.0 2017-08-21 19:39:34.0
011301 214 20 1 / 2 SWIF-USER-NON-ZERO retry 7640562 42234699 2017-08-18 15:11:36.0 2017-08-21 20:11:53.0
011301 194 20 1 / 2 SWIF-USER-NON-ZERO retry 7640573 42234710 2017-08-18 15:11:37.0 2017-08-21 21:24:56.0
011301 155 20 1 / 2 SWIF-USER-NON-ZERO retry 7640575 42234713 2017-08-18 15:11:37.0 2017-08-21 21:26:31.0
011302 013 20 1 / 2 SWIF-USER-NON-ZERO retry 7640588 42234726 2017-08-18 15:11:39.0 2017-08-21 22:50:43.0
011302 019 20 1 / 2 SWIF-USER-NON-ZERO retry 7640590 42234728 2017-08-18 15:11:39.0 2017-08-21 23:06:17.0
011302 014 20 1 / 2 SWIF-USER-NON-ZERO retry 7640600 42234739 2017-08-18 15:11:41.0 2017-08-22 00:14:04.0
011302 015 20 1 / 2 SWIF-USER-NON-ZERO retry 7640602 42234741 2017-08-18 15:11:41.0 2017-08-22 00:03:00.0
011302 018 20 1 / 3 SWIF-USER-NON-ZERO retry 7640603 42234742 2017-08-18 15:11:41.0 2017-08-21 23:56:14.0
011302 018 20 2 / 3 SWIF-USER-NON-ZERO retry 7640603 42516080 2017-08-25 09:40:57.0 2017-08-25 12:40:16.0