recon_2017-01_ver03_batch02
Click on each figure to show larger version
Status
Info retrieved: 2018-09-10 09:18:08.0
Job Limit: 0 Total attempts: 19374
Status from SWIF Summary
Numbers are for individual registered jobs, final status.
| Undispatched |
Dispatched |
Succeeded |
Failed |
Problems |
Canceled |
Total |
| 0 |
0 |
19281 |
0 |
0 |
0 |
19281 |
Auger Status
| Dependency |
Pending |
Staging In |
Active |
Staging Out |
Finishing |
Dispatched Total |
| 0 |
0 |
0 |
0 |
0 |
0 |
0 |
Status by Resources
Counts are for each attempt of running a job, if an attempt fails and the job is resubmitted
the same job will appear in other places as other attempts.
| Resources |
Results |
TOTAL |
| RAM (GB) |
time limit (hrs) |
SUCCESS |
USER ERROR |
FAILED |
TIMEOUT |
OVER_RLIMIT |
UNDISPATCHED |
ACTIVE |
CANCELLED |
| 12.0 |
24.0 |
19292 |
23 |
52 |
5 |
0 |
0 |
0 |
0 |
19372 |
| 12.0 |
30.0 |
2 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
2 |
| TOTAL |
19294 |
23 |
52 |
5 |
0 |
0 |
0 |
0 |
19374 |
Number of Attempts For Each Job
Number of jobs in each stage since launch
Time Spent in Dependency
Time Spent in Pending
Number of Jobs in Each Stage
Duration of Each Stage
Wall Time, CPU Time, CPU Time vs Wall Time
MAX Memory reported by AUGER
Problem Jobs
| Run |
File |
RAM (GB) |
Attempt |
Problem |
Resolution |
SWIF Job ID |
Auger Job ID |
Submit Time |
Complete Time |
| 030281 |
019 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14072875 |
56377352 |
2018-08-09 16:35:47.0 |
2018-08-17 13:00:29.0 |
| 030344 |
050 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14074654 |
56379294 |
2018-08-09 16:38:01.0 |
2018-08-14 21:09:36.0 |
| 030344 |
004 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14074666 |
56379306 |
2018-08-09 16:38:02.0 |
2018-08-22 10:45:30.0 |
| 030344 |
120 |
12 |
1 / 2 |
USER-RESURRECT |
retry |
14074668 |
56379308 |
2018-08-09 16:38:02.0 |
2018-08-22 19:27:46.0 |
| 030344 |
051 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14074671 |
56379311 |
2018-08-09 16:38:02.0 |
2018-08-14 20:57:33.0 |
| 030346 |
120 |
12 |
1 / 2 |
AUGER-TIMEOUT |
modify |
14074912 |
56379596 |
2018-08-09 16:38:37.0 |
2018-08-25 16:58:28.0 |
| 030346 |
065 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14074935 |
56379619 |
2018-08-09 16:38:39.0 |
2018-08-24 17:11:49.0 |
| 030346 |
027 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14074939 |
56379626 |
2018-08-09 16:38:39.0 |
2018-08-24 17:15:37.0 |
| 030346 |
043 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14074941 |
56379628 |
2018-08-09 16:38:39.0 |
2018-08-24 17:15:37.0 |
| 030346 |
047 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14074943 |
56379630 |
2018-08-09 16:38:39.0 |
2018-08-24 17:19:15.0 |
| 030346 |
016 |
12 |
1 / 2 |
AUGER-TIMEOUT |
modify |
14074952 |
56379639 |
2018-08-09 16:38:40.0 |
2018-08-25 17:17:58.0 |
| 030346 |
091 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14074963 |
56379650 |
2018-08-09 16:38:41.0 |
2018-08-24 17:29:03.0 |
| 030346 |
031 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14074965 |
56379652 |
2018-08-09 16:38:41.0 |
2018-08-24 17:29:03.0 |
| 030346 |
103 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14074971 |
56379658 |
2018-08-09 16:38:41.0 |
2018-08-24 17:32:45.0 |
| 030346 |
071 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14074973 |
56379661 |
2018-08-09 16:38:42.0 |
2018-08-24 17:32:45.0 |
| 030349 |
120 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14075272 |
56379984 |
2018-08-09 16:39:04.0 |
2018-08-24 00:34:33.0 |
| 030349 |
033 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14075275 |
56379987 |
2018-08-09 16:39:05.0 |
2018-08-24 00:34:33.0 |
| 030349 |
081 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14075277 |
56379989 |
2018-08-09 16:39:05.0 |
2018-08-24 00:34:33.0 |
| 030349 |
121 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14075296 |
56380011 |
2018-08-09 16:39:06.0 |
2018-08-24 00:34:33.0 |
| 030349 |
080 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14075320 |
56380035 |
2018-08-09 16:39:08.0 |
2018-08-24 00:34:33.0 |
| 030350 |
130 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14075467 |
56380196 |
2018-08-09 16:39:18.0 |
2018-08-13 08:20:12.0 |
| 030351 |
033 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14075505 |
56380237 |
2018-08-09 16:39:20.0 |
2018-08-13 18:25:11.0 |
| 030361 |
053 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14075831 |
56380592 |
2018-08-09 16:39:45.0 |
2018-08-13 18:33:27.0 |
| 030401 |
003 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14076512 |
56381313 |
2018-08-09 16:40:35.0 |
2018-08-24 09:55:35.0 |
| 030401 |
010 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14076514 |
56381315 |
2018-08-09 16:40:35.0 |
2018-08-24 09:55:35.0 |
| 030402 |
066 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14076546 |
56381351 |
2018-08-09 16:40:37.0 |
2018-08-24 16:03:57.0 |
| 030402 |
102 |
12 |
1 / 2 |
AUGER-TIMEOUT |
retry |
14076590 |
56381401 |
2018-08-09 16:40:40.0 |
2018-08-16 10:00:59.0 |
| 030403 |
004 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14076639 |
56381455 |
2018-08-09 16:40:44.0 |
2018-08-15 11:48:36.0 |
| 030405 |
074 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14076815 |
56381657 |
2018-08-09 16:41:00.0 |
2018-08-15 11:48:37.0 |
| 030405 |
068 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14076884 |
56381735 |
2018-08-09 16:41:05.0 |
2018-08-15 11:48:31.0 |
| 030405 |
096 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14076886 |
56381738 |
2018-08-09 16:41:05.0 |
2018-08-15 11:48:31.0 |
| 030408 |
106 |
12 |
1 / 2 |
AUGER-TIMEOUT |
retry |
14077025 |
56381893 |
2018-08-09 16:41:16.0 |
2018-08-23 09:01:38.0 |
| 030429 |
061 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14077667 |
56382650 |
2018-08-09 16:42:26.0 |
2018-08-20 17:40:46.0 |
| 030433 |
111 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14077834 |
56382842 |
2018-08-09 16:42:41.0 |
2018-08-13 09:18:25.0 |
| 030448 |
058 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14078520 |
56383600 |
2018-08-09 16:43:33.0 |
2018-08-16 21:40:36.0 |
| 030449 |
012 |
12 |
1 / 2 |
AUGER-TIMEOUT |
retry |
14078657 |
56383747 |
2018-08-09 16:43:44.0 |
2018-08-21 05:58:10.0 |
| 030450 |
120 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14078747 |
56383842 |
2018-08-09 16:43:50.0 |
2018-08-20 07:43:52.0 |
| 030450 |
018 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14078839 |
56383941 |
2018-08-09 16:44:00.0 |
2018-08-20 21:05:12.0 |
| 030454 |
017 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14079102 |
56384219 |
2018-08-09 16:44:18.0 |
2018-08-23 13:54:30.0 |
| 030460 |
015 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14079408 |
56384545 |
2018-08-09 16:44:42.0 |
2018-08-24 00:34:33.0 |
| 030460 |
013 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14079410 |
56384547 |
2018-08-09 16:44:42.0 |
2018-08-24 00:34:33.0 |
| 030460 |
075 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14079412 |
56384549 |
2018-08-09 16:44:42.0 |
2018-08-24 00:34:33.0 |
| 030460 |
050 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14079414 |
56384551 |
2018-08-09 16:44:42.0 |
2018-08-24 00:34:33.0 |
| 030460 |
103 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14079440 |
56384577 |
2018-08-09 16:44:44.0 |
2018-08-24 00:34:33.0 |
| 030460 |
067 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14079442 |
56384580 |
2018-08-09 16:44:44.0 |
2018-08-24 00:34:33.0 |
| 030460 |
020 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14079444 |
56384583 |
2018-08-09 16:44:44.0 |
2018-08-24 00:34:33.0 |
| 030470 |
016 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14080407 |
56385621 |
2018-08-09 16:46:19.0 |
2018-08-24 00:34:33.0 |
| 030470 |
012 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14080409 |
56385624 |
2018-08-09 16:46:19.0 |
2018-08-24 00:34:34.0 |
| 030484 |
068 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14081110 |
56386365 |
2018-08-09 16:47:10.0 |
2018-08-21 15:47:10.0 |
| 030485 |
045 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14081238 |
56386502 |
2018-08-09 16:47:18.0 |
2018-08-22 20:37:33.0 |
| 030485 |
020 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14081331 |
56386608 |
2018-08-09 16:47:28.0 |
2018-08-14 07:37:15.0 |
| 030488 |
112 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14081731 |
56387043 |
2018-08-09 16:47:56.0 |
2018-08-16 13:01:37.0 |
| 030568 |
011 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14082612 |
56388037 |
2018-08-09 16:49:29.0 |
2018-08-16 00:11:42.0 |
| 030571 |
089 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14082887 |
56388342 |
2018-08-09 16:49:53.0 |
2018-08-10 16:37:15.0 |
| 030571 |
013 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14082889 |
56388344 |
2018-08-09 16:49:53.0 |
2018-08-10 16:37:15.0 |
| 030580 |
103 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14083409 |
56388883 |
2018-08-09 16:50:30.0 |
2018-08-10 20:05:26.0 |
| 030586 |
089 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14083871 |
56389187 |
2018-08-09 16:50:49.0 |
2018-08-21 18:38:58.0 |
| 030590 |
013 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14084215 |
56389475 |
2018-08-09 16:51:08.0 |
2018-08-24 00:54:35.0 |
| 030590 |
011 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14084219 |
56389477 |
2018-08-09 16:51:08.0 |
2018-08-24 00:54:35.0 |
| 030612 |
015 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14085382 |
56390766 |
2018-08-09 16:52:53.0 |
2018-08-23 04:37:23.0 |
| 030618 |
023 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14085950 |
56391150 |
2018-08-09 16:53:20.0 |
2018-08-18 06:42:45.0 |
| 030622 |
024 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14086359 |
56391443 |
2018-08-09 16:53:40.0 |
2018-08-24 06:37:16.0 |
| 030622 |
059 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14086369 |
56391454 |
2018-08-09 16:53:40.0 |
2018-08-24 06:57:29.0 |
| 030623 |
077 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14086608 |
56391614 |
2018-08-09 16:53:54.0 |
2018-08-24 18:28:40.0 |
| 030623 |
045 |
12 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
14086650 |
56391636 |
2018-08-09 16:53:55.0 |
2018-08-15 06:05:21.0 |
| 030624 |
074 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14086826 |
56391725 |
2018-08-09 16:54:01.0 |
2018-08-18 07:41:56.0 |
| 030624 |
072 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14086888 |
56391758 |
2018-08-09 16:54:03.0 |
2018-08-18 10:13:16.0 |
| 030625 |
033 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14087006 |
56391819 |
2018-08-09 16:54:07.0 |
2018-08-23 20:48:08.0 |
| 030626 |
024 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14087146 |
56391895 |
2018-08-09 16:54:12.0 |
2018-08-23 21:25:48.0 |
| 030626 |
057 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14087156 |
56391900 |
2018-08-09 16:54:12.0 |
2018-08-19 16:12:32.0 |
| 030627 |
034 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14087308 |
56392012 |
2018-08-09 16:54:19.0 |
2018-08-14 14:18:00.0 |
| 030636 |
014 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14088132 |
56392707 |
2018-08-09 16:55:08.0 |
2018-08-21 15:47:10.0 |
| 030651 |
009 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14089563 |
56393610 |
2018-08-09 16:56:27.0 |
2018-08-10 16:37:15.0 |
| 030667 |
051 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14091559 |
56395268 |
2018-08-09 16:58:24.0 |
2018-08-24 17:11:49.0 |
| 030668 |
122 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14091565 |
56395274 |
2018-08-09 16:58:24.0 |
2018-08-24 17:19:15.0 |
| 030668 |
018 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14091586 |
56395298 |
2018-08-09 16:58:27.0 |
2018-08-24 17:22:36.0 |
| 030668 |
070 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14091588 |
56395300 |
2018-08-09 16:58:27.0 |
2018-08-24 17:22:36.0 |
| 030668 |
034 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14091590 |
56395302 |
2018-08-09 16:58:27.0 |
2018-08-24 17:26:19.0 |
| 030668 |
117 |
12 |
1 / 2 |
AUGER-OUTPUT-FAIL |
retry |
14091592 |
56395304 |
2018-08-09 16:58:27.0 |
2018-08-24 17:26:19.0 |
| 030668 |
103 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14091595 |
56395307 |
2018-08-09 16:58:27.0 |
2018-08-24 17:30:14.0 |
| 030668 |
067 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14091597 |
56395309 |
2018-08-09 16:58:28.0 |
2018-08-24 17:30:58.0 |
| 030668 |
003 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14091601 |
56395313 |
2018-08-09 16:58:28.0 |
2018-08-24 17:30:14.0 |
| 030676 |
085 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14092239 |
56395913 |
2018-08-09 16:59:07.0 |
2018-08-18 15:19:18.0 |
| 030680 |
017 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14092682 |
56396446 |
2018-08-09 17:00:03.0 |
2018-08-24 00:14:31.0 |
| 030684 |
027 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14092908 |
56396689 |
2018-08-09 17:00:25.0 |
2018-08-24 00:14:31.0 |
| 030684 |
050 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14092942 |
56396709 |
2018-08-09 17:00:27.0 |
2018-08-24 00:14:31.0 |
| 030684 |
121 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14092966 |
56396723 |
2018-08-09 17:00:28.0 |
2018-08-24 00:14:31.0 |
| 030688 |
079 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14093195 |
56396970 |
2018-08-09 17:00:47.0 |
2018-08-24 00:54:35.0 |
| 030688 |
031 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14093203 |
56396980 |
2018-08-09 17:00:49.0 |
2018-08-24 00:54:35.0 |
| 030690 |
064 |
12 |
1 / 2 |
SWIF-USER-NON-ZERO |
retry |
14093361 |
56397154 |
2018-08-09 17:01:04.0 |
2018-08-10 17:57:02.0 |
| 030699 |
086 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14104123 |
56397876 |
2018-08-09 17:01:58.0 |
2018-08-24 09:55:35.0 |
| 030699 |
003 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14104130 |
56397884 |
2018-08-09 17:01:59.0 |
2018-08-24 09:55:35.0 |
| 030699 |
085 |
12 |
1 / 2 |
AUGER-FAILED |
retry |
14104134 |
56397889 |
2018-08-09 17:01:59.0 |
2018-08-24 09:55:35.0 |