offline_monitoring_RunPeriod2015_03_ver10_hd_rawdata
Click on each figure to show larger version
Status
Info retrieved: 2015-10-07 11:10:58.0
Job Limit: 4715 Total attempts: 4404
Status from SWIF Summary
Numbers are for individual registered jobs, final status.
Undispatched |
Dispatched |
Succeeded |
Failed |
Problems |
Canceled |
Total |
0 |
0 |
4313 |
1 |
0 |
0 |
4314 |
Auger Status
Dependency |
Pending |
Staging In |
Active |
Staging Out |
Finishing |
Dispatched Total |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
Status by Resources
Counts are for each attempt of running a job, if an attempt fails and the job is resubmitted
the same job will appear in other places as other attempts.
Resources |
Results |
TOTAL |
RAM (GB) |
time limit (hrs) |
SUCCESS |
USER ERROR |
FAILED |
TIMEOUT |
OVER_RLIMIT |
UNDISPATCHED |
ACTIVE |
CANCELLED |
5.0 |
8.0 |
4228 |
0 |
0 |
0 |
87 |
0 |
0 |
0 |
4315 |
7.0 |
8.0 |
85 |
0 |
0 |
0 |
2 |
0 |
0 |
0 |
87 |
9.0 |
8.0 |
2 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
2 |
TOTAL |
4315 |
0 |
0 |
0 |
89 |
0 |
0 |
0 |
4404 |
Number of Attempts For Each Job
Number of jobs reaching each stage since launch
Time Spent in Dependency
Time Spent in Pending
Duration of Each Stage
Total Job Time in Order of Auger ID
Total Job Time in Order of Total Time
Wall Time, CPU Time vs Wall Time
MAX Memory reported by AUGER
Problem Jobs
Run |
File |
RAM (GB) |
Attempt |
Problem |
Resolution |
SWIF Job ID |
Auger Job ID |
Submit Time |
Complete Time |
002712 |
032 |
5 |
1 / 1 |
SWIF-SYSTEM-ERROR |
abandon |
263585 |
14832446 |
2015-07-27 11:35:28.0 |
2015-07-27 15:10:53.0 |
002791 |
050 |
5 |
1 / 2 |
SWIF-SYSTEM-ERROR |
retry |
263957 |
14881833 |
2015-07-28 10:25:34.0 |
2015-07-28 13:32:25.0 |
002928 |
000 |
5 |
1 / 3 |
AUGER-OVER_RLIMIT |
modify |
265159 |
14767132 |
2015-07-24 22:34:15.0 |
2015-07-25 04:49:56.0 |
002928 |
000 |
7 |
2 / 3 |
AUGER-OVER_RLIMIT |
modify |
265159 |
14767663 |
2015-07-25 07:41:39.0 |
2015-07-25 08:57:00.0 |
003025 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265400 |
14818377 |
2015-07-26 23:52:07.0 |
2015-07-27 01:56:04.0 |
003026 |
000 |
5 |
1 / 3 |
AUGER-OVER_RLIMIT |
modify |
265401 |
14791690 |
2015-07-26 08:44:42.0 |
2015-07-26 11:20:32.0 |
003026 |
000 |
7 |
2 / 3 |
AUGER-OVER_RLIMIT |
modify |
265401 |
14832604 |
2015-07-27 11:35:55.0 |
2015-07-27 13:27:25.0 |
003027 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265402 |
14818378 |
2015-07-26 23:52:07.0 |
2015-07-27 01:54:56.0 |
003028 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265403 |
14818379 |
2015-07-26 23:52:07.0 |
2015-07-27 01:54:23.0 |
003029 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265404 |
14818380 |
2015-07-26 23:52:08.0 |
2015-07-27 01:55:49.0 |
003030 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265405 |
14818381 |
2015-07-26 23:52:08.0 |
2015-07-27 01:56:01.0 |
003031 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265406 |
14818382 |
2015-07-26 23:52:08.0 |
2015-07-27 01:57:03.0 |
003036 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265411 |
14791695 |
2015-07-26 08:44:43.0 |
2015-07-26 11:22:34.0 |
003079 |
096 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265571 |
14875930 |
2015-07-28 06:09:44.0 |
2015-07-28 07:01:07.0 |
003147 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265831 |
14767208 |
2015-07-24 22:34:31.0 |
2015-07-25 02:52:20.0 |
003152 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265836 |
14767213 |
2015-07-24 22:34:32.0 |
2015-07-25 04:16:39.0 |
003178 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265908 |
14785769 |
2015-07-26 03:28:33.0 |
2015-07-26 07:22:25.0 |
003179 |
003 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265910 |
14785770 |
2015-07-26 03:28:33.0 |
2015-07-26 06:52:43.0 |
003179 |
002 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265912 |
14791723 |
2015-07-26 08:44:50.0 |
2015-07-26 10:08:23.0 |
003179 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265913 |
14785772 |
2015-07-26 03:28:33.0 |
2015-07-26 06:16:54.0 |
003179 |
009 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265914 |
14785773 |
2015-07-26 03:28:34.0 |
2015-07-26 06:12:47.0 |
003179 |
012 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265916 |
14785774 |
2015-07-26 03:28:34.0 |
2015-07-26 06:45:09.0 |
003179 |
011 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265917 |
14791725 |
2015-07-26 08:44:51.0 |
2015-07-26 10:06:21.0 |
003179 |
005 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265920 |
14785775 |
2015-07-26 03:28:34.0 |
2015-07-26 05:59:11.0 |
003179 |
023 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265930 |
14791727 |
2015-07-26 08:44:51.0 |
2015-07-26 10:08:53.0 |
003179 |
022 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265931 |
14785783 |
2015-07-26 03:28:35.0 |
2015-07-26 06:20:54.0 |
003180 |
007 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265935 |
14772024 |
2015-07-25 16:50:50.0 |
2015-07-25 18:35:44.0 |
003180 |
005 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265941 |
14785785 |
2015-07-26 03:28:36.0 |
2015-07-26 06:09:35.0 |
003180 |
011 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265942 |
14791731 |
2015-07-26 08:44:52.0 |
2015-07-26 10:25:27.0 |
003180 |
003 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265946 |
14785788 |
2015-07-26 03:28:36.0 |
2015-07-26 07:18:18.0 |
003180 |
019 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265948 |
14785790 |
2015-07-26 03:28:37.0 |
2015-07-26 06:25:42.0 |
003180 |
020 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265953 |
14802081 |
2015-07-26 19:45:07.0 |
2015-07-26 19:57:40.0 |
003180 |
018 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265955 |
14796926 |
2015-07-26 15:37:37.0 |
2015-07-26 17:25:39.0 |
003180 |
021 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265958 |
14802083 |
2015-07-26 19:45:08.0 |
2015-07-26 20:34:07.0 |
003180 |
026 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265961 |
14802085 |
2015-07-26 19:45:08.0 |
2015-07-26 21:19:51.0 |
003180 |
028 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265963 |
14796929 |
2015-07-26 15:37:38.0 |
2015-07-26 16:46:47.0 |
003180 |
029 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265965 |
14802087 |
2015-07-26 19:45:09.0 |
2015-07-26 21:03:35.0 |
003180 |
032 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265967 |
14791735 |
2015-07-26 08:44:53.0 |
2015-07-26 09:50:01.0 |
003180 |
033 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265968 |
14791736 |
2015-07-26 08:44:53.0 |
2015-07-26 10:27:38.0 |
003180 |
037 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265970 |
14772027 |
2015-07-25 16:50:51.0 |
2015-07-25 18:40:26.0 |
003180 |
036 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265972 |
14796931 |
2015-07-26 15:37:38.0 |
2015-07-26 15:59:25.0 |
003180 |
043 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265978 |
14778070 |
2015-07-25 21:59:55.0 |
2015-07-26 00:07:38.0 |
003180 |
045 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265979 |
14778071 |
2015-07-25 21:59:56.0 |
2015-07-26 00:43:14.0 |
003180 |
047 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265982 |
14778072 |
2015-07-25 21:59:56.0 |
2015-07-25 23:59:41.0 |
003180 |
048 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265983 |
14767936 |
2015-07-25 13:08:34.0 |
2015-07-25 15:23:52.0 |
003180 |
051 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265986 |
14767937 |
2015-07-25 13:08:34.0 |
2015-07-25 14:53:59.0 |
003180 |
057 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265992 |
14778073 |
2015-07-25 21:59:56.0 |
2015-07-25 23:29:56.0 |
003180 |
055 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265993 |
14791737 |
2015-07-26 08:44:53.0 |
2015-07-26 10:10:37.0 |
003180 |
054 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265994 |
14778074 |
2015-07-25 21:59:56.0 |
2015-07-25 23:36:41.0 |
003180 |
060 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265995 |
14802089 |
2015-07-26 19:45:09.0 |
2015-07-26 20:26:19.0 |
003180 |
062 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265996 |
14785793 |
2015-07-26 03:28:37.0 |
2015-07-26 07:01:42.0 |
003180 |
064 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265998 |
14791738 |
2015-07-26 08:44:53.0 |
2015-07-26 10:37:47.0 |
003180 |
065 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
265999 |
14796933 |
2015-07-26 15:37:38.0 |
2015-07-26 16:28:51.0 |
003180 |
063 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266000 |
14785795 |
2015-07-26 03:28:37.0 |
2015-07-26 07:26:16.0 |
003180 |
068 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266001 |
14785796 |
2015-07-26 03:28:38.0 |
2015-07-26 07:08:24.0 |
003180 |
069 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266002 |
14772034 |
2015-07-25 16:50:52.0 |
2015-07-25 18:20:21.0 |
003180 |
066 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266004 |
14796934 |
2015-07-26 15:37:38.0 |
2015-07-26 17:16:07.0 |
003182 |
003 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266009 |
14778075 |
2015-07-25 21:59:56.0 |
2015-07-25 23:07:16.0 |
003185 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266040 |
14778080 |
2015-07-25 21:59:57.0 |
2015-07-25 23:50:49.0 |
003185 |
002 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266042 |
14778081 |
2015-07-25 21:59:58.0 |
2015-07-25 23:45:16.0 |
003185 |
004 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266044 |
14785800 |
2015-07-26 03:28:38.0 |
2015-07-26 06:39:18.0 |
003185 |
006 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266045 |
14796935 |
2015-07-26 15:37:39.0 |
2015-07-26 17:23:03.0 |
003185 |
003 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266046 |
14802092 |
2015-07-26 19:45:10.0 |
2015-07-26 21:07:16.0 |
003185 |
009 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266048 |
14785802 |
2015-07-26 03:28:39.0 |
2015-07-26 06:20:51.0 |
003185 |
008 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266049 |
14785803 |
2015-07-26 03:28:39.0 |
2015-07-26 07:14:42.0 |
003185 |
010 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266050 |
14785804 |
2015-07-26 03:28:39.0 |
2015-07-26 07:03:49.0 |
003185 |
012 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266051 |
14796936 |
2015-07-26 15:37:39.0 |
2015-07-26 18:03:54.0 |
003185 |
011 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266053 |
14802094 |
2015-07-26 19:45:10.0 |
2015-07-26 22:00:49.0 |
003185 |
014 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266055 |
14778084 |
2015-07-25 21:59:58.0 |
2015-07-26 00:05:21.0 |
003185 |
015 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266056 |
14791743 |
2015-07-26 08:44:55.0 |
2015-07-26 10:26:56.0 |
003185 |
018 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266057 |
14802095 |
2015-07-26 19:45:10.0 |
2015-07-26 20:49:07.0 |
003185 |
020 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266058 |
14785805 |
2015-07-26 03:28:39.0 |
2015-07-26 06:43:27.0 |
003185 |
017 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266059 |
14791744 |
2015-07-26 08:44:55.0 |
2015-07-26 10:01:22.0 |
003185 |
019 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266063 |
14785807 |
2015-07-26 03:28:39.0 |
2015-07-26 07:00:12.0 |
003185 |
024 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266065 |
14778086 |
2015-07-25 21:59:59.0 |
2015-07-26 00:06:32.0 |
003185 |
026 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266066 |
14802097 |
2015-07-26 19:45:10.0 |
2015-07-26 21:13:08.0 |
003185 |
031 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266069 |
14772043 |
2015-07-25 16:50:54.0 |
2015-07-25 18:25:21.0 |
003186 |
001 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266075 |
14772045 |
2015-07-25 16:50:54.0 |
2015-07-25 19:00:46.0 |
003186 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266076 |
14778089 |
2015-07-25 21:59:59.0 |
2015-07-25 23:41:58.0 |
003186 |
002 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266078 |
14890482 |
2015-07-28 21:28:59.0 |
2015-07-28 23:01:24.0 |
003186 |
004 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266081 |
14890485 |
2015-07-28 21:29:00.0 |
2015-07-28 22:36:06.0 |
003186 |
009 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266083 |
14785808 |
2015-07-26 03:28:40.0 |
2015-07-26 07:00:15.0 |
003186 |
012 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266087 |
14778090 |
2015-07-25 22:00:00.0 |
2015-07-26 00:53:29.0 |
003186 |
011 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266088 |
14791745 |
2015-07-26 08:44:55.0 |
2015-07-26 10:57:50.0 |
003204 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266391 |
14785840 |
2015-07-26 03:28:45.0 |
2015-07-26 06:28:23.0 |
003204 |
002 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266392 |
14767283 |
2015-07-24 22:34:47.0 |
2015-07-25 03:20:51.0 |
003204 |
001 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266393 |
14767631 |
2015-07-25 07:41:32.0 |
2015-07-25 12:32:38.0 |
003205 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266394 |
14767632 |
2015-07-25 07:41:32.0 |
2015-07-25 12:31:01.0 |
003212 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266398 |
14767635 |
2015-07-25 07:41:33.0 |
2015-07-25 12:48:54.0 |
003212 |
001 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266399 |
14767285 |
2015-07-24 22:34:47.0 |
2015-07-25 03:02:13.0 |
003215 |
000 |
5 |
1 / 2 |
AUGER-OVER_RLIMIT |
modify |
266403 |
14767289 |
2015-07-24 22:34:48.0 |
2015-07-25 02:43:20.0 |