[00:05:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 253025 [00:06:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:08:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:09:38] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67517.000000 [00:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 546133 MB (10% inode=46%): [00:10:29] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 253203.000000 [00:23:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:25:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:34:29] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67577 [00:48:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40257 MB (9% inode=99%): [01:01:18] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24297 MB (5% inode=99%): [01:02:19] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 107024 MB (11% inode=98%): [01:02:19] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 107025 MB (11% inode=98%): [01:05:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 254473 [01:05:59] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:06:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:09:19] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 106755 MB (10% inode=98%): [01:09:19] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 106755 MB (10% inode=98%): [01:09:38] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67743.000000 [01:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 546013 MB (10% inode=46%): [01:10:38] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [01:11:28] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 254629.000000 [01:18:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 44143 MB (10% inode=99%): [01:24:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:26:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:31:18] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24435 MB (5% inode=99%): [01:35:29] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67694 [01:38:18] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 52471 MB (12% inode=99%): [02:05:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 255973 [02:06:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:09:38] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67926.000000 [02:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 545937 MB (10% inode=46%): [02:11:38] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 256226.000000 [02:16:38] /sql on thyme is WARNING: DISK WARNING - free space: /sql 161930 MB (16% inode=99%): [02:24:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:27:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:36:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67888 [03:05:09] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 257527 [03:06:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543452 MB (10% inode=46%): [03:09:58] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68070.000000 [03:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 257646.000000 [03:24:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:27:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:36:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67820 [04:06:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 259025 [04:06:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543938 MB (10% inode=46%): [04:09:58] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67846.000000 [04:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 259189.000000 [04:16:45] [[Job scheduling]] ! 10https://wiki.toolserver.org/w/index.php?diff=7443&oldid=7442&rcid=10103 * 24.126.7.203 * (-1) (/* arguments to qsub/qcronsub */ ) [04:17:29] [[Job scheduling]] ! 10https://wiki.toolserver.org/w/index.php?diff=7444&oldid=7443&rcid=10104 * 24.126.7.203 * (+1) (spelling errors) [04:20:11] [[Job scheduling]] ! 10https://wiki.toolserver.org/w/index.php?diff=7445&oldid=7444&rcid=10105 * 24.126.7.203 * (-5) (/* arguments to qsub/qcronsub */ ) [04:23:22] [[Job scheduling]] ! 10https://wiki.toolserver.org/w/index.php?diff=7446&oldid=7445&rcid=10106 * 24.126.7.203 * (+1) (/* Array Jobs */ ) [04:25:11] [[Job scheduling]] ! 10https://wiki.toolserver.org/w/index.php?diff=7447&oldid=7446&rcid=10107 * 24.126.7.203 * (+0) (/* Array Jobs */ ) [04:25:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:25:56] [[Job scheduling]] ! 10https://wiki.toolserver.org/w/index.php?diff=7448&oldid=7447&rcid=10108 * 24.126.7.203 * (-1) (/* Scheduling SQL queries */ ) [04:28:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:37:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68244 [04:42:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 33519 MB (8% inode=99%): [04:45:17] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24093 MB (5% inode=99%): [05:06:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 260487 [05:06:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:08:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543860 MB (10% inode=46%): [05:10:28] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68816.000000 [05:11:59] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 260668.000000 [05:15:19] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 27984 MB (6% inode=99%): [05:16:19] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 21016 MB (5% inode=99%): [05:25:48] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 54416 MB (4% inode=98%): [05:26:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 38091 MB (9% inode=99%): [05:26:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:28:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:37:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68873 [05:46:18] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 3429 MB (0% inode=99%): [06:06:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 261809 [06:06:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:07:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 36375 MB (8% inode=99%): [06:08:17] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 53464 MB (13% inode=99%): [06:08:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543771 MB (10% inode=46%): [06:10:38] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68820.000000 [06:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 261941.000000 [06:26:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:28:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:29:18] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 107425 MB (11% inode=98%): [06:29:18] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 107425 MB (11% inode=98%): [06:36:18] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 106409 MB (10% inode=98%): [06:36:18] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 106409 MB (10% inode=98%): [06:38:29] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 68638 [06:47:09] Load avg. on adenia is WARNING: WARNING - load average: 21.07, 16.79, 10.66 [06:56:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 36946 MB (9% inode=99%): [07:00:08] Load avg. on adenia is OK: OK - load average: 9.79, 14.75, 13.69 [07:06:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 262987 [07:07:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:07:18] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24374 MB (5% inode=99%): [07:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543650 MB (10% inode=46%): [07:10:38] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 68365.000000 [07:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 263107.000000 [07:26:18] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 46266 MB (11% inode=99%): [07:26:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:28:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:33:17] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 32450 MB (7% inode=99%): [07:38:29] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67864 [07:41:18] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24030 MB (5% inode=99%): [08:06:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 263890 [08:07:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:08:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543559 MB (10% inode=46%): [08:10:38] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67527.000000 [08:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 264055.000000 [08:12:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 34312 MB (8% inode=99%): [08:22:19] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24125 MB (5% inode=99%): [08:26:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:28:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:31:18] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 60168 MB (14% inode=99%): [08:38:29] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67360 [09:06:09] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 265515 [09:07:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:09:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543430 MB (10% inode=46%): [09:10:38] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67342.000000 [09:11:49] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:11:49] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 265801.000000 [09:13:18] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 105650 MB (10% inode=98%): [09:13:19] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 105650 MB (10% inode=98%): [09:26:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:29:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:38:29] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67072 [10:06:10] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 268036 [10:07:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:08:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:09:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543225 MB (10% inode=46%): [10:10:50] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67125.000000 [10:11:59] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 268170.000000 [10:26:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:29:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:38:29] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67191 [11:07:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 269258 [11:07:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:08:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:10:48] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67418.000000 [11:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 543051 MB (10% inode=46%): [11:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 269357.000000 [11:26:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:29:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:38:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67436 [11:53:48] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:54:48] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:55:29] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 105799 MB (10% inode=98%): [11:55:29] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 105799 MB (10% inode=98%): [12:07:09] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 270862 [12:07:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:10:48] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67572.000000 [12:10:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 542856 MB (10% inode=46%): [12:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 270990.000000 [12:27:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:29:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:38:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67700 [13:07:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 272133 [13:07:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:08:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 542738 MB (10% inode=46%): [13:10:58] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67443.000000 [13:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 272227.000000 [13:28:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:29:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:38:29] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66797 [14:08:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 273093 [14:08:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 542587 MB (10% inode=46%): [14:10:58] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66873.000000 [14:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 273169.000000 [14:16:38] /sql on thyme is WARNING: DISK WARNING - free space: /sql 160609 MB (16% inode=99%): [14:25:05] DaB. * [Toolserver-announce] Linux-hosts are ready to use [14:29:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:29:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:39:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66955 [15:06:39] [[User talk:Hearing aid battery York PA]] ! 10https://wiki.toolserver.org/w/index.php?diff=7449&oldid=7434&rcid=10109 * 90.59.104.173 * (-2331) (Replaced content with "{{delete|out of project scope}}") [15:08:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 274297 [15:08:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 542478 MB (10% inode=46%): [15:11:09] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67189.000000 [15:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 274390.000000 [15:29:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:29:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:40:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67439 [16:08:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 275648 [16:08:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:08:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 542310 MB (10% inode=46%): [16:11:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67433.000000 [16:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 275762.000000 [16:19:09] Load avg. on adenia is WARNING: WARNING - load average: 17.98, 14.88, 9.29 [16:22:08] Load avg. on adenia is OK: OK - load average: 13.29, 14.62, 10.24 [16:24:58] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2038.000000 [16:27:58] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1661.000000 [16:29:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:30:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:33:09] Load avg. on adenia is WARNING: WARNING - load average: 15.16, 16.34, 13.27 [16:40:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67198 [17:08:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 277043 [17:08:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 542117 MB (10% inode=46%): [17:11:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67126.000000 [17:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 277159.000000 [17:25:48] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 54617 MB (4% inode=98%): [17:29:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:30:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:40:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 67062 [18:08:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 278629 [18:08:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 541487 MB (10% inode=46%): [18:11:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 67067.000000 [18:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 278757.000000 [18:30:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:30:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:40:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66873 [19:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:09:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 280340 [19:09:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 541216 MB (10% inode=46%): [19:11:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66755.000000 [19:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 280426.000000 [19:25:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41153 MB (10% inode=99%): [19:31:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:31:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:39:18] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 22935 MB (5% inode=99%): [19:41:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66433 [20:00:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 37530 MB (9% inode=99%): [20:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:09:09] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 282288 [20:09:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:10:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 541139 MB (10% inode=46%): [20:11:08] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66574.000000 [20:11:18] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23593 MB (5% inode=99%): [20:11:58] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 282379.000000 [20:31:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:31:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:35:18] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 34489 MB (8% inode=99%): [20:41:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66592 [20:48:19] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24288 MB (5% inode=99%): [20:54:18] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 59417 MB (14% inode=99%): [21:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:09:09] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 284501 [21:09:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:10:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 541016 MB (10% inode=46%): [21:11:18] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66684.000000 [21:12:19] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 284688.000000 [21:32:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:32:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:41:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66628 [22:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:09:09] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 288101 [22:09:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 540919 MB (10% inode=46%): [22:11:18] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66681.000000 [22:12:18] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 288287.000000 [22:32:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:32:38] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:42:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66751 [23:08:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:09:08] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 291701 [23:09:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:10:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 540755 MB (10% inode=46%): [23:11:29] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 66668.000000 [23:12:18] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 291887.000000 [23:28:51] nacht ts [23:32:39] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:32:39] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:42:28] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 66383 [23:56:18] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 104764 MB (10% inode=98%): [23:56:18] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 104765 MB (10% inode=98%):