[00:16:57] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 98961 MB (10% inode=99%): [00:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [00:53:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:53:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:53:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:53:57] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 38691 MB (9% inode=99%): [00:54:16] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 87558 MB (8% inode=98%): [00:54:17] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 87557 MB (8% inode=98%): [00:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1311999 [00:57:07] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1311912.000000 [01:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [01:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1309921 [01:57:06] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1309787.000000 [02:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [02:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1307768 [02:55:33] @replag [02:55:34] jeremyb: s1-user: 2w 1d 3h 15m 15s [-0.50 s/s]; s2-user: 1h 23m 22s [+0.09 s/s]; s3-rr-a: 20s [-0.00 s/s]; s3-user: 20s [-0.00 s/s]; s5-rr-a: 34s [+0.00 s/s]; s5-user: 34s [+0.00 s/s] [02:57:07] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1307672.000000 [03:06:37] Load avg. on willow is WARNING: WARNING - load average: 15.66, 14.85, 12.39 [03:07:36] Load avg. on willow is OK: OK - load average: 13.94, 14.45, 12.41 [03:16:37] Load avg. on willow is WARNING: WARNING - load average: 19.07, 18.67, 15.43 [03:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:34:36] Load avg. on willow is OK: OK - load average: 9.67, 13.49, 14.76 [03:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [03:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1306852 [03:57:07] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1306795.000000 [04:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [04:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1305963 [04:57:06] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1305933.000000 [05:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:46:07] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 16955 MB (1% inode=96%): [05:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [05:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1304832 [05:57:07] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1304766.000000 [06:06:56] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23954 MB (5% inode=99%): [06:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:42:57] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40638 MB (9% inode=99%): [06:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [06:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1303384 [06:57:17] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1303224.000000 [07:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [07:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1301473 [07:57:17] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1301388.000000 [08:27:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:27:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:28:26] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:29:17] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 87819 MB (9% inode=98%): [08:29:17] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 87817 MB (9% inode=98%): [08:29:17] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 38507 MB (9% inode=99%): [08:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [08:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:54:27] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:54:27] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:54:27] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1300720 [08:55:07] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 87465 MB (8% inode=98%): [08:55:07] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 38494 MB (9% inode=99%): [08:55:07] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 87465 MB (8% inode=98%): [08:57:16] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1300651.000000 [09:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [09:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1296912 [09:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1296529.000000 [10:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [10:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1293631 [10:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1293498.000000 [11:21:43] hello all [11:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [11:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1291186 [11:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1291039.000000 [12:16:57] /sql on thyme is CRITICAL: DISK CRITICAL - free space: /sql 98891 MB (10% inode=99%): [12:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [12:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1289644 [12:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1289596.000000 [13:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [13:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1289014 [13:57:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1288908.000000 [14:21:15] DaBPunkt: is the database move currently in progress? [14:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:38:31] se4598: yes [14:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [14:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1288529 [14:57:26] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1288515.000000 [15:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:45:06] DaB. * Re: [Toolserver-l] sql-s1 will be read-only on Wednesday [15:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [15:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1288836 [15:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1288822.000000 [16:23:17] Load avg. on ortelius is CRITICAL: CRITICAL - load average: 19.16, 30.37, 19.54 [16:25:17] Load avg. on ortelius is WARNING: WARNING - load average: 8.31, 22.73, 18.02 [16:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:30:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:30:18] Load avg. on ortelius is OK: OK - load average: 5.82, 12.10, 14.62 [16:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:32:47] Free Memory on damiana is WARNING: WARNING - 6.3% (524904 kB) free! [16:33:36] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2000.000000 [16:33:56] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2009 [16:38:04] Andrew Gray * Re: [Toolserver-l] sql-s1 will be read-only on Wednesday [16:43:47] Free Memory on damiana is CRITICAL: CRITICAL - 4.6% (381476 kB) free! [16:45:38] s1 replag on rosemary is CRITICAL: (Service Check Timed Out) [16:47:48] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2504.000000 [16:53:18] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [16:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1288981 [16:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1288973.000000 [17:00:47] Free Memory on damiana is WARNING: WARNING - 5.4% (450436 kB) free! [17:29:58] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:32:46] Free Memory on damiana is OK: OK - 7.2% (607004 kB) free. [17:33:57] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2712 [17:44:47] Free Memory on damiana is WARNING: WARNING - 6.0% (505528 kB) free! [17:44:57] s1 replag on rosemary is CRITICAL: (Service Check Timed Out) [17:46:07] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 14841 MB (1% inode=95%): [17:48:07] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2885.000000 [17:49:16] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [17:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:53:57] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [17:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1288887 [17:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1288755.000000 [18:12:18] Load avg. on ortelius is WARNING: WARNING - load average: 21.78, 18.05, 12.43 [18:19:18] Load avg. on ortelius is CRITICAL: CRITICAL - load average: 33.45, 24.53, 17.20 [18:21:17] Load avg. on ortelius is WARNING: WARNING - load average: 24.16, 24.54, 18.15 [18:25:17] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 201505 MB (20% inode=99%): [18:26:47] Free Memory on damiana is CRITICAL: CRITICAL - 5.0% (420052 kB) free! [18:27:46] Free Memory on damiana is WARNING: WARNING - 5.3% (441104 kB) free! [18:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:33:56] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2050 [18:43:27] s1 replag on rosemary is CRITICAL: (Service Check Timed Out) [18:44:07] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2167.000000 [18:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [18:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:54:36] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1286087 [18:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1285903.000000 [18:59:46] Free Memory on damiana is OK: OK - 7.2% (606984 kB) free. [19:10:46] Free Memory on damiana is WARNING: WARNING - 5.9% (491384 kB) free! [19:23:57] MySQL slave on rosemary is OK: Uptime: 10814788 Threads: 25 Questions: 4277636127 Slow queries: 776176 Opens: 19900 Flush tables: 6 Open tables: 753 Queries per second avg: 395.535 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1793 [19:24:37] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1767.000000 [19:25:58] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 23882 MB (5% inode=99%): [19:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:41:47] Free Memory on damiana is OK: OK - 7.1% (597396 kB) free. [19:50:57] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41512 MB (10% inode=99%): [19:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [19:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1283747 [19:57:27] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1283582.000000 [20:07:47] Free Memory on damiana is WARNING: WARNING - 6.7% (559164 kB) free! [20:09:47] Free Memory on damiana is OK: OK - 7.1% (592696 kB) free. [20:23:46] Free Memory on damiana is WARNING: WARNING - 6.3% (526248 kB) free! [20:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:30:56] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:36:46] Free Memory on damiana is OK: OK - 7.2% (607028 kB) free. [20:50:32] nacht ts [20:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [20:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1281763 [20:55:57] /sql on z-dat-s3-a is WARNING: DISK WARNING - free space: /sql 88822 MB (9% inode=98%): [20:55:57] /sql on z-dat-s6-a is WARNING: DISK WARNING - free space: /sql 88821 MB (9% inode=98%): [20:57:47] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1281554.000000 [21:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:30:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:34:04] Platonides * Re: [Toolserver-l] sql-s1 will be read-only on Wednesday [21:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [21:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1279160 [21:57:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1278836.000000 [22:29:56] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:34:12] @replag [22:34:12] se4598: s1-user: 2w 18h 46m 43s [-0.43 s/s]; s2-user: 2h 29m 52s [+0.06 s/s]; s3-rr-a: 2m 47s [+0.00 s/s]; s3-user: 2m 47s [+0.00 s/s] [22:53:16] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [22:53:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1275560 [22:57:47] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1275274.000000 [23:16:37] Load avg. on willow is WARNING: WARNING - load average: 14.77, 16.30, 13.28 [23:17:37] Load avg. on willow is OK: OK - load average: 11.11, 14.94, 12.98 [23:29:57] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:30:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:30:57] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:53:17] SRaid on nightshade is CRITICAL: NRPE: Unable to read output [23:53:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:54:37] MySQL slave on thyme is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1272099 [23:57:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 1271892.000000