[01:18:56] 2014/03/16 01:11 WARN wolfsbane / DISK WARNING - free space: / 6283 MB (20% inode=93%): [01:21:56] 2014/03/16 01:14 WARN wolfsbane /tmp DISK WARNING - free space: / 6281 MB (20% inode=93%): [03:07:02] 2014/03/16 03:06 OK wolfsbane / DISK OK - free space: / 6472 MB (21% inode=93%): [03:08:02] 2014/03/16 03:06 OK wolfsbane /tmp DISK OK - free space: / 8005 MB (26% inode=93%): [05:39:11] 2014/03/16 05:30 CRIT cassia s4 replag (Service Check Timed Out) [06:01:12] 2014/03/16 05:59 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [06:43:14] 2014/03/16 06:35 CRIT cassia s4 replag (Service Check Timed Out) [06:46:14] 2014/03/16 06:45 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [11:32:31] 2014/03/16 11:25 WARN willow / DISK WARNING - free space: / 20990 MB (20% inode=98%): [11:32:32] 2014/03/16 11:25 WARN willow /tmp DISK WARNING - free space: / 20990 MB (20% inode=98%): [11:40:32] 2014/03/16 11:39 OK willow / DISK OK - free space: / 32328 MB (30% inode=98%): [11:40:32] 2014/03/16 11:39 OK willow /tmp DISK OK - free space: / 32328 MB (30% inode=98%): [11:58:33] 2014/03/16 11:51 ?? cassia Environment IPMI CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [11:58:33] 2014/03/16 11:52 ?? cassia Load avg. CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [11:59:33] 2014/03/16 11:52 ?? cassia / CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [11:59:33] 2014/03/16 11:52 ?? cassia /sql CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [11:59:33] 2014/03/16 11:52 ?? cassia /sql/data/dewiki CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [11:59:33] 2014/03/16 11:52 ?? cassia /tmp CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [11:59:34] 2014/03/16 11:51 CRIT cassia s4 replag (Service Check Timed Out) [12:01:33] 2014/03/16 12:00 CRIT cassia Environment IPMI CHECK_NRPE: Socket timeout after 30 seconds. [12:02:34] 2014/03/16 12:01 ?? cassia Environment IPMI CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [12:04:35] 2014/03/16 12:03 CRIT cassia / CHECK_NRPE: Socket timeout after 30 seconds. [12:04:35] 2014/03/16 12:03 CRIT cassia /sql CHECK_NRPE: Socket timeout after 30 seconds. [12:04:35] 2014/03/16 12:03 CRIT cassia /sql/data/dewiki CHECK_NRPE: Socket timeout after 30 seconds. [12:04:35] 2014/03/16 12:03 CRIT cassia /tmp CHECK_NRPE: Socket timeout after 30 seconds. [12:04:35] 2014/03/16 12:03 CRIT cassia Environment IPMI CHECK_NRPE: Socket timeout after 30 seconds. [12:05:35] 2014/03/16 12:04 CRIT cassia Load avg. CHECK_NRPE: Socket timeout after 30 seconds. [12:07:35] 2014/03/16 12:06 OK cassia /sql/data/dewiki DISK OK - free space: /sql 684617 MB (58% inode=99%): [12:07:35] 2014/03/16 12:06 OK cassia /tmp DISK OK - free space: /tmp 152 MB (99% inode=99%): [12:07:35] 2014/03/16 12:07 OK cassia Load avg. OK - load average: 0.04, 0.19, 0.25 [12:07:35] 2014/03/16 12:00 CRIT cassia s5 replag QUERY CRITICAL: Can't connect to MySQL server on 'cassia' (111) [12:08:35] 2014/03/16 12:07 ?? cassia / CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [12:08:35] 2014/03/16 12:07 ?? cassia /sql CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [12:08:35] 2014/03/16 12:07 ?? cassia Environment IPMI CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [12:08:35] 2014/03/16 12:01 CRIT cassia MySQL Can't connect to MySQL server on 'cassia' (111) [12:08:35] 2014/03/16 12:01 CRIT cassia MySQL slave Can't connect to MySQL server on 'cassia' (111) [12:09:36] 2014/03/16 12:08 OK cassia / DISK OK - free space: / 11871 MB (59% inode=91%): [12:09:36] 2014/03/16 12:08 OK cassia /sql DISK OK - free space: /sql 684617 MB (58% inode=99%): [12:09:36] 2014/03/16 12:08 OK cassia Environment IPMI ok: temperature ok fan ok voltage ok chassis ok [12:23:38] 2014/03/16 12:12 CRIT cassia RAID CHECK_NRPE: Socket timeout after 30 seconds. [12:28:39] 2014/03/16 12:27 OK cassia RAID OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [12:32:39] 2014/03/16 12:31 OK cassia MySQL Uptime: 434 Threads: 1 Questions: 553 Slow queries: 0 Opens: 40 Flush tables: 1 Open tables: 33 Queries per second avg: 1.274 [12:32:39] 2014/03/16 12:32 OK cassia MySQL slave Uptime: 493 Threads: 2 Questions: 25823 Slow queries: 1 Opens: 69 Flush tables: 1 Open tables: 62 Queries per second avg: 52.379 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1536 [12:32:39] 2014/03/16 12:31 WARN cassia s5 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 1830.000000 [12:33:39] 2014/03/16 12:31 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 0.000000 [12:33:39] 2014/03/16 12:32 OK cassia s5 replag QUERY OK: 'SELECT ts_rc_age()' returned 1443.000000 [16:09:53] 2014/03/16 16:02 WARN wolfsbane / DISK WARNING - free space: / 5129 MB (17% inode=93%): [16:09:53] 2014/03/16 16:02 WARN wolfsbane /tmp DISK WARNING - free space: / 5130 MB (17% inode=93%): [17:08:56] 2014/03/16 17:07 OK wolfsbane / DISK OK - free space: / 6791 MB (22% inode=93%): [17:08:56] 2014/03/16 17:07 OK wolfsbane /tmp DISK OK - free space: / 6794 MB (22% inode=93%): [21:30:13] 2014/03/16 21:23 WARN wolfsbane / DISK WARNING - free space: / 6282 MB (20% inode=93%): [21:32:13] 2014/03/16 21:25 WARN wolfsbane /tmp DISK WARNING - free space: / 6280 MB (20% inode=93%):