[02:03:11] 2013/10/07 02:02 CRIT wolfsbane / DISK CRITICAL - free space: / 3262 MB (10% inode=93%): [02:03:11] 2013/10/07 02:02 CRIT wolfsbane /tmp DISK CRITICAL - free space: / 3263 MB (10% inode=93%): [02:04:11] 2013/10/07 02:03 WARN wolfsbane / DISK WARNING - free space: / 3295 MB (11% inode=93%): [02:05:11] 2013/10/07 02:04 CRIT wolfsbane / DISK CRITICAL - free space: / 3274 MB (10% inode=93%): [02:06:13] 2013/10/07 02:05 WARN wolfsbane / DISK WARNING - free space: / 3300 MB (11% inode=93%): [02:07:13] 2013/10/07 02:06 CRIT wolfsbane / DISK CRITICAL - free space: / 3056 MB (10% inode=93%): [02:08:13] 2013/10/07 02:07 WARN wolfsbane / DISK WARNING - free space: / 4008 MB (13% inode=93%): [02:08:13] 2013/10/07 02:07 WARN wolfsbane /tmp DISK WARNING - free space: / 4094 MB (13% inode=93%): [02:10:13] 2013/10/07 02:09 CRIT wolfsbane / DISK CRITICAL - free space: / 3058 MB (10% inode=93%): [02:10:13] 2013/10/07 02:09 CRIT wolfsbane /tmp DISK CRITICAL - free space: / 3106 MB (10% inode=93%): [03:08:17] 2013/10/07 03:07 WARN wolfsbane / DISK WARNING - free space: / 3895 MB (13% inode=93%): [03:08:17] 2013/10/07 03:07 WARN wolfsbane /tmp DISK WARNING - free space: / 3895 MB (13% inode=93%): [05:17:30] 2013/10/07 05:13 CRIT z-dat-s4-a MySQL slave (Service Check Timed Out) [05:17:30] 2013/10/07 05:13 CRIT z-dat-s7-a MySQL slave Can't connect to MySQL server on 'z-dat-s7-a' (110) [05:18:30] 2013/10/07 05:13 CRIT z-dat-s6-a MySQL Can't connect to MySQL server on 'z-dat-s6-a' (110) [05:18:30] 2013/10/07 05:17 OK z-dat-s7-a MySQL slave Uptime: 1699376 Threads: 10 Questions: 349465228 Slow queries: 19169 Opens: 1636839 Flush tables: 1 Open tables: 5966 Queries per second avg: 205.643 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 280 [05:20:30] 2013/10/07 05:13 CRIT hyacinth / Timeout while attempting connection [05:20:31] 2013/10/07 05:13 CRIT hyacinth Load avg. Timeout while attempting connection [05:21:30] 2013/10/07 05:20 OK hyacinth / DISK OK - free space: / 9120 MB (30% inode=86%): [05:21:31] 2013/10/07 05:20 OK hyacinth Load avg. OK - load average: 1.04, 0.57, 0.84 [05:21:31] 2013/10/07 05:20 OK z-dat-s4-a MySQL slave Uptime: 2834115 Threads: 3 Questions: 196681602 Slow queries: 108 Opens: 319 Flush tables: 1 Open tables: 250 Queries per second avg: 69.397 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [05:21:31] 2013/10/07 05:19 OK z-dat-s6-a MySQL Uptime: 2834145 Threads: 3 Questions: 860801918 Slow queries: 76030 Opens: 933665 Flush tables: 1 Open tables: 4118 Queries per second avg: 303.725 [05:58:05] [[Special:Log/newusers]] create 10 * Waneta556 * (New user account) [09:20:41] 2013/10/07 09:14 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2162 [09:21:41] 2013/10/07 09:19 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2192.000000 [09:21:41] 2013/10/07 09:19 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2209.000000 [09:29:42] 2013/10/07 09:29 OK z-dat-s5-b s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 1698.000000 [09:33:42] 2013/10/07 09:33 OK z-dat-s5-b MySQL slave Uptime: 2411713 Threads: 6 Questions: 3979189141 Slow queries: 14112 Opens: 629491 Flush tables: 1 Open tables: 256 Queries per second avg: 1649.943 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1719 [09:33:42] 2013/10/07 09:33 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1719.000000 [09:51:42] 2013/10/07 09:50 CRIT z-dat-s4-a /sql CHECK_NRPE: Socket timeout after 30 seconds. [09:54:42] 2013/10/07 09:53 WARN z-dat-s4-a /sql DISK WARNING - free space: /sql 58796 MB (9% inode=99%): [09:55:42] 2013/10/07 09:50 CRIT z-dat-s6-a MySQL Can't connect to MySQL server on 'z-dat-s6-a' (110) [09:56:42] 2013/10/07 09:55 OK z-dat-s6-a MySQL Uptime: 2850624 Threads: 5 Questions: 870622354 Slow queries: 76355 Opens: 940123 Flush tables: 1 Open tables: 4096 Queries per second avg: 305.414 [11:07:49] 2013/10/07 11:06 OK web.amaranth fisheye.toolserver.org HTTP OK: HTTP/1.1 200 OK - 273 bytes in 11.057 second response time [11:08:49] 2013/10/07 11:08 OK wolfsbane / DISK OK - free space: / 10183 MB (33% inode=93%): [11:08:49] 2013/10/07 11:08 OK wolfsbane /tmp DISK OK - free space: / 10171 MB (33% inode=93%): [11:27:51] 2013/10/07 11:21 CRIT yarrow aliasd Connection refused [11:49:52] 2013/10/07 11:47 WARN rosemary s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2211.000000 [11:52:52] 2013/10/07 11:48 CRIT z-dat-s6-a MySQL Can't connect to MySQL server on 'z-dat-s6-a' (110) [11:52:53] 2013/10/07 11:48 CRIT z-dat-s7-a MySQL slave Can't connect to MySQL server on 'z-dat-s7-a' (110) [11:53:53] 2013/10/07 11:47 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2169.000000 [11:53:53] 2013/10/07 11:52 OK z-dat-s6-a MySQL Uptime: 2857655 Threads: 9 Questions: 872603544 Slow queries: 76482 Opens: 940134 Flush tables: 1 Open tables: 4101 Queries per second avg: 305.356 [11:53:53] 2013/10/07 11:48 CRIT z-dat-s7-a MySQL Can't connect to MySQL server on 'z-dat-s7-a' (110) [12:04:05] Silke Meyer * [Toolserver-l] Need Tool Labs migration support? [12:13:53] 2013/10/07 12:13 CRIT rosemary s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3650.000000 [12:17:53] 2013/10/07 12:17 CRIT z-dat-s5-b s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3609.000000 [12:53:56] 2013/10/07 12:47 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2186 [12:53:56] 2013/10/07 12:47 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2187.000000 [13:16:58] 2013/10/07 13:16 OK z-dat-s5-b MySQL slave Uptime: 2425093 Threads: 7 Questions: 3986138494 Slow queries: 14278 Opens: 630119 Flush tables: 1 Open tables: 256 Queries per second avg: 1643.705 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1785 [13:16:58] 2013/10/07 13:16 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1786.000000 [14:35:58] 2013/10/07 14:29 WARN wolfsbane / DISK WARNING - free space: / 4919 MB (16% inode=93%): [14:35:58] 2013/10/07 14:29 WARN wolfsbane /tmp DISK WARNING - free space: / 4920 MB (16% inode=93%): [16:08:05] 2013/10/07 16:07 OK wolfsbane / DISK OK - free space: / 9402 MB (31% inode=93%): [16:08:06] 2013/10/07 16:07 OK wolfsbane /tmp DISK OK - free space: / 9402 MB (31% inode=93%): [19:33:04] Maarten Dammers * Re: [Toolserver-l] Need Tool Labs migration support? [21:11:20] 2013/10/07 21:10 CRIT z-dat-s4-a /sql CHECK_NRPE: Socket timeout after 30 seconds. [21:12:20] 2013/10/07 21:11 WARN z-dat-s4-a /sql DISK WARNING - free space: /sql 58994 MB (9% inode=99%): [22:29:04] Magnus Manske * Re: [Toolserver-l] Need Tool Labs migration support? [22:35:03] Marc A. Pelletier * Re: [Toolserver-l] Need Tool Labs migration support? [22:43:05] Magnus Manske * Re: [Toolserver-l] Need Tool Labs migration support? [23:02:05] Platonides * Re: [Toolserver-l] Need Tool Labs migration support?