[03:07:52] 2013/07/06 03:07 OK wolfsbane /tmp DISK OK - free space: / 6676 MB (22% inode=92%): [03:08:52] 2013/07/06 03:07 OK wolfsbane / DISK OK - free space: / 6679 MB (22% inode=92%): [03:47:54] 2013/07/06 03:41 CRIT yarrow aliasd Connection refused [04:31:56] 2013/07/06 04:25 CRIT wolfsbane Load avg. CRITICAL - load average: 10.46, 39.28, 25.75 [04:36:58] 2013/07/06 04:36 WARN wolfsbane Load avg. WARNING - load average: 3.21, 16.61, 19.42 [04:43:58] 2013/07/06 04:43 OK wolfsbane Load avg. OK - load average: 4.57, 8.96, 14.55 [06:37:01] 2013/07/06 06:30 WARN wolfsbane /tmp DISK WARNING - free space: / 3649 MB (12% inode=92%): [06:38:01] 2013/07/06 06:30 WARN wolfsbane / DISK WARNING - free space: / 3357 MB (11% inode=92%): [06:45:02] 2013/07/06 06:43 CRIT wolfsbane / DISK CRITICAL - free space: / 3285 MB (10% inode=92%): [06:45:02] 2013/07/06 06:44 CRIT wolfsbane /tmp DISK CRITICAL - free space: / 3280 MB (10% inode=92%): [06:50:03] 2013/07/06 06:49 WARN wolfsbane /tmp DISK WARNING - free space: / 3300 MB (11% inode=92%): [06:51:04] 2013/07/06 06:50 CRIT wolfsbane /tmp DISK CRITICAL - free space: / 3255 MB (10% inode=92%): [08:08:06] 2013/07/06 08:07 OK wolfsbane / DISK OK - free space: / 7336 MB (24% inode=92%): [08:08:07] 2013/07/06 08:07 OK wolfsbane /tmp DISK OK - free space: / 7337 MB (24% inode=92%): [09:06:09] 2013/07/06 08:59 CRIT ortelius toolserver.org HTTP CRITICAL - Socket timeout after 10 seconds [09:12:10] 2013/07/06 09:09 CRIT wolfsbane toolserver.org HTTP CRITICAL - Socket timeout after 10 seconds [09:22:11] 2013/07/06 09:21 OK wolfsbane toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.006 second response time [09:27:11] 2013/07/06 09:26 WARN ortelius toolserver.org HTTP HTTP WARNING: HTTP/1.1 200 OK - 239 bytes in 0.814 second response time [09:28:11] 2013/07/06 09:27 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.008 second response time [09:34:12] 2013/07/06 09:30 CRIT z-dat-s3-a MySQL Can't connect to MySQL server on 'z-dat-s3-a' (111) [09:34:12] 2013/07/06 09:30 CRIT z-dat-s3-a MySQL slave Can't connect to MySQL server on 'z-dat-s3-a' (111) [09:36:12] 2013/07/06 09:35 CRIT ortelius toolserver.org HTTP HTTP CRITICAL: HTTP/1.1 200 OK - 239 bytes in 3.026 second response time [09:37:14] 2013/07/06 09:36 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.005 second response time [09:46:13] 2013/07/06 09:39 CRIT ortelius toolserver.org HTTP CRITICAL - Socket timeout after 10 seconds [09:54:14] 2013/07/06 09:53 OK z-dat-s3-a MySQL Uptime: 1403 Threads: 14 Questions: 16770 Slow queries: 1 Opens: 197 Flush tables: 1 Open tables: 185 Queries per second avg: 11.952 [09:54:14] 2013/07/06 09:53 OK z-dat-s3-a MySQL slave Uptime: 1403 Threads: 14 Questions: 16770 Slow queries: 1 Opens: 197 Flush tables: 1 Open tables: 185 Queries per second avg: 11.952 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1406 [09:56:14] 2013/07/06 09:55 WARN wolfsbane toolserver.org HTTP HTTP WARNING: HTTP/1.1 200 OK - 239 bytes in 0.951 second response time [09:57:14] 2013/07/06 09:56 CRIT wolfsbane toolserver.org HTTP HTTP CRITICAL: HTTP/1.1 200 OK - 239 bytes in 4.313 second response time [09:58:14] 2013/07/06 09:57 OK wolfsbane toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.002 second response time [10:02:14] 2013/07/06 09:58 CRIT z-dat-s3-a MySQL Can't connect to MySQL server on 'z-dat-s3-a' (111) [10:02:14] 2013/07/06 09:58 CRIT z-dat-s3-a MySQL slave Can't connect to MySQL server on 'z-dat-s3-a' (111) [10:23:16] 2013/07/06 10:22 OK z-dat-s3-a MySQL Uptime: 1490 Threads: 9 Questions: 2677 Slow queries: 0 Opens: 92 Flush tables: 1 Open tables: 85 Queries per second avg: 1.796 [10:23:16] 2013/07/06 10:22 WARN z-dat-s3-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3123 [10:33:17] 2013/07/06 10:32 CRIT z-dat-s3-a MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3639 [10:41:17] 2013/07/06 10:40 WARN z-dat-s3-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3509 [10:45:18] 2013/07/06 10:44 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.035 second response time [10:52:18] 2013/07/06 10:51 OK z-dat-s3-a MySQL slave Uptime: 3231 Threads: 21 Questions: 1880767 Slow queries: 134 Opens: 9800 Flush tables: 1 Open tables: 9773 Queries per second avg: 582.100 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1762 [10:56:18] 2013/07/06 10:55 WARN ortelius toolserver.org HTTP HTTP WARNING: HTTP/1.1 200 OK - 239 bytes in 0.679 second response time [10:57:18] 2013/07/06 10:56 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.142 second response time [12:20:23] 2013/07/06 12:13 WARN wolfsbane / DISK WARNING - free space: / 6262 MB (20% inode=92%): [12:22:23] 2013/07/06 12:15 WARN wolfsbane /tmp DISK WARNING - free space: / 6257 MB (20% inode=92%): [12:22:23] 2013/07/06 12:15 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2147.000000 [12:33:23] 2013/07/06 12:32 ?? z-dat-s4-a /sql CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [12:34:23] 2013/07/06 12:33 WARN z-dat-s4-a /sql DISK WARNING - free space: /sql 66146 MB (10% inode=99%): [12:35:23] 2013/07/06 12:32 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1977 [12:37:23] 2013/07/06 12:33 CRIT z-dat-s3-a MySQL Can't connect to MySQL server on 'z-dat-s3-a' (111) [12:37:23] 2013/07/06 12:33 CRIT z-dat-s3-a MySQL slave Can't connect to MySQL server on 'z-dat-s3-a' (111) [12:39:24] 2013/07/06 12:32 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2184.000000 [12:47:23] 2013/07/06 12:46 CRIT z-dat-s5-b s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3607.000000 [12:49:23] 2013/07/06 12:48 OK yarrow aliasd TCP OK - 0.003 second response time on port 984 [500 Not found.] [13:03:23] 2013/07/06 13:02 OK z-dat-s3-a MySQL Uptime: 1754 Threads: 26 Questions: 8168 Slow queries: 1 Opens: 147 Flush tables: 1 Open tables: 128 Queries per second avg: 4.656 [13:03:23] 2013/07/06 13:02 OK z-dat-s3-a MySQL slave Uptime: 1754 Threads: 26 Questions: 8168 Slow queries: 1 Opens: 147 Flush tables: 1 Open tables: 128 Queries per second avg: 4.656 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1758 [13:07:24] 2013/07/06 13:03 WARN z-dat-s3-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1965 [13:07:24] 2013/07/06 13:07 OK z-dat-s5-b MySQL slave Uptime: 1123051 Threads: 15 Questions: 1478346138 Slow queries: 6036 Opens: 534907 Flush tables: 1 Open tables: 256 Queries per second avg: 1316.365 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1728 [13:07:24] 2013/07/06 13:06 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1759.000000 [13:11:24] 2013/07/06 13:10 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3577.000000 [13:11:57] @replag [13:11:57] FunPika: s1-rr-a-wd: 4d 11h 10m 3s [-0.49 s/s]; s2-rr: 25m 38s [+0.01 s/s]; s2-user: 25m 38s [+0.01 s/s]; s2-user-c: error; s2-user-wd: 30m 45s [-0.00 s/s]; s3-user: 38m 5s [-0.01 s/s]; s3-user-wd: 38m 36s [-0.01 s/s]; s4-user-wd: 3d 53m 44s [-0.25 s/s] [13:11:58] FunPika: s5-user: 10m 47s [+0.00 s/s]; s5-user-c: 56m 59s [+0.01 s/s] [13:16:25] 2013/07/06 13:10 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2065.000000 [13:22:26] 2013/07/06 13:21 OK z-dat-s5-b s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 1462.000000 [13:24:26] 2013/07/06 13:17 WARN z-dat-s2-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2137 [13:26:26] 2013/07/06 13:25 OK z-dat-s3-a MySQL slave Uptime: 3134 Threads: 22 Questions: 2000179 Slow queries: 141 Opens: 17636 Flush tables: 1 Open tables: 8942 Queries per second avg: 638.219 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1726 [13:59:28] 2013/07/06 13:52 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 1826.000000 [14:03:28] 2013/07/06 14:02 OK z-dat-s2-b MySQL slave Uptime: 4167575 Threads: 9 Questions: 3829781358 Slow queries: 76704 Opens: 30068922 Flush tables: 1 Open tables: 257 Queries per second avg: 918.947 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1687 [14:11:29] 2013/07/06 14:11 OK z-dat-s2-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1749.000000 [14:14:29] 2013/07/06 14:13 OK z-dat-s5-b s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 1639.000000 [20:45:53] 2013/07/06 20:44 CRIT wolfsbane / DISK CRITICAL - free space: / 3280 MB (10% inode=92%): [20:45:53] 2013/07/06 20:45 CRIT wolfsbane /tmp DISK CRITICAL - free space: / 3268 MB (10% inode=92%): [22:25:12] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8055&oldid=7413&rcid=22022 * 141.0.9.95 * (-925) (Delete Install ) [22:25:57] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8056&oldid=8055&rcid=22023 * 141.0.9.95 * (-11654) (Delete TsIntuition Class) [22:26:37] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8057&oldid=8056&rcid=22024 * 141.0.9.95 * (-210) (Close) [22:27:32] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8058&oldid=8057&rcid=22025 * 141.0.9.95 * (-2789) (Delete Debug and development ) [22:28:11] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8059&oldid=8058&rcid=22026 * 141.0.9.95 * (-226) (Close) [22:28:37] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8060&oldid=8059&rcid=22027 * 141.0.9.95 * (-546) (/* Set up */ ) [22:29:29] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8061&oldid=8060&rcid=22028 * 141.0.9.95 * (-134) (Delete tools translated by Toolserver Intuition ) [22:30:03] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8062&oldid=8061&rcid=22029 * 141.0.9.95 * (-739) (/* Functions */ ) [22:33:11] ehhh [22:33:40] vandalism? [22:37:10] [[User:TParis/Index]] ! 10https://wiki.toolserver.org/w/index.php?diff=8063&oldid=8054&rcid=22030 * Akoopal * (+661) (Undo revision 8054 by [[Special:Contributions/141.0.9.95|141.0.9.95]] ([[User talk:141.0.9.95|talk]])) [22:38:12] [[Toolserver Intuition]] ! 10https://wiki.toolserver.org/w/index.php?diff=8064&oldid=8062&rcid=22031 * Akoopal * (+17223) (revert of mass-delete)