[02:48:46] 2013/07/31 02:45 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1982 [02:51:46] 2013/07/31 02:45 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2042.000000 [03:15:48] 2013/07/31 03:15 OK z-dat-s5-b MySQL slave Uptime: 1608640 Threads: 9 Questions: 2100749152 Slow queries: 15027 Opens: 1437584 Flush tables: 1 Open tables: 256 Queries per second avg: 1305.916 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1797 [03:18:48] 2013/07/31 03:18 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1787.000000 [03:25:49] 2013/07/31 03:22 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1967 [03:28:49] 2013/07/31 03:22 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2040.000000 [03:53:51] 2013/07/31 03:53 OK z-dat-s5-b MySQL slave Uptime: 1610920 Threads: 4 Questions: 2101498364 Slow queries: 15055 Opens: 1475201 Flush tables: 1 Open tables: 256 Queries per second avg: 1304.533 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1715 [03:53:51] 2013/07/31 03:53 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1770.000000 [04:30:16] [[Wiki server assignments]] ! 10https://wiki.toolserver.org/w/index.php?diff=8095&oldid=8091&rcid=22102 * 185.15.59.202 * (+0) (updated page) [08:27:56] Hi all [08:28:13] Is DAB there? [08:31:06] 2013/07/31 08:27 WARN web.amaranth fisheye.toolserver.org HTTP WARNING: HTTP/1.1 200 OK - 272 bytes in 16.310 second response time [08:34:06] 2013/07/31 08:33 OK web.amaranth fisheye.toolserver.org HTTP OK: HTTP/1.1 200 OK - 274 bytes in 11.742 second response time [09:01:07] 2013/07/31 08:56 CRIT z-dat-s6-a MySQL Can't connect to MySQL server on 'z-dat-s6-a' (111) [09:04:08] 2013/07/31 09:02 OK z-dat-s6-a MySQL Uptime: 368 Threads: 3 Questions: 25 Slow queries: 0 Opens: 30 Flush tables: 1 Open tables: 23 Queries per second avg: 0.67 [11:05:13] 2013/07/31 11:04 CRIT thyme / Connection refused or timed out [11:05:13] 2013/07/31 11:04 CRIT thyme /mnt Timeout while attempting connection [11:05:13] 2013/07/31 11:04 CRIT thyme /tmp Connection refused or timed out [11:05:13] 2013/07/31 11:04 CRIT thyme Environment IPMI Connection refused or timed out [11:05:13] 2013/07/31 11:04 CRIT thyme Load avg. Connection refused or timed out [11:05:13] 2013/07/31 11:04 CRIT thyme PING CRITICAL - Host Unreachable (thyme) [11:05:13] 2013/07/31 11:04 CRIT thyme RAID Connection refused or timed out [11:05:14] 2013/07/31 11:04 CRIT thyme SMTP No route to host [11:05:14] 2013/07/31 11:04 CRIT z-dat-s1-b /tmp Timeout while attempting connection [11:05:15] 2013/07/31 11:04 CRIT z-dat-s1-b APT Connection refused or timed out [11:05:15] 2013/07/31 11:04 CRIT z-dat-s1-b Load avg. Connection refused or timed out [11:05:16] 2013/07/31 11:03 CRIT z-dat-s1-b MySQL (Service Check Timed Out) [11:06:13] 2013/07/31 11:04 CRIT thyme NTP CRITICAL - Socket timeout after 10 seconds [11:06:13] 2013/07/31 11:05 CRIT thyme SSH No route to host [11:06:14] 2013/07/31 11:04 CRIT z-dat-s1-b / Connection refused or timed out [11:06:14] 2013/07/31 11:05 CRIT z-dat-s1-b PING CRITICAL - Host Unreachable (z-dat-s1-b) [11:10:14] 2013/07/31 11:09 CRIT thyme CRITICAL - Host Unreachable (thyme) [11:15:15] 2013/07/31 11:15 CRIT z-dat-s1-b CRITICAL - Host Unreachable (z-dat-s1-b) [12:43:21] 2013/07/31 12:42 OK thyme PING OK - Packet loss = 0%, RTA = 0.28 ms [12:43:21] 2013/07/31 12:42 OK thyme PING PING OK - Packet loss = 0%, RTA = 0.16 ms [12:43:22] 2013/07/31 12:42 OK thyme SMTP SMTP OK - 0.131 sec. response time [12:43:22] 2013/07/31 12:43 OK thyme SSH SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0) [12:47:21] 2013/07/31 12:47 OK z-dat-s1-b PING OK - Packet loss = 0%, RTA = 0.21 ms [12:47:21] 2013/07/31 12:46 OK z-dat-s1-b / DISK OK - free space: / 2578 MB (67% inode=89%): [12:48:21] 2013/07/31 12:47 OK z-dat-s1-b /tmp DISK OK - free space: / 2578 MB (67% inode=89%): [12:48:21] 2013/07/31 12:47 WARN z-dat-s1-b APT APT WARNING: 35 packages available for upgrade (0 critical updates). [12:48:21] 2013/07/31 12:47 OK z-dat-s1-b Load avg. OK - load average: 0.78, 0.20, 0.07 [12:48:21] 2013/07/31 12:47 OK z-dat-s1-b PING PING OK - Packet loss = 0%, RTA = 0.19 ms [12:48:21] 2013/07/31 12:47 OK z-dat-s1-b SMTP SMTP OK - 0.177 sec. response time [12:48:21] 2013/07/31 12:47 OK z-dat-s1-b SSH SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0) [12:49:21] 2013/07/31 11:04 CRIT thyme NTP CRITICAL - Socket timeout after 10 seconds [12:51:21] 2013/07/31 11:03 CRIT z-dat-s1-b MySQL slave Can't connect to MySQL server on 'z-dat-s1-b' (111) [12:52:21] 2013/07/31 11:03 CRIT z-dat-s1-b MySQL Can't connect to MySQL server on 'z-dat-s1-b' (111) [13:07:22] 2013/07/31 13:04 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1884 [13:10:23] 2013/07/31 13:04 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2058.000000 [14:20:25] 2013/07/31 14:20 CRIT z-dat-s5-b MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3613 [14:20:26] 2013/07/31 14:20 CRIT z-dat-s5-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3607.000000 [14:25:25] 2013/07/31 14:25 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3556 [14:25:25] 2013/07/31 14:25 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3554.000000 [14:47:27] 2013/07/31 14:47 OK z-dat-s5-b MySQL slave Uptime: 1650160 Threads: 7 Questions: 2194284824 Slow queries: 15426 Opens: 1478177 Flush tables: 1 Open tables: 255 Queries per second avg: 1329.740 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1720 [14:47:27] 2013/07/31 14:47 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1752.000000 [14:52:23] [[Special:Log/newusers]] create 10 * Cary115 * (New user account) [16:16:28] 2013/07/31 16:09 WARN ptolemy Load avg. WARNING - load average: 21.75, 18.92, 12.46 [16:23:28] 2013/07/31 16:22 OK ptolemy Load avg. OK - load average: 7.25, 14.03, 12.92 [17:15:29] 2013/07/31 17:14 CRIT amaranth PING PING CRITICAL - Packet loss = 100% [17:15:29] 2013/07/31 17:14 CRIT amaranth SMTP CRITICAL - Socket timeout after 10 seconds [17:15:29] 2013/07/31 17:15 CRIT amaranth SSH CRITICAL - Socket timeout after 10 seconds [17:15:29] 2013/07/31 17:14 CRIT web.amaranth PING PING CRITICAL - Packet loss = 100% [17:15:29] 2013/07/31 17:14 CRIT web.amaranth fisheye.toolserver.org Connection timed out [17:15:30] 2013/07/31 17:14 CRIT web.amaranth jira.toolserver.org CRITICAL - Socket timeout after 16 seconds [17:15:30] 2013/07/31 17:14 CRIT web.amaranth journal.toolserver.org CRITICAL - Socket timeout after 16 seconds [17:15:31] 2013/07/31 17:14 CRIT web.amaranth wiki.toolserver.org CRITICAL - Socket timeout after 16 seconds [17:22:29] 2013/07/31 17:22 CRIT web.amaranth (Host Check Timed Out) [17:26:29] 2013/07/31 17:25 CRIT amaranth (Host Check Timed Out) [17:27:38] DNS looks to be down? [17:34:29] 2013/07/31 17:30 CRIT z-dat-s4-a MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:34:29] 2013/07/31 17:31 CRIT z-dat-s5-b MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:35:29] 2013/07/31 17:31 CRIT z-dat-s3-a MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:37:29] 2013/07/31 17:30 CRIT rosemary MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:37:29] 2013/07/31 17:30 CRIT z-dat-s2-b MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:37:29] 2013/07/31 17:30 CRIT z-dat-s6-a MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:37:29] 2013/07/31 17:30 CRIT z-dat-s7-a MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:38:29] 2013/07/31 17:31 CRIT cassia MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:38:29] 2013/07/31 17:31 CRIT daphne MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [17:50:30] 2013/07/31 17:43 WARN cassia s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2172.000000 [17:50:30] 2013/07/31 17:43 WARN cassia s5 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2166.000000 [17:50:30] 2013/07/31 17:44 WARN daphne s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2193.000000 [17:50:30] 2013/07/31 17:43 WARN rosemary s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2177.000000 [17:50:30] 2013/07/31 17:44 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2188.000000 [17:51:30] 2013/07/31 17:44 WARN rosemary s1 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2215.000000 [17:51:30] 2013/07/31 17:44 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2205.000000 [18:14:31] 2013/07/31 18:13 CRIT cassia s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3612.000000 [18:14:31] 2013/07/31 18:13 CRIT cassia s5 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3605.000000 [18:14:32] 2013/07/31 18:14 CRIT daphne s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3633.000000 [18:14:32] 2013/07/31 18:13 CRIT rosemary s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3617.000000 [18:14:32] 2013/07/31 18:14 CRIT z-dat-s5-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3628.000000 [18:15:31] 2013/07/31 18:14 CRIT rosemary s1 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3655.000000 [18:15:31] 2013/07/31 18:14 CRIT z-dat-s5-b s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3645.000000 [18:17:32] 2013/07/31 18:16 OK z-dat-s1-b MySQL Uptime: 19830 Threads: 2 Questions: 8 Slow queries: 0 Opens: 21 Flush tables: 1 Open tables: 12 Queries per second avg: 0.0 [18:22:24] I can't SSH into willow. [18:22:32] > ssh: Could not resolve hostname willow.toolserver.org: nodename nor servname provided, or not known [18:33:30] hey [18:33:37] nosy, DaBPunkt: http://lists.wikimedia.org/pipermail/toolserver-l/2013-July/006218.html [18:33:37] jira, wiki and replications are offline [18:33:48] :-( [18:33:49] we are having an issue with amaranth currently [18:33:53] Okay. [18:34:34] funny thing dns is not working currently [18:34:47] DaBPunkt: do you know if our glue records got really updated? [18:37:32] 2013/07/31 18:37 OK amaranth PING OK - Packet loss = 0%, RTA = 118.85 ms [18:37:32] 2013/07/31 18:37 OK web.amaranth PING OK - Packet loss = 0%, RTA = 117.28 ms [18:37:32] 2013/07/31 18:36 OK amaranth SMTP SMTP OK - 0.498 sec. response time [18:37:32] 2013/07/31 18:37 OK amaranth SSH SSH OK - OpenSSH_5.6p1-hpn13v10 (protocol 2.0) [18:37:33] 2013/07/31 18:36 OK web.amaranth fisheye.toolserver.org HTTP OK: HTTP/1.1 200 OK - 274 bytes in 8.521 second response time [18:37:33] 2013/07/31 18:36 WARN web.amaranth journal.toolserver.org HTTP WARNING: HTTP/1.1 200 OK - 213 bytes in 9.659 second response time [18:37:33] 2013/07/31 18:36 OK web.amaranth wiki.toolserver.org HTTP OK: HTTP/1.1 200 OK - 349 bytes in 0.722 second response time [18:38:32] 2013/07/31 18:37 OK amaranth PING PING OK - Packet loss = 0%, RTA = 118.82 ms [18:38:32] 2013/07/31 18:37 OK web.amaranth PING PING OK - Packet loss = 0%, RTA = 117.33 ms [18:38:33] 2013/07/31 18:37 OK web.amaranth jira.toolserver.org HTTP OK: HTTP/1.1 200 OK - 524 bytes in 0.512 second response time [18:38:33] 2013/07/31 18:37 OK web.amaranth journal.toolserver.org HTTP OK: HTTP/1.1 200 OK - 213 bytes in 0.658 second response time [18:39:27] nosy: yes, they are [18:41:07] DaBPunkt: strange thing is it seems resolving did not work because amaranth was not there [18:41:56] but it is expected to since we have the 2 head nodes [18:42:34] ok, wiki, jira and replication restarted [18:43:32] 2013/07/31 18:42 OK rosemary MySQL slave Uptime: 2540043 Threads: 11 Questions: 1965210916 Slow queries: 128486 Opens: 110965 Flush tables: 1 Open tables: 3442 Queries per second avg: 773.691 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [18:45:33] 2013/07/31 18:44 WARN cassia MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2723 [18:45:33] 2013/07/31 18:44 WARN cassia s5 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2572.000000 [18:46:33] 2013/07/31 18:45 OK cassia MySQL slave Uptime: 4012780 Threads: 5 Questions: 3101444653 Slow queries: 58904 Opens: 15432 Flush tables: 1 Open tables: 14118 Queries per second avg: 772.891 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1779 [18:46:33] 2013/07/31 18:45 OK cassia s5 replag QUERY OK: 'SELECT ts_rc_age()' returned 1629.000000 [18:46:33] 2013/07/31 18:45 WARN z-dat-s4-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3577 [18:47:33] 2013/07/31 18:47 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3246 [18:47:33] 2013/07/31 18:47 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3273.000000 [18:49:34] 2013/07/31 18:48 WARN z-dat-s2-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3252 [18:49:34] 2013/07/31 18:48 WARN z-dat-s6-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3279 [18:50:34] 2013/07/31 18:43 CRIT rosemary MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 5364 [18:50:34] 2013/07/31 18:49 OK z-dat-s4-a MySQL slave Uptime: 462312 Threads: 2 Questions: 15016218 Slow queries: 7 Opens: 85 Flush tables: 1 Open tables: 74 Queries per second avg: 32.480 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1375 [18:51:34] 2013/07/31 18:51 OK z-dat-s5-b MySQL slave Uptime: 1664800 Threads: 4 Questions: 2198131408 Slow queries: 15493 Opens: 1478672 Flush tables: 1 Open tables: 256 Queries per second avg: 1320.357 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1766 [18:51:34] 2013/07/31 18:51 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1799.000000 [18:51:34] 2013/07/31 18:50 WARN z-dat-s7-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3332 [18:52:33] 2013/07/31 18:51 OK z-dat-s2-b MySQL slave Uptime: 105373 Threads: 6 Questions: 26085191 Slow queries: 973 Opens: 369923 Flush tables: 1 Open tables: 256 Queries per second avg: 247.550 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1783 [18:53:33] 2013/07/31 18:52 OK z-dat-s6-a MySQL slave Uptime: 35768 Threads: 7 Questions: 9856966 Slow queries: 872 Opens: 510 Flush tables: 1 Open tables: 439 Queries per second avg: 275.580 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1656 [18:55:33] 2013/07/31 18:54 OK z-dat-s7-a MySQL slave Uptime: 458912 Threads: 4 Questions: 191178857 Slow queries: 19954 Opens: 687533 Flush tables: 1 Open tables: 3837 Queries per second avg: 416.591 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1752 [18:59:33] 2013/07/31 18:58 WARN daphne MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3571 [18:59:33] 2013/07/31 18:59 WARN daphne s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3338.000000 [18:59:33] 2013/07/31 18:58 WARN z-dat-s3-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3459 [19:06:33] 2013/07/31 19:05 OK daphne MySQL slave Uptime: 8983139 Threads: 13 Questions: 1764193027 Slow queries: 1287770 Opens: 285969 Flush tables: 1 Open tables: 2168 Queries per second avg: 196.389 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1789 [19:06:33] 2013/07/31 19:06 OK daphne s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 1674.000000 [19:07:33] 2013/07/31 19:06 OK z-dat-s3-a MySQL slave Uptime: 117360 Threads: 22 Questions: 159320480 Slow queries: 5753 Opens: 533514 Flush tables: 1 Open tables: 16384 Queries per second avg: 1357.536 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1772 [19:14:33] 2013/07/31 19:13 WARN cassia s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3594.000000 [19:14:34] 2013/07/31 19:13 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3491.000000 [19:19:34] 2013/07/31 19:18 OK z-dat-s5-b s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 1547.000000 [19:20:34] 2013/07/31 19:19 OK cassia s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 1577.000000 [19:22:34] 2013/07/31 19:21 WARN rosemary s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3571.000000 [19:30:34] 2013/07/31 19:29 WARN rosemary MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3563 [19:30:34] 2013/07/31 19:29 WARN rosemary s1 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3582.000000 [19:33:34] 2013/07/31 19:32 OK rosemary s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 1705.000000 [19:56:36] 2013/07/31 19:55 OK rosemary MySQL slave Uptime: 2544424 Threads: 9 Questions: 1968666311 Slow queries: 128629 Opens: 111259 Flush tables: 1 Open tables: 3446 Queries per second avg: 773.717 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1760 [19:56:36] 2013/07/31 19:55 OK rosemary s1 replag QUERY OK: 'SELECT ts_rc_age()' returned 1797.000000 [19:58:55] Elsie: still broke for you? [19:59:31] No, working now. [20:00:07] I think status.toolserver.org is not up-to-date, though. [20:28:39] 2013/07/31 20:25 CRIT z-dat-s5-b MySQL slave Slave IO: No Slave SQL: No Seconds Behind Master: (null) [21:01:43] 2013/07/31 20:55 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2206.000000 [21:25:44] 2013/07/31 21:25 CRIT z-dat-s5-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3646.000000 [22:39:48] 2013/07/31 22:39 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3308 [22:39:48] 2013/07/31 22:39 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3345.000000 [22:44:48] 2013/07/31 22:44 OK z-dat-s5-b MySQL slave Uptime: 1678780 Threads: 3 Questions: 2203265396 Slow queries: 15679 Opens: 1479259 Flush tables: 1 Open tables: 256 Queries per second avg: 1312.420 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1481 [22:44:48] 2013/07/31 22:44 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1517.000000 [22:48:16] nacht ts [23:41:49] 2013/07/31 23:34 CRIT z-dat-s1-b MySQL Can't connect to MySQL server on 'z-dat-s1-b' (111)