[00:54:02] 2013/06/28 00:47 WARN z-dat-s7-a Load avg. WARNING - load average: 11.28, 15.16, 9.61 [00:55:01] 2013/06/28 00:54 OK z-dat-s7-a Load avg. OK - load average: 7.91, 13.49, 9.37 [03:17:05] 2013/06/28 03:15 WARN wolfsbane Load avg. WARNING - load average: 11.02, 21.15, 12.46 [03:21:05] 2013/06/28 03:20 CRIT wolfsbane Load avg. CRITICAL - load average: 45.14, 25.38, 15.54 [03:26:06] 2013/06/28 03:21 WARN ortelius Load avg. WARNING - load average: 13.16, 16.14, 11.75 [03:27:06] 2013/06/28 03:26 OK ortelius Load avg. OK - load average: 9.75, 14.58, 11.47 [03:38:07] 2013/06/28 03:37 WARN wolfsbane Load avg. WARNING - load average: 1.58, 9.32, 19.66 [03:43:08] 2013/06/28 03:42 OK wolfsbane Load avg. OK - load average: 2.14, 4.79, 14.72 [04:40:10] 2013/06/28 04:39 WARN rosemary wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3549.000000 [05:04:11] 2013/06/28 05:03 OK rosemary wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1632.000000 [05:17:12] 2013/06/28 05:10 WARN z-dat-s1-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2082 [05:24:13] 2013/06/28 05:17 WARN rosemary MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1983 [05:24:13] 2013/06/28 05:17 WARN rosemary s1 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2003.000000 [05:43:13] 2013/06/28 05:42 OK rosemary MySQL slave Uptime: 1071858 Threads: 7 Questions: 1615443921 Slow queries: 66449 Opens: 47953 Flush tables: 1 Open tables: 2985 Queries per second avg: 1507.143 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1797 [05:44:13] 2013/06/28 05:43 OK rosemary s1 replag QUERY OK: 'SELECT ts_rc_age()' returned 1756.000000 [05:57:14] 2013/06/28 05:56 CRIT z-dat-s1-b MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3619 [06:09:14] 2013/06/28 06:08 WARN z-dat-s1-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3563 [06:39:16] 2013/06/28 06:38 OK z-dat-s1-b MySQL slave Uptime: 3449652 Threads: 11 Questions: 3318385415 Slow queries: 54999 Opens: 18190 Flush tables: 1 Open tables: 719 Queries per second avg: 961.947 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1734 [09:07:26] 2013/06/28 09:00 CRIT ortelius toolserver.org HTTP CRITICAL - Socket timeout after 10 seconds [09:09:29] 2013/06/28 09:08 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.140 second response time [09:37:28] 2013/06/28 09:36 WARN ortelius toolserver.org HTTP HTTP WARNING: HTTP/1.1 200 OK - 239 bytes in 0.821 second response time [09:38:29] 2013/06/28 09:37 CRIT ortelius toolserver.org HTTP HTTP CRITICAL: HTTP/1.1 200 OK - 239 bytes in 1.186 second response time [09:39:30] 2013/06/28 09:38 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.093 second response time [10:02:31] 2013/06/28 10:01 WARN ortelius toolserver.org HTTP HTTP WARNING: HTTP/1.1 200 OK - 239 bytes in 0.534 second response time [10:03:31] 2013/06/28 10:02 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.020 second response time [10:16:14] hello all [11:22:41] /mnt/user-store seems slow to me... is only my impression? [11:36:35] 2013/06/28 11:30 WARN z-dat-s5-b /sql DISK WARNING - free space: /sql 102421 MB (10% inode=99%): [11:40:36] 2013/06/28 11:40 OK z-dat-s5-b /sql DISK OK - free space: /sql 105120 MB (11% inode=99%): [13:19:41] 2013/06/28 13:12 WARN z-dat-s4-a /sql DISK WARNING - free space: /sql 67080 MB (10% inode=99%): [14:37:37] [[Special:Log/newusers]] create 10 * Lepsyleon * (New user account) [14:54:45] 2013/06/28 14:48 WARN z-dat-s7-a wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2167.000000 [14:56:08] that’s me [15:18:47] 2013/06/28 15:18 CRIT z-dat-s7-a wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3607.000000 [16:31:49] 2013/06/28 16:25 WARN wolfsbane /tmp DISK WARNING - free space: / 6237 MB (20% inode=92%): [16:32:49] 2013/06/28 16:25 WARN wolfsbane / DISK WARNING - free space: / 6222 MB (20% inode=92%): [19:04:55] 2013/06/28 19:02 WARN wolfsbane Load avg. WARNING - load average: 9.53, 17.84, 13.26 [19:06:55] 2013/06/28 19:06 OK wolfsbane Load avg. OK - load average: 8.43, 14.55, 12.57 [19:07:37] hello [19:07:43] maintenance tonight :) [19:07:50] hi DaBPunkt : I created an issue on jire about lxml, could you tell me if I did it right? [19:08:22] ill now take the user-store offline [19:09:29] nosy: when user-store will be back? [19:09:50] BTW, you mean the /mnt/user-store? [19:09:52] it might take like up to 30 minutes [19:09:56] yes [19:10:17] have to unmount on one system, remount on the other [19:10:29] okay [19:10:34] thks [19:10:46] oh ill need to prepare first [19:11:26] prepare? what do u mean? [19:11:55] i have to map the access privileges on the san to hemlock first [19:11:59] its still online [19:12:26] oh, no problem [19:12:55] I hope to process some xml files out there soon [19:13:08] but I can wait [19:28:08] ok now i have the volume ready on the san for hemlock [19:28:13] going to unmount now [19:31:16] ah, nosy is at esams? /me waves [19:31:56] 2013/06/28 19:31 OK rosemary /mnt user-store DISK OK - free space: / 10101 MB (50% inode=91%): [19:39:38] ok waiting for fsck on hemlock [19:39:55] afterwards i can remount on all hosts, then user-store will be back [19:44:21] fsck is through [19:46:56] 2013/06/28 19:40 CRIT ortelius toolserver.org HTTP CRITICAL - Socket timeout after 10 seconds [19:47:56] 2013/06/28 19:40 CRIT wolfsbane toolserver.org HTTP CRITICAL - Socket timeout after 10 seconds [19:48:18] i am currently remounting (as soon as i get a prompt [19:48:31] clematis/hawthorn are already done [19:49:56] 2013/06/28 19:43 CRIT hemlock /aux0 DISK CRITICAL - free space: /aux0 123218 MB (2% inode=62%): [19:49:56] 2013/06/28 19:49 WARN ortelius toolserver.org HTTP HTTP WARNING: HTTP/1.1 200 OK - 239 bytes in 0.876 second response time [19:50:56] 2013/06/28 19:50 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.108 second response time [19:51:06] osm tiles back too [19:52:57] 2013/06/28 19:52 OK z-dat-s4-a /sql DISK OK - free space: /sql 68166 MB (11% inode=99%): [19:54:57] 2013/06/28 19:53 OK wolfsbane toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.010 second response time [19:56:46] hm...seems i better reboot nightshade and yarrow [19:56:54] doing nightshade [19:57:57] 2013/06/28 19:51 WARN yarrow Load avg. WARNING - load average: 25.53, 19.45, 11.18 [19:58:40] web, mail and willow are already fixed [19:58:57] 2013/06/28 19:58 CRIT nightshade / Connection refused or timed out [19:58:57] 2013/06/28 19:58 CRIT nightshade /tmp Connection refused or timed out [19:58:57] 2013/06/28 19:57 CRIT nightshade /var Connection refused or timed out [19:58:57] 2013/06/28 19:57 CRIT nightshade /var/tmp Connection refused or timed out [19:58:57] 2013/06/28 19:57 CRIT nightshade APT Connection refused or timed out [19:58:58] 2013/06/28 19:58 CRIT nightshade Environment IPMI Connection refused or timed out [19:58:58] 2013/06/28 19:57 CRIT nightshade Load avg. Connection refused or timed out [19:58:58] its only nightshade and yarrow are left [19:58:59] 2013/06/28 19:57 CRIT nightshade PING CRITICAL - Host Unreachable (nightshade) [19:58:59] 2013/06/28 19:58 CRIT nightshade SMTP CRITICAL - Socket timeout after 10 seconds [19:59:00] 2013/06/28 19:58 CRIT nightshade SSH No route to host [19:59:00] 2013/06/28 19:57 CRIT nightshade Sensors Connection refused or timed out [19:59:01] 2013/06/28 19:58 CRIT nightshade Sun Grid Engine execd Connection refused or timed out [19:59:01] 2013/06/28 19:58 CRIT nightshade aliasd Connection refused or timed out [19:59:12] o7 mutante [19:59:57] 2013/06/28 19:58 CRIT nightshade NTP CRITICAL - Socket timeout after 10 seconds [20:00:57] 2013/06/28 20:00 OK nightshade / DISK OK - free space: / 1593 MB (89% inode=94%): [20:00:57] 2013/06/28 20:00 OK nightshade /tmp DISK OK - free space: /tmp 4317 MB (96% inode=99%): [20:00:57] 2013/06/28 20:00 OK nightshade /var DISK OK - free space: /var 9777 MB (73% inode=47%): [20:00:57] 2013/06/28 20:00 OK nightshade /var/tmp DISK OK - free space: /var/tmp 872 MB (98% inode=99%): [20:00:57] 2013/06/28 20:00 OK nightshade Environment IPMI ok: temperature ok fan ok voltage ok chassis ok [20:00:58] 2013/06/28 20:00 OK nightshade Load avg. OK - load average: 0.95, 0.27, 0.09 [20:00:58] 2013/06/28 20:00 OK nightshade SSH SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0) [20:00:59] 2013/06/28 20:00 OK nightshade Sensors sensor ok [20:00:59] 2013/06/28 20:00 OK nightshade aliasd TCP OK - 0.001 second response time on port 984 [500 Not found.] [20:01:57] 2013/06/28 20:00 WARN nightshade APT APT WARNING: 65 packages available for upgrade (0 critical updates). [20:01:58] 2013/06/28 20:00 OK nightshade PING PING OK - Packet loss = 0%, RTA = 0.11 ms [20:01:58] 2013/06/28 20:01 OK nightshade SMTP SMTP OK - 0.041 sec. response time [20:01:58] 2013/06/28 20:01 CRIT yarrow Load avg. CRITICAL - load average: 31.33, 25.35, 15.39 [20:03:21] ok nightshade is fine [20:03:25] checking yarrow [20:03:44] rebooting yarrow [20:04:57] 2013/06/28 20:04 CRIT yarrow /var/tmp Timeout while attempting connection [20:04:58] 2013/06/28 20:04 CRIT yarrow APT Timeout while attempting connection [20:04:58] 2013/06/28 20:04 CRIT yarrow Environment IPMI Timeout while attempting connection [20:04:58] 2013/06/28 20:04 CRIT yarrow SRaid Connection refused or timed out [20:04:58] 2013/06/28 20:04 CRIT yarrow SSH CRITICAL - Socket timeout after 10 seconds [20:04:58] 2013/06/28 20:04 CRIT yarrow Sensors Connection refused or timed out [20:04:58] 2013/06/28 20:04 CRIT yarrow aliasd Timeout while attempting connection [20:05:57] 2013/06/28 20:00 WARN nightshade NTP NTP WARNING: Server has the LI_ALARM bit set, Offset -0.037014 secs [20:05:57] 2013/06/28 19:58 CRIT nightshade Sun Grid Engine execd CRITICAL: execd not communicating [20:05:57] 2013/06/28 20:05 CRIT yarrow / Connection refused or timed out [20:05:57] 2013/06/28 20:05 CRIT yarrow /tmp Connection refused or timed out [20:05:57] 2013/06/28 20:05 CRIT yarrow /var Connection refused or timed out [20:05:58] 2013/06/28 20:05 CRIT yarrow NTP CRITICAL - Socket timeout after 10 seconds [20:05:58] 2013/06/28 20:05 CRIT yarrow PING CRITICAL - Host Unreachable (yarrow) [20:05:59] 2013/06/28 20:04 CRIT yarrow SMTP No route to host [20:05:59] 2013/06/28 20:04 CRIT yarrow Sun Grid Engine execd Connection refused or timed out [20:07:57] 2013/06/28 20:07 OK yarrow SSH SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0) [20:07:57] 2013/06/28 20:07 OK yarrow Sensors sensor ok [20:08:57] 2013/06/28 20:08 OK yarrow / DISK OK - free space: / 1582 MB (88% inode=94%): [20:08:57] 2013/06/28 20:08 OK yarrow /tmp DISK OK - free space: /tmp 4093 MB (96% inode=99%): [20:08:57] 2013/06/28 20:08 OK yarrow /var DISK OK - free space: /var 11540 MB (86% inode=94%): [20:08:57] 2013/06/28 20:08 OK yarrow /var/tmp DISK OK - free space: /var/tmp 827 MB (97% inode=99%): [20:08:57] 2013/06/28 20:08 WARN yarrow APT APT WARNING: 65 packages available for upgrade (0 critical updates). [20:08:58] 2013/06/28 20:08 OK yarrow Environment IPMI ok: temperature ok fan ok voltage ok chassis ok [20:08:58] 2013/06/28 20:08 OK yarrow Load avg. OK - load average: 0.64, 0.22, 0.07 [20:08:59] 2013/06/28 20:08 OK yarrow PING PING OK - Packet loss = 0%, RTA = 0.19 ms [20:08:59] 2013/06/28 20:07 OK yarrow SMTP SMTP OK - 0.038 sec. response time [20:09:00] 2013/06/28 20:08 OK yarrow SRaid OK md0 status=[UU]. [20:09:00] 2013/06/28 20:08 OK yarrow aliasd TCP OK - 0.002 second response time on port 984 [500 Not found.] [20:13:57] 2013/06/28 20:08 WARN yarrow NTP NTP WARNING: Server has the LI_ALARM bit set, Offset -0.006687 secs [20:14:58] 2013/06/28 20:04 CRIT yarrow Sun Grid Engine execd CRITICAL: execd not communicating [20:15:58] 2013/06/28 20:15 OK nightshade NTP NTP OK: Offset -0.112152 secs [20:23:55] husten [20:23:58] 2013/06/28 20:23 OK yarrow NTP NTP OK: Offset -0.022466 secs [20:24:26] uhm I mean hi all [20:25:33] hello dschwen [20:25:39] houston? [20:25:43] a problem? ;) [20:26:09] hi nosy, quick question, the img_name column in table image, was that varbinary(255) all along? [20:26:11] everything should be back [20:27:17] I'm seeing horrible performance when executing SQL queries with a 'WHERE page_title = img_name' clause [20:27:34] that started maybe 2 months ago [20:27:40] dschwen: yes (i only checked for enwiki) [20:27:46] oh ... [20:27:56] on a paricular db or on all? [20:28:06] commonswiki_p.db [20:28:26] ill look [20:29:13] I'm not really an SQL expert.. so bear with me here. Do prefix indexes work on VARBINARY just like they work on VARTEXT ? [20:30:13] dschwen: oh...that is pointing to the s3 instance? [20:30:23] you want to use commons there i guess [20:30:36] do you expect commons and user-dbs or just commons? [20:30:37] host commonswiki-p.db [20:30:37] commonswiki-p.db.toolserver.org is an alias for hap-s4-user.esi.toolserver.org. [20:30:37] hap-s4-user.esi.toolserver.org has address 10.24.1.106 [20:30:48] it could be a mapping problem [20:30:53] commons and userdbs [20:30:59] mysql -h commonswiki_p.db [20:31:05] mysql> SHOW VARIABLES LIKE 'hostname'; [20:31:06] +---------------+------------+ [20:31:06] | Variable_name | Value | [20:31:06] +---------------+------------+ [20:31:06] | hostname | z-dat-s3-a | [20:31:06] +---------------+------------+ [20:31:06] 1 row in set (0.00 sec) [20:31:10] *husten* [20:31:27] I connect through the host name [20:31:29] i connect to commonswiki_p.db [20:31:32] as you wrote [20:31:34] and that seems to point else where [20:31:43] odd [20:31:49] there surely is a bug [20:32:01] it should only just work but can be slow though [20:32:05] je suis confusee! [20:32:12] oh no [20:32:16] no worries [20:32:42] i think ill talk to dab and then point it to s4-user if he has no other things i should keep in mind [20:32:55] the host I am connecting to does have the user dbs that I need (by user:Dispenser) [20:33:21] can you please look up the hostname? [20:33:24] if I suddenly use a different server that is not guaranteed anymore, is it? [20:33:35] which one? [20:34:12] dschwen: I found the COLLATE latin1_bin also fixes the slowdown issues on commons [20:34:47] hm what about the s4/s3 mixup above? [20:35:09] different hosts for sure and probably different user-dbs [20:35:58] 2013/06/28 20:29 CRIT wolfsbane Load avg. CRITICAL - load average: 41.72, 41.87, 24.23 [20:36:42] ok, I can add the COLLATE, but I am now comparing to a VARBINARY(255) column in a temporary table [20:37:24] i.e. I have a perp-query that builds a temp table where page_titles are cconverted to VARBINARY (that just takes half an hour to run) [20:37:27] ("just") [20:37:49] dschwen: s4-user should be faster with commons-queries then s3 [20:38:05] the next query that has a WHERE title=img_name takes forever [20:38:14] even though I added an INDEX on title [20:38:23] and both title and img_name have the same type [20:38:37] ok, nosy, I just don;t know what s4-user means [20:38:51] hap-s4-user? [20:38:55] yes [20:38:57] sorry [20:39:07] = commonswiki-p.db [20:39:17] which is what I am using [20:39:21] which is slow :-( [20:39:39] Above I mentioned that I connect through the host alias [20:39:51] I've never connected through z-dat-s3-a [20:39:58] 2013/06/28 20:39 WARN wolfsbane Load avg. WARNING - load average: 4.59, 21.72, 19.86 [20:40:05] hm... [20:40:11] I don't know if Dispenser's db is even on there [20:41:56] dschwen: then the _ was a typo here? [20:42:08] yeah, sorry! [20:42:14] ok :) [20:42:28] looks like there is more i/o since april [20:42:34] I didn't know that the _ domain also exists [20:42:38] might match your guessed date [20:42:42] me too [20:45:55] seeing a lot of [20:45:57] | 25170712 | daniel_www | turnera-ext-bge0.toolserver.org:50018 | commonswiki_p | Query | 2954 | Copying to tmp table | SELECT /* Gallery */ image.*, page_id, 1 as updated [20:45:57] FROM image [20:45:57] JOIN page ON page_title = img_nam | [20:45:57] | 25170742 | daniel_www | turnera-ext-bge0.toolserver.org:52050 | commonswiki_p | Query | 2947 | Copying to tmp table | SELECT /* Gallery */ image.*, page_id, 1 as updated [20:45:57] FROM image [20:45:57] JOIN page ON page_title = img_nam | [20:45:58] | 25170749 | daniel_www | turnera-ext-bge0.toolserver.org:52455 | commonswiki_p | Query | 2946 | Copying to tmp table | SELECT /* Gallery */ image.*, page_id, 1 as updated [20:45:58] FROM image [20:45:59] JOIN page ON page_title = img_nam | [20:45:59] | 25170753 | daniel_www | turnera-ext-bge0.toolserver.org:52724 | commonswiki_p | Query | 2945 | Copying to tmp table | SELECT /* Gallery */ image.*, page_id, 1 as updated [20:46:00] FROM image [20:46:00] JOIN page ON page_title = img_nam | [20:46:06] for neary an hour? [20:46:51] yikes [20:46:56] why 4 times? [20:46:58] 2013/06/28 20:46 OK wolfsbane Load avg. OK - load average: 3.21, 8.69, 14.25 [20:47:42] where does the /* Gallery */ come from?! [20:47:57] dont know but will ask daniel [20:48:04] oh hold on [20:48:07] ah its a comment [20:48:09] that is a differnt daniel [20:48:16] daniel kinzler [20:48:20] lol [20:48:22] I thought for a minute those were mine [20:48:24] yes there are some [20:48:26] nope [20:48:52] I know it was a comment I just did not recognized it :-) [20:49:05] dschwen: Have you tested how "img_name = CONVERT(page_title USING utf8)" performs? (True question, I don't know what MySQL does if you don't specify it.) [20:49:31] I tested "USING latin1" [20:49:45] apparently that is how utf8 is historically mangled in MW [20:50:14] But I guess those are two different issues [20:51:55] indeed CONVERT(img_name USING latin1) = page_title helps my GPSEXIF bot tremendously already [20:52:22] however my remaining performance issues seem to be unrelated to that [20:58:06] dschwen: yes sort of [21:00:40] well can you see anything peculiar about my currently running query? [21:01:37] dschwen: hm... [21:01:39] | 25113989 | dschwen | turnera-ext-bge0.toolserver.org:43090 | commonswiki_p | Query | 11640 | Sending data | SELECT /* SLOW_OK */ [21:01:39] pid, lat, lon, img_width, img_height, head, title, t.id, globe, [21:01:39] GROUP_ | [21:01:55] Sending data, uh huh. [21:02:23] maybe I should change SLOW_OK to FAST_PLEASE ? [21:05:13] dschwen: there is also tons of slow_ok from magnus glam stuff [21:05:20] all sending data [21:08:46] what does "Sending data" actually mean in the query status. Can I optimize my query somehow? Guess I sould analyze it using DESCRIBE or EXPLAIN [21:13:56] dschwen: might be explain is not working because you dont have access to the underlying tables of the views (they changed this in mysql)...hrhrhr [21:14:19] you can send the query and i do explain if you like [21:15:05] root@localhost:commonswiki_p> SELECT pid, lat, lon, img_width, img_height, head, title, t.id, globe, GROUP_CONCAT( DISTINCT cl_to SEPARATOR '|') FROM image, u_dschwen.compics LEFT JOIN categorylinks ON pid = cl_from LEFT JOIN u_dschwen.wma_tile t ON t.z=14 AND t.x=FLOOR( (lon-FLOOR(lon/360)*360) * 273.066666666667 ) AND t.y=FLOOR( (lat+90.0) * 273.066666666667 ) WHERE title = img_name GROUP BY [21:15:05] Empty set (0.08 sec) [21:15:11] hä? [21:17:26] sorry i need to go [21:17:28] bye [21:18:20] I have a question concerning account approval: At ACCAPP-601, I provided all data I was supposed to and on 03.05.2013 14:10, I sent an E-Mail containing the confidential data missing in the request as requested by DaBPunkt [21:18:51] Please tell me, what is missing? [21:19:22] rillke: let me see [21:20:08] I sent an S_MIME signed e-Mail [21:21:04] The certificate fingerprint is D0:19:A9:68:07:F4:00:40:95:99:4E:97:3F:51:75:FC:1C:D3:D0:29 [21:21:18] I see your mail [21:23:51] Something wrong with it? The certificate expired on 22.06. [21:24:00] but this should not matter ;-) [21:24:08] rillke: The data looks complete. Is it ok if I create the account at Sunday together with the others? [21:24:34] Yes, of course. [21:24:53] Thank you. [21:25:07] np [21:25:26] If something is missing, please ping me at Commons, if possible. [21:25:41] Will try [22:39:03] 2013/06/28 22:32 WARN z-dat-s2-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1822 [22:47:04] 2013/06/28 22:46 OK z-dat-s2-b MySQL slave Uptime: 3507815 Threads: 10 Questions: 3238242451 Slow queries: 64715 Opens: 25159938 Flush tables: 1 Open tables: 256 Queries per second avg: 923.150 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1774 [23:05:22] nighty night TS [23:08:08] nacht ts [23:45:06] 2013/06/28 23:38 WARN z-dat-s2-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1949 [23:57:06] 2013/06/28 23:56 OK z-dat-s2-b MySQL slave Uptime: 3512015 Threads: 8 Questions: 3239790480 Slow queries: 64857 Opens: 25192579 Flush tables: 1 Open tables: 256 Queries per second avg: 922.487 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1696