[03:55:49] 2013/10/29 03:52 WARN z-dat-s7-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1950 [04:27:52] 2013/10/29 04:26 CRIT z-dat-s7-a MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3640 [04:58:55] 2013/10/29 04:57 WARN rosemary MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3600 [04:58:55] 2013/10/29 04:58 WARN rosemary s1 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3569.000000 [06:00:58] 2013/10/29 06:00 OK rosemary s1 replag QUERY OK: 'SELECT ts_rc_age()' returned 1793.000000 [06:02:58] 2013/10/29 06:01 OK rosemary MySQL slave Uptime: 10270383 Threads: 128 Questions: 7152224316 Slow queries: 1460523 Opens: 391467 Flush tables: 1 Open tables: 3909 Queries per second avg: 696.393 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1768 [07:28:04] 2013/10/29 07:25 WARN z-dat-s4-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1959 [07:59:05] 2013/10/29 07:52 WARN daphne MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1961 [07:59:05] 2013/10/29 07:52 WARN daphne s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 1970.000000 [07:59:05] 2013/10/29 07:58 CRIT z-dat-s4-a MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3647 [08:12:06] 2013/10/29 08:05 WARN cassia MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2134 [08:12:06] 2013/10/29 08:05 WARN cassia s5 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2154.000000 [08:39:07] 2013/10/29 08:38 CRIT cassia s5 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3613.000000 [08:40:08] 2013/10/29 08:39 CRIT cassia MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3644 [08:41:08] 2013/10/29 08:40 CRIT daphne MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3616 [08:41:08] 2013/10/29 08:40 CRIT daphne s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3630.000000 [09:23:10] 2013/10/29 09:22 WARN z-dat-s7-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3564 [09:26:10] 2013/10/29 09:19 WARN rosemary MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2132 [09:27:11] 2013/10/29 09:20 WARN rosemary s1 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2162.000000 [09:54:11] 2013/10/29 09:53 WARN hemlock / DISK WARNING - free space: / 2824 MB (14% inode=87%): [09:54:11] 2013/10/29 09:53 OK hemlock /aux0 DISK OK - free space: / 3741 MB (18% inode=87%): [09:55:11] 2013/10/29 09:54 WARN hemlock /tmp DISK WARNING - free space: / 3743 MB (18% inode=87%): [09:59:12] 2013/10/29 09:58 CRIT cassia /sql/data/dewiki DISK CRITICAL - free space: /sql 130120 MB (10% inode=99%): [09:59:12] 2013/10/29 09:58 WARN z-dat-s5-b /sql DISK WARNING - free space: /sql 116111 MB (10% inode=99%): [10:00:11] 2013/10/29 09:53 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2140 [10:00:11] 2013/10/29 09:53 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2149.000000 [10:06:11] 2013/10/29 09:59 WARN cassia /sql DISK WARNING - free space: /sql 130090 MB (10% inode=99%): [10:21:12] 2013/10/29 10:20 OK z-dat-s7-a MySQL slave Uptime: 1558302 Threads: 115 Questions: 244638916 Slow queries: 274938 Opens: 466934 Flush tables: 1 Open tables: 3246 Queries per second avg: 156.990 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1784 [10:34:13] 2013/10/29 10:33 CRIT z-dat-s5-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3601.000000 [10:35:14] 2013/10/29 10:34 CRIT z-dat-s5-b MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3629 [10:52:59] Hi everyoine. I get always the error 'user 'luxo' has exceeded the 'max_user_connections' resource (current value: 15)' - does anyone knows anything about that? has this limit changed? I hadn't this problem in the past. [11:18:17] 2013/10/29 11:17 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3563.000000 [11:19:17] 2013/10/29 11:18 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3425 [11:27:18] 2013/10/29 11:26 OK z-dat-s5-b MySQL slave Uptime: 1031776 Threads: 12 Questions: 1551899887 Slow queries: 6733 Opens: 37572 Flush tables: 1 Open tables: 256 Queries per second avg: 1504.105 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1670 [11:27:18] 2013/10/29 11:26 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1637.000000 [11:50:18] 2013/10/29 11:49 CRIT rosemary MySQL slave Slave IO: No Slave SQL: Yes Seconds Behind Master: (null) [11:51:18] 2013/10/29 11:50 WARN rosemary MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1980 [12:26:19] 2013/10/29 12:19 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2182.000000 [12:45:40] sigh, nothing is working properly recently :-/ [12:50:21] 2013/10/29 12:49 CRIT z-dat-s5-b s4 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3622.000000 [12:54:21] 2013/10/29 12:47 WARN z-dat-s5-b MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1893 [12:54:22] 2013/10/29 12:47 WARN z-dat-s5-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 1886.000000 [12:56:21] 2013/10/29 12:55 OK z-dat-s5-b MySQL slave Uptime: 1037116 Threads: 15 Questions: 1553605801 Slow queries: 6785 Opens: 37792 Flush tables: 1 Open tables: 256 Queries per second avg: 1498.5 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1719 [12:56:21] 2013/10/29 12:55 OK z-dat-s5-b wikidata replag QUERY OK: 'SELECT ts_rc_age()' returned 1705.000000 [13:14:22] 2013/10/29 13:10 CRIT ortelius toolserver.org HTTP HTTP CRITICAL: HTTP/1.1 200 OK - 239 bytes in 4.258 second response time [13:25:23] 2013/10/29 13:24 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.006 second response time [13:56:32] ok now i know why I have exceeded max_user_connections all the time... up to 30 requests/min from "Baiduspider/2.0; +http://www.baidu.com/search/spider.html" ! [14:33:27] 2013/10/29 14:26 CRIT web.amaranth wiki.toolserver.org CRITICAL - Socket timeout after 16 seconds [19:05:41] 2013/10/29 19:05 CRIT rosemary s1 replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3628.000000 [19:06:41] 2013/10/29 19:05 CRIT rosemary MySQL slave SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3643 [21:15:49] 2013/10/29 21:15 OK web.amaranth wiki.toolserver.org HTTP OK: HTTP/1.1 200 OK - 349 bytes in 0.837 second response time [21:36:50] 2013/10/29 21:30 CRIT web.amaranth wiki.toolserver.org CRITICAL - Socket timeout after 16 seconds [22:09:52] 2013/10/29 22:09 OK web.amaranth wiki.toolserver.org HTTP OK: HTTP/1.1 200 OK - 349 bytes in 0.769 second response time [23:46:58] 2013/10/29 23:40 CRIT web.amaranth wiki.toolserver.org CRITICAL - Socket timeout after 16 seconds