[03:29:37] [[Special:Log/newusers]] create 10 * Mbaindia01 * (New user account) [03:58:13] 2013/07/09 03:55 WARN wolfsbane Load avg. WARNING - load average: 5.81, 16.90, 12.03 [03:59:13] 2013/07/09 03:58 OK wolfsbane Load avg. OK - load average: 3.75, 14.33, 11.43 [04:09:14] 2013/07/09 04:03 CRIT ortelius Load avg. CRITICAL - load average: 41.68, 59.74, 32.94 [04:18:14] 2013/07/09 04:17 WARN ortelius Load avg. WARNING - load average: 2.61, 12.23, 19.43 [04:23:15] 2013/07/09 04:22 OK ortelius Load avg. OK - load average: 2.92, 6.23, 14.71 [07:31:30] 2013/07/09 07:24 CRIT ortelius toolserver.org HTTP CRITICAL - Socket timeout after 10 seconds [07:33:30] 2013/07/09 07:32 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.042 second response time [07:47:31] 2013/07/09 07:40 CRIT ortelius toolserver.org HTTP HTTP CRITICAL: HTTP/1.1 200 OK - 239 bytes in 4.186 second response time [07:49:36] 2013/07/09 07:48 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.266 second response time [07:56:33] 2013/07/09 07:49 CRIT ortelius toolserver.org HTTP CRITICAL - Socket timeout after 10 seconds [08:23:34] 2013/07/09 08:22 CRIT ortelius Sun Grid Engine execd Timeout while attempting connection [08:24:34] 2013/07/09 08:23 OK nightshade aliasd TCP OK - 0.003 second response time on port 984 [500 Not found.] [08:24:34] 2013/07/09 08:23 CRIT ortelius / Connection refused or timed out [08:24:34] 2013/07/09 08:23 CRIT ortelius /tmp Connection refused or timed out [08:24:34] 2013/07/09 08:23 CRIT ortelius DiskSuite Connection refused or timed out [08:24:34] 2013/07/09 08:23 CRIT ortelius Environment IPMI Connection refused or timed out [08:24:35] 2013/07/09 08:23 CRIT ortelius Load avg. Connection refused or timed out [08:24:35] 2013/07/09 08:23 CRIT ortelius NTP CRITICAL - Socket timeout after 10 seconds [08:24:36] 2013/07/09 08:23 CRIT ortelius PING CRITICAL - Host Unreachable (ortelius) [08:24:36] 2013/07/09 08:23 CRIT ortelius SMTP No route to host [08:24:37] 2013/07/09 08:23 CRIT ortelius SSH CRITICAL - Socket timeout after 10 seconds [08:24:37] 2013/07/09 08:17 CRIT wolfsbane toolserver.org HTTP HTTP CRITICAL: HTTP/1.1 200 OK - 239 bytes in 3.386 second response time [08:26:34] 2013/07/09 08:25 OK ortelius / DISK OK - free space: / 13820 MB (46% inode=92%): [08:26:34] 2013/07/09 08:25 OK ortelius /tmp DISK OK - free space: /tmp 27752 MB (99% inode=99%): [08:26:35] 2013/07/09 08:25 OK ortelius DiskSuite OK - No disk failures detected [08:26:35] 2013/07/09 08:26 OK ortelius Environment IPMI ok: temperature ok fan ok voltage ok chassis ok [08:26:35] 2013/07/09 08:25 OK ortelius Load avg. OK - load average: 2.02, 0.82, 0.31 [08:26:35] 2013/07/09 08:25 OK ortelius NTP NTP OK: Offset 0.038208 secs [08:26:35] 2013/07/09 08:25 OK ortelius PING PING OK - Packet loss = 0%, RTA = 0.33 ms [08:26:36] 2013/07/09 08:25 OK ortelius SSH SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [08:26:36] 2013/07/09 08:25 WARN ortelius Sun Grid Engine execd NRPE: Unable to read output [08:27:34] 2013/07/09 08:26 OK ortelius SMTP SMTP OK - 0.249 sec. response time [08:27:35] 2013/07/09 08:26 OK ortelius toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.007 second response time [08:28:35] 2013/07/09 08:27 OK wolfsbane toolserver.org HTTP HTTP OK: HTTP/1.1 200 OK - 239 bytes in 0.009 second response time [08:37:34] 2013/07/09 08:36 OK z-dat-s3-a / DISK OK - free space: / 6333 MB (21% inode=84%): [08:37:34] 2013/07/09 08:37 OK z-dat-s3-a /sql DISK OK - free space: /sql 198516 MB (20% inode=99%): [08:38:34] 2013/07/09 08:37 OK z-dat-s3-a /tmp DISK OK - free space: /tmp 38412 MB (99% inode=99%): [08:38:35] 2013/07/09 08:37 OK z-dat-s3-a Load avg. OK - load average: 4.17, 5.10, 4.75 [09:52:38] 2013/07/09 09:48 CRIT z-dat-s3-a MySQL Can't connect to MySQL server on 'z-dat-s3-a' (111) [09:52:38] 2013/07/09 09:48 CRIT z-dat-s3-a MySQL slave Can't connect to MySQL server on 'z-dat-s3-a' (111) [10:26:39] 2013/07/09 10:25 OK z-dat-s3-a MySQL Uptime: 2225 Threads: 26 Questions: 30146 Slow queries: 1 Opens: 294 Flush tables: 1 Open tables: 270 Queries per second avg: 13.548 [10:26:39] 2013/07/09 10:25 WARN z-dat-s3-a MySQL slave SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2234 [10:51:42] 2013/07/09 10:50 OK z-dat-s3-a MySQL slave Uptime: 3725 Threads: 17 Questions: 1650829 Slow queries: 89 Opens: 8857 Flush tables: 1 Open tables: 8831 Queries per second avg: 443.175 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1616 [11:29:43] 2013/07/09 11:22 WARN wolfsbane / DISK WARNING - free space: / 6257 MB (20% inode=92%): [11:29:43] 2013/07/09 11:23 WARN wolfsbane /tmp DISK WARNING - free space: / 6265 MB (20% inode=92%): [13:11:48] 2013/07/09 13:04 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2145.000000 [14:15:49] 2013/07/09 14:14 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3607.000000 [14:17:50] 2013/07/09 14:16 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3600.000000 [14:18:50] 2013/07/09 14:17 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3602.000000 [14:19:51] 2013/07/09 14:18 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3599.000000 [14:20:51] 2013/07/09 14:19 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3601.000000 [14:21:51] 2013/07/09 14:20 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3599.000000 [14:29:51] 2013/07/09 14:28 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3606.000000 [14:30:51] 2013/07/09 14:29 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3585.000000 [14:38:51] 2013/07/09 14:37 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3609.000000 [15:06:55] 2013/07/09 15:05 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3594.000000 [15:09:02] 2013/07/09 15:07 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3604.000000 [15:10:55] 2013/07/09 15:09 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3566.000000 [15:41:54] 2013/07/09 15:40 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3605.000000 [15:42:54] 2013/07/09 15:41 WARN z-dat-s2-b wikidata replag QUERY WARNING: 'SELECT ts_rc_age()' returned 3580.000000 [15:44:54] 2013/07/09 15:43 CRIT z-dat-s2-b wikidata replag QUERY CRITICAL: 'SELECT ts_rc_age()' returned 3630.000000 [18:09:02] 2013/07/09 18:07 CRIT wolfsbane / DISK CRITICAL - free space: / 3225 MB (10% inode=92%): [18:10:02] 2013/07/09 18:08 WARN wolfsbane / DISK WARNING - free space: / 3448 MB (11% inode=92%): [18:25:03] 2013/07/09 18:23 CRIT wolfsbane / DISK CRITICAL - free space: / 3294 MB (10% inode=92%): [18:26:04] 2013/07/09 18:24 WARN wolfsbane / DISK WARNING - free space: / 3330 MB (11% inode=92%): [18:30:04] 2013/07/09 18:28 CRIT wolfsbane / DISK CRITICAL - free space: / 3229 MB (10% inode=92%): [18:30:04] 2013/07/09 18:29 CRIT wolfsbane /tmp DISK CRITICAL - free space: / 3288 MB (10% inode=92%): [18:31:04] 2013/07/09 18:29 WARN wolfsbane / DISK WARNING - free space: / 3302 MB (11% inode=92%): [18:31:04] 2013/07/09 18:30 WARN wolfsbane /tmp DISK WARNING - free space: / 3300 MB (11% inode=92%): [18:32:04] 2013/07/09 18:30 CRIT wolfsbane / DISK CRITICAL - free space: / 3283 MB (10% inode=92%): [18:33:04] 2013/07/09 18:32 CRIT wolfsbane /tmp DISK CRITICAL - free space: / 3264 MB (10% inode=92%): [18:36:04] 2013/07/09 18:34 WARN wolfsbane / DISK WARNING - free space: / 3296 MB (11% inode=92%): [18:37:05] 2013/07/09 18:35 CRIT wolfsbane / DISK CRITICAL - free space: / 3247 MB (10% inode=92%): [20:13:18] 2013/07/09 20:12 OK z-dat-s4-a /sql DISK OK - free space: /sql 67112 MB (11% inode=99%): [20:20:10] 2013/07/09 20:13 WARN z-dat-s4-a /sql DISK WARNING - free space: /sql 66647 MB (10% inode=99%): [22:38:20] 2013/07/09 22:37 WARN wolfsbane / DISK WARNING - free space: / 5158 MB (17% inode=92%): [22:39:20] 2013/07/09 22:38 WARN wolfsbane /tmp DISK WARNING - free space: / 5155 MB (17% inode=92%): [23:46:24] 2013/07/09 23:39 CRIT wolfsbane Load avg. CRITICAL - load average: 29.88, 53.02, 30.39 [23:57:25] 2013/07/09 23:56 WARN wolfsbane Load avg. WARNING - load average: 3.95, 11.81, 19.62