[06:07:40] 2013/09/13 06:03 CRIT z-dat-s4-a MySQL slave (Service Check Timed Out) [06:08:40] 2013/09/13 06:07 OK z-dat-s4-a MySQL slave Uptime: 763375 Threads: 2 Questions: 41430761 Slow queries: 60 Opens: 263 Flush tables: 1 Open tables: 251 Queries per second avg: 54.273 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [10:04:06] [[Default license]] ! 10https://wiki.toolserver.org/w/index.php?diff=8143&oldid=4889&rcid=22239 * Nemobis * (+36) (on a Solaris host (like [[willow]])) [13:14:00] Hello? [13:14:03] Anyone awake? [13:55:01] everyone is sleeping Qcoder00, at least humans [13:55:11] Bother [17:57:11] 2013/09/13 17:50 WARN z-dat-s5-b s4 replag QUERY WARNING: 'SELECT ts_rc_age()' returned 2070.000000 [18:10:11] 2013/09/13 18:04 WARN willow / DISK WARNING - free space: / 14251 MB (13% inode=98%): [18:10:12] 2013/09/13 18:03 WARN willow /tmp DISK WARNING - free space: / 14743 MB (14% inode=98%): [18:13:12] 2013/09/13 18:13 CRIT willow / DISK CRITICAL - free space: / 10481 MB (10% inode=97%): [18:13:12] 2013/09/13 18:12 CRIT willow /tmp DISK CRITICAL - free space: / 10976 MB (10% inode=97%): [18:19:13] 2013/09/13 18:18 OK z-dat-s5-b s4 replag QUERY OK: 'SELECT ts_rc_age()' returned 1737.000000 [18:22:36] Hello all. Linux-Maitenance starts in half ’n hour [18:30:14] 2013/09/13 18:30 OK willow / DISK OK - free space: / 28277 MB (27% inode=99%): [18:30:15] 2013/09/13 18:29 OK willow /tmp DISK OK - free space: / 28484 MB (27% inode=99%): [18:56:49] Danny_B: you know that there is maintencance today? [18:59:21] o7 [18:59:28] maintenance tonight [19:00:08] o7? [19:08:16] 2013/09/13 19:07 OK z-dat-s2-b APT APT OK: 0 packages available for upgrade (0 critical updates). [19:10:15] 2013/09/13 19:06 CRIT z-dat-s2-b SMTP Connection refused [19:11:15] 2013/09/13 19:10 OK yarrow APT APT OK: 0 packages available for upgrade (0 critical updates). [19:11:15] 2013/09/13 19:10 OK z-dat-s2-b SMTP SMTP OK - 0.003 sec. response time [19:18:16] 2013/09/13 19:17 CRIT yarrow /tmp Timeout while attempting connection [19:18:16] 2013/09/13 19:17 CRIT yarrow Environment IPMI Connection refused or timed out [19:18:16] 2013/09/13 19:17 CRIT yarrow NTP CRITICAL - Socket timeout after 10 seconds [19:18:16] 2013/09/13 19:17 CRIT yarrow PING CRITICAL - Host Unreachable (yarrow) [19:18:16] 2013/09/13 19:17 CRIT yarrow SRaid Connection refused or timed out [19:18:16] 2013/09/13 19:17 CRIT yarrow SSH No route to host [19:18:17] 2013/09/13 19:17 CRIT yarrow Sensors Connection refused or timed out [19:18:17] 2013/09/13 19:17 CRIT yarrow aliasd Connection refused or timed out [19:19:15] 2013/09/13 19:18 CRIT yarrow / Connection refused or timed out [19:19:15] 2013/09/13 19:18 CRIT yarrow /var Connection refused or timed out [19:19:15] 2013/09/13 19:18 CRIT yarrow /var/tmp Connection refused or timed out [19:19:15] 2013/09/13 19:18 CRIT yarrow APT Connection refused or timed out [19:19:15] 2013/09/13 19:18 CRIT yarrow Load avg. Connection refused or timed out [19:19:15] 2013/09/13 19:18 CRIT yarrow SMTP No route to host [19:19:16] 2013/09/13 19:18 CRIT yarrow Sun Grid Engine execd Connection refused or timed out [19:19:16] 2013/09/13 19:18 OK z-dat-s1-b APT APT OK: 0 packages available for upgrade (0 critical updates). [19:22:15] 2013/09/13 19:21 OK yarrow / DISK OK - free space: / 1581 MB (88% inode=94%): [19:22:15] 2013/09/13 19:21 OK yarrow /tmp DISK OK - free space: /tmp 4093 MB (96% inode=99%): [19:22:15] 2013/09/13 19:21 OK yarrow /var DISK OK - free space: /var 12477 MB (93% inode=94%): [19:22:15] 2013/09/13 19:21 OK yarrow /var/tmp DISK OK - free space: /var/tmp 827 MB (97% inode=99%): [19:22:15] 2013/09/13 19:21 OK yarrow APT APT OK: 0 packages available for upgrade (0 critical updates). [19:22:16] 2013/09/13 19:21 OK yarrow Environment IPMI ok: temperature ok fan ok voltage ok chassis ok [19:22:16] 2013/09/13 19:21 OK yarrow Load avg. OK - load average: 0.77, 0.26, 0.09 [19:22:16] 2013/09/13 19:21 OK yarrow PING PING OK - Packet loss = 0%, RTA = 0.11 ms [19:22:17] 2013/09/13 19:21 OK yarrow SMTP SMTP OK - 0.046 sec. response time [19:22:18] 2013/09/13 19:21 OK yarrow SRaid OK md0 status=[UU]. [19:22:18] 2013/09/13 19:21 OK yarrow SSH SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0) [19:22:18] 2013/09/13 19:21 OK yarrow Sensors sensor ok [19:25:15] 2013/09/13 19:18 CRIT z-dat-s1-b SMTP Connection refused [19:26:15] 2013/09/13 19:25 OK nightshade APT APT OK: 0 packages available for upgrade (0 critical updates). [19:27:15] 2013/09/13 19:18 CRIT yarrow Sun Grid Engine execd CRITICAL: execd not communicating [19:27:16] 2013/09/13 19:26 OK z-dat-s1-b SMTP SMTP OK - 0.021 sec. response time [19:28:16] 2013/09/13 19:21 WARN yarrow NTP NTP WARNING: Server has the LI_ALARM bit set, Offset 0.065738 secs [19:31:15] 2013/09/13 19:30 CRIT nightshade /tmp Connection refused or timed out [19:31:15] 2013/09/13 19:30 CRIT nightshade /var/tmp Timeout while attempting connection [19:31:15] 2013/09/13 19:30 CRIT nightshade APT Timeout while attempting connection [19:31:15] 2013/09/13 19:30 CRIT nightshade Environment IPMI Connection refused or timed out [19:31:15] 2013/09/13 19:30 CRIT nightshade SMTP CRITICAL - Socket timeout after 10 seconds [19:31:15] 2013/09/13 19:30 CRIT nightshade Sensors Connection refused or timed out [19:31:16] 2013/09/13 19:30 CRIT nightshade aliasd Connection refused or timed out [19:31:16] 2013/09/13 19:30 OK sage APT APT OK: 0 packages available for upgrade (0 critical updates). [19:32:15] 2013/09/13 19:31 CRIT nightshade / Connection refused or timed out [19:32:15] 2013/09/13 19:31 CRIT nightshade /var Connection refused or timed out [19:32:15] 2013/09/13 19:31 CRIT nightshade Load avg. Connection refused or timed out [19:32:15] 2013/09/13 19:31 CRIT nightshade NTP CRITICAL - Socket timeout after 10 seconds [19:32:15] 2013/09/13 19:31 CRIT nightshade PING CRITICAL - Host Unreachable (nightshade) [19:32:15] 2013/09/13 19:31 CRIT nightshade SSH No route to host [19:32:16] 2013/09/13 19:31 CRIT nightshade Sun Grid Engine execd Connection refused or timed out [19:35:16] 2013/09/13 19:34 OK nightshade / DISK OK - free space: / 1592 MB (89% inode=94%): [19:35:16] 2013/09/13 19:34 OK nightshade /tmp DISK OK - free space: /tmp 4317 MB (96% inode=99%): [19:35:16] 2013/09/13 19:34 OK nightshade /var DISK OK - free space: /var 9480 MB (70% inode=47%): [19:35:16] 2013/09/13 19:34 OK nightshade /var/tmp DISK OK - free space: /var/tmp 872 MB (98% inode=99%): [19:35:16] 2013/09/13 19:34 OK nightshade APT APT OK: 0 packages available for upgrade (0 critical updates). [19:35:16] 2013/09/13 19:34 OK nightshade Environment IPMI ok: temperature ok fan ok voltage ok chassis ok [19:35:17] 2013/09/13 19:34 OK nightshade Load avg. OK - load average: 1.72, 0.67, 0.24 [19:35:17] 2013/09/13 19:34 OK nightshade PING PING OK - Packet loss = 0%, RTA = 0.34 ms [19:35:18] 2013/09/13 19:34 OK nightshade SMTP SMTP OK - 0.045 sec. response time [19:35:18] 2013/09/13 19:34 OK nightshade SSH SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0) [19:35:19] 2013/09/13 19:34 OK nightshade Sensors sensor ok [19:35:19] 2013/09/13 19:34 OK nightshade aliasd TCP OK - 0.001 second response time on port 984 [500 Not found.] [19:38:16] 2013/09/13 19:37 CRIT yarrow NTP NTP CRITICAL: Server not synchronized, Offset unknown [19:40:17] 2013/09/13 19:31 CRIT nightshade Sun Grid Engine execd CRITICAL: execd not communicating [19:40:17] 2013/09/13 19:33 CRIT sage SSH CRITICAL - Socket timeout after 10 seconds [19:40:17] 2013/09/13 19:39 WARN yarrow NTP NTP WARNING: Server has the LI_ALARM bit set, Offset 0.003105 secs [19:41:17] 2013/09/13 19:40 OK sage SMTP SMTP OK - 0.003 sec. response time [19:48:18] 2013/09/13 19:47 OK yucca APT APT OK: 0 packages available for upgrade (0 critical updates). [19:49:18] 2013/09/13 19:42 WARN hawthorn Load avg. WARNING - load average: 20.29, 15.78, 8.09 [19:50:18] 2013/09/13 19:43 WARN clematis Load avg. WARNING - load average: 20.25, 16.35, 8.57 [19:53:19] 2013/09/13 19:52 OK yarrow NTP NTP OK: Offset 0.001925 secs [20:02:19] 2013/09/13 20:01 CRIT hawthorn Load avg. CRITICAL - load average: 1045.07, 263.48, 98.66 [20:13:19] 2013/09/13 20:12 OK yarrow Sun Grid Engine execd Host and Queues Ok [20:15:19] 2013/09/13 20:14 OK nightshade Sun Grid Engine execd Host and Queues Ok [20:21:20] 2013/09/13 20:21 CRIT clematis Load avg. CRITICAL - load average: 118.64, 40.71, 25.74 [20:26:20] 2013/09/13 20:26 WARN hawthorn Load avg. WARNING - load average: 0.17, 2.14, 19.27 [20:27:20] 2013/09/13 20:27 WARN clematis Load avg. WARNING - load average: 0.51, 14.91, 19.13 [20:30:21] 2013/09/13 20:30 OK hawthorn Load avg. OK - load average: 1.21, 1.27, 14.89 [20:31:21] 2013/09/13 20:31 OK clematis Load avg. OK - load average: 0.11, 6.79, 14.71 [20:53:21] 2013/09/13 20:52 OK sage SSH SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0) [23:24:38] nacht ts [23:48:05] DaB. * Re: [Toolserver-announce] [Toolserver-l] Linux-Maintenance next Friday and upgrade-announcement