[00:06:00] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:06:38] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:08:48] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:16:03] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [00:17:53] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:29:23] Environment IPMI on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:30:14] Environment IPMI on adenia is OK: ok: temperature ok fan ok voltage ok chassis ok [00:32:43] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:37:13] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [00:39:47] 3(created) [MAGNUS-328] Size of video files in glamorous.php; Magnus' tools; Trivial Bug <10https://jira.toolserver.org/browse/MAGNUS-328> (DerHexer) [00:40:04] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:51:53] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 409214 MB (7% inode=40%): [00:55:14] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:55:14] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:55:15] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:55:22] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:55:22] Environment IPMI on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:55:56] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [00:56:04] Environment IPMI on hyacinth is OK: ok: temperature ok fan ok voltage ok chassis ok [00:56:04] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [00:56:04] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [00:56:04] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [01:06:03] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:06:54] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:09:04] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:09:13] SMTP on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:09:13] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:09:13] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:09:13] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:09:23] Load avg. on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:23] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:23] Environment IPMI on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:23] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:23] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:09:33] / on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:33] SMF on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:33] / on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:33] SMF on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:33] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:34] SMF on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:42] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:09:44] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:44] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:44] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:44] / on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:44] Load avg. on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:09:56] / on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:10:05] /tmp on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:10:05] SMTP on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:10:14] s4 replag on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [01:10:23] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:10:24] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:10:24] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:10:24] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:10:24] SMF on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:10:55] MySQL on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [01:10:55] MySQL on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [01:10:55] MySQL slave on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [01:11:04] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 1048 MB (99% inode=99%): [01:11:04] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 1048 MB (99% inode=99%): [01:11:04] SMF on z-dat-s7-a is OK: OK - all services online [01:11:04] /sql on z-dat-s7-a is OK: DISK OK - free space: /sql 76998 MB (19% inode=99%): [01:11:04] Load avg. on z-dat-s3-a is OK: OK - load average: 0.32, 1.29, 2.14 [01:11:05] Load avg. on z-dat-s4-a is OK: OK - load average: 0.31, 1.30, 2.15 [01:11:05] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:11:06] / on z-dat-s3-a is OK: DISK OK - free space: / 8215 MB (27% inode=85%): [01:11:06] SMF on z-dat-s3-a is OK: OK - all services online [01:11:07] SMF on z-dat-s6-a is OK: OK - all services online [01:11:07] / on z-dat-s7-a is OK: DISK OK - free space: / 8215 MB (27% inode=85%): [01:11:13] SMTP on z-dat-s7-a is OK: SMTP OK - 5.883 sec. response time [01:11:14] s4 replag on z-dat-s4-a is OK: QUERY OK: SELECT ts_rc_age() returned 207.000000 [01:11:14] SMF on z-dat-s4-a is OK: OK - all services online [01:11:14] SMF on hyacinth is OK: OK - all services online [01:11:14] Load avg. on z-dat-s7-a is OK: OK - load average: 0.35, 1.26, 2.11 [01:11:14] MySQL on z-dat-s7-a is OK: Uptime: 1890946 Threads: 18 Questions: 600974938 Slow queries: 106616 Opens: 4343751 Flush tables: 1 Open tables: 6281 Queries per second avg: 317.817 [01:11:15] MySQL on z-dat-s6-a is OK: Uptime: 908122 Threads: 17 Questions: 175463863 Slow queries: 77598 Opens: 1542948 Flush tables: 1 Open tables: 2877 Queries per second avg: 193.216 [01:11:15] MySQL slave on z-dat-s6-a is OK: Uptime: 908122 Threads: 17 Questions: 175463867 Slow queries: 77598 Opens: 1542948 Flush tables: 1 Open tables: 2877 Queries per second avg: 193.216 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 260 [01:11:16] MySQL slave on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [01:11:16] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 1029 MB (99% inode=99%): [01:11:17] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [01:11:17] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 116958 MB (12% inode=98%): [01:11:33] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [01:11:33] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [01:11:34] SMTP on hyacinth is OK: SMTP OK - 0.005 sec. response time [01:11:34] /tmp on z-dat-s7-a is OK: DISK OK - free space: /tmp 1010 MB (99% inode=99%): [01:11:43] MySQL on z-dat-s3-a is OK: Uptime: 4251055 Threads: 38 Questions: 4496006383 Slow queries: 298754 Opens: 45406289 Flush tables: 1 Open tables: 16383 Queries per second avg: 1057.621 [01:11:43] MySQL slave on z-dat-s3-a is OK: Uptime: 4251055 Threads: 38 Questions: 4496006380 Slow queries: 298754 Opens: 45406289 Flush tables: 1 Open tables: 16383 Queries per second avg: 1057.621 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 257 [01:12:20] SMTP on z-dat-s3-a is OK: SMTP OK - 0.080 sec. response time [01:12:20] SMTP on z-dat-s6-a is OK: SMTP OK - 0.003 sec. response time [01:16:33] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [01:18:53] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:40:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:51:54] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 423844 MB (8% inode=41%): [01:56:53] /sql on thyme is WARNING: DISK WARNING - free space: /sql 198400 MB (20% inode=99%): [02:06:32] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:07:52] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:10:01] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:13:21] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:14:01] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [02:17:31] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [02:19:53] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:22:20] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:40:34] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 42626 MB (10% inode=99%): [02:41:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:48:31] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 67018 MB (16% inode=99%): [02:52:53] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 425704 MB (8% inode=41%): [03:06:34] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:07:52] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:10:02] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:17:32] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [03:20:01] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:41:33] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:43:04] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:53:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 421637 MB (7% inode=40%): [04:06:33] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:06:33] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.506348/1.10, alarm hl:np_load_long=0.381836/1.55, alarm hl:mem_free=238.000000M/500M, alarm hl:tmp_free=14546M/200M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.506348/1.00, alarm hl:np_load_long=0.381836/1.50, alarm hl:mem_free=238.000000M/600M, alarm hl:tmp_free= [04:08:01] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:10:11] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:11:54] [[User talk:TParis]] ! 10https://wiki.toolserver.org/w/index.php?diff=7391&oldid=7014&rcid=9979 * 65.255.37.169 * (-1) (Hii, this is suraj verma, hometown- saharsa bihar, currently persuing b.tech from 'giacr rayagada, odisha') [04:17:31] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [04:20:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:21:41] SMTP on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:21:41] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:21:41] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:21:51] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:21:51] Environment IPMI on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:21:51] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:22:00] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:22:09] SMF on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:22:10] SMF on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:22:32] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:22:32] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:22:33] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:22:49] Load avg. on z-dat-s3-a is OK: OK - load average: 0.23, 1.28, 1.83 [04:22:49] SMF on z-dat-s6-a is OK: OK - all services online [04:22:49] SMF on z-dat-s3-a is OK: OK - all services online [04:22:49] SMF on hyacinth is OK: OK - all services online [04:23:21] SMTP on hyacinth is OK: SMTP OK - 0.003 sec. response time [04:23:21] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:23:21] SMTP on z-dat-s6-a is OK: SMTP OK - 0.236 sec. response time [04:23:31] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [04:23:31] Environment IPMI on hyacinth is OK: ok: temperature ok fan ok voltage ok chassis ok [04:23:31] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:23:31] SMTP on z-dat-s7-a is OK: SMTP OK - 0.065 sec. response time [04:23:40] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:25:32] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [04:29:31] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.464355/1.10, alarm hl:np_load_long=0.477539/1.55, alarm hl:mem_free=199.000000M/500M, alarm hl:tmp_free=14543M/200M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.464355/1.00, alarm hl:np_load_long=0.477539/1.50, alarm hl:mem_free=199.000000M/600M, alarm hl:tmp_free= [04:37:49] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [04:42:31] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:42:40] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:42:40] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:42:50] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:42:50] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:42:50] Environment IPMI on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:43:20] Load avg. on z-dat-s3-a is OK: OK - load average: 0.98, 1.82, 2.11 [04:43:30] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [04:43:30] Environment IPMI on hyacinth is OK: ok: temperature ok fan ok voltage ok chassis ok [04:43:30] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:43:30] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:47:40] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [04:53:20] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 420299 MB (7% inode=40%): [05:06:40] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:07:41] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.161133/1.00, alarm hl:np_load_long=0.252441/1.50, alarm hl:mem_free=550.000000M/600M, alarm hl:tmp_free=14553M/100M, alarm hl:available=1/0 [05:08:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:10:33] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [05:17:41] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [05:20:33] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:38:42] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [05:42:30] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:48:59] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:49:41] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [05:53:32] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 429641 MB (8% inode=41%): [05:59:41] SMTP on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:59:41] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:59:41] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:59:50] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:00:00] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:00:00] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:00:10] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:00:32] NTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:00:41] s4 replag on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [06:00:41] MySQL slave on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [06:01:00] MySQL on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [06:01:00] MySQL slave on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [06:01:31] MySQL slave on z-dat-s4-a is OK: Uptime: 1930002 Threads: 15 Questions: 121886507 Slow queries: 20595 Opens: 35377 Flush tables: 1 Open tables: 998 Queries per second avg: 63.153 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 498 [06:01:32] s4 replag on z-dat-s4-a is OK: QUERY OK: SELECT ts_rc_age() returned 499.000000 [06:01:32] Load avg. on z-dat-s3-a is OK: OK - load average: 0.23, 2.47, 3.30 [06:01:32] SMTP on z-dat-s7-a is OK: SMTP OK - 0.002 sec. response time [06:01:32] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [06:01:32] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [06:01:41] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [06:01:41] MySQL on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [06:01:41] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [06:01:41] MySQL slave on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [06:01:41] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [06:01:42] SMF on z-dat-s6-a is OK: OK - all services online [06:01:42] MySQL on z-dat-s6-a is OK: Uptime: 925553 Threads: 13 Questions: 182240667 Slow queries: 79093 Opens: 1570622 Flush tables: 1 Open tables: 2949 Queries per second avg: 196.899 [06:01:42] MySQL slave on z-dat-s6-a is OK: Uptime: 925553 Threads: 13 Questions: 182240668 Slow queries: 79093 Opens: 1570622 Flush tables: 1 Open tables: 2949 Queries per second avg: 196.899 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 219 [06:01:50] MySQL slave on z-dat-s3-a is OK: Uptime: 4268463 Threads: 19 Questions: 4504239765 Slow queries: 301246 Opens: 45554774 Flush tables: 1 Open tables: 16384 Queries per second avg: 1055.236 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 228 [06:01:50] MySQL on z-dat-s7-a is OK: Uptime: 1908385 Threads: 7 Questions: 605819855 Slow queries: 107347 Opens: 4344534 Flush tables: 1 Open tables: 6520 Queries per second avg: 317.451 [06:01:50] MySQL on z-dat-s3-a is OK: Uptime: 4268463 Threads: 19 Questions: 4504239777 Slow queries: 301246 Opens: 45554774 Flush tables: 1 Open tables: 16384 Queries per second avg: 1055.236 [06:01:50] MySQL slave on z-dat-s7-a is OK: Uptime: 1908385 Threads: 7 Questions: 605819856 Slow queries: 107347 Opens: 4344534 Flush tables: 1 Open tables: 6520 Queries per second avg: 317.451 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 151 [06:02:20] NTP on hyacinth is OK: NTP OK: Offset -0.000265 secs [06:06:42] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:08:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:10:50] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:15:50] MySQL slave on z-dat-s3-a is CRITICAL: Cant connect to MySQL server on z-dat-s3-a (146) [06:15:50] MySQL on z-dat-s3-a is CRITICAL: Cant connect to MySQL server on z-dat-s3-a (146) [06:16:10] MySQL slave on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [06:16:10] MySQL on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [06:17:42] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [06:20:09] MySQL slave on z-dat-s6-a is OK: Uptime: 364 Threads: 9 Questions: 4630 Slow queries: 0 Opens: 181 Flush tables: 1 Open tables: 164 Queries per second avg: 12.719 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 239 [06:20:09] MySQL on z-dat-s6-a is OK: Uptime: 364 Threads: 8 Questions: 4638 Slow queries: 0 Opens: 181 Flush tables: 1 Open tables: 164 Queries per second avg: 12.741 [06:21:31] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:26:31] [[Special:Log/newusers]] create 10 * Certclick55 * (New user account) [06:30:50] MySQL slave on z-dat-s3-a is OK: Uptime: 1010 Threads: 14 Questions: 367 Slow queries: 2 Opens: 212 Flush tables: 1 Open tables: 202 Queries per second avg: 0.363 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1472 [06:30:50] MySQL on z-dat-s3-a is OK: Uptime: 1010 Threads: 14 Questions: 369 Slow queries: 2 Opens: 212 Flush tables: 1 Open tables: 202 Queries per second avg: 0.365 [06:39:50] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1901 [06:42:32] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:54:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 421863 MB (7% inode=41%): [06:56:50] MySQL slave on z-dat-s3-a is OK: Uptime: 2570 Threads: 24 Questions: 474888 Slow queries: 112 Opens: 10765 Flush tables: 1 Open tables: 10737 Queries per second avg: 184.781 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1618 [07:07:41] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:09:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:10:51] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:17:50] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [07:21:32] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:25:19] why is PHP cURL failing for me on Willow? [07:42:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:54:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 420148 MB (7% inode=40%): [08:02:21] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 44107 MB (10% inode=99%): [08:06:20] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 70510 MB (17% inode=99%): [08:07:50] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:10:31] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:10:51] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:18:01] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [08:21:40] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:42:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:53:20] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 43225 MB (10% inode=99%): [08:54:31] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 420272 MB (7% inode=40%): [09:01:27] Magog_the_Ogre: works for me [09:08:01] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:09:21] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 66601 MB (16% inode=99%): [09:10:31] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:11:10] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:19:01] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [09:21:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:42:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:43:02] Andre Karwath * [Toolserver-l] Mail with "Unable to read script file because of error: no input read from stdin" [09:54:31] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 427618 MB (8% inode=41%): [10:00:40] /sql on cassia is WARNING: DISK WARNING - free space: /sql 90520 MB (7% inode=99%): [10:08:01] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:11:10] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:11:41] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:12:20] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40334 MB (9% inode=99%): [10:19:01] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [10:21:40] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:24:20] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24420 MB (5% inode=99%): [10:40:20] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 47974 MB (11% inode=99%): [10:42:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:43:20] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 38463 MB (9% inode=99%): [10:51:20] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 73263 MB (18% inode=99%): [10:54:40] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 420773 MB (7% inode=40%): [11:08:11] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:11:20] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:11:41] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:20:10] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [11:21:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:40:00] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1920 [11:42:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:54:41] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 420548 MB (7% inode=40%): [11:55:10] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1920 [11:57:00] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1900 [12:08:11] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:10:20] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41910 MB (10% inode=99%): [12:11:20] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:11:42] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:18:21] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 70694 MB (17% inode=99%): [12:20:10] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [12:21:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:28:10] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3655 [12:35:00] MySQL slave on z-dat-s3-a is OK: Uptime: 22863 Threads: 51 Questions: 11690085 Slow queries: 2939 Opens: 106378 Flush tables: 1 Open tables: 16384 Queries per second avg: 511.310 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1782 [12:35:00] MySQL slave on z-dat-s7-a is OK: Uptime: 1931982 Threads: 26 Questions: 617757072 Slow queries: 108893 Opens: 4466703 Flush tables: 1 Open tables: 6465 Queries per second avg: 319.753 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1691 [12:42:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:54:41] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 420384 MB (7% inode=40%): [13:09:12] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:11:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:12:02] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:21:02] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [13:22:01] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:28:33] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 7270 [13:39:19] user-store isnt mounted on yarrow :( [13:43:01] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:53:11] MySQL on z-dat-s6-a is CRITICAL: Too many connections [13:55:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 426337 MB (8% inode=41%): [13:57:32] /sql on thyme is WARNING: DISK WARNING - free space: /sql 197769 MB (20% inode=99%): [14:09:11] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:12:02] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:12:31] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:21:02] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [14:22:02] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:29:31] MySQL slave on z-dat-s6-a is CRITICAL: Too many connections [14:43:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:53:12] MySQL on z-dat-s6-a is CRITICAL: Too many connections [14:55:03] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 419905 MB (7% inode=40%): [15:09:12] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:12:03] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:12:31] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [15:21:02] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [15:22:02] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:30:31] MySQL slave on z-dat-s6-a is CRITICAL: Too many connections [15:43:02] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:50:44] 3(created) [MNT-1250] Restart mysql on z-dat-s6-a; Maintenance; Emergency work <10https://jira.toolserver.org/browse/MNT-1250> (DaB.) [15:54:12] MySQL on z-dat-s6-a is CRITICAL: Too many connections [15:55:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 418025 MB (7% inode=40%): [16:00:42] 3(commented) [MNT-1250] Restart mysql on z-dat-s6-a <10https://jira.toolserver.org/browse/MNT-1250> (DaB.) [16:08:02] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:09:11] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:12:03] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:12:41] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:21:12] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [16:22:12] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:30:31] MySQL slave on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [16:43:11] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:54:11] MySQL on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [16:55:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 421422 MB (7% inode=40%): [17:09:13] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:12:41] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:13:02] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:13:02] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:22:11] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [17:23:11] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:30:30] MySQL slave on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [17:43:12] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:54:12] MySQL on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [17:56:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 413607 MB (7% inode=40%): [18:09:47] 3(commented) [MNT-1250] Restart mysql on z-dat-s6-a <10https://jira.toolserver.org/browse/MNT-1250> (DaB.) [18:10:12] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:12:50] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:13:12] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:22:11] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [18:23:11] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:30:42] MySQL slave on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [18:43:11] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:54:12] MySQL on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [18:56:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 413519 MB (7% inode=40%): [18:56:42] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1883.000000 [19:05:02] Hersfold Wikipedia * Re: [Toolserver-l] Mail with "Unable to read script file because [19:10:24] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:12:51] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [19:14:10] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:22:21] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [19:23:20] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:31:41] MySQL slave on z-dat-s6-a is CRITICAL: Cant connect to MySQL server on z-dat-s6-a (146) [19:36:06] [[Special:Log/newusers]] create 10 * Yourfitnessdating * (New user account) [19:43:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:45:11] MySQL on z-dat-s6-a is OK: Uptime: 485 Threads: 15 Questions: 86436 Slow queries: 1 Opens: 399 Flush tables: 1 Open tables: 98 Queries per second avg: 178.218 [19:53:01] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:53:47] 3(commented) [MNT-1250] Restart mysql on z-dat-s6-a <10https://jira.toolserver.org/browse/MNT-1250> (Marlen Caemmerer) [19:56:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 421446 MB (7% inode=40%): [19:56:51] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2977.000000 [20:11:31] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:13:00] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:14:11] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:17:52] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [20:19:12] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1920 [20:22:20] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [20:23:31] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:25:51] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1787.000000 [20:31:41] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 31578 [20:33:01] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:43:31] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:56:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 414065 MB (7% inode=40%): [21:11:33] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:13:01] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [21:13:10] MySQL slave on z-dat-s7-a is OK: Uptime: 1963065 Threads: 7 Questions: 622504148 Slow queries: 110571 Opens: 4466874 Flush tables: 1 Open tables: 6484 Queries per second avg: 317.108 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1649 [21:13:47] 3(commented) [MNT-1250] Restart mysql on z-dat-s6-a <10https://jira.toolserver.org/browse/MNT-1250> (DaB.) [21:14:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:22:21] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [21:23:31] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:31:52] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 31050 [21:34:02] Dr. Trigon * Re: [Toolserver-l] Anoter SGE question [21:40:01] gn8 ts [21:44:31] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:56:01] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 413237 MB (7% inode=40%): [22:01:01] /sql on cassia is WARNING: DISK WARNING - free space: /sql 90888 MB (7% inode=99%): [22:08:02] Merlissimo * Re: [Toolserver-l] Anoter SGE question [22:09:02] Platonides * Re: [Toolserver-l] Anoter SGE question [22:11:42] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:14:02] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:15:21] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:22:21] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [22:23:42] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:32:51] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 19342 [22:44:41] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:56:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 420113 MB (7% inode=40%): [23:12:41] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:14:03] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [23:15:22] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:22:21] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [23:24:41] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:32:51] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 8163 [23:44:42] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:56:03] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 411380 MB (7% inode=40%): [23:58:41] [[Special:Log/newusers]] create 10 * Ga5432222222222222 * (New user account)