[00:03:49] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [00:05:10] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [00:06:10] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:21:58] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [00:25:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:40:10] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 434244 MB (8% inode=41%): [00:47:46] 3(commented) [ACC-248] timezone adjustment <10https://jira.toolserver.org/browse/ACC-248> (Simon Walker) [00:53:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:55:40] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:57:40] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 144857 [01:03:49] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [01:05:09] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [01:06:19] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:25:40] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:40:10] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 440005 MB (8% inode=42%): [01:53:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:54:09] /sql on thyme is WARNING: DISK WARNING - free space: /sql 199640 MB (20% inode=99%): [01:55:39] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:58:39] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 146720 [02:03:49] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [02:05:20] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [02:06:19] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:22:20] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:26:03] anyone have a minute to help with a query? Im trying to tweak http://pastebin.com/v7icRX0L to find all files that are un-used or that are just used on a subpage of [[User:Multichill]] [02:26:41] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:33:22] Brooke: any ideas? [02:35:56] Is this for Commons? [02:36:04] You'll have to check global links as well, I guess, then. [02:36:12] Brooke: no [02:36:15] its for enwiki [02:36:23] Multichill has subpages of images? [02:36:39] Brooke: yeah [02:36:48] [[User:Multichill/Free uploads/2011-07-16]] [02:36:57] So you're trying to get the imaegs that are unused and that are listed there? [02:37:03] No [02:37:31] images * [02:37:35] Im trying to get list of all zero use files, or files that are only used on his sub pages [02:38:09] IE http://en.wikipedia.org/wiki/File:3-2_2-3_son_clave.png [02:38:19] and others that have zero uses [02:39:09] like http://en.wikipedia.org/wiki/File:16BARS_Logo.jpg [02:40:22] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 435034 MB (8% inode=41%): [02:41:09] Right. Just do two queries. [02:41:16] Get the files from his subpages. [02:41:24] Then look through it and see which have only one use. [02:41:29] Those are the unused ones. [02:41:41] Well, not two queries. But two steps. [02:50:39] [[Special:Log/newusers]] create 10 * Whicheb5 * (New user account) [02:53:50] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:55:40] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:58:40] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 148305 [03:01:59] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [03:03:59] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [03:05:21] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [03:06:22] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:17:21] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:27:41] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:41:21] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 434661 MB (8% inode=41%): [03:54:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:55:39] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:59:40] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 148032 [04:03:59] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [04:06:19] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [04:07:21] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:10:20] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.412109/1.10, alarm hl:np_load_long=0.374512/1.55, alarm hl:mem_free=476.000000M/500M, alarm hl:tmp_free=14443M/200M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.412109/1.00, alarm hl:np_load_long=0.374512/1.50, alarm hl:mem_free=476.000000M/600M, alarm hl:tmp_free= [04:13:19] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [04:20:29] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.332031/1.00, alarm hl:np_load_long=0.373535/1.50, alarm hl:mem_free=568.000000M/600M, alarm hl:tmp_free=14448M/100M, alarm hl:available=1/0 [04:24:49] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:24:49] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:24:49] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:24:59] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:24:59] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:25:20] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:20] / on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:20] SMF on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:20] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:21] SMF on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:21] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:21] / on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:21] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:30] SSH on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:25:30] SMTP on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:25:39] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:40] /tmp on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:40] Load avg. on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:40] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:40] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:40] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:51] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:51] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:51] Load avg. on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:25:51] SMTP on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:25:51] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:25:59] SMF on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:26:09] s4 replag on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [04:26:09] / on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:26:09] / on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:26:30] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [04:26:40] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [04:26:40] MySQL on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [04:26:40] / on z-dat-s3-a is OK: DISK OK - free space: / 8224 MB (27% inode=85%): [04:26:40] / on z-dat-s7-a is OK: DISK OK - free space: / 8224 MB (27% inode=85%): [04:26:40] Load avg. on z-dat-s4-a is OK: OK - load average: 0.45, 1.41, 2.60 [04:26:40] Load avg. on z-dat-s7-a is OK: OK - load average: 0.44, 1.40, 2.59 [04:26:40] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:26:41] Load avg. on z-dat-s3-a is OK: OK - load average: 0.45, 1.41, 2.60 [04:26:41] SMF on z-dat-s7-a is OK: OK - all services online [04:26:50] / on z-dat-s4-a is OK: DISK OK - free space: / 8224 MB (27% inode=85%): [04:26:50] SMF on z-dat-s3-a is OK: OK - all services online [04:26:50] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 67248 MB (16% inode=99%): [04:26:50] SMF on z-dat-s4-a is OK: OK - all services online [04:26:50] /sql on z-dat-s7-a is OK: DISK OK - free space: /sql 77315 MB (19% inode=99%): [04:26:51] / on z-dat-s6-a is OK: DISK OK - free space: / 8224 MB (27% inode=85%): [04:26:51] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 115586 MB (11% inode=98%): [04:27:09] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 115586 MB (11% inode=98%): [04:27:09] Load avg. on z-dat-s6-a is OK: OK - load average: 0.43, 1.24, 2.47 [04:27:09] /tmp on z-dat-s7-a is OK: DISK OK - free space: /tmp 1894 MB (99% inode=99%): [04:27:09] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 1894 MB (99% inode=99%): [04:27:09] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 1894 MB (99% inode=99%): [04:27:10] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 1894 MB (99% inode=99%): [04:27:29] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:27:29] MySQL on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [04:27:30] SMTP on z-dat-s3-a is OK: SMTP OK - 7.973 sec. response time [04:27:30] s4 replag on z-dat-s4-a is OK: QUERY OK: SELECT ts_rc_age() returned 290.000000 [04:27:40] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [04:27:40] MySQL on z-dat-s4-a is OK: Uptime: 1751565 Threads: 8 Questions: 112511582 Slow queries: 18624 Opens: 33426 Flush tables: 1 Open tables: 997 Queries per second avg: 64.234 [04:27:40] MySQL on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [04:27:40] SMTP on z-dat-s7-a is OK: SMTP OK - 0.003 sec. response time [04:27:40] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:27:40] SMTP on z-dat-s6-a is OK: SMTP OK - 0.002 sec. response time [04:27:40] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:27:49] MySQL slave on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [04:27:49] MySQL on z-dat-s3-a is OK: Uptime: 4090023 Threads: 25 Questions: 4302152287 Slow queries: 284044 Opens: 42868978 Flush tables: 1 Open tables: 16384 Queries per second avg: 1051.865 [04:27:49] MySQL on z-dat-s7-a is OK: Uptime: 1729945 Threads: 9 Questions: 558084309 Slow queries: 101236 Opens: 3854866 Flush tables: 1 Open tables: 6499 Queries per second avg: 322.602 [04:27:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:27:50] SMF on z-dat-s6-a is OK: OK - all services online [04:27:50] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:27:59] MySQL slave on z-dat-s3-a is OK: Uptime: 4090031 Threads: 28 Questions: 4302166989 Slow queries: 284044 Opens: 42870555 Flush tables: 1 Open tables: 16381 Queries per second avg: 1051.866 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 308 [04:27:59] MySQL on z-dat-s6-a is OK: Uptime: 747128 Threads: 13 Questions: 139909690 Slow queries: 67449 Opens: 1292969 Flush tables: 1 Open tables: 2862 Queries per second avg: 187.263 [04:27:59] MySQL slave on z-dat-s7-a is OK: Uptime: 1729952 Threads: 10 Questions: 558086442 Slow queries: 101236 Opens: 3854866 Flush tables: 1 Open tables: 6499 Queries per second avg: 322.602 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 146 [04:28:19] SMTP on hyacinth is OK: SMTP OK - 0.003 sec. response time [04:28:19] SSH on hyacinth is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [04:41:50] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:41:59] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:41:59] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:42:20] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:42:20] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 442730 MB (8% inode=42%): [04:42:20] / on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:42:30] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:42:30] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:42:39] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:42:39] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:42:39] Load avg. on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:42:50] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:43:08] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [04:43:20] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [04:43:21] SMTP on z-dat-s4-a is OK: SMTP OK - 0.060 sec. response time [04:54:50] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:55:51] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:00:30] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 149182 [05:03:59] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [05:06:20] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [05:07:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:15:51] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 42118 MB (10% inode=99%): [05:25:49] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 67158 MB (16% inode=99%): [05:27:50] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:41:59] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:42:09] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:20] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 434600 MB (8% inode=41%): [05:42:29] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:42:40] /tmp on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:40] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:40] Load avg. on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:40] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:40] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:41] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:48] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:49] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:49] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:42:49] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:42:49] Load avg. on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:42:49] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:42:58] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [05:43:09] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [05:43:09] /tmp on z-dat-s7-a is OK: DISK OK - free space: /tmp 1807 MB (99% inode=99%): [05:43:09] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 1808 MB (99% inode=99%): [05:43:09] Load avg. on z-dat-s6-a is OK: OK - load average: 0.94, 2.16, 2.68 [05:43:09] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 1808 MB (99% inode=99%): [05:43:09] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 115447 MB (11% inode=98%): [05:43:10] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 1808 MB (99% inode=99%): [05:43:20] Load avg. on z-dat-s4-a is OK: OK - load average: 1.11, 2.18, 2.69 [05:43:20] Load avg. on z-dat-s3-a is OK: OK - load average: 1.11, 2.18, 2.69 [05:43:20] Load avg. on z-dat-s7-a is OK: OK - load average: 1.63, 2.27, 2.71 [05:43:20] SMTP on z-dat-s4-a is OK: SMTP OK - 0.002 sec. response time [05:43:40] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [05:43:40] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [05:43:40] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [05:54:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:55:50] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:00:29] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 149105 [06:03:59] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [06:06:20] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [06:07:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:19:32] [[Special:Log/newusers]] create 10 * Sharolyn619 * (New user account) [06:28:00] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:43:18] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 434500 MB (8% inode=41%): [06:50:29] Load avg. on adenia is WARNING: WARNING - load average: 16.56, 12.42, 9.02 [06:54:59] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:56:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:01:29] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 148909 [07:03:00] Load avg. on willow is WARNING: WARNING - load average: 17.51, 12.97, 10.23 [07:03:59] Load avg. on willow is OK: OK - load average: 12.16, 12.24, 10.14 [07:04:08] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [07:06:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [07:06:29] Load avg. on adenia is OK: OK - load average: 13.07, 14.68, 13.39 [07:08:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:16:29] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.416992/1.00, alarm hl:np_load_long=0.378906/1.50, alarm hl:mem_free=582.000000M/600M, alarm hl:tmp_free=14311M/100M, alarm hl:available=1/0 [07:17:29] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [07:28:58] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:35:45] 3(created) [MAGNUS-327] [File siblings] JavaScript injection via uselang; Magnus' tools; Critical Bug <10https://jira.toolserver.org/browse/MAGNUS-327> (Fomafix) [07:43:19] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 433554 MB (8% inode=41%): [07:55:59] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:56:59] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:01:29] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 149646 [08:04:09] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [08:06:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [08:08:29] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:29:09] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:43:20] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 438877 MB (8% inode=41%): [08:56:09] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:57:09] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:01:29] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 149803 [09:04:20] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [09:06:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [09:08:39] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:16:15] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 44133 MB (10% inode=99%): [09:25:16] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 71245 MB (17% inode=99%): [09:29:15] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:43:55] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 433225 MB (8% inode=41%): [09:56:15] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:57:15] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:58:55] /sql on cassia is WARNING: DISK WARNING - free space: /sql 93970 MB (7% inode=99%): [10:01:55] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 149939 [10:04:24] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [10:06:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [10:08:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:10:56] Sun Grid Engine execd on wolfsbane is WARNING: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=1.053223/1.00, alarm hl:np_load_long=0.765625/1.50, alarm hl:mem_free=1293.000000M/600M, alarm hl:tmp_free=14176M/100M, alarm hl:available=1/0 [10:11:56] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [10:13:24] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:13:25] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:14:04] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [10:14:14] SSH on z-dat-s6-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:29:15] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:29:25] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:29:44] SMF on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:29:44] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:29:44] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:29:44] /tmp on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:29:44] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:29:45] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:29:45] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:30:04] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:04] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:04] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:15] SMF on z-dat-s3-a is OK: OK - all services online [10:30:15] /tmp on z-dat-s6-a is OK: DISK OK - free space: /tmp 1843 MB (99% inode=99%): [10:30:15] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 1842 MB (99% inode=99%): [10:30:15] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 115622 MB (11% inode=98%): [10:30:15] /tmp on z-dat-s7-a is OK: DISK OK - free space: /tmp 1852 MB (99% inode=99%): [10:30:15] Load avg. on z-dat-s3-a is OK: OK - load average: 0.80, 1.30, 1.73 [10:30:15] Load avg. on z-dat-s4-a is OK: OK - load average: 0.80, 1.30, 1.73 [10:30:33] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [10:30:43] MySQL slave on z-dat-s3-a is OK: Uptime: 4111795 Threads: 28 Questions: 4329931926 Slow queries: 286877 Opens: 43245623 Flush tables: 1 Open tables: 16384 Queries per second avg: 1053.51 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 152 [10:30:55] SSH on z-dat-s3-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:30:55] SSH on z-dat-s7-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:30:55] SSH on z-dat-s4-a is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [10:43:57] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 432070 MB (8% inode=41%): [10:55:24] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:56:04] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [10:57:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:58:14] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:02:15] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 150611 [11:04:24] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [11:06:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [11:08:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:30:14] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:42:24] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:44:55] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 430937 MB (8% inode=41%): [11:56:55] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [11:57:15] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:58:14] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:02:14] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 150760 [12:04:24] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [12:06:55] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [12:09:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:12:31] @replag [12:12:32] closedmouth: s1-rr-a: 1m 3s [-0.00 s/s]; s1-user: 14s [+0.00 s/s]; s2-user: 1w 1d 6h 48m 20s [-1.89 s/s]; s2-user-c: 3m 4s [-0.11 s/s]; s3-rr-a: 31s [+0.00 s/s]; s3-user: 31s [+0.00 s/s]; s5-rr-a: 12m 53s [+0.01 s/s]; s5-user: 12m 53s [+0.01 s/s] [12:12:33] closedmouth: s5-user-c: 3m 4s [-0.11 s/s]; s6-rr-a: 1d 17h 56m 33s [+0.20 s/s]; s6-user: 1d 17h 56m 33s [+0.20 s/s] [12:27:37] / on willow is WARNING: DISK WARNING - free space: / 21996 MB (20% inode=99%): [12:27:37] /tmp on willow is WARNING: DISK WARNING - free space: / 21996 MB (20% inode=99%): [12:27:54] 3(created) [ACCAPP-529] Would like to install "wp-revision-network", a tool to visualize controversies derived from Wikipedia article histories; Account Approval; New Account <10https://jira.toolserver.org/browse/ACCAPP-529> (Jan Behrens) [12:31:14] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:44:55] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 439249 MB (8% inode=42%): [12:56:14] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 43195 MB (10% inode=99%): [12:56:40] [[~Psubhashish/tool]] ! 10https://wiki.toolserver.org/w/index.php?diff=7385&oldid=7366&rcid=9965 * Psubhashish * (+288) (/* Output field */ ) [12:57:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:58:14] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:00:04] [[Special:Log/newusers]] create 10 * JamesA * (New user account) [13:03:14] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 151534 [13:04:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [13:07:14] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 67623 MB (16% inode=99%): [13:07:56] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [13:09:55] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:23:56] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.413574/1.10, alarm hl:np_load_long=0.408691/1.55, alarm hl:mem_free=362.000000M/500M, alarm hl:tmp_free=13971M/200M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.413574/1.00, alarm hl:np_load_long=0.408691/1.50, alarm hl:mem_free=362.000000M/600M, alarm hl:tmp_free= [13:25:56] Sun Grid Engine execd on wolfsbane is OK: short-sol@wolfsbane OK: medium-sol@wolfsbane OK [13:26:55] /tmp on willow is WARNING: DISK WARNING - free space: / 21884 MB (20% inode=99%): [13:26:55] / on willow is WARNING: DISK WARNING - free space: / 21884 MB (20% inode=99%): [13:28:54] Sun Grid Engine execd on wolfsbane is WARNING: short-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.287598/1.10, alarm hl:np_load_long=0.375976/1.55, alarm hl:mem_free=346.000000M/500M, alarm hl:tmp_free=13947M/200M, alarm hl:available=1/0: medium-sol@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.287598/1.00, alarm hl:np_load_long=0.375976/1.50, alarm hl:mem_free=346.000000M/600M, alarm hl:tmp_free= [13:31:15] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:44:54] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 431278 MB (8% inode=41%): [13:45:45] 3(commented) [TS-1398] Large lag for Polish Wikipedia database <10https://jira.toolserver.org/browse/TS-1398> (Marlen Caemmerer) [13:54:11] [[Special:Log/newusers]] create 10 * Lusicyew524ds8 * (New user account) [13:54:55] /sql on thyme is WARNING: DISK WARNING - free space: /sql 199592 MB (20% inode=99%): [13:57:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:58:14] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:03:14] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 151428 [14:04:33] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [14:07:55] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [14:09:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:26:56] / on willow is WARNING: DISK WARNING - free space: / 21779 MB (20% inode=99%): [14:26:56] /tmp on willow is WARNING: DISK WARNING - free space: / 21779 MB (20% inode=99%): [14:31:15] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:44:56] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 432550 MB (8% inode=41%): [14:50:53] Requesting a checkup on this ticket: https://jira.toolserver.org/browse/ACCAPP-508 [14:57:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:57:25] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:58:14] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:03:14] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 150821 [15:04:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [15:07:55] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [15:09:57] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:15:56] Environment IPMI on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:16:33] Environment IPMI on adenia is OK: ok: temperature ok fan ok voltage ok chassis ok [15:16:59] @replag [15:16:59] cwek: s1-rr-a: 60s [-0.00 s/s]; s1-user: 17s [+0.00 s/s]; s2-user: 1w 1d 1h 17m 35s [-1.37 s/s]; s3-rr-a: 24s [+0.00 s/s]; s3-user: 24s [+0.00 s/s]; s6-rr-a: 1d 17h 46m 22s [-0.22 s/s]; s6-user: 1d 17h 46m 22s [-0.22 s/s] [15:27:56] / on willow is WARNING: DISK WARNING - free space: / 21666 MB (20% inode=99%): [15:27:56] /tmp on willow is WARNING: DISK WARNING - free space: / 21666 MB (20% inode=99%): [15:31:15] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:44:57] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 432367 MB (8% inode=41%): [15:57:13] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:58:14] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:02:24] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:03:15] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 149890 [16:04:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [16:07:55] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [16:07:55] Environment IPMI on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:09:44] Environment IPMI on adenia is OK: ok: temperature ok fan ok voltage ok chassis ok [16:09:56] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:12:05] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [16:28:04] /tmp on willow is WARNING: DISK WARNING - free space: / 21550 MB (20% inode=99%): [16:28:05] / on willow is WARNING: DISK WARNING - free space: / 21550 MB (20% inode=99%): [16:31:24] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:45:54] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 435460 MB (8% inode=41%): [16:57:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:58:14] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:04:14] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 149555 [17:04:33] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [17:08:05] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [17:10:06] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:28:04] /tmp on willow is WARNING: DISK WARNING - free space: / 21436 MB (20% inode=98%): [17:28:04] / on willow is WARNING: DISK WARNING - free space: / 21436 MB (20% inode=98%): [17:31:25] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:45:53] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 432130 MB (8% inode=41%): [17:57:13] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:58:24] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:04:13] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 148537 [18:04:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [18:08:04] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [18:11:06] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:28:04] /tmp on willow is WARNING: DISK WARNING - free space: / 21312 MB (20% inode=98%): [18:29:05] / on willow is WARNING: DISK WARNING - free space: / 21310 MB (20% inode=98%): [18:31:24] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:44:13] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [18:44:14] MySQL slave on daphne is CRITICAL: (Return code of 139 is out of bounds) [18:45:53] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 431992 MB (8% inode=41%): [18:57:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:58:24] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:04:15] MySQL slave on z-dat-s4-a is OK: Uptime: 1804164 Threads: 8 Questions: 116152018 Slow queries: 19163 Opens: 34090 Flush tables: 1 Open tables: 997 Queries per second avg: 64.379 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1259 [19:04:15] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 147677 [19:04:15] MySQL slave on daphne is OK: Uptime: 8960937 Threads: 14 Questions: 634072943 Slow queries: 341474 Opens: 1246 Flush tables: 2 Open tables: 323 Queries per second avg: 70.759 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1104 [19:04:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [19:08:04] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [19:12:04] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:28:04] /tmp on willow is WARNING: DISK WARNING - free space: / 21180 MB (20% inode=98%): [19:29:04] / on willow is WARNING: DISK WARNING - free space: / 21178 MB (20% inode=98%): [19:32:34] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:36:14] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1951.000000 [19:45:53] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 433317 MB (8% inode=41%): [19:47:24] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:57:14] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:58:34] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:04:14] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3631.000000 [20:04:34] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [20:05:15] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 149391 [20:08:04] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [20:11:07] @replag [20:11:07] DaBPunkt: s2-user: 1w 23h 26m 0s [-0.38 s/s]; s2-user-c: 1h 7m 29s [+0.17 s/s]; s5-user-c: 1h 7m 29s [+0.17 s/s]; s6-rr-a: 1d 17h 34m 4s [-0.04 s/s]; s6-user: 1d 17h 34m 4s [-0.04 s/s] [20:12:13] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:27:04] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [20:28:04] /tmp on willow is WARNING: DISK WARNING - free space: / 21067 MB (20% inode=98%): [20:29:14] / on willow is WARNING: DISK WARNING - free space: / 21066 MB (20% inode=98%): [20:32:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:38:46] [[Account limits]] 10https://wiki.toolserver.org/w/index.php?diff=7386&oldid=5607&rcid=9968 * Dab * (+2) (/* Memory */ 1GB is wrong AFAIS) [20:43:10] [[Account limits]] M 10https://wiki.toolserver.org/w/index.php?diff=7387&oldid=7386&rcid=9969 * Dab * (+2) (/* Memory */ ) [20:43:24] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3498.000000 [20:45:54] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 431713 MB (8% inode=41%): [20:57:35] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:58:24] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1712.000000 [20:58:34] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:04:44] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [21:05:24] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 150827 [21:08:14] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [21:11:21] [[Special:Log/newusers]] create 10 * CRCComputer * (New user account) [21:12:14] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:21:43] 3(created) [TS-1409] Please add me to the erfgoed project; Toolserver: Accounts; Task <10https://jira.toolserver.org/browse/TS-1409> (Max Semenik) [21:26:44] 3(assigned) [TS-1409] Please add me to the erfgoed project <10https://jira.toolserver.org/browse/TS-1409> (DaB.) [21:26:47] 3(commented) [TS-1409] Please add me to the erfgoed project <10https://jira.toolserver.org/browse/TS-1409> (DaB.) [21:28:04] /tmp on willow is WARNING: DISK WARNING - free space: / 20968 MB (20% inode=98%): [21:28:44] 3(commented) [TS-1409] Please add me to the erfgoed project <10https://jira.toolserver.org/browse/TS-1409> (Platonides) [21:29:14] / on willow is WARNING: DISK WARNING - free space: / 20966 MB (20% inode=98%): [21:32:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:41:43] 3(resolved) [TS-1409] Please add me to the erfgoed project <10https://jira.toolserver.org/browse/TS-1409> (DaB.) [21:45:53] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 431463 MB (8% inode=41%): [21:58:34] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:58:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:59:24] /sql on cassia is WARNING: DISK WARNING - free space: /sql 94540 MB (7% inode=99%): [22:04:45] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [22:05:24] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 152240 [22:08:24] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [22:12:25] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:21:14] /tmp on willow is OK: DISK OK - free space: / 24025 MB (22% inode=99%): [22:21:14] / on willow is OK: DISK OK - free space: / 24025 MB (22% inode=99%): [22:32:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:45:54] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 434528 MB (8% inode=41%): [22:58:35] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:58:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:04:54] FMA on yarrow is CRITICAL: ERROR - unexpected output from snmpwalk [23:05:25] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 153935 [23:06:24] ping Krinkle [23:06:34] yes? [23:06:56] where's the official TsIntuition now? [23:07:00] look at https://toolserver.org/~erfgoed/api/ [23:07:55] It has *never* been there under ~krinkle [23:08:02] Only for my personal testing [23:08:22] How did you get that path [23:08:25] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [23:08:39] https://wiki.toolserver.org/view/Toolserver_Intuition#Install [23:08:41] Platonides: [23:08:50] https://toolserver.org/~intuition/ [23:12:16] and where's ToolStart in ~intuition ? [23:12:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:12:56] Platonides: ? [23:13:04] Look at the first link [23:13:29] btw, that require_once( '/home/krinkle/TsIntuition/ToolStart.php' ); was not added by me, but by multichill [23:13:35] ok :) [23:13:45] he might have looked into my home directory and snatched it from there [23:14:48] sigh, I had triedboth /home/project/i/n/t/intuition/ToolStart.php and /home/project/i/n/t/intuition/TsIntuition/ToolStart.php, but not /home/project/i/n/t/intuition/ToolserverI18N/ToolStart.php [23:15:07] why isn't the home folder readable for all? [23:23:25] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 41898 MB (10% inode=99%): [23:32:35] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:36:25] /sql on z-dat-s4-a is CRITICAL: DISK CRITICAL - free space: /sql 24398 MB (5% inode=99%): [23:37:25] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 59555 MB (14% inode=99%): [23:41:34] wtf? [23:45:54] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 430062 MB (8% inode=41%): [23:49:25] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 43244 MB (10% inode=99%): [23:50:01] nacht ts [23:58:35] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:58:35] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default