[00:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 352081.000000 [00:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 52637 MB (8% inode=99%): [00:01:00] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3651.000000 [00:01:00] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3650.000000 [00:01:09] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:01:09] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [00:02:00] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [00:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [00:03:09] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:30] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [00:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [00:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:04:39] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [00:04:49] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [00:05:10] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [00:05:30] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 372755 MB (6% inode=63%): [00:05:30] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [00:05:30] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:06:19] DaBPunkt, Susan thanks, my doubt was on the possible values for up_value, 0, 1 or others. It's allways 1 and 0, right? [00:06:53] i was tryng to figure out if it's possible to check how many people disabled a gadget [00:06:55] no [00:07:39] that's not a bollean-field [00:07:44] boolean [00:08:30] a piece: up_property LIKE 'gadget-%' AND up_value = x [00:09:59] Alchimista: I guess your question is: Is 0 true or false? [00:13:31] DaBPunkt: not quite, i mean if there is a way to count how many gadgets where desable. Someone told me that there where a way to check it [00:15:24] Alchimista: you can use this table for that, yes. The only problem is AFAIK that the table stores no default-values by default. So if the default of a gadget is "enabled" the tables stores no such data as long as a user does not change his/her settings [00:19:07] DaBPunkt: so that answers my question indeed. table stores only enabled or not enabled [00:19:54] Alchimista: the tables stores all settings a user has done. [00:20:43] thanks for spreading the magic DaBPunkt :P [00:21:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:25:51] Alchimista: If the gadget is opt-in, then nothing will be stored. [00:26:00] Except gadget-foo when it's true. [00:26:33] Alchimista: it is after midnight, so magic is normal now :) [00:26:42] If the gadget is opt-out, then gadget-foo will be stored if it's specifically disabled by a user. [00:26:50] MySQL slave on rosemary is OK: Uptime: 1155753 Threads: 6 Questions: 1056151247 Slow queries: 359002 Opens: 54623 Flush tables: 1 Open tables: 3389 Queries per second avg: 913.820 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1768 [00:26:51] I'm just echoing. [00:27:00] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1760.000000 [00:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [00:29:45] DaBPunkt: it's 1.30 here, there must be even more, so it's a kind of magic (and dreams) :P [00:32:10] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 75841.000000 [00:33:13] nacht ts [00:57:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:57:49] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 326507.000000 [00:57:59] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:58:20] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 323221.000000 [00:58:30] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:59:10] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 363437.000000 [00:59:10] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 444492.000000 [00:59:10] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:59:19] / on thyme is UNKNOWN: NRPE: Unable to read output [00:59:29] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 205022.000000 [00:59:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:59:49] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [00:59:49] RAID on thyme is UNKNOWN: NRPE: Unable to read output [01:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 355681.000000 [01:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 52383 MB (8% inode=99%): [01:01:01] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7251.000000 [01:01:01] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7251.000000 [01:01:09] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:01:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [01:02:00] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [01:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [01:03:09] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:03:30] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [01:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [01:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:04:39] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [01:04:49] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [01:05:10] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [01:05:30] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 373802 MB (7% inode=63%): [01:05:31] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [01:05:31] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:21:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [01:32:10] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 79441.000000 [01:37:30] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 28982 MB (2% inode=99%): [01:43:48] * Jasper_Deng_busy thinks IPv6 was disabled on TS for stability reasons [01:43:56] (for toolserver.org) [01:44:44] [[User talk:فلورانس]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7902&rcid=21750 * Florence * (+53) (Created page with "~~~~") [01:57:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:57:50] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 328901.000000 [01:58:00] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:58:20] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 326822.000000 [01:58:30] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:59:09] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 367037.000000 [01:59:09] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 448092.000000 [01:59:09] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:59:19] / on thyme is UNKNOWN: NRPE: Unable to read output [01:59:29] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 208623.000000 [01:59:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:59:50] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [01:59:50] RAID on thyme is UNKNOWN: NRPE: Unable to read output [02:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 359281.000000 [02:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 52235 MB (8% inode=99%): [02:01:00] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10851.000000 [02:01:00] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10850.000000 [02:01:09] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:01:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [02:02:00] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [02:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [02:03:10] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:03:30] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [02:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [02:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:04:39] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [02:04:50] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [02:05:10] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [02:05:30] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 373077 MB (7% inode=63%): [02:05:30] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [02:05:30] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:21:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [02:32:10] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 83041.000000 [02:57:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:57:49] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 330264.000000 [02:58:00] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:58:20] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 330422.000000 [02:58:30] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:59:10] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 370637.000000 [02:59:10] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 451692.000000 [02:59:10] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:59:19] / on thyme is UNKNOWN: NRPE: Unable to read output [02:59:29] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 212223.000000 [02:59:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:59:49] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [02:59:49] RAID on thyme is UNKNOWN: NRPE: Unable to read output [03:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 362881.000000 [03:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 52098 MB (8% inode=99%): [03:01:00] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 14451.000000 [03:01:00] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 14451.000000 [03:01:09] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:01:09] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [03:02:01] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [03:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [03:03:09] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:03:30] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [03:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [03:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:04:39] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [03:04:49] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [03:05:09] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [03:05:30] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 372815 MB (7% inode=63%): [03:05:30] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [03:05:30] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:21:09] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [03:32:10] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 86641.000000 [03:40:29] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31442 MB (5% inode=99%): [03:42:29] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 33091 MB (6% inode=99%): [03:57:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:57:49] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 330823.000000 [03:57:59] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:58:20] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 334022.000000 [03:58:30] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:59:10] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 374237.000000 [03:59:10] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 455292.000000 [03:59:10] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:59:19] / on thyme is UNKNOWN: NRPE: Unable to read output [03:59:29] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 215822.000000 [03:59:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:59:49] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [03:59:50] RAID on thyme is UNKNOWN: NRPE: Unable to read output [04:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 366481.000000 [04:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 51930 MB (8% inode=99%): [04:01:00] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18050.000000 [04:01:00] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18051.000000 [04:01:12] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:01:12] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [04:02:00] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [04:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [04:03:09] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:03:30] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [04:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [04:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:04:39] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [04:04:49] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [04:05:10] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [04:05:30] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 371335 MB (6% inode=63%): [04:05:30] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [04:05:30] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:21:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [04:30:14] [[Wiki server assignments]] ! 10https://wiki.toolserver.org/w/index.php?diff=7903&oldid=7894&rcid=21751 * 185.15.59.202 * (+0) (updated page) [04:32:10] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 90241.000000 [04:57:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:57:50] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 333111.000000 [04:57:59] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:58:19] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 337622.000000 [04:58:30] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:59:10] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 377837.000000 [04:59:10] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 458892.000000 [04:59:10] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:59:19] / on thyme is UNKNOWN: NRPE: Unable to read output [04:59:29] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 219422.000000 [04:59:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:59:49] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [04:59:50] RAID on thyme is UNKNOWN: NRPE: Unable to read output [04:59:59] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 370081.000000 [05:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 51766 MB (8% inode=99%): [05:01:00] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21651.000000 [05:01:01] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21650.000000 [05:01:10] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:01:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [05:02:00] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [05:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [05:03:10] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:03:29] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [05:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [05:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:04:40] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [05:04:50] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [05:05:09] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [05:05:29] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 371683 MB (6% inode=63%): [05:05:30] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [05:05:30] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:08:49] Free Memory on damiana is CRITICAL: CRITICAL - 2.4% (197292 kB) free! [05:21:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:28:29] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31579 MB (5% inode=99%): [05:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [05:32:09] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 93842.000000 [05:32:30] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 31932 MB (6% inode=99%): [05:37:29] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31581 MB (5% inode=99%): [05:56:59] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:57:50] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 335116.000000 [05:58:00] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:58:19] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 341222.000000 [05:58:29] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:59:09] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 381439.000000 [05:59:10] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 462492.000000 [05:59:10] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:59:20] / on thyme is UNKNOWN: NRPE: Unable to read output [05:59:30] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 223023.000000 [05:59:30] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:59:50] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [05:59:50] RAID on thyme is UNKNOWN: NRPE: Unable to read output [06:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 373681.000000 [06:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 51590 MB (8% inode=99%): [06:01:00] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25251.000000 [06:01:01] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25250.000000 [06:01:10] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:01:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [06:02:00] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [06:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [06:03:10] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:03:30] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [06:03:49] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [06:03:59] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:04:40] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [06:04:50] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [06:05:10] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [06:05:29] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 371634 MB (6% inode=63%): [06:05:29] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [06:05:29] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:08:50] Free Memory on damiana is CRITICAL: CRITICAL - 2.2% (180652 kB) free! [06:21:11] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:25:30] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 32441 MB (6% inode=99%): [06:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [06:32:09] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 97442.000000 [06:57:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:57:00] MySQL on z-dat-s5-b is CRITICAL: Cant connect to MySQL server on z-dat-s5-b (146) [06:57:49] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 335726.000000 [06:58:00] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:58:20] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 344486.000000 [06:58:30] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:59:10] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 384971.000000 [06:59:10] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 465671.000000 [06:59:10] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:59:19] / on thyme is UNKNOWN: NRPE: Unable to read output [06:59:29] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 226337.000000 [06:59:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:59:50] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [06:59:50] RAID on thyme is UNKNOWN: NRPE: Unable to read output [07:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 376940.000000 [07:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 51432 MB (8% inode=99%): [07:01:01] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on z-dat-s5-b (146) [07:01:01] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 27004.000000 [07:01:10] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:01:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [07:02:00] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [07:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [07:03:04] Byrial Jensen * [Toolserver-l] When is the best time of day to run programs? [07:03:10] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:03:29] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [07:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [07:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:04:39] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [07:04:49] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 98167 [07:05:09] MySQL slave on z-dat-s5-b is CRITICAL: Cant connect to MySQL server on z-dat-s5-b (146) [07:05:30] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 371529 MB (6% inode=63%): [07:05:30] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [07:05:30] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:08:49] Free Memory on damiana is CRITICAL: CRITICAL - 2.3% (193276 kB) free! [07:21:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:26:00] Load avg. on nightshade is WARNING: WARNING - load average: 7.87, 21.11, 15.15 [07:28:00] Load avg. on nightshade is OK: OK - load average: 3.12, 14.98, 13.63 [07:28:49] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [07:32:10] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on z-dat-s5-b (146) [07:37:50] aliasd on yarrow is CRITICAL: Connection refused [07:51:00] MySQL on z-dat-s5-b is OK: Uptime: 27 Threads: 1 Questions: 277 Slow queries: 0 Opens: 54 Flush tables: 1 Open tables: 46 Queries per second avg: 10.259 [07:57:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:57:50] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 337291.000000 [07:58:00] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:58:20] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 343612.000000 [07:58:30] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:10] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 464121.000000 [07:59:10] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:19] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 388293.000000 [07:59:19] / on thyme is UNKNOWN: NRPE: Unable to read output [07:59:29] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 226631.000000 [07:59:29] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:59:50] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [07:59:51] RAID on thyme is UNKNOWN: NRPE: Unable to read output [08:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 376799.000000 [08:00:10] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 51229 MB (8% inode=99%): [08:01:00] s4 replag on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [08:01:09] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:01:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [08:02:00] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18080.000000 [08:02:00] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [08:02:10] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [08:02:29] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31361 MB (5% inode=99%): [08:03:09] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:30] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [08:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [08:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:04:39] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [08:04:49] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 97955 [08:05:30] MySQL slave on z-dat-s5-b is CRITICAL: (Service Check Timed Out) [08:05:30] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 371371 MB (6% inode=63%): [08:05:30] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [08:05:30] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:06:29] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 31634 MB (6% inode=99%): [08:06:49] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1967 [08:07:00] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1966.000000 [08:08:50] Free Memory on damiana is CRITICAL: CRITICAL - 1.9% (155064 kB) free! [08:21:10] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:27:30] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31592 MB (5% inode=99%): [08:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [08:31:29] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 31600 MB (6% inode=99%): [08:32:20] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 98661.000000 [08:32:30] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31591 MB (5% inode=99%): [08:37:50] aliasd on yarrow is CRITICAL: Connection refused [08:42:50] MySQL slave on rosemary is OK: Uptime: 1185512 Threads: 11 Questions: 1079012306 Slow queries: 362758 Opens: 55472 Flush tables: 1 Open tables: 3425 Queries per second avg: 910.165 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1709 [08:43:00] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1706.000000 [08:53:30] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31555 MB (5% inode=99%): [08:57:00] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:57:50] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 339467.000000 [08:58:00] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:58:19] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 342884.000000 [08:58:29] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:59:10] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 462525.000000 [08:59:10] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:59:20] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 389732.000000 [08:59:20] / on thyme is UNKNOWN: NRPE: Unable to read output [08:59:30] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 226518.000000 [08:59:30] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:59:50] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [08:59:50] RAID on thyme is UNKNOWN: NRPE: Unable to read output [09:00:00] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 375618.000000 [09:00:09] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 51018 MB (8% inode=99%): [09:01:10] s4 replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 36059.000000 [09:01:10] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:01:10] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [09:01:59] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5491.000000 [09:02:01] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [09:02:09] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [09:03:10] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:03:29] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [09:03:50] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [09:04:00] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:04:39] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [09:04:50] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 80495 [09:05:29] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 369905 MB (6% inode=63%): [09:05:29] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [09:05:29] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:06:10] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 94510 [09:08:49] Free Memory on damiana is CRITICAL: CRITICAL - 2.0% (168960 kB) free! [09:19:30] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 32507 MB (6% inode=99%): [09:21:04] Silke Meyer * Re: [Toolserver-l] [Labs-l] A (21) day in the Labs [09:21:20] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:27:00] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3434.000000 [09:28:50] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [09:31:01] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1723.000000 [09:32:21] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 89962.000000 [09:37:50] aliasd on yarrow is CRITICAL: Connection refused [09:53:02] APT on yucca is CRITICAL: (Service Check Timed Out) [09:59:32] Hi all [09:59:59] I can't connect to phpmyadmin - known issue? [10:01:14] Well I can't connect to the whole ts... [10:02:14] Magnus Manske * [Toolserver-l] Can't log into toolserver [10:05:14] Silke Meyer * Re: [Toolserver-l] Can't log into toolserver [10:34:45] Authoritative DNS on ha-dns-auth is WARNING: (null) [10:34:45] Free Memory on damiana is OK: OK - 84.3% (7061080 kB) free. [10:35:54] PING on ha-dns-auth is WARNING: (null) [10:39:04] Johannes Kroll * Re: [Toolserver-l] Can't log into toolserver [10:59:45] Authoritative DNS on ha-dns-auth is OK: DNS OK: 0.957 seconds response time. 1.www.toolserver.org returns 91.198.174.203 [11:00:04] PING on ha-dns-auth is OK: PING OK - Packet loss = 0%, RTA = 0.10 ms [11:17:05] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:19:36] / on thyme is UNKNOWN: NRPE: Unable to read output [11:19:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [11:19:46] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [11:19:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [11:19:46] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [11:20:05] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [11:20:05] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [11:20:25] RAID on thyme is UNKNOWN: NRPE: Unable to read output [11:38:35] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:17:05] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:19:36] / on thyme is UNKNOWN: NRPE: Unable to read output [12:19:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [12:19:46] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [12:19:47] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [12:19:47] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:19:47] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [12:20:05] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [12:20:05] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [12:20:25] RAID on thyme is UNKNOWN: NRPE: Unable to read output [12:38:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:53:51] hey guys, I need help restoring my JIRA account [12:54:00] anyone can help me please? [12:57:14] huji: having problems with jira? Try filling a jira bug XD [12:57:43] Alchimista: can't because you need to be logged in to file a bug, and my problem is I can't login! [12:57:43] now serious, jira is having some problems, just hold on, i'm not sure who can help with it [12:58:30] and so does the wiki; I tried reseting password on wiki too, and that is broken too [12:58:39] basically, I can't log onto any TS web interface :) [12:58:54] do you have an account? [12:59:06] Yes, in both places [12:59:11] username "huji" [12:59:13] so try sending an email [12:59:14] https://lists.wikimedia.org/mailman/listinfo/toolserver-l [13:00:51] good idea [13:01:12] Alchimista: I have already emailed DaB from within DE Wikipedia, but he seems to be too busy [13:03:52] oh god, I can't remember my mailing list password, and their reminder system is also slow/notworking [13:03:58] * huji can't catch a break [13:16:43] @replag [13:17:05] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:19:05] Dr. Trigon * [Toolserver-l] Login and account [13:19:05] Dr. Trigon * Re: [Toolserver-l] mayapple config & cron jobs [13:19:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [13:19:46] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [13:19:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [13:20:05] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [13:20:05] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [13:20:26] RAID on thyme is UNKNOWN: NRPE: Unable to read output [13:20:36] / on thyme is UNKNOWN: NRPE: Unable to read output [13:20:46] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:20:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [13:38:35] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:15:09] K. Peachey * Re: [Toolserver-l] mayapple config & cron jobs [14:16:04] K. Peachey * Re: [Toolserver-l] Login and account [14:17:05] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:19:46] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [14:19:46] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [14:19:46] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [14:20:04] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [14:20:04] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [14:20:25] RAID on thyme is UNKNOWN: NRPE: Unable to read output [14:20:36] / on thyme is UNKNOWN: NRPE: Unable to read output [14:20:46] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:20:46] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [14:38:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:43:48] @replag [14:45:44] Alchimista: I issued a @replag 1.5h ago but no response by now [14:46:04] liangent: seems that the bot is sleeping :s [15:08:04] Silke Meyer * [Toolserver-announce] Reminder: Information on Tool Labs/ Your help needed [15:17:06] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:19:48] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [15:19:48] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [15:19:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [15:20:06] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [15:20:06] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [15:20:26] RAID on thyme is UNKNOWN: NRPE: Unable to read output [15:20:36] / on thyme is UNKNOWN: NRPE: Unable to read output [15:20:47] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:20:48] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [15:20:55] Coren|Sleep: poke me when you get back [15:38:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:59:46] s4 replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1535.000000 [16:17:05] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:19:48] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [16:19:48] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [16:19:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [16:20:06] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [16:20:06] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [16:20:26] RAID on thyme is UNKNOWN: NRPE: Unable to read output [16:20:36] / on thyme is UNKNOWN: NRPE: Unable to read output [16:20:47] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:47] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [16:38:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:11:18] Danny_B: you around? [17:17:06] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:20:06] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [17:20:06] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [17:20:25] RAID on thyme is UNKNOWN: NRPE: Unable to read output [17:20:36] / on thyme is UNKNOWN: NRPE: Unable to read output [17:20:48] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [17:20:48] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:20:48] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [17:20:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [17:20:48] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [17:37:36] greenrosetta: yup. but assuming you want DaBPunkt instead...? [17:38:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:06:09] * Coren pokes Betacommand [18:07:04] Tim Landscheidt * Re: [Toolserver-l] When is the best time of day to run programs? [18:17:06] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:20:05] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [18:20:06] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [18:20:26] RAID on thyme is UNKNOWN: NRPE: Unable to read output [18:20:36] / on thyme is UNKNOWN: NRPE: Unable to read output [18:21:48] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [18:21:48] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:21:48] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [18:21:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [18:21:48] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [18:38:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:40:54] Coren: any eta on replication for labs? [18:42:04] Byrial Jensen * Re: [Toolserver-l] When is the best time of day to run programs? [18:42:11] Betacommand: It should be in testing on tools around the end of the month, I think. There's still a lot to do but we're keeping to schedule well enough. [18:43:24] Cluster s3 is down. [18:47:58] Toolserver is extremely slow. [18:49:37] Toolserver is hanging up now. [18:55:04] Marc A. Pelletier * Re: [Toolserver-l] When is the best time of day to run programs? [19:17:09] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:20:05] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [19:20:05] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [19:20:26] RAID on thyme is UNKNOWN: NRPE: Unable to read output [19:20:36] / on thyme is UNKNOWN: NRPE: Unable to read output [19:21:47] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [19:21:47] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:21:47] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [19:21:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [19:21:48] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [19:36:04] Merlissimo * Re: [Toolserver-l] When is the best time of day to run programs? [19:38:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:39:27] Is UTF-8 still default? https://jira.toolserver.org/browse/TS-847 [19:40:39] seems so [19:40:53] Merlissimo: whole cluster* [19:41:36] jeremyb_: oh, thank for the w [19:41:53] Merlissimo: prego [19:41:55] (sp?) [19:42:04] Petr Onderka * Re: [Toolserver-l] When is the best time of day to run programs? [19:59:36] Yes!!!! PYTHONIOENCODING=utf_8 :-D [20:08:08] Are toolserver accoutns able to create indexes on the database? [20:11:00] greenrosetta: no [20:11:10] greenrosetta: we cannot edit the database [20:11:16] I didn't think sp [20:11:21] TP ran a query for me [20:11:35] what did you want a index on? [20:11:37] and he said it took 2 mins to run and said I should use indexes to improve performance [20:11:52] greenrosetta: pastebin the query [20:12:02] http://bpaste.net/show/kLpy9s7buL7bb3cygmOG/ [20:12:49] seems like a straight fowrad query. [20:13:01] Just by specualtion, I would think all the id columns would already have indexes [20:14:13] you dont need to join the user table [20:15:09] why not? I want the username [20:16:27] greenrosetta: give me a page title you where quering [20:16:33] Foobar [20:16:43] Which has less than 1K diffs [20:16:55] That should be almost instant [20:17:05] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:18:09] greenrosetta: .014 seconds [20:18:22] select distinct(rev_user_text) from revision LEFT JOIN page on rev_page = page_id WHERE page_title='Foobar' and page_namespace = '0'; [20:19:08] sorry that should have been 0.14 [20:19:35] why is rev_user_text stored in revision instead of just the id? [20:19:56] greenrosetta: performance reasons [20:19:57] is that because usernames can change? [20:20:25] RAID on thyme is UNKNOWN: NRPE: Unable to read output [20:20:32] greenrosetta: helps avoid joining to the user table for every query [20:20:36] / on thyme is UNKNOWN: NRPE: Unable to read output [20:20:57] does articlespace = 0? [20:21:04] for page_namespaoce [20:21:06] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [20:21:06] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [20:21:10] yes [20:21:36] is there a table that has all those values? [20:21:40] there is an index on page_title,page_namespace [20:21:53] greenrosetta: no [20:22:46] I'd like to be able to have the option of searching all namespaces, or limiting it [20:22:47] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [20:22:47] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:22:47] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [20:22:48] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [20:22:48] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [20:23:03] what would the query look like if you were searching my talk page? [20:24:00] greenrosetta: I just did it on Barack Obama one of the most edited articles on enwiki [20:24:09] how long? [20:24:11] 6191 rows in set (2.40 sec) [20:24:18] not too shabby [20:24:39] greenrosetta: what is your user name [20:24:48] http://en.wikipedia.org/wiki/User_talk:Little_green_rosetta [20:26:14] are these the correct values for the namespaces? (stole it from snottywong's tool) http://bpaste.net/show/srv2ofstT6vaUkqAvzzG/ [20:26:37] http://en.wikipedia.org/w/api.php?action=query&meta=siteinfo&siprop=general|namespaces|namespacealiases|statistics&format=jsonfm [20:26:43] greenrosetta: use that [20:27:03] select distinct(rev_user_text) from revision LEFT JOIN page on rev_page = page_id WHERE page_title='Little_green_rosetta' and page_namespace = '3'; [20:28:05] ok, so every page name in wikipedia goes in that table, and the usersapace determines the "type" [20:28:26] greenrosetta: No [20:28:36] everything goes into the page table [20:29:01] sory, thats what i meant [20:29:16] Betacommand: im loving python btw [20:29:17] page_namespace determines what kind of page it is, article, template, category ect [20:31:00] greenrosetta: did you review the database link I gave you? [20:31:17] Yes [20:32:04] wait.. are you talking about this one: http://en.wikipedia.org/w/api.php?action=query&meta=siteinfo&siprop=general|namespaces|namespacealiases|statistics&format=jsonfm [20:32:12] No [20:32:43] http://www.mediawiki.org/wiki/Manual:Database_layout [20:38:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:01:54] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 48167 MB (7% inode=99%): [21:01:54] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 31731 MB (6% inode=99%): [21:01:55] s4 replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7272.000000 [21:01:55] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 365347 MB (6% inode=63%): [21:02:01] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [21:06:46] @replag [21:06:48] Alchimista: s1-rr-a: 11h 15m 55s [-]; s1-rr-a-wd: 3d 21h 55m 51s [-]; s1-user: 5h 50m 25s [-]; s1-user-wd: 5d 12h 9m 27s [-]; s2-rr: 11h 15m 59s [-]; s2-user: 11h 15m 59s [-]; s2-user-c: error; s2-user-wd: 4d 16h 35m 52s [-] [21:06:49] Alchimista: s3-user: 20s [-]; s3-user-wd: 4d 6h 3m 28s [-]; s4-user-wd: 4d 7h 43m 27s [-]; s5-rr-a-wd: 2d 21h 3m 34s [-]; s5-user: 11h 15m 57s [-]; s5-user-c: 2h 6m 10s [-]; s6-user-wd: 4d 6h 26m 57s [-]; s7-user: 43s [-] [21:06:50] Alchimista: s7-user-wd: 4d 12h 48m 45s [-] [21:07:11] aliasd on yarrow is CRITICAL: Connection refused [21:07:12] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:07:12] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:07:22] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:07:52] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 27628 MB (2% inode=99%): [21:07:52] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [21:07:52] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [21:07:52] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [21:08:02] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 248682.000000 [21:08:02] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 391794.000000 [21:08:02] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:13:52] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31594 MB (5% inode=99%): [21:17:12] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:21:11] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [21:21:12] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [21:21:12] RAID on thyme is UNKNOWN: NRPE: Unable to read output [21:21:21] / on thyme is UNKNOWN: NRPE: Unable to read output [21:23:21] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:23:31] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [21:23:32] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [21:23:32] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [21:23:42] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [21:28:21] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 249808.000000 [21:28:21] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 48074 MB (7% inode=99%): [21:28:21] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:28:21] /sql on z-dat-s7-a is CRITICAL: DISK CRITICAL - free space: /sql 31194 MB (5% inode=99%): [21:28:21] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [21:28:21] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [21:28:21] / on thyme is UNKNOWN: NRPE: Unable to read output [21:28:28] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [21:28:28] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:28:58] SMF on web.amaranth is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [21:29:48] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:33:50] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:33:50] aliasd on yarrow is CRITICAL: Connection refused [21:33:57] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:33:57] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:34:07] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 406697.000000 [21:34:08] PING on amaranth is WARNING: PING WARNING - Packet loss = 20%, RTA = 168.00 ms [21:34:08] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:34:28] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:37:07] PING on amaranth is OK: PING OK - Packet loss = 0%, RTA = 135.00 ms [21:49:04] @replag [21:49:05] Alchimista: s1-rr-a: 11h 58m 13s [+1.00 s/s]; s1-rr-a-wd: 3d 22h 26m 35s [+0.73 s/s]; s1-user: 6h 32m 43s [+1.00 s/s]; s1-user-wd: 5d 12h 39m 6s [+0.70 s/s]; s2-rr: 11h 58m 17s [+1.00 s/s]; s2-user: 11h 58m 17s [+1.00 s/s]; s2-user-c: error; s2-user-wd: 4d 17h 6m 8s [+0.72 s/s] [21:49:06] Alchimista: s3-user: 48s [+0.01 s/s]; s3-user-wd: 4d 6h 36m 38s [+0.78 s/s]; s4-user-wd: 4d 8h 25m 6s [+0.98 s/s]; s5-rr-a-wd: 2d 21h 37m 54s [+0.81 s/s]; s5-user: 11h 58m 16s [+1.00 s/s]; s5-user-c: 2h 22m 55s [+0.40 s/s]; s6-user-wd: 4d 7h 38s [+0.80 s/s]; s7-user-wd: 4d 13h 16m 42s [+0.66 s/s] [21:49:45] Betacommand: can you check this query please? http://bpaste.net/show/pyGc92UyEFgr1ysrYbdt/ [21:50:19] I want it to give me the page names and counts of my top 10 edited pages [21:50:26] oops.. I missed something [21:51:11] http://bpaste.net/show/HR24iuCUQWKobl8Le1CP/ [21:51:13] thats better [21:55:52] greenrosetta: several issues [21:56:58] s4 replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3343.000000 [21:58:18] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:58:40] greenrosetta: do me a quick favor, go to your preferences and get me your user_id [21:59:10] Username: [21:59:10] Little green rosetta [21:59:56] greenrosetta: I need your user_id not user_name [21:59:58] s4 replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1497.000000 [22:00:00] ah [22:00:15] 17310446 [22:01:06] rev_user_text doesnt have an index while rev_user does [22:03:58] s4 replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3257.000000 [22:04:13] how about this? http://bpaste.net/show/GguyJDXVrZSlkPzvCKia/ [22:06:11] greenrosetta: http://pastebin.com/q922HVRu [22:06:52] results http://pastebin.com/1NTWDu5k [22:07:58] s4 replag on cassia is OK: QUERY OK: SELECT ts_rc_age() returned 1595.000000 [22:12:19] Betacommand: please run this one (should only give me article space) http://pastebin.com/nh71FeVB [22:17:32] greenrosetta: FAIL [22:18:03] where did I mess up? I used your SQL and added "page_namespace=1" [22:18:04] Byrial Jensen * Re: [Toolserver-l] When is the best time of day to run programs? [22:18:34] greenrosetta: page_namespace = 1 is not articles, its talk pages [22:19:01] ah.. can you run it on zero pls? [22:19:08] http://pastebin.com/k1wc3fMg [22:22:18] /sql on z-dat-s7-a is WARNING: DISK WARNING - free space: /sql 32257 MB (6% inode=99%): [22:27:28] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [22:27:28] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [22:27:28] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 364930 MB (6% inode=63%): [22:27:28] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [22:27:28] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [22:27:38] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [22:27:38] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [22:27:38] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [22:27:38] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [22:27:48] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 378148.000000 [22:27:48] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [22:27:48] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [22:27:58] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:27:58] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:27:58] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 25888.000000 [22:28:08] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 45427.000000 [22:28:08] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 371094.000000 [22:28:08] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 392845.000000 [22:28:08] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 476935.000000 [22:28:08] RAID on thyme is UNKNOWN: NRPE: Unable to read output [22:28:17] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 251221.000000 [22:28:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47840 MB (7% inode=99%): [22:28:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:28:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:28:19] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [22:28:19] / on thyme is UNKNOWN: NRPE: Unable to read output [22:28:27] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [22:28:27] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:29:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:33:47] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:33:48] aliasd on yarrow is CRITICAL: Connection refused [22:33:58] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:33:58] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:34:09] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 406212.000000 [22:34:09] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:34:28] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:45:06] Betacommand: one more pls: http://bpaste.net/show/uFJLpwpSM0NFOFKiLDes/ [22:45:31] greenrosetta: what is the goal there? [22:45:50] im just prepping my SQL for when I get TS access [22:46:12] I'll not bug you with more. [22:46:19] greenrosetta: what is the goal of the query? [22:46:35] show me the top 100 articles in article space that I edited, plus thir count [22:46:45] greenrosetta: its not what its doing [22:47:26] the count is the number of diffs per article, correct? [22:47:48] greenrosetta: you selected the talk namespace [22:47:54] ah shit [22:48:15] please change that to 0 [22:48:46] greenrosetta: OK, but that is why I was questioning you :P [22:49:04] Sucks having to send my queries off [22:49:19] If you see DaB, poke him for me :) [22:50:23] http://pastebin.com/6SaXinCb [22:50:40] greenrosetta: DaB will get to it when he can [22:51:31] excellent... [22:58:18] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:27:28] s1 replag on thyme is CRITICAL: QUERY CRITICAL: Cant connect to MySQL server on thyme (146) [23:27:28] /mnt on thyme is UNKNOWN: NRPE: Unable to read output [23:27:28] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 363316 MB (6% inode=63%): [23:27:28] /tmp on thyme is UNKNOWN: NRPE: Unable to read output [23:27:28] MySQL slave on z-dat-s5-b is CRITICAL: (Return code of 139 is out of bounds) [23:27:38] Environment IPMI on thyme is UNKNOWN: NRPE: Unable to read output [23:27:38] APT on sage is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [23:27:38] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [23:27:38] MySQL slave on z-dat-s1-b is CRITICAL: (Return code of 139 is out of bounds) [23:27:47] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 381459.000000 [23:27:47] Load avg. on thyme is UNKNOWN: NRPE: Unable to read output [23:27:47] FMA on thyme is CRITICAL: ERROR - unexpected output from snmpwalk [23:27:57] SMTP on z-dat-s5-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:27:58] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:27:58] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 29489.000000 [23:28:07] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 49027.000000 [23:28:07] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 392854.000000 [23:28:08] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 371628.000000 [23:28:08] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 476273.000000 [23:28:08] RAID on thyme is UNKNOWN: NRPE: Unable to read output [23:28:18] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 252108.000000 [23:28:18] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47558 MB (7% inode=99%): [23:28:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:28:18] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [23:28:18] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [23:28:18] / on thyme is UNKNOWN: NRPE: Unable to read output [23:28:28] APT on yucca is WARNING: APT WARNING: 1 packages available for upgrade (0 critical updates). [23:28:28] SMTP on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:29:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:33:48] NTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:33:48] aliasd on yarrow is CRITICAL: Connection refused [23:33:58] SMTP on yucca is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:33:58] SMTP on z-dat-s2-b is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:34:08] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 404610.000000 [23:34:08] NTP on sage is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:34:28] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:52:04] Tim Landscheidt * Re: [Toolserver-l] When is the best time of day to run programs? [23:52:21] scfc_de: Marc* [23:58:17] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL