[07:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [07:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [07:32:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [07:34:43] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2462.000000 [07:34:52] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2428 [07:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 70316 MB (11% inode=99%): [07:38:02] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [07:38:02] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [07:38:54] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:38:54] aliasd on mayapple is CRITICAL: Connection refused [07:40:43] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1787.000000 [07:40:53] MySQL slave on rosemary is OK: Uptime: 645811 Threads: 13 Questions: 588985081 Slow queries: 319142 Opens: 42646 Flush tables: 1 Open tables: 3115 Queries per second avg: 912.8 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1751 [07:42:03] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 137603 MB (2% inode=68%): [07:46:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 73078.000000 [08:14:13] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:31:15] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [08:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [08:32:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [08:33:03] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1916.000000 [08:33:43] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1857 [08:34:43] MySQL slave on z-dat-s5-b is OK: Uptime: 200311 Threads: 4 Questions: 287217470 Slow queries: 4778 Opens: 18713 Flush tables: 1 Open tables: 256 Queries per second avg: 1433.857 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1747 [08:35:03] wikidata replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1714.000000 [08:37:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:37:42] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 70099 MB (11% inode=99%): [08:38:02] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [08:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [08:38:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:38:53] aliasd on mayapple is CRITICAL: Connection refused [08:42:03] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 137318 MB (2% inode=68%): [08:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 76286.000000 [09:15:13] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [09:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [09:33:03] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [09:37:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69830 MB (11% inode=99%): [09:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [09:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:38:32] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [09:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:39:53] aliasd on mayapple is CRITICAL: Connection refused [09:42:02] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 135830 MB (2% inode=68%): [09:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 79428.000000 [10:16:13] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [10:31:52] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [10:33:12] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [10:37:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69573 MB (11% inode=99%): [10:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [10:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:38:32] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [10:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:39:53] aliasd on mayapple is CRITICAL: Connection refused [10:42:02] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 135379 MB (2% inode=68%): [10:46:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:51:03] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2112.000000 [10:51:43] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2141 [10:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 82418.000000 [11:05:13] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 58465 MB (5% inode=99%): [11:07:12] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 60715 MB (6% inode=99%): [11:16:13] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [11:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [11:34:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [11:34:42] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3614 [11:35:03] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3633.000000 [11:37:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69337 MB (11% inode=99%): [11:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [11:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [11:39:13] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 58224 MB (5% inode=99%): [11:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:39:53] aliasd on mayapple is CRITICAL: Connection refused [11:40:53] aliasd on mayapple is OK: TCP OK - 0.002 second response time on port 984 [500 Not found.] [11:42:03] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 135021 MB (2% inode=68%): [11:43:13] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 59350 MB (6% inode=99%): [11:44:13] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 58341 MB (5% inode=99%): [11:46:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:47:53] aliasd on mayapple is CRITICAL: Connection refused [11:58:42] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 85509.000000 [12:04:13] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 63360 MB (6% inode=99%): [12:07:05] Marlen Caemmerer * Re: [Toolserver-l] mayapple config & cron jobs [12:16:13] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [12:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [12:34:12] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [12:34:43] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 6727 [12:35:03] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 6749.000000 [12:35:38] [[Main Page/lang]] ! 10https://wiki.toolserver.org/w/index.php?diff=7844&oldid=7834&rcid=21634 * Chihonglee * (+35) () [12:37:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:37:42] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:37:42] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69095 MB (11% inode=99%): [12:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [12:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 134631 MB (2% inode=68%): [12:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:47:53] aliasd on mayapple is CRITICAL: Connection refused [12:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 88478.000000 [13:16:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [13:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [13:34:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [13:34:43] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 9854 [13:35:03] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9875.000000 [13:37:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68855 MB (11% inode=99%): [13:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [13:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [13:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 134286 MB (2% inode=68%): [13:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:47:53] aliasd on mayapple is CRITICAL: Connection refused [13:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 90976.000000 [14:16:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [14:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [14:34:43] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 12345 [14:35:03] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12352.000000 [14:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [14:37:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68600 MB (11% inode=99%): [14:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [14:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:38:32] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [14:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:42:12] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 133785 MB (2% inode=68%): [14:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:48:53] aliasd on mayapple is CRITICAL: Connection refused [14:52:55] aliasd on mayapple is OK: TCP OK - 0.001 second response time on port 984 [500 Not found.] [14:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 91978.000000 [15:16:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [15:31:52] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [15:34:43] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 12753 [15:35:02] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12759.000000 [15:35:12] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [15:37:14] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68352 MB (11% inode=99%): [15:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [15:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:38:32] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [15:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 133430 MB (2% inode=68%): [15:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 92664.000000 [16:16:23] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:31:12] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [16:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [16:34:43] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 9683 [16:35:03] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 9618.000000 [16:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [16:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68101 MB (11% inode=99%): [16:37:44] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [16:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [16:39:52] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 133115 MB (2% inode=68%): [16:46:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:52:39] hi [16:52:46] what is wrong with qcronsub -b y -wd /home/filnik/pywikipedia -l h_rt=0:25:0 -l virtual_free=60M /home/filnik/pywikipedia/welcome.py -nlog -edit:0 -break -limit:250 -filter -random -savedata ? [16:53:14] or how can I take a look at the errors? It doesn't print any output :( [16:54:21] valhallasw, hi, can you help me? :) [16:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 94794.000000 [17:02:43] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3564 [17:03:03] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3442.000000 [17:07:04] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:14:43] MySQL slave on z-dat-s5-b is OK: Uptime: 231512 Threads: 3 Questions: 292672287 Slow queries: 6086 Opens: 21089 Flush tables: 1 Open tables: 256 Queries per second avg: 1264.177 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1668 [17:15:03] wikidata replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1578.000000 [17:16:23] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:31:14] APT on nightshade is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [17:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [17:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [17:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 67846 MB (11% inode=99%): [17:37:44] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [17:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [17:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:40:05] Dr. Trigon * Re: [Toolserver-l] mayapple config & cron jobs [17:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 132607 MB (2% inode=68%): [17:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 96869.000000 [18:07:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:16:23] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 7 packages available for upgrade (7 critical updates). [18:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [18:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [18:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 67652 MB (11% inode=99%): [18:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [18:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [18:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 131757 MB (2% inode=68%): [18:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 98960.000000 [19:07:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:16:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 7 packages available for upgrade (7 critical updates). [19:31:56] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [19:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [19:37:43] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 67347 MB (11% inode=99%): [19:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [19:38:03] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:38:32] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [19:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 131204 MB (2% inode=68%): [19:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:50:15] [[Operators]] 10https://wiki.toolserver.org/w/index.php?diff=7845&oldid=7842&rcid=21635 * Dab * (+33) (/* General rights */ +puppet-svn) [19:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 101227.000000 [20:05:20] [[Special:Log/newusers]] create 10 * Marianasoffer * (New user account) [20:07:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:16:22] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 7 packages available for upgrade (7 critical updates). [20:31:43] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 67087 MB (10% inode=99%): [20:31:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [20:35:43] toolserver.org HTTP on ortelius is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - 239 bytes in 4.100 second response time [20:37:46] toolserver.org HTTP on ortelius is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 239 bytes in 0.654 second response time [20:37:46] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [20:38:12] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:38:32] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [20:38:43] toolserver.org HTTP on ortelius is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - 239 bytes in 3.174 second response time [20:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 118490 MB (2% inode=68%): [20:46:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:58:42] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 102911.000000 [21:07:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:16:23] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 7 packages available for upgrade (7 critical updates). [21:31:43] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66815 MB (10% inode=99%): [21:31:54] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [21:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [21:37:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:38:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [21:38:14] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [21:39:52] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 101591 MB (1% inode=68%): [21:46:32] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 105008.000000 [22:07:02] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:16:23] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 7 packages available for upgrade (7 critical updates). [22:31:43] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66522 MB (10% inode=99%): [22:32:58] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [22:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [22:37:52] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:38:13] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:38:33] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [22:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 88072 MB (1% inode=68%): [22:46:33] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:57:25] [[Special:Log/delete]] delete 10 * MZMcBride * (deleted "[[02User talk:Standupboard10]]": spam) [22:57:39] [[Special:Log/block]] block 10 * MZMcBride * (blocked [[02User:Standupboard10]] with an expiry time of infinite (account creation disabled): spam) [22:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 106682.000000 [23:07:03] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:16:23] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:27:08] who runs wikirc ? [23:27:27] The Toolserver roots, I believe. [23:29:34] it has wrong color formatting [23:31:13] APT on nightshade is CRITICAL: APT CRITICAL: 7 packages available for upgrade (7 critical updates). [23:31:43] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66283 MB (10% inode=99%): [23:32:53] APT on yarrow is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [23:35:13] APT on mayapple is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [23:38:03] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [23:38:13] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:38:32] APT on yucca is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [23:38:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:39:53] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:42:13] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 77538 MB (1% inode=68%): [23:46:43] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:58:43] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 107893.000000