[00:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39879 MB (6% inode=99%): [00:05:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [00:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [00:14:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:26:47] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 357516 MB (6% inode=42%): [00:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:56:57] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [01:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39675 MB (6% inode=99%): [01:05:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [01:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [01:14:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:26:48] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 361030 MB (6% inode=43%): [01:32:17] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 82065 MB (8% inode=99%): [01:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:56:57] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [01:58:46] Load avg. on ortelius is CRITICAL: CRITICAL - load average: 83.50, 57.43, 32.28 [02:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37796 MB (6% inode=99%): [02:05:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [02:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [02:14:48] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:26:47] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 361202 MB (6% inode=43%): [02:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:56:57] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [02:58:47] Load avg. on ortelius is CRITICAL: CRITICAL - load average: 17.00, 19.88, 25.23 [03:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39561 MB (6% inode=99%): [03:05:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [03:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [03:14:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:16:47] Load avg. on ortelius is WARNING: WARNING - load average: 5.38, 12.52, 19.45 [03:22:47] Load avg. on ortelius is OK: OK - load average: 3.62, 7.20, 14.78 [03:23:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:26:47] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 361441 MB (6% inode=43%): [03:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:56:57] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [04:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39293 MB (6% inode=99%): [04:06:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [04:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [04:15:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:27:10] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 363398 MB (6% inode=43%): [04:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:57:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [05:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 39104 MB (6% inode=99%): [05:06:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [05:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [05:13:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3310 MB (19% inode=99%): [05:15:08] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:22:27] /tmp on ortelius is OK: DISK OK - free space: /tmp 3681 MB (21% inode=99%): [05:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:28:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 364730 MB (6% inode=44%): [05:29:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3413 MB (20% inode=99%): [05:37:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:57:08] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [06:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38988 MB (6% inode=99%): [06:06:08] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [06:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [06:15:08] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:23:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:28:08] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 365526 MB (6% inode=44%): [06:37:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:57:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [06:57:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3433 MB (20% inode=99%): [07:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38854 MB (6% inode=99%): [07:05:27] /tmp on ortelius is OK: DISK OK - free space: /tmp 3610 MB (21% inode=99%): [07:06:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:07:08] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [07:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [07:12:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3160 MB (19% inode=99%): [07:15:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:28:08] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 366999 MB (6% inode=44%): [07:37:12] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:57:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [08:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38708 MB (6% inode=99%): [08:06:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [08:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [08:12:26] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3368 MB (20% inode=99%): [08:15:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:28:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 368376 MB (6% inode=44%): [08:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:42:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:57:08] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [09:00:27] /tmp on ortelius is OK: DISK OK - free space: /tmp 3549 MB (21% inode=99%): [09:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38564 MB (6% inode=99%): [09:06:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [09:07:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3274 MB (19% inode=99%): [09:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [09:13:27] /tmp on ortelius is OK: DISK OK - free space: /tmp 3672 MB (21% inode=99%): [09:15:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:23:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:28:08] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 369663 MB (6% inode=45%): [09:37:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:42:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:57:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [09:59:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3121 MB (18% inode=99%): [10:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38385 MB (6% inode=99%): [10:06:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [10:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [10:15:12] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:28:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 370625 MB (6% inode=45%): [10:35:37] Sun Grid Engine execd on wolfsbane is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:36:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:38:47] Sun Grid Engine execd on willow is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:41:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:41:37] Sun Grid Engine execd on ortelius is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:42:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:57:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [10:59:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3058 MB (18% inode=99%): [11:04:22] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 38187 MB (6% inode=99%): [11:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [11:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [11:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:28:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 371938 MB (6% inode=45%): [11:29:08] Load avg. on ptolemy is WARNING: WARNING - load average: 16.93, 16.56, 10.48 [11:34:07] Load avg. on ptolemy is OK: OK - load average: 9.51, 13.80, 11.11 [11:37:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:40:27] /tmp on ortelius is OK: DISK OK - free space: /tmp 3676 MB (21% inode=99%): [11:41:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:42:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:47:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3469 MB (20% inode=99%): [11:57:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [11:59:27] /tmp on ortelius is OK: DISK OK - free space: /tmp 3589 MB (21% inode=99%): [12:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37958 MB (6% inode=99%): [12:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [12:23:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:28:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 373203 MB (7% inode=45%): [12:37:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:37:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:39:27] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3307 MB (19% inode=99%): [12:41:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:42:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:57:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [13:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37770 MB (6% inode=99%): [13:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [13:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [13:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:28:07] Free Memory on damiana is CRITICAL: CRITICAL - 1.6% (137756 kB) free! [13:28:08] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 374444 MB (7% inode=46%): [13:31:07] Free Memory on damiana is WARNING: WARNING - 5.1% (426128 kB) free! [13:31:08] Load avg. on ortelius is WARNING: WARNING - load average: 11.78, 16.84, 12.96 [13:32:07] Free Memory on damiana is OK: OK - 7.7% (643092 kB) free. [13:32:27] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 81838 MB (8% inode=99%): [13:33:07] Load avg. on ortelius is OK: OK - load average: 6.57, 13.37, 12.14 [13:37:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:39:37] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 2601 MB (16% inode=99%): [13:41:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:42:08] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:51:04] where is that list of reasons why not to move to labs? [13:54:13] Free Memory on damiana is WARNING: WARNING - 6.6% (552516 kB) free! [13:57:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [14:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37581 MB (6% inode=99%): [14:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [14:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [14:12:07] Free Memory on damiana is OK: OK - 7.1% (596240 kB) free. [14:23:07] Sun Grid Engine execd on willow is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:28:08] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 368967 MB (6% inode=45%): [14:37:08] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:37:08] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:39:39] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 3008 MB (18% inode=99%): [14:42:08] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:54:07] Free Memory on damiana is WARNING: WARNING - 5.5% (460328 kB) free! [14:56:07] Free Memory on damiana is CRITICAL: CRITICAL - 5.0% (415788 kB) free! [14:57:08] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [15:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37387 MB (6% inode=99%): [15:07:07] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [15:11:07] Free Memory on damiana is WARNING: WARNING - 5.3% (447312 kB) free! [15:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [15:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:28:07] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 363928 MB (6% inode=45%): [15:37:07] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:37:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:39:37] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 2867 MB (17% inode=99%): [15:42:08] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:57:07] Free Memory on damiana is WARNING: WARNING - 5.9% (491004 kB) free! [15:57:08] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [16:00:37] /tmp on ortelius is CRITICAL: DISK CRITICAL - free space: /tmp 1618 MB (10% inode=99%): [16:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 37192 MB (6% inode=99%): [16:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [16:07:47] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 1671 MB (11% inode=99%): [16:10:07] Free Memory on damiana is OK: OK - 7.1% (591252 kB) free. [16:11:38] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [16:21:07] Free Memory on damiana is WARNING: WARNING - 5.3% (446068 kB) free! [16:23:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:23:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:28:07] Free Memory on damiana is CRITICAL: CRITICAL - 3.7% (306412 kB) free! [16:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 362571 MB (6% inode=45%): [16:37:17] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:37:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:41:47] /tmp on ortelius is CRITICAL: DISK CRITICAL - free space: /tmp 1366 MB (9% inode=99%): [16:42:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:42:47] /tmp on ortelius is WARNING: DISK WARNING - free space: /tmp 1892 MB (12% inode=99%): [16:49:47] /tmp on ortelius is OK: DISK OK - free space: /tmp 15242 MB (96% inode=99%): [16:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [17:02:07] Free Memory on damiana is WARNING: WARNING - 5.5% (460120 kB) free! [17:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 36945 MB (6% inode=99%): [17:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [17:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [17:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:23:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:28:07] Free Memory on damiana is CRITICAL: CRITICAL - 4.4% (366536 kB) free! [17:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 359372 MB (6% inode=45%): [17:30:07] Free Memory on damiana is WARNING: WARNING - 5.6% (473128 kB) free! [17:31:07] Free Memory on damiana is CRITICAL: CRITICAL - 4.8% (401696 kB) free! [17:37:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:37:17] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:42:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [18:03:07] Free Memory on damiana is WARNING: WARNING - 5.9% (491872 kB) free! [18:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 36704 MB (5% inode=99%): [18:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [18:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [18:23:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:28:07] Free Memory on damiana is CRITICAL: CRITICAL - 4.1% (339872 kB) free! [18:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 357886 MB (6% inode=45%): [18:30:07] Free Memory on damiana is WARNING: WARNING - 5.9% (495004 kB) free! [18:34:07] Free Memory on damiana is OK: OK - 7.3% (608196 kB) free. [18:37:17] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:37:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:42:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:57:16] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [19:00:07] Free Memory on damiana is WARNING: WARNING - 6.4% (536348 kB) free! [19:04:07] Free Memory on damiana is OK: OK - 7.1% (595452 kB) free. [19:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 36495 MB (5% inode=99%): [19:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [19:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [19:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 357263 MB (6% inode=45%): [19:34:07] Free Memory on damiana is WARNING: WARNING - 5.7% (477600 kB) free! [19:37:17] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:37:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:38:07] Free Memory on damiana is CRITICAL: CRITICAL - 4.3% (358992 kB) free! [19:42:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:43:07] Free Memory on damiana is OK: OK - 7.9% (659936 kB) free. [19:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [20:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 36288 MB (5% inode=99%): [20:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [20:11:42] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [20:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 353792 MB (6% inode=45%): [20:37:17] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:37:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:42:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [21:01:07] Free Memory on damiana is WARNING: WARNING - 5.4% (449692 kB) free! [21:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 36071 MB (5% inode=99%): [21:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [21:11:07] Free Memory on damiana is OK: OK - 7.1% (598320 kB) free. [21:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [21:19:07] Free Memory on damiana is WARNING: WARNING - 6.2% (519548 kB) free! [21:23:38] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:28:07] Free Memory on damiana is CRITICAL: CRITICAL - 3.4% (286228 kB) free! [21:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 351073 MB (6% inode=45%): [21:37:17] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:37:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:42:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [22:04:37] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 35857 MB (5% inode=99%): [22:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:11:38] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [22:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 351920 MB (6% inode=46%): [22:37:16] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:37:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:42:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [22:58:07] Free Memory on damiana is WARNING: WARNING - 6.6% (551456 kB) free! [23:00:08] Free Memory on damiana is CRITICAL: CRITICAL - 4.7% (396472 kB) free! [23:01:59] Danny_B: Find it? [23:03:55] Danny_B: https://meta.wikimedia.org/wiki/Future_of_Toolserver [23:03:57] And links from there. [23:04:38] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 35670 MB (5% inode=99%): [23:07:07] Free Memory on damiana is WARNING: WARNING - 5.1% (425884 kB) free! [23:07:17] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [23:11:37] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [23:19:07] Free Memory on damiana is CRITICAL: CRITICAL - 3.6% (302036 kB) free! [23:23:37] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:23:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:27:07] Free Memory on damiana is OK: OK - 9.3% (777552 kB) free. [23:28:17] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 347575 MB (6% inode=45%): [23:37:17] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:37:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:42:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:47:07] Free Memory on damiana is WARNING: WARNING - 6.8% (573596 kB) free! [23:57:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7