[00:04:16] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 48701 MB (7% inode=99%): [00:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [00:11:25] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [00:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:24:46] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:27:46] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 256524 MB (4% inode=29%): [00:36:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:36:56] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:53:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:56:46] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [01:04:16] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 48426 MB (7% inode=99%): [01:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [01:10:04] @replag [01:10:04] Merlissimo: s1-rr-a-wd: 14s [-0.02 s/s]; s2-user-c: error; s2-user-wd: 15s [-0.01 s/s]; s3-user: 55s [+0.00 s/s]; s4-user-wd: 16s [+0.00 s/s]; s5-user-c: error; s5-user-wd: 16s [-0.01 s/s]; s6-user-wd: 10s [-0.00 s/s] [01:10:06] Merlissimo: s7-user-wd: 15s [+0.00 s/s] [01:11:26] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [01:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:24:46] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:27:50] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 263292 MB (4% inode=30%): [01:32:06] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 82918 MB (8% inode=99%): [01:36:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:36:56] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:53:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:56:46] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [02:04:16] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 46447 MB (7% inode=99%): [02:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [02:11:26] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [02:18:46] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:24:46] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:27:46] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 265581 MB (4% inode=30%): [02:36:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:36:55] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:53:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:56:46] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [03:04:16] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 48012 MB (7% inode=99%): [03:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [03:11:26] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [03:18:46] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:26:41] Dispenser: poke [03:26:49] hi [03:27:07] Dispenser: http://toolserver.org/~dispenser/cgi-bin/reflinks.py?lang=en&page=List_of_United_Kingdom_by-elections_(1900%E2%80%931918)&autoclick=wpDiff [03:27:22] epic script fail [03:27:46] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 268330 MB (5% inode=30%): [03:28:19] :) [03:31:43] how the fuck do I browse the pywikipedia svn again? [03:32:08] http://svn.wikimedia.org/svnroot/pywikipedia/trunk/pywikipedia/ [03:36:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:36:17] Looks like the same problem might be in pywikipedia's reflinks [03:36:56] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:37:17] So never upgraded to support the new parameters of cite.php [03:38:02] Dispenser: looks like it was attempted, but not done correctly [03:38:28] I'm gonna put it off till tomorrow, thanks for letting me know [03:39:19] The regexes for matching groups are weird because it was weird in cite.php [03:39:26] Dispenser: no problem just passing it along I often get these questions [03:43:46] Free Memory on damiana is WARNING: WARNING - 6.0% (501656 kB) free! [03:53:46] Free Memory on damiana is OK: OK - 8.1% (676924 kB) free. [03:53:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [04:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47870 MB (7% inode=99%): [04:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [04:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [04:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:24:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 272316 MB (5% inode=31%): [04:36:08] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [05:04:18] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47736 MB (7% inode=99%): [05:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [05:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [05:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 275747 MB (5% inode=31%): [05:36:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:56:46] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [06:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47606 MB (7% inode=99%): [06:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [06:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [06:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 277311 MB (5% inode=31%): [06:29:47] Free Memory on damiana is WARNING: WARNING - 5.7% (480424 kB) free! [06:35:47] Free Memory on damiana is OK: OK - 7.1% (592388 kB) free. [06:36:08] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:56:52] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [07:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47471 MB (7% inode=99%): [07:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [07:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [07:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:27:48] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 280292 MB (5% inode=32%): [07:36:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [08:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47360 MB (7% inode=99%): [08:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [08:11:26] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [08:18:48] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:27:48] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 281767 MB (5% inode=32%): [08:33:47] Free Memory on damiana is WARNING: WARNING - 6.6% (550164 kB) free! [08:36:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:36:47] Free Memory on damiana is OK: OK - 7.3% (611184 kB) free. [08:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:54:47] Free Memory on damiana is WARNING: WARNING - 6.4% (540136 kB) free! [08:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [09:04:18] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47226 MB (7% inode=99%): [09:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [09:07:48] Free Memory on damiana is OK: OK - 7.9% (663888 kB) free. [09:11:26] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [09:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 282936 MB (5% inode=32%): [09:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:37:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [10:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 47059 MB (7% inode=99%): [10:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [10:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [10:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:24:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:26:47] Free Memory on damiana is WARNING: WARNING - 6.8% (573668 kB) free! [10:27:47] Free Memory on damiana is CRITICAL: CRITICAL - 4.9% (413640 kB) free! [10:27:48] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 284096 MB (5% inode=32%): [10:29:47] Free Memory on damiana is WARNING: WARNING - 5.8% (482844 kB) free! [10:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:53:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [11:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 46898 MB (7% inode=99%): [11:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc: [11:11:32] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [11:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:21:14] @replag [11:21:15] Merlissimo: s1-rr-a-wd: 10s [-0.00 s/s]; s1-user-wd: 10s [-]; s2-user: 2m 28s [-0.02 s/s]; s2-user-c: error; s2-user-wd: 14s [-0.00 s/s]; s3-user: 60s [+0.00 s/s]; s4-user-wd: 10s [-0.00 s/s]; s5-user-c: error [11:21:15] Merlissimo: s5-user-wd: 14s [-0.00 s/s]; s6-user: 16s [-0.00 s/s]; s7-user: 13s [-0.10 s/s]; s7-user-wd: 10s [-0.00 s/s] [11:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:27:11] * aude wonders what my ldap password is.... [11:27:48] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 285319 MB (5% inode=32%): [11:30:05] reset [11:33:55] @replag all [11:33:56] Merlissimo: s1-rr-a: 0s [-0.00 s/s]; s1-rr-a-wd: 12s [+0.00 s/s]; s1-user: 0s [-0.00 s/s]; s1-user-c: 7s [-0.00 s/s]; s1-user-wd: 9s [-0.00 s/s]; s2-user: 8s [-0.18 s/s]; s2-user-c: error; s2-user-wd: 12s [-0.00 s/s] [11:33:56] Merlissimo: s3-user: 37s [-0.03 s/s]; s4-rr-a: 2s [-0.00 s/s]; s4-user: 2s [-0.00 s/s]; s4-user-wd: 10s [-]; s5-rr-a: 2s [-0.00 s/s]; s5-user: 2s [-0.00 s/s]; s5-user-c: error; s5-user-wd: 12s [-0.00 s/s] [11:33:58] Merlissimo: s6-user: 2s [-0.02 s/s]; s6-user-wd: 11s [+0.00 s/s]; s7-user: 6s [-0.01 s/s]; s7-user-wd: 10s [-] [11:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:54:06] aude: iirc it is the same as stored in my.cnf unless you changed it [11:56:48] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [12:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 46720 MB (7% inode=99%): [12:06:34] Hello all [12:06:37] @replag [12:06:38] DaBPunkt: s1-rr-a-wd: 18s [+0.00 s/s]; s1-user-wd: 19s [+0.01 s/s]; s2-user-c: error; s2-user-wd: 20s [+0.00 s/s]; s4-user-wd: 19s [+0.00 s/s]; s5-user-c: error; s5-user-wd: 20s [+0.00 s/s]; s6-user-wd: 25s [+0.01 s/s] [12:06:39] DaBPunkt: s7-user-wd: 19s [+0.00 s/s] [12:06:51] good! :) [12:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:11:28] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [12:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:24:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 286370 MB (5% inode=33%): [12:29:47] Free Memory on damiana is WARNING: WARNING - 6.3% (529296 kB) free! [12:35:48] Free Memory on damiana is OK: OK - 7.2% (607152 kB) free. [12:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:51:48] Free Memory on damiana is WARNING: WARNING - 6.6% (553876 kB) free! [12:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [12:59:47] Free Memory on damiana is OK: OK - 7.3% (610876 kB) free. [13:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 46488 MB (7% inode=99%): [13:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [13:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [13:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:24:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 287800 MB (5% inode=33%): [13:32:16] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 83036 MB (8% inode=99%): [13:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:37:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:56:48] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [14:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 46279 MB (7% inode=99%): [14:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [14:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [14:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:24:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 290265 MB (5% inode=33%): [14:31:47] Free Memory on damiana is WARNING: WARNING - 5.4% (451540 kB) free! [14:36:47] Free Memory on damiana is OK: OK - 7.3% (612992 kB) free. [14:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [15:04:18] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 46091 MB (7% inode=99%): [15:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [15:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [15:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:27:48] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 291980 MB (5% inode=33%): [15:31:47] Free Memory on damiana is CRITICAL: CRITICAL - 4.5% (374512 kB) free! [15:32:48] Free Memory on damiana is WARNING: WARNING - 6.0% (501240 kB) free! [15:34:47] Free Memory on damiana is OK: OK - 7.1% (598264 kB) free. [15:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:51:38] @replag [15:51:40] Merlissimo: s1-rr-a-wd: 18m 35s [+0.08 s/s]; s1-user: 15s [+0.00 s/s]; s1-user-wd: 22m 12s [+0.10 s/s]; s2-user-c: error; s2-user-wd: 23m 52s [+0.10 s/s]; s3-user: 35s [-0.00 s/s]; s4-user-wd: 18m 28s [+0.08 s/s]; s5-user-c: error [15:51:41] Merlissimo: s5-user-wd: 23m 52s [+0.10 s/s]; s6-user-wd: 21m 24s [+0.09 s/s]; s7-user-wd: 21m 6s [+0.09 s/s] [15:53:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [16:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 45901 MB (7% inode=99%): [16:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [16:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [16:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 293623 MB (5% inode=34%): [16:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:56:48] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [17:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 45709 MB (7% inode=99%): [17:06:48] Free Memory on damiana is WARNING: WARNING - 6.3% (524536 kB) free! [17:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [17:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [17:14:47] Free Memory on damiana is OK: OK - 7.1% (597832 kB) free. [17:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 294706 MB (5% inode=34%): [17:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:56:46] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [18:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 45502 MB (7% inode=99%): [18:05:47] Free Memory on damiana is WARNING: WARNING - 6.5% (542056 kB) free! [18:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [18:10:27] PING on amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 217.00 ms [18:10:28] PING on web.amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 218.00 ms [18:11:27] PING on amaranth is OK: PING OK - Packet loss = 0%, RTA = 118.00 ms [18:11:27] PING on web.amaranth is OK: PING OK - Packet loss = 0%, RTA = 118.00 ms [18:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [18:12:47] Free Memory on damiana is OK: OK - 7.1% (593728 kB) free. [18:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 296584 MB (5% inode=34%): [18:32:47] Free Memory on damiana is WARNING: WARNING - 6.1% (507768 kB) free! [18:35:49] Free Memory on damiana is OK: OK - 7.1% (596404 kB) free. [18:36:56] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:46:27] PING on web.amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 193.00 ms [18:46:27] PING on amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 193.00 ms [18:46:47] Free Memory on damiana is WARNING: WARNING - 6.8% (573904 kB) free! [18:47:27] PING on web.amaranth is OK: PING OK - Packet loss = 0%, RTA = 154.00 ms [18:47:28] PING on amaranth is OK: PING OK - Packet loss = 0%, RTA = 154.00 ms [18:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:56:48] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [19:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 45331 MB (7% inode=99%): [19:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [19:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [19:17:27] PING on amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 194.00 ms [19:17:27] PING on web.amaranth is WARNING: PING WARNING - Packet loss = 0%, RTA = 194.00 ms [19:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:20:27] PING on web.amaranth is OK: PING OK - Packet loss = 0%, RTA = 112.00 ms [19:20:27] PING on amaranth is OK: PING OK - Packet loss = 0%, RTA = 112.00 ms [19:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 298567 MB (5% inode=34%): [19:35:53] anyone know if it's possible to get information about pending-changes protected articles from the toolserver database? [19:35:59] like a list of PC-protected articles [19:36:09] or a list of edits to PC-protected articles that haven't yet been accepted/rejected [19:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:46:10] or the API [19:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [20:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 45092 MB (7% inode=99%): [20:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [20:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [20:18:48] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:27:48] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 300164 MB (5% inode=35%): [20:31:47] Free Memory on damiana is WARNING: WARNING - 5.9% (496776 kB) free! [20:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:37:47] Free Memory on damiana is OK: OK - 7.2% (606880 kB) free. [20:38:28] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2211 [20:41:07] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2135 [20:42:07] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2179 [20:54:01] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [21:02:17] MySQL slave on z-dat-s3-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3628 [21:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 44842 MB (7% inode=99%): [21:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [21:11:08] MySQL slave on z-dat-s7-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3628 [21:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [21:13:07] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3612 [21:17:47] Free Memory on damiana is WARNING: WARNING - 6.2% (517860 kB) free! [21:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:24:08] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3589 [21:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:25:47] Free Memory on damiana is OK: OK - 7.2% (607384 kB) free. [21:26:08] MySQL slave on z-dat-s6-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3602 [21:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 301378 MB (5% inode=35%): [21:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:46:07] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2395 [21:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:55:07] MySQL slave on z-dat-s6-a is OK: Uptime: 811988 Threads: 10 Questions: 256508536 Slow queries: 36482 Opens: 1422054 Flush tables: 1 Open tables: 3083 Queries per second avg: 315.901 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1699 [21:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [22:02:27] MySQL slave on z-dat-s3-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 6824 [22:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 44656 MB (7% inode=99%): [22:06:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:11:17] MySQL slave on z-dat-s7-a is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 5784 [22:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [22:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:24:48] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 303038 MB (5% inode=35%): [22:32:18] MySQL slave on z-dat-s7-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3538 [22:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:40:18] MySQL slave on z-dat-s7-a is OK: Uptime: 975729 Threads: 6 Questions: 324599703 Slow queries: 23393 Opens: 1065358 Flush tables: 1 Open tables: 4751 Queries per second avg: 332.674 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1666 [22:47:47] Free Memory on damiana is WARNING: WARNING - 5.7% (477028 kB) free! [22:49:27] MySQL slave on z-dat-s3-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3516 [22:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [22:57:47] Free Memory on damiana is OK: OK - 7.1% (594564 kB) free. [23:04:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 44368 MB (7% inode=99%): [23:04:27] MySQL slave on z-dat-s3-a is OK: Uptime: 497229 Threads: 24 Questions: 497469895 Slow queries: 35226 Opens: 4516763 Flush tables: 1 Open tables: 16383 Queries per second avg: 1000.484 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1734 [23:06:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B: [23:11:27] s4 replag on cassia is CRITICAL: QUERY CRITICAL: Unknown database commonswiki_p [23:18:47] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:24:47] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:27:47] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 303441 MB (5% inode=35%): [23:36:57] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:37:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:53:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:56:47] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7