[00:06:54] Oahi brion! [00:07:00] Ohai* [00:11:15] yo [00:22:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [00:25:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [00:26:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [00:28:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:29:07] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:29:57] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 323022 MB (6% inode=68%): [00:31:08] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31949 MB (5% inode=99%): [00:37:17] MySQL slave on z-dat-s6-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3426 [00:49:17] MySQL slave on z-dat-s6-a is OK: Uptime: 908795 Threads: 12 Questions: 283518028 Slow queries: 39658 Opens: 1487677 Flush tables: 1 Open tables: 3062 Queries per second avg: 311.971 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1580 [01:20:13] [[Special:Log/newusers]] create 10 * Certificateseo * (New user account) [01:22:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:23:31] [[User talk:Certificateseo]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7817&rcid=21563 * Certificateseo * (+561) (Created page with "Support Arrangements Learner Need Support Arrangement Language, literacy and numeracy needs Cultural/religious needs Disability Learning styles Workplace culture ...") [01:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [01:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:25:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:26:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [01:28:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:28:43] [[User talk:Certificateseo]] ! 10https://wiki.toolserver.org/w/index.php?diff=7818&oldid=7817&rcid=21564 * 92.231.144.79 * (-551) (Replaced content with "{{delete}}") [01:29:08] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:29:47] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2118 [01:29:57] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 325643 MB (6% inode=68%): [01:29:57] wikidata replag on z-dat-s2-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2119.000000 [01:31:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31781 MB (5% inode=99%): [01:38:57] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 69067 MB (7% inode=99%): [02:23:17] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [02:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [02:26:07] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:26:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [02:26:46] MySQL slave on z-dat-s2-b is OK: Uptime: 457200 Threads: 13 Questions: 335754839 Slow queries: 7393 Opens: 15906505 Flush tables: 1 Open tables: 65 Queries per second avg: 734.371 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1732 [02:28:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:29:43] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:29:57] wikidata replag on z-dat-s2-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3289.000000 [02:29:58] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 324675 MB (6% inode=68%): [02:32:08] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31941 MB (5% inode=99%): [02:41:11] [[Special:Log/newusers]] create 10 * Poppaddle * (New user account) [02:44:23] [[User talk:Poppaddle]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7819&rcid=21566 * Poppaddle * (+447) (Created page with "With the aim of introducing the game of surfing to more and more people all around the world, we are very proud of being one of the world’s leading companies in the field of pa...") [03:06:58] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3660.000000 [03:10:21] [[Special:Log/delete]] delete 10 * Dab * (deleted "[[02User talk:Poppaddle10]]": SPAM) [03:10:38] [[Special:Log/block]] block 10 * Dab * (blocked [[02User:Poppaddle10]] with an expiry time of infinite (account creation disabled): Spammer) [03:11:22] nacht ts [03:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc: [03:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:26:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [03:26:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:28:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:29:56] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 323553 MB (6% inode=68%): [03:32:07] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31584 MB (5% inode=99%): [03:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:06:57] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5897.000000 [04:08:47] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2127 [04:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:23:58] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [04:25:36] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:26:07] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [04:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:28:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:29:16] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:29:57] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 323656 MB (6% inode=68%): [04:30:16] [[Wiki server assignments]] ! 10https://wiki.toolserver.org/w/index.php?diff=7820&oldid=7811&rcid=21569 * 91.198.174.202 * (+0) (updated page) [04:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31471 MB (5% inode=99%): [04:40:47] MySQL slave on z-dat-s2-b is OK: Uptime: 465242 Threads: 12 Questions: 343085141 Slow queries: 7641 Opens: 16201572 Flush tables: 1 Open tables: 65 Queries per second avg: 737.433 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1700 [04:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:54:57] wikidata replag on z-dat-s2-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3387.000000 [04:59:57] wikidata replag on z-dat-s2-b is OK: QUERY OK: SELECT ts_rc_age() returned 1492.000000 [05:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [05:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [05:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [05:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:29:57] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 323049 MB (6% inode=68%): [05:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31344 MB (5% inode=99%): [05:42:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 319090 MB (5% inode=68%): [05:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:14:57] /mnt user-store on rosemary is WARNING: DISK WARNING - free space: /mnt 321851 MB (6% inode=68%): [06:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 318479 MB (5% inode=68%): [06:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [06:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [06:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:29:20] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31226 MB (5% inode=99%): [06:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 318334 MB (5% inode=68%): [07:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [07:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [07:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:32:16] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 31100 MB (5% inode=99%): [07:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:15:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 317571 MB (5% inode=68%): [08:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (3 errors): null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.CommunicationLost.desc:S3:oob:S4:2530:S9:ts-array5:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.descri [08:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [08:26:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:27:07] Load avg. on adenia is WARNING: WARNING - load average: 17.25, 18.13, 14.50 [08:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:30:06] Peter Körner * Re: [Toolserver-l] New Rule: SGE-constraint for bots [08:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 30896 MB (5% inode=99%): [08:37:07] Load avg. on adenia is OK: OK - load average: 12.91, 14.74, 14.43 [08:51:44] [[Special:Log/newusers]] create 10 * Nancyenm * (New user account) [08:53:07] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:53:26] [[User talk:Nancyenm]] !N 10https://wiki.toolserver.org/w/index.php?oldid=7821&rcid=21571 * Nancyenm * (+2042) (Created page with "Everybody hits potholes. You can't cure it. However, if someone strike a single with plenty drive, the specific fatigue might be wrecked along with worse, your rim could be bent ...") [09:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 316100 MB (5% inode=68%): [09:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [09:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:25:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [09:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 30639 MB (5% inode=99%): [09:51:47] Load avg. on ptolemy is WARNING: WARNING - load average: 22.13, 16.49, 11.40 [09:57:47] Load avg. on ptolemy is OK: OK - load average: 7.63, 13.50, 12.07 [10:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 316708 MB (5% inode=68%): [10:22:58] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:23:58] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [10:23:58] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:24:46] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2032 [10:25:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [10:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:28:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 30407 MB (4% inode=99%): [10:46:38] @replag [10:46:38] Alchimista: s1-rr-a-wd: 3m 12s [+0.00 s/s]; s1-user-wd: 3m 12s [+0.00 s/s]; s2-rr: 49m 14s [+0.00 s/s]; s2-user: 49m 14s [+0.00 s/s]; s2-user-c: error; s2-user-wd: 3m 12s [+0.00 s/s]; s3-user: 37s [+0.00 s/s]; s4-user-wd: 3m 12s [+0.00 s/s] [10:46:39] Alchimista: s5-user-c: 35s [-0.00 s/s]; s5-user-wd: 3m 12s [+0.00 s/s]; s6-user-wd: 3m 12s [+0.00 s/s]; s7-user: 10s [+0.00 s/s]; s7-user-wd: 3m 12s [+0.00 s/s] [10:55:47] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [11:06:58] Hello allo [11:07:10] -o [11:07:10] @replag [11:07:10] DaBPunkt: s1-rr-a-wd: 2m 13s [-0.05 s/s]; s1-user-wd: 2m 5s [-0.05 s/s]; s2-rr: 1h 9m 41s [+1.00 s/s]; s2-user: 1h 9m 41s [+1.00 s/s]; s2-user-c: error; s2-user-wd: 2m 5s [-0.05 s/s]; s3-user: 12s [-0.02 s/s]; s4-user-wd: 2m 13s [-0.05 s/s] [11:07:10] DaBPunkt: s5-user-c: 1m 15s [+0.03 s/s]; s5-user-wd: 2m 13s [-0.05 s/s]; s6-user-wd: 2m 5s [-0.05 s/s]; s7-user-wd: 2m 13s [-0.05 s/s] [11:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 315446 MB (5% inode=68%): [11:23:07] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [11:23:58] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:26:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [11:26:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 30152 MB (4% inode=99%): [11:55:47] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [12:11:06] DaB. * [Toolserver-announce] sql-s5 (dewiki) will be read-only tomorrow [12:15:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 314769 MB (5% inode=68%): [12:23:08] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:24:06] Bryan Tong Minh * Re: [Toolserver-l] sql-s5 (dewiki) will be read-only tomorrow [12:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:26:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [12:26:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [12:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:29:19] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 29862 MB (4% inode=99%): [12:55:46] MySQL slave on z-dat-s2-b is CRITICAL: (Return code of 139 is out of bounds) [13:02:57] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [13:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 313924 MB (5% inode=68%): [13:22:03] @replag [13:22:03] Alchimista: s1-rr-a-wd: 56s [-0.01 s/s]; s1-user-wd: 58s [-0.01 s/s]; s2-rr: 3h 17m 37s [+0.95 s/s]; s2-user: 3h 17m 37s [+0.95 s/s]; s2-user-c: error; s2-user-wd: 2m 25s [+0.00 s/s]; s3-user: 23s [+0.00 s/s]; s4-user-wd: 57s [-0.01 s/s] [13:22:04] Alchimista: s5-user-c: 1m 38s [+0.00 s/s]; s5-user-wd: 56s [-0.01 s/s]; s6-user-wd: 58s [-0.01 s/s]; s7-user-wd: 58s [-0.01 s/s] [13:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [13:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:26:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [13:26:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:29:22] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 29584 MB (4% inode=99%): [13:38:57] /sql on rosemary is WARNING: DISK WARNING - free space: /sql 69143 MB (7% inode=99%): [13:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:55:24] @replag [13:55:24] Alchimista: s1-rr-a-wd: 58s [+0.00 s/s]; s1-user-wd: 56s [-0.00 s/s]; s2-rr: 3h 24m 13s [+0.20 s/s]; s2-user: 3h 24m 13s [+0.20 s/s]; s2-user-c: error; s2-user-wd: 10m 0s [+0.23 s/s]; s4-user-wd: 57s [-]; s5-user-c: 1m 45s [+0.00 s/s] [13:55:25] Alchimista: s5-user-wd: 56s [-]; s6-user-wd: 58s [-]; s7-user-wd: 57s [-0.00 s/s] [13:55:47] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 12252 [14:02:57] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [14:15:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 313290 MB (5% inode=68%): [14:21:06] Silke Meyer * [Toolserver-announce] Visibility of tools [14:22:06] Silke Meyer * [Toolserver-announce] List of tools on the toolserver - Help needed [14:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [14:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [14:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:26:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [14:26:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [14:28:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:32:18] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 29322 MB (4% inode=99%): [14:53:07] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:55:47] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 8754 [14:59:06] Mashiah Davidson * Re: [Toolserver-l] sql-s5 (dewiki) will be read-only tomorrow [15:02:57] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [15:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 312545 MB (5% inode=68%): [15:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [15:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [15:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [15:26:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:28:19] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:28:33] hello [15:28:47] hrmmmmm, nosy feeling better? i see mail from her this morning [15:29:06] I'm wondering if someone can help me defining how much resources my tasks need. I actually I have no clue about it [15:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:29:26] well you're sure to not get an answer if you don't ask [15:30:28] jeremyb_, are you talking with me? ask to whom? [15:30:49] ciao Gnumarcoo :) [15:31:02] anyone? [15:31:04] the wind [15:31:09] so, you could maybe describe your tasks in some way for starters [15:31:25] ehi Filnik, ciao! [15:31:55] jeremyb_, are instances of welcome.py on it.wikipedia, checkimages.py on it.wikipedia and commons [15:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 28990 MB (4% inode=99%): [15:32:21] Gnumarcoo, have you fixed your bot with qcronsub? [15:32:33] so, you're asking for SGE? [15:32:48] i would hope (but don't know) if you can get some stats from SGE [15:33:00] Filnik, qcronsub? [15:33:09] and then you can look at what does it normally use and set a value based on that [15:33:10] never used it ;) [15:33:35] scfc_de`: Merlissimo: is that right? [15:33:35] Gnumarcoo, seems that you will, since we have to specify the resources needed. Otherwise you get some scripts disabled ( https://wiki.toolserver.org/view/Job_scheduling ) [15:34:18] jeremyb_, yes exactly, thanks. if there is some stats it would be great (but why not use it as default instead of disabling the scripts? uhm) [15:34:22] uhm, k. [15:34:42] or maybe Coren knows? [15:34:45] Gnumarcoo, welcome.py and checkimages.py are down :( [15:34:51] Filnik, i know [15:35:00] Hmm? [15:35:04] * Coren reads the backlog. [15:35:26] Coren, do you know how to see how much resources uses a certain job? (for SGE) [15:35:27] Coren: can you get historical resource use stats (ram/cpu/etc.) for your recent jobs? [15:35:56] i should get a TS account :P [15:37:29] qacct [15:37:36] * Filnik tries [15:37:50] Filnik: when an it.wp user told me that ur bot was stopped, i was sure qcronsub was crashed [15:37:52] Simplest scenario: qacct -j [15:38:32] You can also ask for range of dates, etc. [15:39:01] Coren, so it's only for running jobs? otherwise how can I get the jobid? (is it the pid?) [15:39:28] You get the job ID when the job is submitted, and, IIRC, you also should have it at the head of the output file. [15:39:29] *were (argh, i'm doing too many things together) [15:40:01] Otherwise, you can use -b / -e to set a begin and end time for jobs you want info on instead of job id. [15:40:03] man qacct [15:40:04] :-) [15:40:13] * Filnik mumbles [15:40:30] (I don't remember the date format it expects offhand) :-) [15:40:59] [[CC]YY]MMDDhhmm[.SS] [15:41:02] Coren, uhm, what output file? [15:41:20] Filnik: Well, that was presuming your job had output. :-) [15:42:01] qsub tells you the job id when you submit it -- it's a good practice to log this somewhere. [15:42:17] * Filnik misses the qsub thing [15:42:44] But otherwise, use -b -e to set a date range and you should be able to see the jobs you ran in that interval. [15:43:16] Coren, so I have to guess something at first, then see the usage and then make another guess to establish how much resources I need? :S [15:43:31] * Filnik doesn't like that much this system. Sounds tricky [15:45:40] Filnik: Well, if you don't have a better way to estimate, that iteration is your best bet. [15:45:41] i typically run it on my own machine, look at how much it takes up, then give it a little extra on the ts [15:45:42] ok, thanks [15:45:42] * Filnik wonders why it's not done automatically [15:48:08] Coren, thanks hoewever. Now i try to fix it [15:48:15] http://www.adafruit.com/blog/2013/02/19/sun-printed-apples/ reminds me of square watermelons [15:49:23] heh thats pretty cool [15:50:02] "Susan Brown can breed apples with a stable variation of this mutation that creates candy-cane red stripes on a pale yellow-skinned apple." [15:55:47] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 8604 [16:02:57] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [16:10:15] Coren: Filnik: Cool, I didn't know about qacct before. I normally used "/usr/bin/time -f 'Command: %C\nMemory: %M\nTime: %E' script". [16:11:03] scfc_de`: Well, that's also a good way of getting the data /before/ submiting a job. [16:13:04] as long as you don't have one of those buggy time(1) reporting the memory wrong :P [16:14:32] It worked so far :-). [16:14:44] (Tested on the Toolserver, of course.) [16:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 311974 MB (5% inode=68%): [16:22:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:23:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [16:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [16:26:37] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:29:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:29:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 28774 MB (4% inode=99%): [16:55:47] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 10906 [16:58:57] wikidata replag on z-dat-s2-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1920.000000 [17:02:56] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [17:09:56] wikidata replag on z-dat-s2-b is OK: QUERY OK: SELECT ts_rc_age() returned 1793.000000 [17:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 311469 MB (5% inode=68%): [17:21:57] * Coren tries to understand why the incoming spam hitting his mail system trebled in the last week. [17:23:07] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:23:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [17:23:57] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [17:26:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:26:17] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [17:26:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:27:06] Tim Landscheidt * Re: [Toolserver-l] Visibility of tools [17:29:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:29:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 28515 MB (4% inode=99%): [17:48:06] Morten Wang * Re: [Toolserver-l] Visibility of tools [17:55:46] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 8532 [18:02:56] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [18:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 310961 MB (5% inode=68%): [18:23:17] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [18:24:07] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [18:26:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:26:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [18:26:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:29:17] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 28183 MB (4% inode=99%): [18:55:46] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4036 [18:58:49] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3480 [19:02:57] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [19:04:47] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3624 [19:06:47] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3580 [19:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 309251 MB (5% inode=68%): [19:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [19:24:07] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [19:26:19] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:26:19] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [19:26:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:26:47] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4246 [19:29:18] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:29:18] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 26077 MB (4% inode=99%): [19:34:33] hi, there are few files which i would like to share with other (copyright free books which can be put on wikisource). currently i am planning to share it from my public_html dir. is it a good place for serving them? [19:35:02] i thought of using something like dropbox.com/box.com but it may take some time [19:36:00] If it's related to Wikisource, it sounds fine. [19:36:10] But there's a rule about serving page content. [19:36:32] > Tools may not serve significant portions of wiki page text to clients. "Significant" means distributing actual page content; for example, installing MediaWiki to serve the text of wikis would not be allowed, but showing a short extract to provide context for a tool would be okay. [19:36:38] https://wiki.toolserver.org/view/Rules [19:36:56] I think text files should be fine. [19:37:08] But if you want to be sure, you can always e-mail the mailing list (toolserver-l@lists.wikimedia.org). [19:38:40] Susan: thanks. [19:40:12] currently i am downloading the data in multiple tif files, converting it to single pdf and moving it to public_html. i think i better download it locally and share it with dropbox/box [19:41:33] has anyone written any tool do upload the .pdf to wikisource from cli? [19:42:27] No idea. [19:42:34] There are frameworks that could easily support that, I imagine. [19:42:39] In Java, Perl, Python, PHP, etc. [19:42:51] If all you to do is a simple file upload to a MediaWiki wiki. [19:43:01] If you want OCR and all that, it's a whole different thing, of course. ;-) [19:43:43] afaik, there isn't any OCR available :( [19:45:30] Susan: i was looking for something which can upload the file to wikisource which displays the scanned pages in right half of the screen and left half is for typing. [19:45:42] Oh. [19:45:46] That's a MediaWiki extension. [19:45:50] Wikisource has that. [19:45:59] https://en.wikisource.org/wiki/Special:Version [19:46:00] One of those. [19:46:12] > PagedTiffHandler [19:46:16] > PDF Handler [19:46:18] And then there's... [19:46:25] The main one. [19:46:57] > ProofreadPage [19:47:02] https://www.mediawiki.org/wiki/Extension:Proofread_Page [19:47:23] Susan: yes. i want to upload the pdf directly for proofreading. [19:49:26] Isn't that Wikisource does already? [19:50:22] Susan: is there CLI for doing that? so that i can automate the uploads... [19:52:22] that what * [19:52:32] shantanoo: MediaWiki has a fairly robust API. [19:52:47] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3594 [19:52:47] https://en.wikisource.org/w/api.php [19:52:54] Dunno what shape it's in for this task. [19:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:54:53] Susan: i was looking for predefined steps for doing so using the api. which api calls/urls should i look. [19:55:14] > [19:55:15] * action=upload * [19:55:16] Upload a file, or get the status of pending uploads. [19:55:18] > [19:57:00] Susan: once the file is uploaded, some more information needs to be updated so it is visible for proofreading (afaik). right? am not aware of those steps. [19:58:47] MySQL slave on z-dat-s2-b is OK: Uptime: 520323 Threads: 11 Questions: 390735091 Slow queries: 8560 Opens: 18131319 Flush tables: 1 Open tables: 64 Queries per second avg: 750.947 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1761 [19:58:50] Sorry, I got distracted. [19:58:56] It's the ProofreadPage extension you want, I think. [19:59:00] I don't know what API support it has. [19:59:05] You'd have to look at its source code to know for sure. [19:59:21] https://gerrit.wikimedia.org/r/gitweb?p=mediawiki/extensions/ProofreadPage.git;a=tree [19:59:26] > ApiQueryProofread.php [19:59:28] checking [19:59:30] > ApiQueryProofreadInfo.php [19:59:37] Those look like its only API code. [19:59:44] The functionality you want may not be inside MediaWiki yet. [19:59:47] Wikisource is undeveloped. [20:02:56] MySQL slave on z-dat-s4-a is CRITICAL: (Return code of 139 is out of bounds) [20:08:11] for time being i will keep it on tool server machine. will move it over time to wikisource [20:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 308935 MB (5% inode=68%): [20:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [20:24:08] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [20:26:18] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:26:18] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [20:26:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:29:17] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:29:26] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:32:17] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 27563 MB (4% inode=99%): [20:48:08] DaBPunkt: ping [20:48:12] you should have mail [20:48:13] pong [20:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:53:29] DaBPunkt: did you see the mail? [20:54:29] jeremyb_: I get many mails. What is the subject? [20:54:46] it was sent 9 minutes ago [20:55:01] Re: [wikimedia #4497] Replace bad dimms : amaranth in Tampa [20:56:07] I see it [20:58:06] Mashiah Davidson * Re: [Toolserver-l] Visibility of tools [20:58:18] jeremyb_: answered [20:58:24] let me see [20:58:43] reading [21:02:57] MySQL slave on z-dat-s4-a is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3323 [21:05:49] DaBPunkt: do you have a dmidecode installed on your $PATH? [21:05:57] MySQL slave on z-dat-s4-a is OK: Uptime: 3102816 Threads: 1 Questions: 328877904 Slow queries: 127 Opens: 647 Flush tables: 11 Open tables: 221 Queries per second avg: 105.993 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1635 [21:06:09] also, have you tried smbios? [21:06:15] https://blogs.oracle.com/dmick/entry/dmidecode_for_solaris [21:06:35] jeremyb_: If I would have dmidecode I had use it already :) [21:06:43] heheh [21:07:07] smbios looks avaiale [21:07:48] I will passte the output in a pastebin [21:08:48] o maybe beetter a file [21:10:16] sent [21:11:06] Анастасия Львова * Re: [Toolserver-l] Visibility of tools [21:13:31] DaBPunkt: danke, not sure yet what that gave us... I will look more in a bit [21:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 308262 MB (5% inode=68%): [21:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [21:24:07] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [21:26:27] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:26:27] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [21:26:50] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:29:27] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:29:27] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:32:27] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 27275 MB (4% inode=99%): [21:51:56] DaBPunkt: you have a ping in #wikimedia-tech [21:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:54:08] jeremyb_: I get a OSD-message AND the irc-tab gets red ;) [21:54:21] :) [21:56:57] wikidata replag on z-dat-s2-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2162.000000 [21:57:07] wikidata replag on z-dat-s7-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2167.000000 [21:57:07] wikidata replag on daphne is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2168.000000 [21:57:07] wikidata replag on thyme is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2171.000000 [21:57:17] wikidata replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2183.000000 [21:57:27] wikidata replag on cassia is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2190.000000 [21:57:57] wikidata replag on z-dat-s6-a is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2220.000000 [22:16:02] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 307267 MB (5% inode=68%): [22:20:57] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3602.000000 [22:21:07] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3607.000000 [22:21:08] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3608.000000 [22:21:08] wikidata replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3611.000000 [22:21:16] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3623.000000 [22:21:30] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3631.000000 [22:21:57] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3659.000000 [22:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [22:24:07] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [22:26:27] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:26:28] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [22:26:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:29:27] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:29:27] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:32:29] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 26947 MB (4% inode=99%): [22:52:56] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:15:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 306748 MB (5% inode=68%): [23:20:57] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7202.000000 [23:21:06] wikidata replag on z-dat-s7-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7206.000000 [23:21:07] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7208.000000 [23:21:08] wikidata replag on thyme is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7212.000000 [23:21:17] wikidata replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7223.000000 [23:21:26] wikidata replag on cassia is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7231.000000 [23:21:57] wikidata replag on z-dat-s6-a is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7259.000000 [23:23:57] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [23:24:07] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [23:26:27] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:26:28] FMA on amaranth is CRITICAL: Failed components: hc://:product-id=SUN-FIRE-X4150:server-id=amaranth:chassis-id=0819QAR1D1:serial=518545072303039020:part=72T256520HFD3SB:revision=--/motherboard=0/memory-controller=1/dram-channel=2/dimm=3/rank=7 [23:26:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:29:27] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:29:27] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:32:27] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 26685 MB (4% inode=99%): [23:52:57] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL