[00:00:09] why do you ask? [00:00:18] because i was do the math in bc [00:00:25] just curious [00:01:45] I restart sql-s5-user for a moment [00:07:26] MySQL on z-dat-s5-b is CRITICAL: Cant connect to MySQL server on z-dat-s5-b (146) [00:08:54] jeremyb_: in this case I will use ~8MB/s. [00:11:02] enjoy :) [00:12:56] MySQL on z-dat-s5-b is OK: Uptime: 6 Threads: 4 Questions: 35 Slow queries: 0 Opens: 22 Flush tables: 1 Open tables: 15 Queries per second avg: 5.833 [00:13:16] Load avg. on nightshade is WARNING: WARNING - load average: 9.59, 16.89, 16.26 [00:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 178554.000000 [00:19:56] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 69266.000000 [00:19:56] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 69283 [00:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 141216 MB (2% inode=66%): [00:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [00:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [00:31:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69009 MB (11% inode=99%): [00:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 137972.000000 [00:35:16] Load avg. on nightshade is OK: OK - load average: 13.04, 13.72, 14.83 [00:35:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [00:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 61816 [00:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [00:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [00:47:16] / on ortelius is WARNING: DISK WARNING - free space: / 5030 MB (16% inode=92%): [00:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [00:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:02:06] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 53469 MB (5% inode=99%): [01:07:05] @replag [01:07:06] DaBPunkt: s1-rr-a-wd: 49s [-0.01 s/s]; s1-user-wd: 49s [-0.01 s/s]; s2-rr: 17h 11m 8s [-0.01 s/s]; s2-user: 17h 11m 8s [-0.01 s/s]; s2-user-c: error; s2-user-wd: 1d 14h 21m 7s [+0.12 s/s]; s3-user-wd: 50s [-0.01 s/s]; s4-user-wd: 1d 22h 59m 29s [-1.25 s/s] [01:07:07] DaBPunkt: s5-user: 18h 18m 49s [-3.97 s/s]; s5-user-c: 2w 3d 7h 7m 45s [+0.77 s/s]; s6-user-wd: 49s [-0.01 s/s]; s7-user-wd: 54s [-0.01 s/s] [01:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 168532.000000 [01:17:08] @replag [01:17:09] DaBPunkt: s1-rr-a-wd: 48s [-0.00 s/s]; s1-user-wd: 48s [-0.00 s/s]; s2-rr: 17h 2m 55s [-0.82 s/s]; s2-user: 17h 2m 55s [-0.82 s/s]; s2-user-c: error; s2-user-wd: 1d 14h 18m 14s [-0.29 s/s]; s3-user: 1m 22s [+0.00 s/s]; s3-user-wd: 50s [-] [01:17:10] DaBPunkt: s4-user-wd: 1d 22h 44m 17s [-1.51 s/s]; s5-user: 16h 56m 51s [-8.16 s/s]; s5-user-c: 2w 3d 7h 14m 16s [+0.65 s/s]; s6-user-wd: 48s [-0.00 s/s]; s7-user-wd: 50s [-0.01 s/s] [01:19:56] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 60078.000000 [01:20:27] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 59830 [01:27:00] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 137326 MB (2% inode=66%): [01:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [01:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [01:31:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68788 MB (11% inode=99%): [01:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 137371.000000 [01:35:47] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [01:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 58788 [01:44:27] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [01:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [01:47:16] / on ortelius is WARNING: DISK WARNING - free space: / 4430 MB (14% inode=92%): [01:48:36] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66877 MB (10% inode=99%): [01:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [01:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [01:58:16] / on ortelius is OK: DISK OK - free space: / 10684 MB (35% inode=92%): [02:01:29] nacht ts [02:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 158864.000000 [02:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 72137 MB (11% inode=99%): [02:19:56] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 36879.000000 [02:20:26] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 36655 [02:26:55] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 134560 MB (2% inode=66%): [02:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [02:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [02:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 134336.000000 [02:35:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [02:38:35] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 52396 [02:38:46] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [02:41:36] Load avg. on rosemary is WARNING: WARNING - load average: 15.14, 14.14, 11.38 [02:42:36] Load avg. on rosemary is OK: OK - load average: 14.68, 14.18, 11.57 [02:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [02:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [02:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [02:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [03:08:26] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2173.000000 [03:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 149289.000000 [03:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69603 MB (11% inode=99%): [03:19:56] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 24789.000000 [03:20:26] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 24804 [03:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 131809 MB (2% inode=66%): [03:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [03:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [03:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 132434.000000 [03:32:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3613.000000 [03:35:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [03:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 48671 [03:38:46] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [03:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [03:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [03:47:16] Load avg. on nightshade is WARNING: WARNING - load average: 10.94, 20.99, 18.16 [03:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [03:51:45] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:01:16] Load avg. on nightshade is OK: OK - load average: 11.79, 12.87, 14.82 [04:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 145003.000000 [04:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69447 MB (11% inode=99%): [04:19:56] wikidata replag on z-dat-s5-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 16632.000000 [04:20:26] MySQL slave on z-dat-s5-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 16400 [04:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 128749 MB (2% inode=66%): [04:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [04:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [04:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 131767.000000 [04:32:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 7213.000000 [04:35:47] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [04:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 47318 [04:38:46] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [04:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [04:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [04:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [04:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [04:54:26] MySQL slave on z-dat-s5-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3276 [04:54:57] wikidata replag on z-dat-s5-b is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3064.000000 [04:57:56] wikidata replag on z-dat-s5-b is OK: QUERY OK: SELECT ts_rc_age() returned 1751.000000 [04:58:26] MySQL slave on z-dat-s5-b is OK: Uptime: 17150 Threads: 6 Questions: 18563906 Slow queries: 156 Opens: 43081 Flush tables: 1 Open tables: 256 Queries per second avg: 1082.443 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1476 [05:15:25] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 139301.000000 [05:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69262 MB (11% inode=99%): [05:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 127296 MB (2% inode=66%): [05:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [05:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [05:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 130844.000000 [05:32:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 10814.000000 [05:36:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [05:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 46555 [05:38:46] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [05:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [05:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [05:45:34] [[Special:Log/newusers]] create 10 * RaphaelQS * (New user account) [05:51:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [05:51:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [06:15:27] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 135568.000000 [06:18:35] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 69070 MB (11% inode=99%): [06:26:57] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 127128 MB (2% inode=66%): [06:28:35] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [06:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [06:32:15] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 128048.000000 [06:32:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 14414.000000 [06:36:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 41495 [06:38:46] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [06:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [06:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [06:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [06:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [07:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 130423.000000 [07:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68888 MB (11% inode=99%): [07:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 126883 MB (2% inode=66%): [07:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [07:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [07:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 125879.000000 [07:32:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 18014.000000 [07:36:47] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [07:38:35] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 39764 [07:38:46] MySQL slave on rosemary is CRITICAL: (Return code of 139 is out of bounds) [07:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [07:45:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [07:48:16] Load avg. on nightshade is WARNING: WARNING - load average: 14.91, 15.81, 15.12 [07:50:17] Load avg. on nightshade is OK: OK - load average: 10.98, 14.29, 14.66 [07:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [07:51:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [08:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 125093.000000 [08:16:16] Load avg. on nightshade is WARNING: WARNING - load average: 22.95, 18.74, 15.64 [08:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68746 MB (11% inode=99%): [08:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 126683 MB (2% inode=66%): [08:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [08:28:42] [[Special:Log/newusers]] create 10 * Lena12Nott * (New user account) [08:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [08:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 124286.000000 [08:32:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 21261.000000 [08:36:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [08:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 33397 [08:38:46] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 20901 [08:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [08:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [08:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [08:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 121058.000000 [09:16:16] Load avg. on nightshade is WARNING: WARNING - load average: 13.68, 14.92, 15.37 [09:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68510 MB (11% inode=99%): [09:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 126421 MB (2% inode=66%): [09:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [09:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [09:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 121957.000000 [09:32:25] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 17433.000000 [09:34:16] Load avg. on nightshade is OK: OK - load average: 14.48, 14.45, 14.98 [09:36:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [09:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 25411 [09:38:46] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 16313 [09:44:25] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [09:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [09:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [09:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [09:55:16] Load avg. on nightshade is WARNING: WARNING - load average: 13.43, 15.11, 15.05 [09:56:16] Load avg. on nightshade is OK: OK - load average: 12.52, 14.53, 14.85 [10:15:27] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 116250.000000 [10:18:35] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68282 MB (11% inode=99%): [10:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 126094 MB (2% inode=66%): [10:27:28] Tonight I had a dream. Is possible to pipe a content to more than one command? [10:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [10:29:19] fale: You can use "tee". [10:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [10:30:40] scfc_de: so I could read the xml dump file and pipe it in the istream of more than one pywikipedia/replace instance so with only one I/O disc operation I can parse multiple fixes, isn't it? [10:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 120866.000000 [10:32:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 12670.000000 [10:33:55] fale: Yes, but it's more complicated than just a "normal" read. Do you find I/O a limiting issue? [10:34:37] scfc_de: I'm working on 4 sets of fixes and I think it's a waste of I/O resources in reading the dump 4 times... [10:35:02] fale: Didn't you file a bug about the multiple-fixes thing? That would probably be better to invest time in. [10:36:22] scfc_de: I did file the bug, but it seems not interesting to anyone (no comments left) and I'm not able to do it by myself (I've written few lines of python in my life) [10:36:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [10:38:43] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 17919 [10:38:46] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 11427 [10:39:03] fale: You don't have to do everything yourself and not everything needs to be done immediately :-). [10:40:06] scfc_de: true, but in the meantime the toolserver will have to deal with more jobs than it would need to ;) [10:42:05] fale: If you use SGE, I don't think that's really an issue, it just may take a bit longer :-). [10:42:49] scfc_de: yeah, I switched to SGE so it's a little bit less bad, but I hope not to fullfill the queues :D [10:44:15] fale: I don't use pywikipedia, but replace.py's doReplacements() speaks of "applying all replacements". Are you sure it's not possible to specify more than one? [10:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [10:44:51] scfc_de: you mean with pywikipedia? [10:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [10:45:07] fale: Yes. [10:45:35] fale: class ReplaceRobot: "replacements - A list of 2-tuples of original text (as a compiled regular expression) and replacement text (as a string)." [10:45:38] scfc_de: no, I'm not sure. The feature is not documented and, asking in IRC chan (#pywikipedia) they told me that was not possible [10:48:10] fale: https://github.com/legoktm/pywikipedia-original/blob/master/replace.py#L765 looks to me as if you can just specify replacements as pairs on the command line. But as said before, I never used pywikipedia. [10:48:39] valhallasw: legoktm: Do you know more? [10:48:55] Oh hi [10:48:58] * legoktm looks [10:49:32] fale: what exactly are you trying to do? [10:49:52] you want to do multiple replacements at once? [10:50:17] legoktm: parse the dump one time with multiple -fix and to dump the pages in multiple -save file [10:50:54] something like: python replace.py -xml:itwiki.xml -fix:a -save:a.log -fix:b -save:b.log [10:50:59] no i mean like what are you actually trying to do [10:51:03] whats the end goal [10:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [10:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [10:52:02] have multiple file, one per fix containing the list of pages that respond to that fix with the minimum of I/O possible [10:52:11] ohhh [10:52:12] i see [10:52:33] (now I do it with multiple replace.py -xml:itwiki.xml -fix:a -save:a.log) [10:52:34] hmm [10:52:37] to be honest [10:52:43] i would just write my own script to do that [10:52:54] just use pywikipedia's dump parser [10:53:21] and with the page content, go through all of the fixes, and save them to the right files [10:53:51] I see, do you think my is a very rare case or that it could be worth sharing because there are a lot of other people with the same needs? [10:54:10] actually i have a script that does exactly this [10:54:12] hold on a sec :P [10:54:28] lemme check if i published it [10:54:31] legoktm: thanks :) [10:55:27] https://github.com/legoktm/wikidata/blob/master/xmlscanner.py#L459 [10:55:34] itll need a bit of tweaking [10:55:35] legoktm: I've made a change in the user-fixes.py to be able to include all files in the user-fixes/ folder. Do you think I can ask a pull for it or is a weird thing to do? [10:55:45] thanks :) [10:55:51] but what it does is basically [10:56:01] $python xmlscanner.py itwiki > list.txt [10:56:12] so i guess you would need to include the file writing part in the program itself [10:56:44] but if you can avoid calling "import wikipedia", your code will be a lot faster :) [10:56:56] i'm actually not too familiar with how user-fixes works... [10:57:13] someone posted to the mailing list about this... [10:57:17] Thanks :) [10:57:18] legoktm: Sounds like it was from http://www.commitlogsfromlastnight.com/ :-). [10:57:44] ahahaha [10:57:57] fale: http://lists.wikimedia.org/pipermail/pywikipedia-l/2013-March/007777.html [10:58:09] i'm not even sure what thats about [10:58:16] i dont use any of the fixes so :P [10:58:33] oh scfc_de i had an idea for the reports [10:58:48] so i noticed that people wanted to categorize the reports [10:58:53] which meant i needed to hardcode it [10:59:13] legoktm: thanks legoktm and scfc_de :) I'll try tweaking legoktm's script and I'll send an email in the ml with my user-fixes proposal [10:59:48] i think it would be better if we by default had something like {{#ifexist: /Header|{{/Header}}|}} and a /Footer, so it wouldnt need to be hardcoded. [10:59:50] fale: np :) [11:02:26] legoktm: Hmmm. You mean wiki categories? What I like about having the "header" in the script is that it is "in sync" with the code. But I see no problem adding something like what you suggested to include categorization & Co. [11:02:52] Yeah [11:02:59] Well I would want to keep the current header. [11:03:15] But like if someone wants to add {{shortcut|WP:SOMETHING}} [11:03:24] We shouldn't need to update the code for that. [11:05:58] legoktm: You're right. Should be easy to add in dbreps's "# Format report header and footer.". [11:06:20] (Setting page_header.) [11:06:52] I have to admit I haven't looked at the new format yet :/ [11:07:02] * legoktm looks [11:07:12] Is there a reason it isn't dbreps.py? [11:09:28] I use *.py (and *.pl, *.pm, etc.) for libraries & Co. and non-extended filenames for programs so that it isn't important if it is reimplemented some time in another programming language. [11:11:44] Ok i gues [11:11:47] guess* [11:11:56] Load avg. on ortelius is WARNING: WARNING - load average: 5.30, 17.57, 12.58 [11:13:56] Load avg. on ortelius is OK: OK - load average: 5.42, 13.58, 11.68 [11:14:13] wiki.setUserAgent('http://en.wikipedia.org/wiki/Wikipedia_talk:Database_reports') [11:14:20] Surely we can come up with a better one than that? [11:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 110366.000000 [11:16:14] Like ... ? :-) [11:17:17] yurik keeps nagging everyone about this, lemme find his mail :P [11:17:50] http://lists.wikimedia.org/pipermail/mediawiki-api/2013-March/002907.html [11:18:10] MyCoolTool/1.1 (http://example.com/MyCoolTool/;MyCoolTool at example.com) BasedOnSuperLib/1.4 [11:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 68035 MB (11% inode=99%): [11:19:24] I know the syntax :-). MyCoolTool = dbreps, link as above? [11:19:35] sure [11:19:38] I haven't figured out a proper versioning scheme, though. [11:21:53] Lets just make this 1.0 and bump it up whenever we feel like it :P [11:23:15] In that case, I rather leave out the "/1.0" :-). Got to think about it a bit more and look at other tools that are set up in a similar way. [11:26:51] scfc_de: normal replacements can be given in pairs, but only one -fix is possible [11:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 125700 MB (2% inode=66%): [11:28:04] fale: Did you read that? valhallasw: Thanks. [11:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [11:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [11:30:02] scfc_de: thanks :), but I don't think I can take advante from it [11:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 118897.000000 [11:32:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5350.000000 [11:36:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:38:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 9147 [11:38:46] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4435 [11:39:52] is right to call qacct this wat? qacct -d 20 [11:44:28] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [11:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [11:46:25] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 3572.000000 [11:46:27] fale: Yes, but it can take a while to return some results. [11:46:43] scfc_de: I see :) thanks [11:46:45] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3499 [11:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [11:51:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [11:56:26] s1 replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1722.000000 [11:56:47] MySQL slave on rosemary is OK: Uptime: 1525164 Threads: 23 Questions: 1338071548 Slow queries: 903469 Opens: 95631 Flush tables: 1 Open tables: 3613 Queries per second avg: 877.329 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1640 [11:59:36] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3557 [12:15:25] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 101521.000000 [12:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 67764 MB (11% inode=99%): [12:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 125218 MB (2% inode=66%): [12:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [12:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [12:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 116340.000000 [12:36:47] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [12:43:36] MySQL slave on z-dat-s2-b is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3609 [12:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [12:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [12:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:51:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:02:06] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 53692 MB (5% inode=99%): [13:12:37] MySQL slave on z-dat-s2-b is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3539 [13:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 98145.000000 [13:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 67471 MB (11% inode=99%): [13:26:36] MySQL slave on z-dat-s2-b is OK: Uptime: 51214 Threads: 10 Questions: 83466173 Slow queries: 721 Opens: 725213 Flush tables: 1 Open tables: 256 Queries per second avg: 1629.753 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 1711 [13:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 124518 MB (2% inode=66%): [13:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [13:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [13:32:15] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 114719.000000 [13:36:46] Environment IPMI on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [13:38:57] hello all [13:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [13:44:37] Environment IPMI on thyme is UNKNOWN: CHECK_NRPE: Received 0 bytes from daemon. Check the remote server logs for error messages. [13:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [13:50:56] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [13:51:05] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [13:51:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [13:54:56] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is OK: FC port 0/12:UP:1 UP: OK [13:55:06] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is OK: FC port 0/12:UP:1 UP: OK [14:02:06] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [14:02:57] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [14:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 91469.000000 [14:18:36] /sql on ptolemy is WARNING: DISK WARNING - free space: /sql 67216 MB (11% inode=99%): [14:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 124124 MB (2% inode=66%): [14:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [14:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [14:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 110324.000000 [14:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [14:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [14:51:26] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:51:36] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 67090 MB (10% inode=99%): [14:51:43] I have a bounch of queries (sql) that I would like to run but are too havy (some of them are killed even in "SLOW OK". Is there any suggestions or any software, or any doc that I can look or use to learn how to optimize these queries? [14:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:02:06] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [15:02:56] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [15:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 86629.000000 [15:17:57] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is OK: FC port 0/12:UP:1 UP: OK [15:24:57] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [15:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 123531 MB (2% inode=66%): [15:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [15:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [15:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 108940.000000 [15:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [15:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [15:51:36] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66808 MB (10% inode=99%): [15:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [15:52:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:00:56] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is OK: FC port 0/12:UP:1 UP: OK [16:01:06] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is OK: FC port 0/12:UP:1 UP: OK [16:08:56] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [16:09:07] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is CRITICAL: FC port 0/12:DOWN: 1 int NOK : CRITICAL [16:12:37] wikidata replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 1968.000000 [16:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 84282.000000 [16:23:07] 9600n8 is realy a pain… [16:24:56] Load avg. on ortelius is WARNING: WARNING - load average: 7.63, 17.04, 11.50 [16:25:56] Load avg. on ortelius is OK: OK - load average: 5.74, 14.79, 11.05 [16:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 123030 MB (2% inode=66%): [16:28:06] FC 0/12 [thyme] on fsw1-n1-oe16-esams.mgmt is OK: FC port 0/12:UP:1 UP: OK [16:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [16:28:56] FC 0/12 [thyme] on fsw2-n1-oe16-esams.mgmt is OK: FC port 0/12:UP:1 UP: OK [16:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [16:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 110366.000000 [16:44:25] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [16:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [16:51:36] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66578 MB (10% inode=99%): [16:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [16:52:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [17:12:36] wikidata replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2214.000000 [17:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 81644.000000 [17:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 122580 MB (2% inode=66%): [17:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [17:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [17:32:15] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 107201.000000 [17:38:53] @replag [17:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [17:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [17:51:41] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66303 MB (10% inode=99%): [17:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [17:52:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:00:06] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [18:11:15] / on ortelius is WARNING: DISK WARNING - free space: / 6211 MB (20% inode=92%): [18:12:36] wikidata replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2147.000000 [18:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 78173.000000 [18:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 122218 MB (2% inode=66%): [18:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [18:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [18:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 103475.000000 [18:32:31] DaBPunkt: i cannot change ownership on files, any ideas? [18:41:29] giftpflanze: You can only change ownership as root. You need to cp & rm as a normal user. [18:42:36] but that's my file [18:42:48] i have my own user and a mmt one [18:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [18:44:30] Yes, you have to cp the file as the MMT one (and rm the originals as your account). Then the file is owned by the MMT user. [18:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [18:45:33] stupid [18:49:25] scfc_de: thx :) [18:51:36] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 66036 MB (10% inode=99%): [18:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [18:52:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:00:06] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [19:11:16] / on ortelius is WARNING: DISK WARNING - free space: / 5703 MB (19% inode=92%): [19:12:36] wikidata replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2217.000000 [19:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 73572.000000 [19:23:26] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2025.000000 [19:23:46] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2036 [19:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 121970 MB (2% inode=66%): [19:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [19:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [19:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 100287.000000 [19:37:36] wikidata replag on rosemary is OK: QUERY OK: SELECT ts_rc_age() returned 1767.000000 [19:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [19:45:07] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [19:51:46] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 65767 MB (10% inode=99%): [19:51:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [19:52:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:00:07] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [20:11:16] / on ortelius is WARNING: DISK WARNING - free space: / 5170 MB (17% inode=92%): [20:15:25] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 69429.000000 [20:23:26] s1 replag on rosemary is WARNING: QUERY WARNING: SELECT ts_rc_age() returned 2950.000000 [20:23:47] MySQL slave on rosemary is WARNING: SLOW_SLAVE WARNING: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2963 [20:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 121736 MB (2% inode=66%): [20:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [20:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors, 1 warning): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A:, null :OSGi.com.sun.storage.cam.agent(com.sun.netstorage.fm.storade.agent.Messages):monitor.Communicatio [20:32:17] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 98693.000000 [20:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [20:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [20:47:46] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3604 [20:48:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 3620.000000 [20:51:46] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 65565 MB (10% inode=99%): [20:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [20:52:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [21:00:06] APT on nightshade is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [21:11:16] / on ortelius is WARNING: DISK WARNING - free space: / 4662 MB (15% inode=92%): [21:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 65239.000000 [21:15:46] APT on yarrow is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [21:15:56] APT on mayapple is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [21:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 121312 MB (2% inode=66%): [21:28:37] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [21:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [21:32:17] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 95474.000000 [21:34:46] APT on yarrow is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:34:56] APT on mayapple is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:35:06] APT on nightshade is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [21:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [21:47:50] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4128 [21:48:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 4131.000000 [21:51:46] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 65228 MB (10% inode=99%): [21:51:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [21:52:17] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:11:16] / on ortelius is WARNING: DISK WARNING - free space: / 4146 MB (13% inode=92%): [22:15:26] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 58607.000000 [22:26:56] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 121165 MB (2% inode=66%): [22:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [22:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [22:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 94834.000000 [22:44:04] Paolo Massa * [Toolserver-l] No user_properties table on arwiki_p database [22:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [22:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [22:47:47] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 5046 [22:48:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5065.000000 [22:51:47] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 64902 MB (10% inode=99%): [22:51:47] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [22:52:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:07:17] [[Special:Log/newusers]] create 10 * Hasimgultekin * (New user account) [23:11:16] / on ortelius is WARNING: DISK WARNING - free space: / 3630 MB (12% inode=92%): [23:15:25] wikidata replag on daphne is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 52259.000000 [23:21:37] Well, Friday should be over in Italy by now :-). [23:26:04] Anuradha Uduwage * [Toolserver-l] Error in Revision Table in lbwiki [23:27:06] /mnt user-store on rosemary is CRITICAL: DISK CRITICAL - free space: /mnt 108978 MB (2% inode=66%): [23:28:36] Virtual disks on far1-n1-oe16-esams.mgmt is CRITICAL: OK 3, WARN 0, CRIT 1: far1-n1-fast3 FTOL, far1-n1-bulk CRIT, far1-n1-fast2 FTOL, far1-n1-fast FTOL [23:29:56] CAM on hemlock is CRITICAL: CRITICAL - Storage ts-array5 (2 errors): null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.B:, null :OSGi.com.sun.storage.cam.agent(device.2530):event.ProblemEvent.REC_EXPIRED_BATTERY.description:S17:Tray.85.Battery.A: [23:32:16] wikidata replag on z-dat-s2-b is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 91284.000000 [23:37:59] I've putted in crontab this https://github.com/Fale/ToolServer/blob/master/sge/createLists.sh, it runned but no SGE task has been putted in the queue. Am I doing something wrong? (running the same script from the CLI does put the tasks in SGE [23:42:54] fale: Ahem, you've added minutes/hours/days to your crontab, haven't you? :-) [23:43:30] scfc_de: this is the crontab line: " 0 23 * * * $HOME/ToolServer/sge/createLists.sh" [23:44:06] Did you receive any mail? [23:44:26] Sun Grid Engine execd on wolfsbane is WARNING: NRPE: Unable to read output [23:44:27] scfc_de: nope [23:45:06] Sun Grid Engine execd on willow is WARNING: NRPE: Unable to read output [23:45:22] (and 23:00 was 45' ago, so it should have processed the line) [23:47:17] fale: There are four jobs running for you started at :23/:37. That were your manual jobs? [23:47:53] scfc_de: yep, when I tryed to test if the script was working.... well, it was working [23:48:26] s1 replag on rosemary is CRITICAL: QUERY CRITICAL: SELECT ts_rc_age() returned 5944.000000 [23:48:46] MySQL slave on rosemary is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 5942 [23:48:51] fale: My assumption is that PATH isn't set, but that *should* have triggered an error. Anyway, try adding "PATH=/opt/ts/gnu/bin:/sge/GE/bin/sol-amd64:/usr/bin:/bin" to your cronietab. [23:49:29] (Default PATH is /bin:/usr/bin which doesn't include qcronsub.) [23:49:30] scfc_de: hang on... I'm using strandard crontab... is this the problem? [23:49:54] fale: /home/fale/ToolServer/sge/createLists.sh has no shebang. Also I'm not sure if cron-lines that starts with spaces are processed [23:50:47] DaBPunkt: I see... I'm going to add the shebang, remove the spaces and check if it works :) [23:51:16] DaBPunkt: Shouldn't the missing shebang not treat the file as a standard shell script? [23:51:46] /sql on ptolemy is CRITICAL: DISK CRITICAL - free space: /sql 64887 MB (10% inode=99%): [23:51:46] SMF on web.amaranth is CRITICAL: ERROR - maintenance: svc:/application/jira:default [23:52:16] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [23:54:17] scfc_de: the defaut shell at solaris is a form of a korn-shell – I do not support that ;) [23:54:48] DaBPunkt: so I have to declear /bin/bash, not only /bin/sh? [23:55:44] fale: your choice [23:55:49] DaBPunkt: Me neither, but I do hope something like "qcronsub -N ducati $HOME/ToolServer/sge/wrapper/ducati.sh" works on both :-). [23:56:30] @replag [23:56:54] I'm start thinking that solaris is very weird :D [23:56:58] where is tsbot > [23:57:29] Betacommand: I think that is a sign of a huge lag :D [23:57:36] Betacommand: could not see the missery anymore… [23:58:26] DaBPunkt: do you have any idea how long the import of enwiki will take? [23:59:17] I've run a sge task until few minutes ago (it was 1571701) but "qacct -j 1571701" returns "error: job id 1571701 not found" :o [23:59:46] @replag [23:59:46] DaBPunkt: s1-user: 1h 38m 21s [-]; s2-user-c: error; s2-user-wd: 1d 59m 58s [-]; s3-user-wd: 11m 39s [-]; s4-user-wd: 13h 16m 1s [-]; s5-user-c: 2w 3d 2h 3m 57s [-]; s6-user-wd: 4m 17s [-]