[00:00:23] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [00:02:32] Load avg. on willow is WARNING: WARNING - load average: 16.27, 13.69, 11.11 [00:03:18] [[User:Waldir]] ! 10https://wiki.toolserver.org/w/index.php?diff=6846&oldid=6844&rcid=9019 * Waldir * (+37) () [00:03:33] Load avg. on willow is OK: OK - load average: 14.63, 13.71, 11.29 [00:07:33] Load avg. on willow is WARNING: WARNING - load average: 15.66, 14.80, 12.30 [00:38:02] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 466195 MB (8% inode=44%): [00:52:32] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 31855 MB (3% inode=99%): [00:56:23] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [00:57:22] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.553223/1.8, alarm hl:np_load_avg=1.506348/2.3, alarm hl:mem_free=177.000000M/300M, alarm hl:available=1/0: longrun@willow exceedes load threshold: alarm hl:np_load_short=1.553223/1.9, alarm hl:np_load_long=1.486816/2.25, alarm hl:mem_free=177.000000M/200M, alarm hl:available=1/0 [01:00:23] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [01:00:23] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [01:00:23] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:03:22] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.624512/1.8, alarm hl:np_load_avg=1.757324/2.3, alarm hl:mem_free=265.000000M/300M, alarm hl:available=1/0 [01:38:03] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 466150 MB (8% inode=44%): [01:48:24] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.324219/1.8, alarm hl:np_load_avg=1.441406/2.3, alarm hl:mem_free=173.000000M/300M, alarm hl:available=1/0: longrun@willow exceedes load threshold: alarm hl:np_load_short=1.324219/1.9, alarm hl:np_load_long=1.471680/2.25, alarm hl:mem_free=173.000000M/200M, alarm hl:available=1/0 [01:50:09] Danny_B|backup: I can't delete dumps now. [01:50:43] that's on purpose [01:51:13] they will be deleted on periodical basis [01:51:29] -rwxrwxr-x 1 mzmcbride dumps 12582185031 Sep 11 2010 enwiki-20100904-pages-meta-current.xml.bz2 [01:51:29] so noone can delete them under somebody's hands [01:51:32] -rwxrwxr-x 1 mzmcbride dumps 12661454208 Sep 23 2010 enwiki-20100916-pages-meta-current.xml.bz2 [01:51:35] -rwxrwxr-x 1 mzmcbride dumps 12823734687 Dec 28 2010 enwiki-20101011-pages-meta-current.xml.bz2 [01:51:38] You can delete those. [01:51:49] And -rwxrwxr-x 1 mzmcbride dumps 14178295224 May 27 2011 enwiki-20110526-pages-meta-current.xml.bz2 [01:52:59] Okay, this shit is just annoying me. [01:53:23] I'm just putting the dump in /mnt/user-store/mzmcbirde/. [01:53:44] which dump? [01:53:52] wget "http://dumps.wikimedia.org/enwiki/20120307/enwiki-20120307-pages-meta-current.xml.bz2" [01:54:12] It's going really fast right now. [01:56:24] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [01:57:06] Joan: did you read readme in dumps/ ? [01:57:45] No. [01:58:49] Maybe I'll move it later. [01:58:53] The permissions are annoying. [02:00:01] they are on purpose, to protect users [02:00:24] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [02:00:24] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [02:01:17] I understand the theory. [02:02:22] it's just a question of habit [02:02:34] Load avg. on willow is WARNING: WARNING - load average: 16.52, 15.92, 13.63 [02:02:40] when it's new, i can understand it is unusual [02:02:58] Right. When auto-downloading is setup, it'll be better. [02:03:31] it actually nearly is [02:03:39] all dumps but en were updated [02:03:59] i didn't have time to finish with en [02:04:23] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [02:04:33] Load avg. on willow is OK: OK - load average: 12.32, 14.57, 13.42 [02:06:10] Ah. [02:07:32] my pov actually is, that we could have another machine for store just for dumps which would be rsynced with wmf dumpservers [02:09:19] i need to catch up sk to have him change his scripts [02:10:23] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.004883/1.00, alarm hl:np_load_long=0.820312/1.50, alarm hl:mem_free=14734.000000M/300M, alarm hl:available=1/0 [02:10:23] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.349121/1.8, alarm hl:np_load_avg=1.546387/2.3, alarm hl:mem_free=259.000000M/300M, alarm hl:available=1/0 [02:11:23] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [02:12:24] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [02:15:24] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.099609/1.00, alarm hl:np_load_long=0.892578/1.50, alarm hl:mem_free=14681.000000M/300M, alarm hl:available=1/0 [02:36:26] Joan: are you familiar with pwb? [02:36:57] I don't think so. [02:36:58] Danny_B|backup: I am [02:38:04] Betacommand: when it works with dumps, it opens .xml file, right? [02:38:05] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 435162 MB (8% inode=43%): [02:38:30] Danny_B|backup: it can, it can also work with the bz2 files [02:38:57] ok, need to tell that to nemo [02:39:10] he is using xml only [02:39:35] What is pwb? [02:39:40] Oh, pywikipediabot. [02:39:46] I'm familiar. To be avoided. [02:39:52] replace.py -xml:enwiki-latest-pages-meta-current.xml.bz2 [02:40:05] that works just fine [02:40:17] un-compresses on the fly [02:41:13] ok, big part of users solved [02:41:52] even reads the 7z versions [02:42:43] Load avg. on willow is WARNING: WARNING - load average: 15.09, 14.65, 13.93 [02:43:44] Load avg. on willow is OK: OK - load average: 13.80, 14.37, 13.88 [02:51:40] tts, gneb [02:56:23] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:00:33] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [03:01:23] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [03:12:44] Load avg. on willow is WARNING: WARNING - load average: 17.04, 16.41, 15.03 [03:23:44] Load avg. on willow is OK: OK - load average: 13.89, 14.81, 14.92 [03:32:44] Load avg. on willow is WARNING: WARNING - load average: 14.80, 15.89, 15.33 [03:38:04] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 383607 MB (7% inode=40%): [03:39:44] Load avg. on willow is OK: OK - load average: 13.95, 14.72, 14.98 [03:56:24] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:01:25] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [04:01:25] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [04:18:48] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.034180/1.00, alarm hl:np_load_long=1.088867/1.50, alarm hl:mem_free=14159.000000M/300M, alarm hl:available=1/0 [04:20:47] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=2.054199/1.8, alarm hl:np_load_avg=2.039551/2.3, alarm hl:mem_free=288.000000M/300M, alarm hl:available=1/0: longrun@willow exceedes load threshold: alarm hl:np_load_short=2.054199/1.9, alarm hl:np_load_long=2.052246/2.25, alarm hl:mem_free=288.000000M/200M, alarm hl:available=1/0 [04:20:48] Load avg. on willow is WARNING: WARNING - load average: 15.16, 16.04, 16.32 [04:28:48] Sun Grid Engine execd on wolfsbane is WARNING: short@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.306152/1.10, alarm hl:np_load_long=0.315430/1.55, alarm hl:mem_free=265.000000M/300M, alarm hl:available=1/0: all.q@wolfsbane exceedes load threshold: alarm hl:np_load_short=0.306152/1.00, alarm hl:np_load_long=0.315430/1.50, alarm hl:mem_free=265.000000M/300M, alarm hl:available=1/0 [04:32:50] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [04:34:47] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [04:35:48] Sun Grid Engine execd on wolfsbane is OK: short@wolfsbane OK: all.q@wolfsbane OK [04:38:18] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 370012 MB (6% inode=39%): [04:42:49] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.938476/1.8, alarm hl:np_load_avg=1.891601/2.3, alarm hl:mem_free=365.000000M/300M, alarm hl:available=1/0: longrun@willow exceedes load threshold: alarm hl:np_load_short=1.938476/1.9, alarm hl:np_load_long=1.956543/2.25, alarm hl:mem_free=365.000000M/200M, alarm hl:available=1/0 [04:44:48] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [04:45:49] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.625976/1.10, alarm hl:np_load_long=1.044922/1.55, alarm hl:mem_free=13311.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.625976/1.00, alarm hl:np_load_long=1.044922/1.50, alarm hl:mem_free=13311.000000M/300M, alarm hl:available=1/0 [04:47:48] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [04:54:49] Load avg. on willow is OK: OK - load average: 13.01, 14.19, 14.91 [04:56:27] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:01:28] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [05:01:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [05:02:49] Load avg. on willow is WARNING: WARNING - load average: 15.54, 15.75, 15.29 [05:06:51] Load avg. on willow is OK: OK - load average: 13.08, 14.45, 14.86 [05:24:47] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.263672/1.10, alarm hl:np_load_long=0.908203/1.55, alarm hl:mem_free=13318.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.263672/1.00, alarm hl:np_load_long=0.908203/1.50, alarm hl:mem_free=13318.000000M/300M, alarm hl:available=1/0 [05:25:48] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [05:32:48] Load avg. on willow is WARNING: WARNING - load average: 14.11, 15.94, 15.05 [05:34:48] Load avg. on willow is OK: OK - load average: 13.15, 14.99, 14.80 [05:38:19] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 361714 MB (6% inode=38%): [05:40:48] Load avg. on willow is WARNING: WARNING - load average: 14.86, 15.13, 14.92 [05:56:27] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:01:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [06:01:28] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [06:01:28] RAID on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:01:57] Environment on thyme is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [06:02:28] SSH on thyme is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:02:38] s1 replag on thyme is CRITICAL: (Service Check Timed Out) [06:03:07] MySQL on thyme is CRITICAL: (Service Check Timed Out) [06:03:07] MySQL slave on thyme is CRITICAL: (Service Check Timed Out) [06:03:17] MySQL on thyme is OK: Uptime: 633296 Threads: 12 Questions: 199842584 Slow queries: 60602 Opens: 35940 Flush tables: 1 Open tables: 2833 Queries per second avg: 315.559 [06:03:17] MySQL slave on thyme is OK: Uptime: 633296 Threads: 11 Questions: 199842585 Slow queries: 60602 Opens: 35940 Flush tables: 1 Open tables: 2833 Queries per second avg: 315.559 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 285 [06:03:17] RAID on thyme is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [06:03:18] SSH on thyme is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [06:03:18] s1 replag on thyme is OK: QUERY OK: SELECT ts_rc_age() returned 281.000000 [06:03:37] Environment on thyme is OK: ok: temperature ok fan ok voltage ok chassis ok [06:18:48] Load avg. on willow is WARNING: WARNING - load average: 12.13, 13.94, 15.02 [06:20:48] Load avg. on willow is OK: OK - load average: 13.44, 14.10, 14.97 [06:30:47] Load avg. on willow is CRITICAL: CRITICAL - load average: 38.09, 22.16, 17.40 [06:31:48] Load avg. on willow is WARNING: WARNING - load average: 29.60, 22.62, 17.87 [06:39:17] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 361693 MB (6% inode=38%): [06:56:27] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:01:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [07:01:29] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [07:08:58] Load avg. on willow is OK: OK - load average: 11.02, 13.30, 14.96 [07:23:48] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.151367/1.10, alarm hl:np_load_long=0.912110/1.55, alarm hl:mem_free=13489.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.151367/1.00, alarm hl:np_load_long=0.912110/1.50, alarm hl:mem_free=13489.000000M/300M, alarm hl:available=1/0 [07:28:47] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [07:34:48] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.010742/1.00, alarm hl:np_load_long=0.960938/1.50, alarm hl:mem_free=13487.000000M/300M, alarm hl:available=1/0 [07:37:57] Load avg. on willow is WARNING: WARNING - load average: 15.68, 15.23, 14.56 [07:39:17] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 361653 MB (6% inode=38%): [07:46:58] Load avg. on willow is OK: OK - load average: 12.28, 14.76, 14.89 [07:56:28] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:01:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [08:02:28] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [08:12:42] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.329101/1.8, alarm hl:np_load_avg=1.304688/2.3, alarm hl:mem_free=209.000000M/300M, alarm hl:available=1/0 [08:14:42] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [08:16:41] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.547851/1.10, alarm hl:np_load_long=1.078125/1.55, alarm hl:mem_free=13797.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.547851/1.00, alarm hl:np_load_long=1.078125/1.50, alarm hl:mem_free=13797.000000M/300M, alarm hl:available=1/0 [08:19:42] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [08:22:41] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.006836/1.00, alarm hl:np_load_long=1.056641/1.50, alarm hl:mem_free=14862.000000M/300M, alarm hl:available=1/0 [08:39:20] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 361473 MB (6% inode=38%): [08:54:42] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.111816/1.8, alarm hl:np_load_avg=1.219238/2.3, alarm hl:mem_free=208.000000M/300M, alarm hl:available=1/0 [08:56:42] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:01:42] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [09:01:43] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [09:02:52] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [09:31:19] Daniel_WMDE_ill: get well soon [09:31:39] thanks... [09:39:21] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 407392 MB (7% inode=41%): [09:44:52] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.166016/1.10, alarm hl:np_load_long=0.933594/1.55, alarm hl:mem_free=14418.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.166016/1.00, alarm hl:np_load_long=0.933594/1.50, alarm hl:mem_free=14418.000000M/300M, alarm hl:available=1/0 [09:45:51] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [09:56:52] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:01:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [10:03:02] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [10:40:20] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 407292 MB (7% inode=41%): [10:57:01] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:02:49] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [11:03:02] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.298340/1.8, alarm hl:np_load_avg=1.218262/2.3, alarm hl:mem_free=294.000000M/300M, alarm hl:available=1/0 [11:03:03] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [11:05:01] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [11:08:41] RAID on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:09:20] RAID on hyacinth is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [11:15:10] SSH on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:15:11] SSH on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:15:11] SSH on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:15:11] SSH on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:15:11] SSH on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:15:30] /sql on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:30] /tmp on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:30] SMF on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:30] /sql on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:30] / on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:30] /tmp on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:30] Load avg. on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:31] SMF on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:32] Load avg. on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:32] /sql on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:32] / on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:33] / on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:50] /tmp on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:50] /sql on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:50] Load avg. on z-dat-s4-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:50] /tmp on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:50] Load avg. on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:15:50] Load avg. on hyacinth is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:16:10] SMTP on z-dat-s6-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:10] SMF on z-dat-s6-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:16:20] SMF on z-dat-s3-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:16:20] SMF on z-dat-s7-a is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [11:16:49] s4 replag on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [11:17:10] NTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:17:10] SMTP on hyacinth is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:17:30] MySQL on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [11:17:30] MySQL slave on z-dat-s3-a is CRITICAL: (Service Check Timed Out) [11:18:09] SMTP on z-dat-s7-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:18:20] MySQL on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [11:18:21] MySQL slave on z-dat-s6-a is CRITICAL: (Service Check Timed Out) [11:18:21] MySQL on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [11:18:29] MySQL slave on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [11:18:30] MySQL on z-dat-s7-a is CRITICAL: (Service Check Timed Out) [11:19:01] Load avg. on z-dat-s3-a is OK: OK - load average: 0.09, 0.79, 1.68 [11:19:04] they're all dying :( [11:19:10] SMTP on z-dat-s3-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:10] SMTP on z-dat-s4-a is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:20] MySQL slave on z-dat-s4-a is CRITICAL: (Service Check Timed Out) [11:19:30] /tmp on z-dat-s3-a is OK: DISK OK - free space: /tmp 2956 MB (99% inode=99%): [11:19:30] / on z-dat-s3-a is OK: DISK OK - free space: / 11660 MB (38% inode=87%): [11:19:30] /sql on z-dat-s3-a is OK: DISK OK - free space: /sql 201814 MB (20% inode=99%): [11:19:30] Load avg. on hyacinth is OK: OK - load average: 0.08, 0.72, 1.63 [11:19:30] Load avg. on z-dat-s6-a is OK: OK - load average: 0.08, 0.72, 1.63 [11:19:30] / on hyacinth is OK: DISK OK - free space: / 11660 MB (38% inode=87%): [11:19:30] /tmp on hyacinth is OK: DISK OK - free space: /tmp 2959 MB (100% inode=99%): [11:19:31] Load avg. on z-dat-s7-a is OK: OK - load average: 0.08, 0.72, 1.63 [11:19:31] / on z-dat-s7-a is OK: DISK OK - free space: / 11660 MB (38% inode=87%): [11:19:32] /tmp on z-dat-s7-a is OK: DISK OK - free space: /tmp 2975 MB (99% inode=99%): [11:19:32] /sql on z-dat-s7-a is OK: DISK OK - free space: /sql 117716 MB (29% inode=99%): [11:19:33] /sql on z-dat-s6-a is OK: DISK OK - free space: /sql 201814 MB (20% inode=99%): [11:19:49] MySQL slave on z-dat-s7-a is OK: Uptime: 1475792 Threads: 11 Questions: 354056846 Slow queries: 53820 Opens: 2570010 Flush tables: 1 Open tables: 6667 Queries per second avg: 239.909 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 399 [11:19:49] MySQL on z-dat-s7-a is OK: Uptime: 1475792 Threads: 10 Questions: 354056848 Slow queries: 53820 Opens: 2570010 Flush tables: 1 Open tables: 6667 Queries per second avg: 239.909 [11:19:50] SMF on z-dat-s3-a is OK: OK - all services online [11:19:50] SMF on z-dat-s7-a is OK: OK - all services online [11:20:01] MySQL slave on z-dat-s3-a is OK: Uptime: 1043380 Threads: 44 Questions: 1363311836 Slow queries: 84569 Opens: 9722722 Flush tables: 1 Open tables: 16384 Queries per second avg: 1306.630 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 534 [11:20:02] MySQL on z-dat-s3-a is OK: Uptime: 1043380 Threads: 45 Questions: 1363311839 Slow queries: 84569 Opens: 9722722 Flush tables: 1 Open tables: 16384 Queries per second avg: 1306.630 [11:20:02] NTP on hyacinth is OK: NTP OK: Offset -0.001774 secs [11:20:02] SMTP on hyacinth is OK: SMTP OK - 0.010 sec. response time [11:20:02] SSH on hyacinth is OK: SSH OK - OpenSSH_5.8p2-hpn13v11 (protocol 2.0) [11:20:02] SMF on hyacinth is OK: OK - all services online [11:20:02] SMF on z-dat-s4-a is OK: OK - all services online [11:20:03] SMTP on z-dat-s7-a is OK: SMTP OK - 0.193 sec. response time [11:20:03] /tmp on z-dat-s4-a is OK: DISK OK - free space: /tmp 3002 MB (99% inode=99%): [11:20:04] / on z-dat-s4-a is OK: DISK OK - free space: / 11660 MB (38% inode=87%): [11:20:04] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 104400 MB (25% inode=99%): [11:20:05] SMTP on z-dat-s3-a is OK: SMTP OK - 0.258 sec. response time [11:20:05] SMTP on z-dat-s4-a is OK: SMTP OK - 0.339 sec. response time [11:20:06] SMTP on z-dat-s6-a is OK: SMTP OK - 0.003 sec. response time [11:20:21] Environment on hyacinth is OK: ok: temperature ok fan ok voltage ok chassis ok [11:32:50] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.006836/1.00, alarm hl:np_load_long=0.790039/1.50, alarm hl:mem_free=13458.000000M/300M, alarm hl:available=1/0 [11:33:50] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [11:38:33] wb, Nemo_bis [11:38:47] I said hello a hour ago to you :p [11:40:36] i know [11:40:46] ok [11:41:20] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 405427 MB (7% inode=41%): [11:41:31] you actually did not say hello, but morgen :-P [11:43:58] 3(reopened) [DBQ-178] Statistics about abuse filters on all Wikimedia projects <10https://jira.toolserver.org/browse/DBQ-178> (Federico Leva) [11:44:50] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.073242/1.00, alarm hl:np_load_long=0.845703/1.50, alarm hl:mem_free=13870.000000M/300M, alarm hl:available=1/0 [11:48:02] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.085449/1.8, alarm hl:np_load_avg=1.132812/2.3, alarm hl:mem_free=288.000000M/300M, alarm hl:available=1/0 [11:48:22] Danny_B|backup, of course [11:48:50] hmmm, enwikt mmp definitely needs to change their script [11:48:50] but I'm always confused by the fact that there's no real verb for "say hello" and so on in English (or is there?) [11:49:02] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [11:49:16] like "helloing"? ;-) [11:49:48] like "greeting" but more generic [11:49:58] "salutare" in Latin and Italian [11:50:06] saluting? [11:51:28] hmm [11:51:45] apparently not [11:57:01] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:02:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:04:01] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:13:01] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.310547/1.8, alarm hl:np_load_avg=1.273926/2.3, alarm hl:mem_free=235.000000M/300M, alarm hl:available=1/0 [12:14:01] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [12:40:01] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.091797/1.8, alarm hl:np_load_avg=1.065430/2.3, alarm hl:mem_free=214.000000M/300M, alarm hl:available=1/0 [12:41:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 404900 MB (7% inode=41%): [12:43:01] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [12:53:01] /sql on rosemary is CRITICAL: DISK CRITICAL - free space: /sql 31790 MB (3% inode=99%): [12:57:01] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:02:50] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:03:02] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.109375/1.8, alarm hl:np_load_avg=1.113281/2.3, alarm hl:mem_free=264.000000M/300M, alarm hl:available=1/0 [13:05:02] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:06:02] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [13:18:01] /tmp on wolfsbane is WARNING: DISK WARNING - free space: /tmp 493 MB (19% inode=99%): [13:19:01] /tmp on wolfsbane is CRITICAL: DISK CRITICAL - free space: /tmp 238 MB (10% inode=99%): [13:20:01] /tmp on wolfsbane is OK: DISK OK - free space: /tmp 653 MB (24% inode=99%): [13:29:27] Hello all [13:31:01] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.707031/1.8, alarm hl:np_load_avg=1.171875/2.3, alarm hl:mem_free=211.000000M/300M, alarm hl:available=1/0 [13:32:01] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [13:41:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 404778 MB (7% inode=41%): [13:50:02] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=1.063476/1.8, alarm hl:np_load_avg=1.151367/2.3, alarm hl:mem_free=209.000000M/300M, alarm hl:available=1/0 [13:52:56] hi [13:54:17] hello fale [13:54:26] hi DaBPunkt :) [13:55:02] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [13:55:04] DaBPunkt: I submitted a new account request :) [13:58:01] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:03:01] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:05:01] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:05:08] fale: the new-account-queue is a little bit delayed at the moemnt, but I hope to make some progress there at the weekend [14:06:01] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.015625/1.00, alarm hl:np_load_long=0.838867/1.50, alarm hl:mem_free=14102.000000M/300M, alarm hl:available=1/0 [14:06:25] DaBPunkt: I hope so :) Atm I'm still coding the tool, but I have to execute it against the WP API, and this makes the bot slow and heavy for the wiki servers :( [14:08:01] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [14:18:40] fisheye.toolserver.org on web.amaranth is CRITICAL: CRITICAL - Socket timeout after 21 seconds [14:27:40] fisheye.toolserver.org on web.amaranth is WARNING: HTTP WARNING: HTTP/1.1 200 OK - 272 bytes in 17.063 second response time [14:28:30] fisheye.toolserver.org on web.amaranth is OK: HTTP OK: HTTP/1.1 200 OK - 273 bytes in 10.371 second response time [14:41:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 404675 MB (7% inode=41%): [14:48:54] 3(commented) [TS-1328] Please add me to OSM-MMP group <10https://jira.toolserver.org/browse/TS-1328> (Kai Krueger) [14:57:04] DaBPunkt: when there will be that debian installed back, are we going to have apache instead of zws as well? [14:57:40] Danny_B|backup: yes, but later. The webserver will not be switched on the first round [14:59:02] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:59:27] afk [15:03:01] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:03:09] DaBPunkt: Are there plans to switch ptolemy to debian at some point as well? [15:06:01] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:07:02] Jeremy Baron * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [15:24:01] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=42.019531/1.10, alarm hl:np_load_long=6.266602/1.55, alarm hl:mem_free=18470.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=42.019531/1.00, alarm hl:np_load_long=6.266602/1.50, alarm hl:mem_free=18470.000000M/300M, alarm hl:available=1/0 [15:24:20] Load avg. on ortelius is CRITICAL: CRITICAL - load average: 92.02, 55.82, 24.38 [15:26:56] Hey all. Could it be tht user crontabs are not executed on ortelius? [15:27:10] If so, why? [15:29:20] Load avg. on ortelius is WARNING: WARNING - load average: 5.56, 23.47, 18.71 [15:29:59] dschwen: does your crontab ends with a return? [15:30:32] uh [15:30:35] let me see [15:31:10] no [15:31:16] now it does [15:31:29] was that the reason? [15:31:40] we will know in 2 minutes [15:32:09] :-) [15:33:17] BAM! [15:33:20] works! [15:34:10] since you are here, did you make any changes related to fastcgi? [15:34:22] no [15:34:30] Load avg. on ortelius is OK: OK - load average: 4.41, 11.45, 14.67 [15:41:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 407451 MB (7% inode=41%): [15:41:45] is there any list of expired accounts with the date of their expiration? [15:45:53] 3(created) [UTRS-67] Allow [[linking]] to other appeals in comments; UTRS: Main Interface; New Feature <10https://jira.toolserver.org/browse/UTRS-67> (Hersfold) [15:57:29] Danny_B|backup: http://toolserver.org/~dab/expired_users.txt [15:58:01] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [15:59:52] danke schon [16:00:00] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:00:02] Merlijn van Deen * [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [16:04:02] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:06:02] Paul Selitskas * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [16:06:10] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:20:02] Platonides * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [16:22:02] Dr. Trigon * Re: [Toolserver-l] How to silence qsub/qcronsub? [16:32:02] DaB. * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [16:38:01] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.091797/1.00, alarm hl:np_load_long=0.893555/1.50, alarm hl:mem_free=18425.000000M/300M, alarm hl:available=1/0 [16:41:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 399602 MB (7% inode=41%): [16:41:51] @replag [16:41:52] fale: s3-rr-a: 30s [+0.00 s/s]; s3-user: 30s [+0.00 s/s] [16:49:00] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [16:49:02] DaB. * Re: [Toolserver-l] How to silence qsub/qcronsub? [16:55:02] Soxred93 * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [16:58:01] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=0.576660/1.8, alarm hl:np_load_avg=0.626953/2.3, alarm hl:mem_free=290.000000M/300M, alarm hl:available=1/0 [17:00:00] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [17:00:10] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:03:11] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=0.641602/1.8, alarm hl:np_load_avg=0.716309/2.3, alarm hl:mem_free=227.000000M/300M, alarm hl:available=1/0 [17:04:11] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:07:09] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:10:10] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.102539/1.10, alarm hl:np_load_long=0.902344/1.55, alarm hl:mem_free=18407.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.102539/1.00, alarm hl:np_load_long=0.902344/1.50, alarm hl:mem_free=18407.000000M/300M, alarm hl:available=1/0 [17:14:09] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [17:41:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 397953 MB (7% inode=40%): [18:00:10] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:04:11] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:04:46] sk__: hello [18:05:15] hi danny [18:07:10] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:25:10] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.031250/1.00, alarm hl:np_load_long=0.933594/1.50, alarm hl:mem_free=17848.000000M/300M, alarm hl:available=1/0 [18:27:10] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [18:36:02] Krinkle * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [18:36:32] wow, it showed up here before gmail was done with the loading animation [18:37:02] Krinkle * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [18:37:10] or not [18:41:31] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 394325 MB (7% inode=40%): [19:00:10] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:03:10] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=0.610352/1.8, alarm hl:np_load_avg=0.673828/2.3, alarm hl:mem_free=267.000000M/300M, alarm hl:available=1/0 [19:04:10] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:06:11] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [19:08:11] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:11:10] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=0.720703/1.8, alarm hl:np_load_avg=0.653320/2.3, alarm hl:mem_free=219.000000M/300M, alarm hl:available=1/0 [19:15:11] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.165039/1.10, alarm hl:np_load_long=0.861328/1.55, alarm hl:mem_free=17880.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.165039/1.00, alarm hl:np_load_long=0.861328/1.50, alarm hl:mem_free=17880.000000M/300M, alarm hl:available=1/0 [19:20:11] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [19:31:53] 3(created) [DRTRIGON-121] Subster bot 'error' parameter does not accept '\n' (like in default value); DrTrigon's tools: DrTrigonBot - pywikipedia; Bug <10https://jira.toolserver.org/browse/DRTRIGON-121> (drtrigon) [19:41:40] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 399795 MB (7% inode=41%): [19:44:10] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.166992/1.10, alarm hl:np_load_long=0.902344/1.55, alarm hl:mem_free=18374.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.166992/1.00, alarm hl:np_load_long=0.902344/1.50, alarm hl:mem_free=18374.000000M/300M, alarm hl:available=1/0 [19:46:10] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [20:01:11] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:04:19] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:08:20] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:21:02] Platonides * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [20:21:54] 3(resolved) [LUXO-25] Global block link for IPs at ~luxo/contributions/contributions.php <10https://jira.toolserver.org/browse/LUXO-25> (Luxo) [20:23:54] 3(closed) [LUXO-25] Global block link for IPs at ~luxo/contributions/contributions.php <10https://jira.toolserver.org/browse/LUXO-25> (Luxo) [20:39:10] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.066406/1.00, alarm hl:np_load_long=0.851562/1.50, alarm hl:mem_free=17336.000000M/300M, alarm hl:available=1/0 [20:39:52] 3(closed) [LUXO-22] Switch ~~~ for [[User:{{subst:REVISIONUSER}}|{{subst:REVISIONUSER}}]] (derivativeFX) <10https://jira.toolserver.org/browse/LUXO-22> (Luxo) [20:39:55] 3(resolved) [LUXO-22] Switch ~~~ for [[User:{{subst:REVISIONUSER}}|{{subst:REVISIONUSER}}]] (derivativeFX) <10https://jira.toolserver.org/browse/LUXO-22> (Luxo) [20:40:10] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [20:41:40] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 388604 MB (7% inode=40%): [20:43:10] Sun Grid Engine execd on ortelius is WARNING: short@ortelius exceedes load threshold: alarm hl:np_load_short=1.144531/1.10, alarm hl:np_load_long=0.900390/1.55, alarm hl:mem_free=17188.000000M/300M, alarm hl:available=1/0: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.144531/1.00, alarm hl:np_load_long=0.900390/1.50, alarm hl:mem_free=17188.000000M/300M, alarm hl:available=1/0 [20:52:16] does anyone familiar with the page view statistics toolchain have any idea what's happening with http://stats.grok.se/en/latest/Cuisinart ? [20:53:08] [[w:Cuisinart]] was only edited four times last year, it has seven sentences, 1.7 KB, 2 refs, 2 ELs, a photo, a navbox, and 5 AFT responses. There's no way it is getting a million hits per month. [20:53:14] it has to be a joke [20:54:05] I found it in the raw logs which Henrik's stats.grok.se gets from Domas's software, and so I asked on Domas's enwiki talk page, but I see he hasn't edited for a year and a half. Does anyone know the best way to reach him? [20:55:40] nm he is on IRC often [20:56:21] well if you see him would you please ask him about this? If there is a prize for finding this, please feel free to claim it for yourself. [20:57:06] I suspect it was added so that Domas would discover who looks at views per byte. It is second only to the main page in that statistic, supposedly [21:01:20] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:04:22] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:08:20] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:37:55] 3(commented) [TS-1328] Please add me to OSM-MMP group <10https://jira.toolserver.org/browse/TS-1328> (Kolossos ) [21:41:40] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 393845 MB (7% inode=40%): [21:50:22] how can you join commons and enwiki? [21:53:02] Betacommand: thta's only possible on sql-s1-rr at the moment [21:53:14] DaBPunkt: thanks [22:00:44] Danny_B|backup: Sorry if I sounded annoyed/frustrated yesterday. I really do appreciate you cleaning up the dumps mess, but the permissions were quickly aggravating. I'm surely once the kinks are worked out, it'll be great. :-) [22:01:14] no prob [22:01:20] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:05:21] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:07:55] 3(resolved) [TS-1328] Please add me to OSM-MMP group <10https://jira.toolserver.org/browse/TS-1328> (Bernhard Westmark) [22:08:20] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:16:02] Tim Landscheidt * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [22:23:10] Sun Grid Engine execd on ortelius is WARNING: all.q@ortelius exceedes load threshold: alarm hl:np_load_short=1.064453/1.00, alarm hl:np_load_long=0.793945/1.50, alarm hl:mem_free=18672.000000M/300M, alarm hl:available=1/0 [22:25:10] Sun Grid Engine execd on ortelius is OK: short@ortelius OK: all.q@ortelius OK [22:32:02] MZMcBride * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [22:41:10] Sun Grid Engine execd on willow is WARNING: all.q@willow exceedes load threshold: alarm hl:np_load_short=0.732910/1.8, alarm hl:np_load_avg=0.718262/2.3, alarm hl:mem_free=255.000000M/300M, alarm hl:available=1/0 [22:41:40] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 405780 MB (7% inode=41%): [22:45:10] Sun Grid Engine execd on willow is OK: all.q@willow OK: longrun@willow OK [23:02:20] SMF on damiana is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:05:31] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:09:20] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:41:41] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 403502 MB (7% inode=41%):