[12:30:09] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [12:30:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [12:32:08] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [12:34:48] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [12:36:49] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [12:36:49] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 331496 MB (6% inode=35%): [12:38:07] /sql on z-dat-s4-a is WARNING: DISK WARNING - free space: /sql 40099 MB (9% inode=99%): [12:42:45] 3(work started) [TS-1428] cron jobs not running intermittently? <10https://jira.toolserver.org/browse/TS-1428> (DaB.) [12:42:45] 3(assigned) [TS-1428] cron jobs not running intermittently? <10https://jira.toolserver.org/browse/TS-1428> (DaB.) [12:44:48] 3(commented) [TS-1428] cron jobs not running intermittently? <10https://jira.toolserver.org/browse/TS-1428> (DaB.) [12:57:08] /sql on z-dat-s4-a is OK: DISK OK - free space: /sql 61567 MB (15% inode=99%): [13:12:28] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70992 MB (5% inode=99%): [13:15:29] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71368 MB (6% inode=99%): [13:19:44] 3(created) [TS-1429] lost links; Toolserver; Bug <10https://jira.toolserver.org/browse/TS-1429> (Lvova Anastasiya) [13:30:28] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [13:31:07] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [13:32:08] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [13:34:49] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [13:36:42] 3(created) [MNT-1253] Disabe reboot_when_memory_low.sh on ha-nodes; Maintenance; Minor work <10https://jira.toolserver.org/browse/MNT-1253> (DaB.) [13:37:48] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [13:37:48] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 337975 MB (6% inode=35%): [13:39:43] 3(resolved) [MNT-1253] Disabe reboot_when_memory_low.sh on ha-nodes <10https://jira.toolserver.org/browse/MNT-1253> (DaB.) [13:42:28] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70988 MB (5% inode=99%): [13:43:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [13:43:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:03:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71213 MB (6% inode=99%): [14:06:00] /sql on thyme is WARNING: DISK WARNING - free space: /sql 188712 MB (19% inode=99%): [14:10:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70755 MB (5% inode=99%): [14:11:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71301 MB (6% inode=99%): [14:13:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70837 MB (5% inode=99%): [14:36:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71272 MB (6% inode=99%): [14:43:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [14:43:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [14:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [14:43:29] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 331006 MB (6% inode=35%): [14:43:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [14:43:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [14:44:19] @¶eplag [14:44:22] @replag [14:44:23] Daniel_WMDE: s2-user: 13s [-0.01 s/s]; s3-rr-a: 40s [-0.11 s/s]; s3-user: 40s [-0.11 s/s] [15:05:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70626 MB (5% inode=99%): [15:06:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71187 MB (6% inode=99%): [15:08:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70993 MB (5% inode=99%): [15:32:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71172 MB (6% inode=99%): [15:43:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [15:43:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [15:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [15:43:29] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 331063 MB (6% inode=35%): [15:43:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [15:43:51] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [15:57:27] hello all [15:59:03] DaB. * Re: [Toolserver-l] Dude, where is my logfile? [16:07:53] DaBPunkt: Is it easy to setup an svn hook to automatically send out an email when someone commits something? [16:08:21] multichill: yes, there is already code for that in each svn-repository [16:08:34] Result like http://lists.wikimedia.org/pipermail/pywikipedia-svn/2012-June/thread.html ? [16:09:23] more or less, yes. We have 1 MMP that uses mail-sending already AFAIR [16:11:07] I keep missing the Erfgoed svn changes so that would be nice [16:13:39] Does the toolserver mail support something like erfgoed=@toolserver.org so we can use erfgoed=svn@toolserver.org [16:13:43] Makes filtering easy :-) [16:14:00] DaBPunkt: ^^ [16:14:18] multichill: they use already a script that message http://cia.vc/stats/project/erfgoed-wlm which has a rss-feed AFAIS; but I can config it to send mails to your too [16:14:52] Script is broken, log message gets lost [16:16:12] multichill: ok. Then open a jira-bugreport and I will look for it today or tomorrow [16:16:24] ok :-) [16:16:30] specify the receiv-adress [16:18:08] DaBPunkt: seems the replag issues on S2 are finally resolved, so status.toolserver.org can be updated again? [16:18:23] good point [16:20:03] done [16:21:14] aw< for dinner-making [16:21:18] away [16:22:03] Thehelpfulone * Re: [Toolserver-l] Dude, where is my logfile? [16:22:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70215 MB (5% inode=99%): [16:23:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71175 MB (6% inode=99%): [16:29:18] RAID on adenia is CRITICAL: CHECK_NRPE: Socket timeout after 30 seconds. [16:43:08] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [16:43:18] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [16:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [16:43:29] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 338902 MB (6% inode=35%): [16:44:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [16:44:50] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [16:49:09] RAID on adenia is OK: OK - TOTAL: 2: FAILED: 0: DEGRADED: 0 [16:52:08] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70930 MB (5% inode=99%): [16:59:43] 3(created) [TS-1430] Set up email notifications for Erfgoed svn; Toolserver; Task <10https://jira.toolserver.org/browse/TS-1430> (Multichill) [17:10:10] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71555 MB (6% inode=99%): [17:11:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70298 MB (5% inode=99%): [17:22:48] [[Special:Log/newusers]] create 10 * PatAgb * (New user account) [17:43:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [17:43:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [17:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [17:43:29] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 338226 MB (6% inode=35%): [17:44:51] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [17:44:51] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [18:09:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 72665 MB (6% inode=99%): [18:32:44] 3(commented) [TS-1428] cron jobs not running intermittently? <10https://jira.toolserver.org/browse/TS-1428> (Krinkle) [18:43:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [18:43:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [18:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [18:43:29] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 338032 MB (6% inode=35%): [18:45:50] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [18:45:50] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [19:27:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70992 MB (5% inode=99%): [19:41:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71295 MB (6% inode=99%): [19:43:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [19:43:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [19:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [19:43:29] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 337380 MB (6% inode=35%): [19:45:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [19:45:50] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:17:28] [[User:Bishnu Saikia]] ! 10https://wiki.toolserver.org/w/index.php?diff=7414&oldid=6687&rcid=10028 * Bishnu Saikia * (+542) () [20:17:52] [[User:Bishnu Saikia]] ! 10https://wiki.toolserver.org/w/index.php?diff=7415&oldid=7414&rcid=10029 * Bishnu Saikia * (-321) () [20:25:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70793 MB (5% inode=99%): [20:29:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71155 MB (6% inode=99%): [20:30:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70833 MB (5% inode=99%): [20:43:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [20:43:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [20:43:30] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [20:43:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 337190 MB (6% inode=35%): [20:45:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [20:45:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [20:57:07] Hello all! Could any one help me to figure out how to contribute to Wikimedia Foundation as a sys admin? I'm quite new here. Please! [20:59:15] adminxor: hello. You are in the wrong channel. try #wikimedia-tech oder #wikimedia [20:59:55] Okay. Thank you! [21:04:32] didn't he already volunteer yesterday or the day before? [21:05:36] yes, he was on #wikimedia-tech on Sunday [21:07:34] personally, I'd be very wary of giving root -or even server access- to a contributor who came out of the blue, without a track of previous contributions «somewhere» [21:08:15] same here, but that's the decision of the wmf ;) [21:09:18] I suppose they will direct him to puppetize some systems :P [21:10:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71252 MB (6% inode=99%): [21:36:48] nacht ts [21:43:08] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [21:43:18] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [21:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [21:43:30] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 343528 MB (6% inode=35%): [21:45:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [21:45:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:31:04] Ja Ga * Re: [Toolserver-l] SSH client for iPad [22:43:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [22:43:19] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [22:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [22:43:29] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 343409 MB (6% inode=35%): [22:45:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [22:45:49] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output [22:55:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70849 MB (5% inode=99%): [22:56:09] /sql on cassia is WARNING: DISK WARNING - free space: /sql 71194 MB (6% inode=99%): [23:10:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70996 MB (5% inode=99%): [23:32:09] /sql on cassia is CRITICAL: DISK CRITICAL - free space: /sql 70786 MB (5% inode=99%): [23:43:09] SMF on willow is CRITICAL: ERROR - maintenance: svc:/network/puppetmasterd:default [23:43:20] SMF on turnera is CRITICAL: ERROR - offline: svc:/system/cluster/scsymon-srv:default [23:43:29] SMF on damiana is CRITICAL: ERROR - maintenance: svc:/network/ldap/client:default offline: svc:/system/cluster/scsymon-srv:default [23:43:29] /aux0 on hemlock is WARNING: DISK WARNING - free space: /aux0 341804 MB (6% inode=35%): [23:45:49] ethernet 0/1/24 [ortelius.mgmt] on asw-oe10-esams.mgmt is CRITICAL: GigabitEthernet0/1/24:DOWN: 1 int NOK : CRITICAL [23:45:50] Sun Grid Engine execd on ortelius is WARNING: NRPE: Unable to read output