[00:40:18] <grrrit-wm>	 (03PS1) 10Ori.livneh: Re-enable LuaSandbox on mw1053 [operations/puppet] - 10https://gerrit.wikimedia.org/r/149485 
[00:41:08] <icinga-wm>	 PROBLEM - puppet last run on neon is CRITICAL: CRITICAL: Puppet has 1 failures  
[00:41:45] <grrrit-wm>	 (03PS1) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[00:41:49] <YuviPanda>	 legoktm: ^, I'll test and refactor now
[00:41:58] <legoktm>	 uh, how do I test it?
[00:42:04] <legoktm>	 oh
[00:42:06] <legoktm>	 you'll test
[00:42:06] <legoktm>	 <3
[00:42:50] <YuviPanda>	 legoktm: :D
[00:44:28] <grrrit-wm>	 (03CR) 10Ori.livneh: [C: 032 V: 032] Re-enable LuaSandbox on mw1053 [operations/puppet] - 10https://gerrit.wikimedia.org/r/149485 (owner: 10Ori.livneh)
[00:45:05] <grrrit-wm>	 (03PS2) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[00:45:25] <YuviPanda>	 legoktm: it's not fully done, but the only parts left are 1. make it work, 2. cron, 3. nginx
[00:46:58] <legoktm>	 :D
[00:47:08] <ori>	 YuviPanda: are you not using zerg emperor penguin mode?
[00:47:33] <YuviPanda>	 ori: y'know, I actually had to google to make sure that's not a thing
[00:47:37] <YuviPanda>	 ori: considering uwsgi has a tyrant mode
[00:47:47] <YuviPanda>	 ori: even though I was pretty sure I wouldn't even had to use tyrant here
[00:47:56] <ori>	 zerg and emperor are UWSGI things too
[00:48:00] <ori>	 not sure about penguin
[00:48:08] <ori>	 http://uwsgi-docs.readthedocs.org/en/latest/Zerg.html
[00:48:10] <YuviPanda>	 heh
[00:48:37] <YuviPanda>	 ori: no penguins tho
[00:52:58] <grrrit-wm>	 (03CR) 10Ori.livneh: [C: 04-1] [WIP] Add extdist role (037 comments) [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (owner: 10Yuvipanda)
[00:53:15] <grrrit-wm>	 (03PS3) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[00:53:50] <YuviPanda>	 ori: w00t, ty
[00:53:55] <ori>	 np
[00:54:02] <YuviPanda>	 ori: and what do you mean by my vim plugin not aligning them correctly? 
[00:54:11] <YuviPanda>	 ori: I personally still maintain that any amount of aligning is evil
[00:54:12] <YuviPanda>	 :)
[00:54:29] <YuviPanda>	 but if you mean it should only align things in the same 'scope'...
[00:54:30] <YuviPanda>	 I agree
[00:55:01] <ori>	 yep
[00:55:12] <ori>	 YuviPanda: can i amend?
[00:55:27] <ori>	 nevermind, i'll just let you fix it :P
[00:55:33] <YuviPanda>	 ori: sure! :D If you want
[00:55:34] <grrrit-wm>	 (03PS4) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[00:55:42] <YuviPanda>	 ori: but yeah, I'm doing that too. Haven't actually setup an uwsgi + nginx thing yet
[00:55:47] <YuviPanda>	 (with puppet, I mean)
[00:56:41] <YuviPanda>	 ori: I also need to find a better workflow that's not 1. edit, 2. commit, 3. pull on test instance, 4. test
[00:56:53] <ori>	 you should be able to cp -R the uwsgi module into vagrant's puppet/modules dir 
[00:57:03] <ori>	 i don't think it depends on a lot of wikimedia things
[00:57:04] <grrrit-wm>	 (03PS5) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[00:57:11] <YuviPanda>	 ori: tru
[00:57:15] <YuviPanda>	 *true
[00:57:16] <ori>	 in fact if you wanted to commit the uwsgi module to vagrant that's fine by me
[00:57:45] <YuviPanda>	 ori: I need to play around with puppetception at some point. I was thinking of including all of ops/puppet as a subtree (or submodule) and then symlinking whatever I needed, then realized that all the icinga calls would fuck that up
[00:57:52] <YuviPanda>	 (whenever they exist in the modules and not the roles, that is)
[00:58:10] <ori>	 we should just merge them gradually by hand
[00:58:11] <ori>	 submodules suck
[00:58:19] <ori>	 if a module is good just copy it over
[00:58:21] <YuviPanda>	 ori: merge what? the current submodules?
[00:58:26] <YuviPanda>	 ori: have you looked at subtrees?
[00:58:32] <ori>	 yes, not a whole lot better
[00:58:35] <ori>	 more of a neat hack
[00:58:53] <YuviPanda>	 true, I don't know if it records all that remote info somewhere at all
[00:59:05] <ori>	 gotta run!
[00:59:08] <icinga-wm>	 RECOVERY - puppet last run on neon is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures  
[00:59:09] * ori waves
[00:59:10] <YuviPanda>	 ori: cya
[00:59:18] <YuviPanda>	 legoktm: w00t, uwsgi services running now :)
[00:59:26] <YuviPanda>	 legoktm: let me put an nginx in front of them now
[00:59:55] <legoktm>	 :D
[01:00:23] <YuviPanda>	 legoktm: and the cron.
[01:01:23] <YuviPanda>	 legoktm: what does the cron do, btw?
[01:01:30] <legoktm>	 it generates the tarballs
[01:01:48] <YuviPanda>	 legoktm: ok
[01:02:02] <legoktm>	 it's the nightly.py script
[01:02:08] <legoktm>	 which is poorly named >.>
[01:02:32] <legoktm>	 but I've never heard anyone say "download hourlies!"
[01:02:48] <YuviPanda>	 legoktm: :)
[01:03:07] <YuviPanda>	 legoktm: I'm going to create a local system user called extdist, and run eveything via that
[01:06:13] <YuviPanda>	 legoktm: does it need write over all of /srv? can you modify it to do it to a subpath?
[01:06:19] <YuviPanda>	 legoktm: or even better, read the path from a config file...
[01:06:39] <legoktm>	 https://github.com/wikimedia/labs-tools-extdist/blob/master/conf.py
[01:06:48] <YuviPanda>	 legoktm: heh, ok
[01:06:52] <legoktm>	 it just needs two directories for read/writing in
[01:07:46] <YuviPanda>	 legoktm: hmm, hourly is just */1, right?
[01:08:13] <legoktm>	 @hourly is 0 * * * *
[01:08:18] <legoktm>	 https://en.wikipedia.org/wiki/Cron#Predefined_scheduling_definitions
[01:08:39] <YuviPanda>	 legoktm: what's the difference between 0 and */1?
[01:09:21] <legoktm>	 uhh, none I guess. 
[01:09:26] <legoktm>	 0 is just clearer imo
[01:09:34] <legoktm>	 also it's what Wikipedia uses so :P
[01:09:53] <YuviPanda>	 heh :P
[01:09:54] <YuviPanda>	 fine
[01:11:30] <grrrit-wm>	 (03PS6) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[01:12:42] <grrrit-wm>	 (03PS7) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[01:12:44] <Deskana>	 YuviPanda: I'm going to echo the spirit of the comment Tomasz just made to me. "Don't forget to go to bed, Yuvi!"
[01:12:53] <Deskana>	 (I got a "Don't forget to go home, Dan!" from him)
[01:13:31] <legoktm>	 Deskana: wait no, he's nearly done!
[01:13:38] <legoktm>	 YuviPanda: ignore what Deskana said
[01:14:15] <YuviPanda>	 legoktm: :P
[01:19:58] <icinga-wm>	 RECOVERY - Puppet freshness on db1007 is OK: puppet ran at Sat Jul 26 01:19:54 UTC 2014  
[01:21:14] <grrrit-wm>	 (03PS8) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[01:25:45] <grrrit-wm>	 (03PS9) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[01:29:06] <YuviPanda>	 legoktm: boom at extdist-test.wmflabs.org.
[01:29:09] <YuviPanda>	 legoktm: can you test?
[01:29:14] * legoktm does
[01:30:00] <legoktm>	 http://extdist-test.wmflabs.org/?ext=VisualEditor is a 502 :/
[01:30:03] <YuviPanda>	 legoktm: I dunno if the cron has run yet
[01:30:20] <legoktm>	 this is a different instance right?
[01:30:40] <YuviPanda>	 legoktm: yeah
[01:30:42] <YuviPanda>	 legoktm: extdist-test
[01:30:43] <grrrit-wm>	 (03PS10) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 
[01:32:19] <YuviPanda>	 legoktm: OSError: [Errno 2] No such file or directory: '/srv/src/extensions'
[01:32:24] <YuviPanda>	 legoktm: that's what the cron is giving me
[01:32:31] <legoktm>	 oh
[01:32:53] <YuviPanda>	 legoktm: and uwsgi is giving me
[01:32:55] <legoktm>	 should we make that dir in puppet or in the app?
[01:32:55] <YuviPanda>	  fname = os.path.join(conf.SRC_PATH, 'mw-conf.json')
[01:32:56] <YuviPanda>	 UnboundLocalError: local variable 'conf' referenced before assignment
[01:33:06] <legoktm>	 grr
[01:33:09] <YuviPanda>	 legoktm: you should do it in the app if it doesn't exist
[01:33:41] <legoktm>	 ok
[01:33:42] * legoktm fixes
[01:34:33] <legoktm>	 YuviPanda: where are the error logs btw?
[01:34:43] <legoktm>	 oh, found it
[01:34:46] <YuviPanda>	 legoktm: :D heh
[01:34:47] <legoktm>	 in uwsgi/app/
[01:35:30] <YuviPanda>	 legoktm: yup
[01:37:43] <YuviPanda>	 legoktm: the cronjob is setup, though
[01:37:45] <YuviPanda>	 legoktm: and so is nginx
[01:39:27] <YuviPanda>	 legoktm: I wonder if I should go to sleep, and let you debug this as of now :D
[01:39:47] <YuviPanda>	 legoktm: I think the puppet role as of now covers everything in https://etherpad.wikimedia.org/p/extdist
[01:41:48] <legoktm>	 [18:32:20]  <YuviPanda>	 legoktm: OSError: [Errno 2] No such file or directory: '/srv/src/extensions' <-- do you have a line number for that?
[01:42:19] <YuviPanda>	 legoktm:   File "/srv/extdist/nightly.py", line 114, in update_extension
[01:42:30] <legoktm>	 ok, thought so
[01:46:12] <legoktm>	 YuviPanda: did you manually git pull in /srv/extdist or did it auto do that?
[01:46:19] <YuviPanda>	 legoktm: puppet auto -does that
[01:46:24] <legoktm>	 :D
[01:46:26] <legoktm>	 ok
[01:46:35] <legoktm>	 do we need to reload uwsgi or anything?
[01:50:50] <YuviPanda>	 legoktm: no, puppet auto does that as well, I think
[01:51:05] <YuviPanda>	 legoktm: you might have to do that, I don't know if a git pull done by the git clone emits a refresh event or not
[02:01:00] <YuviPanda>	 legoktm: you should also probably add tests and jenkins jobs. Remember any merged commit will be deployed in under 30m automatically :)
[02:16:34] <logmsgbot>	 !log LocalisationUpdate completed (1.24wmf14) at 2014-07-26 02:15:31+00:00
[02:16:43] <morebots>	 Logged the message, Master
[02:19:09] <legoktm>	 YuviPanda|zzzzzz: yeah, I do need tests. thanks for all your help :D
[02:26:49] <logmsgbot>	 !log LocalisationUpdate completed (1.24wmf15) at 2014-07-26 02:25:46+00:00
[02:26:55] <morebots>	 Logged the message, Master
[02:28:39] <grrrit-wm>	 (03CR) 10Tim Landscheidt: [C: 031] planet.wikimedia.org -- fix https redirects to http [operations/puppet] - 10https://gerrit.wikimedia.org/r/149311 (https://bugzilla.wikimedia.org/68554) (owner: 10Chmarkine)
[02:58:58] <logmsgbot>	 !log LocalisationUpdate ResourceLoader cache refresh completed at Sat Jul 26 02:57:52 UTC 2014 (duration 57m 50s)
[02:59:03] <morebots>	 Logged the message, Master
[04:31:07] <grrrit-wm>	 (03CR) 10Physikerwelt: WIP: Draft for Mathoid role (035 comments) [operations/puppet] - 10https://gerrit.wikimedia.org/r/148836 (owner: 10Physikerwelt)
[04:32:14] <grrrit-wm>	 (03PS10) 10Physikerwelt: WIP: Draft for Mathoid role [operations/puppet] - 10https://gerrit.wikimedia.org/r/148836 
[05:13:09] <grrrit-wm>	 (03CR) 10BryanDavis: WIP: Draft for Mathoid role (031 comment) [operations/puppet] - 10https://gerrit.wikimedia.org/r/148836 (owner: 10Physikerwelt)
[05:53:48] <icinga-wm>	 PROBLEM - Puppet freshness on db1006 is CRITICAL: Last successful Puppet run was Sat 26 Jul 2014 03:53:11 UTC  
[06:28:48] <icinga-wm>	 PROBLEM - puppet last run on db1059 is CRITICAL: CRITICAL: Puppet has 1 failures  
[06:28:48] <icinga-wm>	 PROBLEM - puppet last run on cp1061 is CRITICAL: CRITICAL: Puppet has 1 failures  
[06:28:48] <icinga-wm>	 PROBLEM - puppet last run on db1002 is CRITICAL: CRITICAL: Puppet has 1 failures  
[06:29:48] <icinga-wm>	 PROBLEM - puppet last run on mw1065 is CRITICAL: CRITICAL: Puppet has 1 failures  
[06:29:59] <icinga-wm>	 PROBLEM - puppet last run on mw1069 is CRITICAL: CRITICAL: Puppet has 1 failures  
[06:29:59] <icinga-wm>	 PROBLEM - puppet last run on mw1099 is CRITICAL: CRITICAL: Puppet has 1 failures  
[06:30:38] <icinga-wm>	 PROBLEM - puppet last run on mw1100 is CRITICAL: CRITICAL: Puppet has 1 failures  
[06:30:58] <icinga-wm>	 PROBLEM - puppet last run on mw1166 is CRITICAL: CRITICAL: Puppet has 2 failures  
[06:32:08] <icinga-wm>	 PROBLEM - puppet last run on searchidx1001 is CRITICAL: CRITICAL: Puppet has 2 failures  
[06:32:48] <icinga-wm>	 RECOVERY - Puppet freshness on db1006 is OK: puppet ran at Sat Jul 26 06:32:46 UTC 2014  
[06:44:58] <icinga-wm>	 RECOVERY - puppet last run on mw1099 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures  
[06:45:38] <icinga-wm>	 RECOVERY - puppet last run on mw1100 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures  
[06:45:48] <icinga-wm>	 RECOVERY - puppet last run on db1059 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures  
[06:45:48] <icinga-wm>	 RECOVERY - puppet last run on cp1061 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures  
[06:46:48] <icinga-wm>	 RECOVERY - puppet last run on mw1065 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures  
[06:46:48] <icinga-wm>	 RECOVERY - puppet last run on db1002 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures  
[06:46:58] <icinga-wm>	 RECOVERY - puppet last run on mw1166 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures  
[06:46:58] <icinga-wm>	 RECOVERY - puppet last run on mw1069 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures  
[06:47:08] <icinga-wm>	 RECOVERY - puppet last run on searchidx1001 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures  
[06:52:59] <icinga-wm>	 PROBLEM - puppet last run on db1020 is CRITICAL: CRITICAL: Puppet has 1 failures  
[07:10:58] <icinga-wm>	 RECOVERY - puppet last run on db1020 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures  
[07:17:08] <grrrit-wm>	 (03CR) 10Legoktm: [C: 04-1] "Running into IOError: [Errno 13] Permission denied: '/srv/src/extensions/mw-conf.json'" (031 comment) [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (owner: 10Yuvipanda)
[07:28:43] <grrrit-wm>	 (03PS11) 10Legoktm: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (owner: 10Yuvipanda)
[07:29:21] <grrrit-wm>	 (03CR) 10Legoktm: "PS11: Added doc comments based on other roles and enhanced the commit message." [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (owner: 10Yuvipanda)
[07:42:09] <grrrit-wm>	 (03PS12) 10Legoktm: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (https://bugzilla.wikimedia.org/68609) (owner: 10Yuvipanda)
[09:21:03] <grrrit-wm>	 (03PS13) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (https://bugzilla.wikimedia.org/68609) 
[09:21:36] <YuviPanda|zzzzzz>	 legoktm: also wait, if you're just going to assume the tarballs are there, why have uwsgi at all? can't you just run the cron and use plain nginx to serve them?
[09:27:59] <icinga-wm>	 PROBLEM - puppet last run on db1046 is CRITICAL: CRITICAL: Puppet has 1 failures  
[09:45:59] <icinga-wm>	 RECOVERY - puppet last run on db1046 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures  
[09:57:48] <icinga-wm>	 PROBLEM - Puppet freshness on db1009 is CRITICAL: Last successful Puppet run was Sat 26 Jul 2014 07:57:25 UTC  
[10:05:08] <grrrit-wm>	 (03CR) 10Yuvipanda: "Hmm, the folder on /srv/src seems to have weird permissions. I think we should just create that folder in puppet. Should also let us have " [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (https://bugzilla.wikimedia.org/68609) (owner: 10Yuvipanda)
[10:15:30] <grrrit-wm>	 (03PS14) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (https://bugzilla.wikimedia.org/68609) 
[10:21:06] <grrrit-wm>	 (03PS15) 10Yuvipanda: [WIP] Add extdist role [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (https://bugzilla.wikimedia.org/68609) 
[10:23:59] <grrrit-wm>	 (03CR) 10Yuvipanda: "Now it's failing with:" [operations/puppet] - 10https://gerrit.wikimedia.org/r/149486 (https://bugzilla.wikimedia.org/68609) (owner: 10Yuvipanda)
[10:31:39] <grrrit-wm>	 (03CR) 10JanZerebecki: [C: 031] planet.wikimedia.org -- fix https redirects to http [operations/puppet] - 10https://gerrit.wikimedia.org/r/149311 (https://bugzilla.wikimedia.org/68554) (owner: 10Chmarkine)
[11:57:08] <icinga-wm>	 RECOVERY - Puppet freshness on db1009 is OK: puppet ran at Sat Jul 26 11:57:01 UTC 2014  
[13:44:15] <grrrit-wm>	 (03CR) 10Physikerwelt: WIP: Draft for Mathoid role (031 comment) [operations/puppet] - 10https://gerrit.wikimedia.org/r/148836 (owner: 10Physikerwelt)
[14:10:16] <legoktm>	 YuviPanda: ummmmmmmmmmmm
[14:10:32] <legoktm>	 YuviPanda: yeah............
[14:13:43] <YuviPanda>	 legoktm: hmm?
[14:13:55] <legoktm>	 not needing uwsgi
[14:14:10] <YuviPanda>	 legoktm: heh, right. 
[14:14:29] <YuviPanda>	 legoktm: so, 1. nginx should just serve static files from the /srv/src/ directory?
[14:14:37] <YuviPanda>	 legoktm: and the flask files should be killed?
[14:14:41] <legoktm>	 /srv/dist
[14:14:53] <YuviPanda>	 legoktm: ah, right. puppet should create that folder too
[14:14:54] <legoktm>	 yeah
[14:15:07] <YuviPanda>	 legoktm: we need to make puppet create folders, since otherwise you can't really create them on /srv (permissions!)
[14:15:23] <YuviPanda>	 legoktm: are you going to be able to modify the python repo today?
[14:15:42] <YuviPanda>	 legoktm: I can also make this into a proper module, so if we ever decide to put this in prod (why not?) it should be trivial
[14:15:45] <legoktm>	 I'm going to be afk most of today
[14:15:50] <legoktm>	 <3
[14:15:54] <YuviPanda>	 legoktm: hmm, ok. so I'll just let it be today?
[14:15:59] <YuviPanda>	 I'll modularize it and then not make any other changes
[14:16:00] <legoktm>	 sure
[14:16:05] <YuviPanda>	 legoktm: cool
[14:19:42] <JohnLewis>	 hoo: are you patching that bug?
[14:19:52] <JohnLewis>	 oh just saw assignee :p
[14:19:56] <grrrit-wm>	 (03PS1) 10Hoo man: Add import sources for bhwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149530 (https://bugzilla.wikimedia.org/68616) 
[14:20:13] <hoo>	 JohnLewis: Yeah, just opened the bug to have something to link the change to
[14:20:25] <hoo>	 didn't want to bother that user with opening a bug also and stuff
[14:20:38] <hoo>	 they have gone a long way to import stuff anyway (if you see my meta talk)
[14:21:44] <grrrit-wm>	 (03CR) 10John F. Lewis: [C: 031] Add import sources for bhwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149530 (https://bugzilla.wikimedia.org/68616) (owner: 10Hoo man)
[14:21:45] <JohnLewis>	 Yeah
[14:40:48] <icinga-wm>	 PROBLEM - gitblit.wikimedia.org on antimony is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[14:44:48] <icinga-wm>	 RECOVERY - gitblit.wikimedia.org on antimony is OK: HTTP OK: HTTP/1.1 200 OK - 53290 bytes in 7.295 second response time  
[14:54:48] <icinga-wm>	 PROBLEM - gitblit.wikimedia.org on antimony is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[14:55:38] <icinga-wm>	 RECOVERY - gitblit.wikimedia.org on antimony is OK: HTTP OK: HTTP/1.1 200 OK - 53290 bytes in 0.316 second response time  
[15:28:28] <grrrit-wm>	 (03PS1) 10Vogone: Add 'abusefilter-log-detail' to 'rollbacker' and 'patroller' group at eswiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149533 (https://bugzilla.wikimedia.org/68319) 
[15:31:28] <grrrit-wm>	 (03CR) 10Hoo man: "I personally don't care how we grant it... if you prefer we can still do it this way and unset the global right." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/139655 (owner: 10Gerrit Patch Uploader)
[16:09:39] <grrrit-wm>	 (03CR) 10Vogone: "As all other remaining CA rights (except for centralauth-merge) are assigned locally, I believe it should also done that way with centrala" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/139655 (owner: 10Gerrit Patch Uploader)
[16:57:59] <Krenair>	 Anyone able to find the number of people subscribed to mailman lists?
[16:59:09] <Krenair>	 I think that's people with access to sodium... Though probably someone with the 'site password' can help?
[17:12:51] <Nemo_bis>	 Krenair: the owners of each list can; what list is this?
[17:12:58] <Krenair>	 Specifically, I'd (well, RD really) would like the number of subscriptions for otrs-de-l, otrs-hu and contact-nl
[17:13:13] <Nemo_bis>	 Can't you ask the owners
[17:13:33] <Krenair>	 Apparently the OTRS admins don't have the passwords to those lists, for some reason
[17:13:44] <Nemo_bis>	 List owners, not OTRS admins
[17:14:35] <Krenair>	 That involves contacting three or more people rather than one.
[17:14:42] <Nemo_bis>	 otrs-hu doesn't exist
[17:14:45] <RD>	 some of them aren't even our mailman lists
[17:15:13] <Nemo_bis>	 Raymond|afk: some needs you
[17:15:24] <Nemo_bis>	 eia and Jurgen are very reachable as well
[17:16:23] <JohnLewis>	 Jurgen is only right now
[17:20:40] <Raymond|afk>	 Nemo_bis: wh?
[17:20:43] <Raymond|afk>	 who?
[17:21:50] <sjoerddebruin>	 :O
[17:33:30] <Nemo_bis>	 Raymond|afk: can you tell the number of subscribers to otrs-de-l
[17:36:27] <Raymond|afk>	 Nemo_bis: why?
[17:37:10] <Raymond|afk>	 Nemo_bis: 64
[17:41:10] <Krenair>	 pm
[17:42:40] <grrrit-wm>	 (03CR) 10BryanDavis: WIP: Draft for Mathoid role (031 comment) [operations/puppet] - 10https://gerrit.wikimedia.org/r/148836 (owner: 10Physikerwelt)
[18:20:48] <icinga-wm>	 PROBLEM - HTTP 5xx req/min on tungsten is CRITICAL: CRITICAL: 13.33% of data above the critical threshold [500.0]  
[18:34:48] <icinga-wm>	 RECOVERY - HTTP 5xx req/min on tungsten is OK: OK: Less than 1.00% above the threshold [250.0]  
[19:07:48] <icinga-wm>	 PROBLEM - puppetmaster backend https on palladium is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[19:08:38] <icinga-wm>	 RECOVERY - puppetmaster backend https on palladium is OK: HTTP OK: Status line output matched 400 - 335 bytes in 0.014 second response time  
[19:17:48] <icinga-wm>	 PROBLEM - Puppet freshness on db1009 is CRITICAL: Last successful Puppet run was Sat 26 Jul 2014 17:17:17 UTC  
[19:52:48] <icinga-wm>	 PROBLEM - HTTP 5xx req/min on tungsten is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [500.0]  
[20:09:44] <grrrit-wm>	 (03PS1) 10Bartosz Dziewoński: Wikimedia wikis configuration for $wgExtraSignatureNamespaces [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 
[20:11:37] <grrrit-wm>	 (03CR) 10Bartosz Dziewoński: "(About wikimania2014wiki needs, see https://meta.wikimedia.org/wiki/User_talk:Matma_Rex/visualeditor-signature.js ; about metawiki, ask Ne" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 (owner: 10Bartosz Dziewoński)
[20:11:48] <icinga-wm>	 RECOVERY - HTTP 5xx req/min on tungsten is OK: OK: Less than 1.00% above the threshold [250.0]  
[20:13:38] <icinga-wm>	 PROBLEM - SSH on lvs3001 is CRITICAL: Server answer:  
[20:17:28] <icinga-wm>	 RECOVERY - Puppet freshness on db1009 is OK: puppet ran at Sat Jul 26 20:17:18 UTC 2014  
[20:19:13] <grrrit-wm>	 (03CR) 10Nemo bis: "I'm confused, NS_PROJECT shouldn't be required: see question on https://gerrit.wikimedia.org/r/#/c/87649/14" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 (owner: 10Bartosz Dziewoński)
[20:19:53] <grrrit-wm>	 (03CR) 10Bartosz Dziewoński: "Replied there." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 (owner: 10Bartosz Dziewoński)
[21:10:38] <icinga-wm>	 RECOVERY - SSH on lvs3001 is OK: SSH OK - OpenSSH_5.9p1 Debian-5ubuntu1.4 (protocol 2.0)  
[21:10:53] <grrrit-wm>	 (03PS1) 10Aaron Schulz: [WIP] Added a streamlined RunJobs that can be used by redisJobService [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149587 
[21:29:13] <hashar>	 !log restarting Zuul to clear up some stalled changes.
[21:29:19] <morebots>	 Logged the message, Master
[21:31:30] <hashar>	 that is all. See you on monday
[21:52:34] <grrrit-wm>	 (03PS2) 10Aaron Schulz: [WIP] Added a streamlined RunJobs that can be used by redisJobService [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149587 
[22:16:51] <grrrit-wm>	 (03CR) 10Nemo bis: "I retract that, MatmaRex explained me some redundancy is made necessary by VisualEditor and the use it will make of the config." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 (owner: 10Bartosz Dziewoński)
[22:18:09] <grrrit-wm>	 (03Abandoned) 10Bartosz Dziewoński: Wikimedia wikis configuration for $wgExtraSignatureNamespaces [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 (owner: 10Bartosz Dziewoński)
[22:19:03] <grrrit-wm>	 (03CR) 10Nemo bis: "Hmpf, I was amending it" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 (owner: 10Bartosz Dziewoński)
[22:29:49] <grrrit-wm>	 (03CR) 10Bartosz Dziewoński: "Please submit a separate patch. I think it's premature given that there's no agreement what the config option is going to do, or even how " [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 (owner: 10Bartosz Dziewoński)
[22:35:16] <Nemo_bis>	 MatmaRex: can you restore it for a moment so that I can cherry-pick
[22:35:23] * Nemo_bis lazy
[22:36:17] <MatmaRex>	 Nemo_bis: git checkout master && git fetch https://gerrit.wikimedia.org/r/operations/mediawiki-config refs/changes/84/149584/1 && git cherry-pick FETCH_HEAD && git commit --amend --reset-author && git review
[22:36:50] <MatmaRex>	 oh, and i forgot --no-edit on the git commit.
[22:37:35] <Nemo_bis>	 but that doesn't leave pretty comments ;) ok
[22:44:06] <grrrit-wm>	 (03PS1) 10Nemo bis: Wikimedia wikis configuration for $wgExtraSignatureNamespaces [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149591 
[22:44:40] <grrrit-wm>	 (03CR) 10Nemo bis: "Ok, done at https://gerrit.wikimedia.org/r/149591" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149584 (owner: 10Bartosz Dziewoński)
[22:46:12] <MatmaRex>	 Nemo_bis: it does when you git cherry-pick -x
[22:46:48] <MatmaRex>	 (that used to be the default behavior, which is probably why gerrit does it)
[22:47:24] <MatmaRex>	 Nemo_bis: awww, i asked you to --reset-author :(
[22:48:23] <MatmaRex>	 marking me as the author means i can't unsubscribe from the changeset mail, too :/
[22:50:16] <grrrit-wm>	 (03CR) 10Bartosz Dziewoński: [C: 04-1] "Please `git commit --amend --reset-author` so that I may unsubscribe from mail about this." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149591 (owner: 10Nemo bis)
[22:51:37] <Vogone>	 orly?
[22:57:40] <grrrit-wm>	 (03PS2) 10Nemo bis: Wikimedia wikis configuration for $wgExtraSignatureNamespaces [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149591 
[22:58:26] <grrrit-wm>	 (03CR) 10Nemo bis: "Sob, as if I wasn't doing this only because you convinced me it was a good idea some days ago. :-) Done." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/149591 (owner: 10Nemo bis)
[23:53:48] <icinga-wm>	 PROBLEM - Puppet freshness on db1006 is CRITICAL: Last successful Puppet run was Sat 26 Jul 2014 21:53:22 UTC