[00:02:19] <grrrit-wm>	 (03PS1) 10John F. Lewis: Add Affiliate namespace on chapcomwiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154713 (https://bugzilla.wikimedia.org/69549) 
[00:10:18] <grrrit-wm>	 (03PS1) 10John F. Lewis: Remove emlwiki from commonsuploads.dblist [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154714 (https://bugzilla.wikimedia.org/69056) 
[00:10:55] <grrrit-wm>	 (03CR) 10Vogone: [C: 031] "LGTM" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154713 (https://bugzilla.wikimedia.org/69549) (owner: 10John F. Lewis)
[00:11:34] <JohnLewis>	 Vogone: thanks :p
[00:11:45] <JohnLewis>	 Already put down for Monday night's SWAT
[00:13:33] <grrrit-wm>	 (03CR) 10Vogone: [C: 031] "LGTM" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154714 (https://bugzilla.wikimedia.org/69056) (owner: 10John F. Lewis)
[00:15:13] <Vogone>	 JohnLewis: too many for Mo. afternoon?
[00:15:45] <JohnLewis>	 Yeah, the limit is 8 there are 7 right now and I have 1 more patch coming up and then possibly another after it.
[00:15:56] <JohnLewis>	 And I prefer all my patches to be in one chunck :)
[00:16:14] <Vogone>	 I could move mine :p
[00:16:31] <legoktm>	 hmm
[00:16:31] <JohnLewis>	 No; keep them there :)
[00:16:36] <legoktm>	 I still have two more to backport...
[00:16:47] <Vogone>	 legoktm: shall I move then?
[00:16:57] <legoktm>	 nah, I'll just re-shuffle mine
[00:17:08] <Vogone>	 that eliminator thingie is not too important
[00:19:58] <Vogone>	 legoktm: seriously, I could move 'eliminator' to Tuesday, then all your patches would fit to Monday afternoon
[00:20:26] <legoktm>	 ok, that would be appreciated :)
[00:21:01] <grrrit-wm>	 (03PS2) 10Yuvipanda: graphite: Fixes to work with trusty [operations/puppet] - 10https://gerrit.wikimedia.org/r/154712 
[00:21:13] <grrrit-wm>	 (03PS1) 10John F. Lewis: Add two commonswiki CopyUploadDomains [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154718 (https://bugzilla.wikimedia.org/69439) 
[00:22:28] <Vogone>	 legoktm: https://wikitech.wikimedia.org/w/index.php?title=Deployments&diff=123730&oldid=123729
[00:23:05] <legoktm>	 ty :)
[00:24:39] <grrrit-wm>	 (03Abandoned) 10John F. Lewis: Add DNS for us-ne [operations/dns] - 10https://gerrit.wikimedia.org/r/133980 (https://bugzilla.wikimedia.org/64557) (owner: 10John F. Lewis)
[00:24:46] <grrrit-wm>	 (03Abandoned) 10John F. Lewis: Apache set up for us-ne [operations/apache-config] - 10https://gerrit.wikimedia.org/r/133981 (https://bugzilla.wikimedia.org/64557) (owner: 10John F. Lewis)
[00:24:59] <grrrit-wm>	 (03Abandoned) 10John F. Lewis: Redirect usne to us-ne [operations/apache-config] - 10https://gerrit.wikimedia.org/r/133991 (https://bugzilla.wikimedia.org/64557) (owner: 10John F. Lewis)
[00:25:04] <grrrit-wm>	 (03Abandoned) 10John F. Lewis: Add usne DNS [operations/dns] - 10https://gerrit.wikimedia.org/r/133992 (https://bugzilla.wikimedia.org/64557) (owner: 10John F. Lewis)
[00:25:24] <grrrit-wm>	 (03Abandoned) 10John F. Lewis: Add us_newikimedia set up configs [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/133982 (https://bugzilla.wikimedia.org/64557) (owner: 10John F. Lewis)
[00:25:44] <JohnLewis>	 sorry for the above; old clean up from May :p
[00:26:50] <grrrit-wm>	 (03CR) 10Vogone: [C: 031] "LGTM" [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154718 (https://bugzilla.wikimedia.org/69439) (owner: 10John F. Lewis)
[00:27:42] <grrrit-wm>	 (03PS3) 10Yuvipanda: graphite: Fixes to work with trusty [operations/puppet] - 10https://gerrit.wikimedia.org/r/154712 
[00:29:14] <grrrit-wm>	 (03PS4) 10Yuvipanda: graphite: Fixes to work with trusty [operations/puppet] - 10https://gerrit.wikimedia.org/r/154712 
[00:34:54] <grrrit-wm>	 (03PS1) 10John F. Lewis: Change wgMaxRedirects for enwiki and dewiki [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154720 (https://bugzilla.wikimedia.org/63388) 
[00:38:07] <Vogone>	 JohnLewis: hm, doesn't that still need confirmation?
[00:39:17] <JohnLewis>	 eh, It's been in my assigned list for a while so I patched it. See what the SWATer thinks. It patched so eh
[00:40:01] <grrrit-wm>	 (03CR) 10Vogone: [C: 04-1] "Pending confirmation whether this works as expected." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154720 (https://bugzilla.wikimedia.org/63388) (owner: 10John F. Lewis)
[00:40:23] <Vogone>	 JohnLewis: fine? :p
[00:40:33] <JohnLewis>	 I guess :p
[00:40:36] <Vogone>	 so the SWATer can test it! :p
[00:40:59] <JohnLewis>	 It's there anyway, they won't -2 it so it can be merged when someone tests it works or fixes it :p
[00:41:14] <Vogone>	 yup
[00:41:59] <JohnLewis>	 I think that is SWAT done for me
[00:42:15] <JohnLewis>	 I'm looking at other general bugs now so see what can be done
[00:45:16] <grrrit-wm>	 (03CR) 10Legoktm: [C: 04-1] "This is a pretty large behavior change and needs more discussion / testing before being deployed." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154720 (https://bugzilla.wikimedia.org/63388) (owner: 10John F. Lewis)
[00:45:57] <Vogone>	 JohnLewis: now it is -2
[00:46:01] <Vogone>	 ty legoktm
[00:46:13] <JohnLewis>	 and removed from SWAT just now
[00:48:53] <grrrit-wm>	 (03CR) 10Yuvipanda: "Tested to work on Trusty, and should work on Precise too - but needs to be tested first." [operations/puppet] - 10https://gerrit.wikimedia.org/r/154712 (owner: 10Yuvipanda)
[00:56:15] <YuviPanda>	 jesus, RT sucks
[01:20:31] <JohnLewis>	 YuviPanda: howso?
[01:20:38] <JohnLewis>	 (delayed but meh :p)
[01:20:45] <YuviPanda>	 JohnLewis: well, 'RT <number>' doesn't autolink
[01:21:11] <JohnLewis>	 YuviPanda: Hm, where?
[01:21:23] <legoktm>	 YuviPanda: RT: # should
[01:21:33] <YuviPanda>	 legoktm: hmm, too late :) will do next time
[01:21:54] * YuviPanda urges phab on
[01:22:03] <JohnLewis>	 phab :D
[01:22:44] <Vogone>	 annäsässärie
[01:22:56] <JohnLewis>	 meh, night
[01:23:00] <Vogone>	 +1
[01:23:03] <Vogone>	 nighty
[01:25:45] <springle>	 YuviPanda: looks like these http://aerosuidae.net/paste/9/53f1554b (plus a few variations) had the most impact on tmp disk space
[01:25:54] <YuviPanda>	 springle: heya
[01:26:30] <YuviPanda>	 springle: hmmm, sigh. I think a not-quite-clean restart of the celery deamon that was doing query killing left a few running longer than they should
[01:26:49] <YuviPanda>	 springle: I've switched the entire query killer to a cron based one that runs every minute and is separate from celery, should be better now. 
[01:27:03] <springle>	 YuviPanda: sounds good, thanks
[01:27:11] <YuviPanda>	 springle: I also submitted like some 45 queries simultaneously (only 24 run at a time, tho)
[01:27:19] <YuviPanda>	 because of output format changing
[01:27:36] <YuviPanda>	 springle: hope it wasn't too bad. I can get added to alert groups for labsdb if you want
[01:32:23] <springle>	 YuviPanda: https://tendril.wikimedia.org/report/slow_queries?host=^labsdb1002&user=u2029&schema=&qmode=eq&query=Quarry&hours=32
[01:33:33] <springle>	 61 seen on the spike. EpochFail submitted 11 of those. were those all re-runs?
[01:34:03] <YuviPanda>	 springle: yeah, all re-runs
[01:34:24] <YuviPanda>	 springle: I'll hopefully never need re-runs again, and will be more careful with the killer when those happen
[01:34:37] <springle>	 or just spread them out a bit more
[01:37:14] <YuviPanda>	 springle: right.
[01:37:31] <YuviPanda>	 springle: although, EpochFail's queries were titled 'HAMMER THE DBs, THIS SHOULD GET KILLED IN 10M'
[01:37:41] <quiddity>	 lol
[01:37:53] <springle>	 heh
[01:40:54] <YuviPanda>	 springle: didn't know of tendril, will be super useful
[01:42:09] <springle>	 tendril has some rough edges yet
[01:57:12] <icinga-wm>	 PROBLEM - puppet last run on amssq37 is CRITICAL: CRITICAL: Epic puppet fail  
[02:17:12] <icinga-wm>	 RECOVERY - puppet last run on amssq37 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures  
[02:19:56] <logmsgbot>	 !log LocalisationUpdate completed (1.24wmf16) at 2014-08-18 02:18:52+00:00
[02:20:07] <morebots>	 Logged the message, Master
[02:31:20] <logmsgbot>	 !log LocalisationUpdate completed (1.24wmf17) at 2014-08-18 02:30:17+00:00
[02:31:26] <morebots>	 Logged the message, Master
[21:10:25] <grrrit-wm1>	 (03PS3) 10Hashar: Raise recovery throttle to 100mb/s [operations/puppet] - 10https://gerrit.wikimedia.org/r/150586 (owner: 10Chad)
[21:11:01] <grrrit-wm1>	 (03PS1) 10BBlack: bump passenger maxreqs to 10K [operations/puppet] - 10https://gerrit.wikimedia.org/r/154944 
[21:11:49] <grrrit-wm1>	 (03CR) 10BBlack: [C: 032 V: 032] bump passenger maxreqs to 10K [operations/puppet] - 10https://gerrit.wikimedia.org/r/154944 (owner: 10BBlack)
[21:12:27] <ottomata>	 thanks hashar, dunno what you just did but thanks?
[21:12:34] <ottomata>	 ok if I merge that now?
[21:12:47] <hashar>	 ottomata: basically need to restart the Jenkins Gearman plug
[21:12:48] <hashar>	 in
[21:22:44] <grrrit-wm1>	 (03PS4) 10Chad: Adding missing Swift dependencies, bump to Swift plugin 0.5 [operations/software/elasticsearch/plugins] - 10https://gerrit.wikimedia.org/r/151108 
[21:28:08] <hashar>	 !log Zuul processing again. Definitely need to write doc about how to unstuck it
[21:28:14] <morebots>	 Logged the message, Master
[21:31:07] <grrrit-wm1>	 (03CR) 10Dzahn: "tried to have this applied by/with milimetric but current puppet breakage related to mariadb blocks it" [operations/puppet] - 10https://gerrit.wikimedia.org/r/153961 (owner: 10Dzahn)
[21:31:50] <grrrit-wm1>	 (03CR) 10Manybubbles: [C: 031] Adding missing Swift dependencies, bump to Swift plugin 0.5 [operations/software/elasticsearch/plugins] - 10https://gerrit.wikimedia.org/r/151108 (owner: 10Chad)
[21:32:07] <grrrit-wm1>	 (03CR) 10Manybubbles: "Want me to just merge it? Then we'll put the 1.3 upgrade on top?" [operations/software/elasticsearch/plugins] - 10https://gerrit.wikimedia.org/r/151108 (owner: 10Chad)
[21:33:49] <bd808>	 hashar: Please write an email/wikipage on fixing zuul next time it breaks (or before). You should not be stuck being the only person who manages that.
[21:34:13] <bd808>	 hashar: twentyafterfour would be a great person to teach about it actually
[21:37:29] <grrrit-wm1>	 (03CR) 10Chad: "Sounds good to me." [operations/software/elasticsearch/plugins] - 10https://gerrit.wikimedia.org/r/151108 (owner: 10Chad)
[21:39:09] <grrrit-wm1>	 (03CR) 10Manybubbles: [C: 032] "+2. We'll deploy this when we do the Elasticsearch 1.3 upgrade on Wednesday." [operations/software/elasticsearch/plugins] - 10https://gerrit.wikimedia.org/r/151108 (owner: 10Chad)
[21:39:13] <grrrit-wm1>	 (03CR) 10Manybubbles: [V: 032] Adding missing Swift dependencies, bump to Swift plugin 0.5 [operations/software/elasticsearch/plugins] - 10https://gerrit.wikimedia.org/r/151108 (owner: 10Chad)
[21:43:42] <hashar>	 bd808: definitely
[21:44:07] <hashar>	 bd808: I think I sent a mail on ops list at some point.  I need to write a monitor + point to a doc to be written :-/
[21:44:08] <hashar>	 sorry
[21:44:39] <bd808>	 hashar: Don't be sorry, just make it so that you can say "not my problem" :)
[22:00:16] <ottomata>	 anybody know how to force a puppet variable to be a Fixnum (int) wihtout doing
[22:00:18] <ottomata>	 $var = 123 + 0?
[22:01:07] <bblack>	 !log done futzing w/ puppetmasters+neon, all agents enabled and bot back online
[22:01:13] <morebots>	 Logged the message, Master
[22:07:31] <grrrit-wm1>	 (03CR) 10Dzahn: "if you moved this node for alpha sorting, it was actually right before, "labmon" is before "labsdb" because it's not "labsmon" (yes, namin" [operations/puppet] - 10https://gerrit.wikimedia.org/r/154854 (owner: 10Yuvipanda)
[22:11:26] <grrrit-wm1>	 (03CR) 10Ottomata: [C: 032 V: 032] Parameterize more YARN/MapReduce memory settings [operations/puppet/cdh] - 10https://gerrit.wikimedia.org/r/154928 (owner: 10Ottomata)
[22:11:28] <grrrit-wm1>	 (03CR) 10Dzahn: [C: 032] racktables - use ssl_ciphersuite [operations/puppet] - 10https://gerrit.wikimedia.org/r/153973 (owner: 10Dzahn)
[22:13:38] <grrrit-wm1>	 (03CR) 10Dzahn: [C: 032] rt - use ssl_ciphersuite [operations/puppet] - 10https://gerrit.wikimedia.org/r/153981 (owner: 10Dzahn)
[22:15:26] <grrrit-wm1>	 (03CR) 10Dzahn: "checked on magnesium, along with "the other RT" - works fine" [operations/puppet] - 10https://gerrit.wikimedia.org/r/153973 (owner: 10Dzahn)
[22:15:32] <grrrit-wm1>	 (03CR) 10Dzahn: "checked on magnesium, along with "the other RT" - works fine" [operations/puppet] - 10https://gerrit.wikimedia.org/r/153981 (owner: 10Dzahn)
[22:19:41] <icinga-wm>	 PROBLEM - Disk space on lanthanum is CRITICAL: DISK CRITICAL - free space: /var/lib/jenkins-slave/tmpfs 14 MB (2% inode=99%):  
[22:20:36] <grrrit-wm1>	 (03CR) 10Dzahn: "blocked by labs - Error 400 on SERVER: Could not parse for environment production: Syntax error at '{'; expected" [operations/puppet] - 10https://gerrit.wikimedia.org/r/153961 (owner: 10Dzahn)
[22:23:04] <grrrit-wm1>	 (03PS3) 10Dzahn: ganglia - use ssl_ciphersuite [operations/puppet] - 10https://gerrit.wikimedia.org/r/153972 
[22:24:13] <grrrit-wm1>	 (03PS1) 10Ottomata: Tune YARN and MapReduce memory settings [operations/puppet] - 10https://gerrit.wikimedia.org/r/154956 
[22:36:24] <andrewbogott>	 !log disabling puppet on virt1000 and virt1006 while I try to convince the scheduler to overlook virt1006
[22:36:29] <morebots>	 Logged the message, Master
[22:45:01] <grrrit-wm1>	 (03CR) 10Dzahn: [C: 031] Allow puppetmaster to send reports to logstash [operations/puppet] - 10https://gerrit.wikimedia.org/r/143788 (https://bugzilla.wikimedia.org/60690) (owner: 10BryanDavis)
[22:45:07] <grrrit-wm1>	 (03PS10) 10Dzahn: Allow puppetmaster to send reports to logstash [operations/puppet] - 10https://gerrit.wikimedia.org/r/143788 (https://bugzilla.wikimedia.org/60690) (owner: 10BryanDavis)
[22:46:25] <grrrit-wm1>	 (03CR) 10Dzahn: [C: 032] ishmael - use ssl_ciphersuite [operations/puppet] - 10https://gerrit.wikimedia.org/r/153982 (owner: 10Dzahn)
[22:49:35] <hashar_>	 matanya: mutante: puppet-lint 1.0 got released two hours ago! https://github.com/rodjek/puppet-lint/issues/259
[22:50:47] <mutante>	 hashar_: hah, nice version jump and i guess the beers solved it :)
[22:56:51] <grrrit-wm1>	 (03PS1) 10John F. Lewis: mailman: use a new default theme (prettier mailman) [operations/puppet] - 10https://gerrit.wikimedia.org/r/154964 (https://bugzilla.wikimedia.org/61283) 
[22:57:33] <JohnFLewis>	 Thehelpfulone: ^ :)
[22:57:33] <grrrit-wm1>	 (03CR) 10jenkins-bot: [V: 04-1] mailman: use a new default theme (prettier mailman) [operations/puppet] - 10https://gerrit.wikimedia.org/r/154964 (https://bugzilla.wikimedia.org/61283) (owner: 10John F. Lewis)
[22:57:40] <JohnFLewis>	 Hm.
[22:58:37] <mutante>	 JohnFLewis: it doesn't like that you are adding literal tab characters, please replace with 4 spaces
[22:58:53] <JohnFLewis>	 mutante: oh will do
[22:59:27] <grrrit-wm1>	 (03PS1) 10Andrew Bogott: Don't schedule new instances on virt1006. [operations/puppet] - 10https://gerrit.wikimedia.org/r/154965 
[22:59:38] <Thehelpfulone>	 JohnFLewis: https://gerrit.wikimedia.org/r/#/c/154964/1/files/mailman/templates/nl/listinfo.html looks like I forgot one thing: <html lang="en">
[22:59:53] <Thehelpfulone>	 should I switch that to whatever lang code it is on Meta?
[23:00:09] <Thehelpfulone>	 "The HTML lang attribute can be used to declare the language of a Web page or a portion of a Web page. This is meant to assist search engines and browser"
[23:00:23] <grrrit-wm1>	 (03PS2) 10John F. Lewis: mailman: use a new default theme (prettier mailman) [operations/puppet] - 10https://gerrit.wikimedia.org/r/154964 (https://bugzilla.wikimedia.org/61283) 
[23:00:41] <Thehelpfulone>	 also will the <languages /> tag to anything to break anything?
[23:00:51] <JohnFLewis>	 Thehelpfulone: yeah
[23:00:56] <JohnFLewis>	 I'll fix that in Gerrit ow
[23:01:19] <Thehelpfulone>	 ok, and I just fixed it on Meta
[23:02:09] <grrrit-wm1>	 (03PS3) 10John F. Lewis: mailman: use a new default theme (prettier mailman) [operations/puppet] - 10https://gerrit.wikimedia.org/r/154964 (https://bugzilla.wikimedia.org/61283) 
[23:02:25] <grrrit-wm1>	 (03CR) 10Andrew Bogott: [C: 032] Don't schedule new instances on virt1006. [operations/puppet] - 10https://gerrit.wikimedia.org/r/154965 (owner: 10Andrew Bogott)
[23:02:25] <JohnFLewis>	 right; that's that hopefully :)
[23:03:17] <andrewbogott>	 !log isolated virt1006, re-enabling puppet on virt1000 and virt1006
[23:03:23] <morebots>	 Logged the message, Master
[23:04:36] <grrrit-wm1>	 (03PS1) 10Dzahn: ishmael - retab Apache config template [operations/puppet] - 10https://gerrit.wikimedia.org/r/154966 
[23:05:32] <icinga-wm>	 PROBLEM - puppet last run on palladium is CRITICAL: CRITICAL: Epic puppet fail  
[23:07:46] <Thehelpfulone>	 JohnFLewis: what are the red highlighted bits at https://gerrit.wikimedia.org/r/#/c/154964/3/files/mailman/templates/nl/listinfo.html ?
[23:08:07] <JohnFLewis>	 white spaces
[23:08:32] <icinga-wm>	 RECOVERY - puppet last run on palladium is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures  
[23:09:06] <Thehelpfulone>	 JohnFLewis: one thing, can you sync that to the labs instance please?
[23:09:18] <Thehelpfulone>	 I just want to double check everything's okay with it (rather than the wikidata one)
[23:09:20] <grrrit-wm1>	 (03CR) 10Dzahn: mailman: use a new default theme (prettier mailman) (031 comment) [operations/puppet] - 10https://gerrit.wikimedia.org/r/154964 (https://bugzilla.wikimedia.org/61283) (owner: 10John F. Lewis)
[23:09:46] <Thehelpfulone>	 with potentially 500+ lists to change, we don't want to break anything ;)
[23:10:30] <grrrit-wm1>	 (03PS4) 10John F. Lewis: mailman: use a new default theme (prettier mailman) [operations/puppet] - 10https://gerrit.wikimedia.org/r/154964 (https://bugzilla.wikimedia.org/61283) 
[23:10:54] <mutante>	 Thehelpfulone: maybe http://validator.w3.org/ it 
[23:11:03] <grrrit-wm1>	 (03CR) 10John F. Lewis: mailman: use a new default theme (prettier mailman) (031 comment) [operations/puppet] - 10https://gerrit.wikimedia.org/r/154964 (https://bugzilla.wikimedia.org/61283) (owner: 10John F. Lewis)
[23:11:38] <JohnFLewis>	 Thehelpfulone: sure I guess :p
[23:13:57] <JohnFLewis>	 done as puppet would do it
[23:14:41] <icinga-wm>	 PROBLEM - Disk space on lanthanum is CRITICAL: DISK CRITICAL - free space: /var/lib/jenkins-slave/tmpfs 19 MB (3% inode=99%):  
[23:14:55] <grrrit-wm1>	 (03CR) 10Hashar: "Chad: that is good to know thanks." [operations/puppet] - 10https://gerrit.wikimedia.org/r/154524 (https://bugzilla.wikimedia.org/66095) (owner: 10Hashar)
[23:14:59] <JohnFLewis>	 Thehelpfulone: Enabled Dutch on https://mailman.wmflabs.org/mailman/listinfo/default. {{works}}
[23:15:45] <Thehelpfulone>	 minor issue with the freecsstemplates.org spacing but I can fix that on Meta
[23:15:45] <Thehelpfulone>	 http://validator.w3.org/check?uri=https%3A%2F%2Fmailman.wmflabs.org%2Fmailman%2Flistinfo%2Ftest&charset=%28detect+automatically%29&doctype=Inline&group=0&user-agent=W3C_Validator%2F1.3+http%3A%2F%2Fvalidator.w3.org%2Fservices
[23:15:53] <Thehelpfulone>	 how many of those can we fix JohnFLewis ? ^
[23:16:25] <grrrit-wm1>	 (03CR) 10Hashar: "recheck" [operations/puppet] - 10https://gerrit.wikimedia.org/r/154524 (https://bugzilla.wikimedia.org/66095) (owner: 10Hashar)
[23:18:21] <JohnFLewis>	 Thehelpfulone: nothing seems urgent there so I'll look later
[23:18:28] <JohnFLewis>	 = after SWAT when it starts :p
[23:18:32] <Thehelpfulone>	 heh okay
[23:18:41] <Thehelpfulone>	 I found that I missed the headers from trnaslation
[23:18:44] <Thehelpfulone>	 so just marking htem now
[23:19:03] <JohnFLewis>	 Ok :)
[23:25:45] <grrrit-wm1>	 (03CR) 10Dzahn: [C: 032] ishmael - retab Apache config template [operations/puppet] - 10https://gerrit.wikimedia.org/r/154966 (owner: 10Dzahn)
[23:26:45] <Thehelpfulone>	 also added a translate this page link at the bottom of the page, https://mailman.wmflabs.org/mailman/listinfo/test and https://github.com/quimgil/mailman-templates/blob/master/mailman-template.html 
[23:27:10] <grrrit-wm1>	 (03PS1) 10Andrew Bogott: Add virt1009 to the eqiad virt pool. [operations/puppet] - 10https://gerrit.wikimedia.org/r/154968 
[23:27:50] <JohnFLewis>	 Thehelpfulone: want me to apply that to the patch then?
[23:27:55] <Thehelpfulone>	 JohnFLewis: https://github.com/JohnFLewis that's you right?
[23:28:00] <JohnFLewis>	 yeah
[23:28:27] <Thehelpfulone>	 yes please, I'll add you directly to Quim's github repo if I can so you can make any of the W3 fixes live (I can sync with meta)
[23:28:58] <JohnFLewis>	 Alright
[23:28:58] <grrrit-wm1>	 (03PS2) 10Andrew Bogott: Add virt1009 to the eqiad virt pool. [operations/puppet] - 10https://gerrit.wikimedia.org/r/154968 
[23:29:52] <Thehelpfulone>	 hmm I don't know if I can actually, I'll have to ask Quim to add you
[23:30:25] <Thehelpfulone>	 if you just make pull requests, then I should be able to merge them for now?
[23:30:32] <JohnFLewis>	 yeah
[23:30:38] <JohnFLewis>	 I'll send an email off to him now actually
[23:32:06] <grrrit-wm1>	 (03PS5) 10John F. Lewis: mailman: use a new default theme (prettier mailman) [operations/puppet] - 10https://gerrit.wikimedia.org/r/154964 (https://bugzilla.wikimedia.org/61283) 
[23:32:13] <JohnFLewis>	 Thehelpfulone: ^^ :)
[23:33:45] <Thehelpfulone>	 JohnFLewis: thanks, from that the only thing I can see is that the Wikimedia logo needs an alt
[23:34:01] <icinga-wm>	 PROBLEM - Host google is DOWN: PING CRITICAL - Packet loss = 100%  
[23:34:31] <icinga-wm>	 RECOVERY - Host google is UP: PING OK - Packet loss = 0%, RTA = 27.86 ms  
[23:35:20] <JohnFLewis>	 hm?
[23:35:23] <mutante>	 heh
[23:35:43] <JohnFLewis>	 Thehelpfulone: emailed Quim, cc'd you :)
[23:36:11] <Vogone>	 JohnFLewis: he, I like the current defualt one
[23:36:16] <Vogone>	 *default
[23:36:34] <MatmaRex>	 is somebody swatting?
[23:36:38] <JohnFLewis>	 ori / MaxSem: SWAT? :) (unless I am getting the wrong time and poking you earlier)
[23:36:47] <JohnFLewis>	 MatmaRex: just poked them above
[23:37:26] <MaxSem>	 wat?
[23:37:39] <MatmaRex>	 swat!
[23:37:54] <JohnFLewis>	 Thehelpfulone can you get the current default and put it somewhere so listadmins can revert back if they want?
[23:37:57] <MaxSem>	 s wat?
[23:38:09] <MaxSem>	 or, swat wat?
[23:38:22] <Thehelpfulone>	 Yep
[23:38:31] <JohnFLewis>	 MaxSem: break the wiki instead :D
[23:40:04] <JohnFLewis>	 Thehelpfulone: so; are there any other mailman features/bugs that are long overdue and should be dealt with or are we going to go and test .15 on labs?
[23:40:39] <MaxSem>	 JohnFLewis, swat was 40 minutes ago
[23:40:58] <Thehelpfulone>	 Warning Legacy encoding us-ascii used. Documents should use UTF-8.
[23:41:16] <mutante>	 +1
[23:41:27] <MatmaRex>	 MaxSem: should have bee, but wasn't
[23:41:29] <MatmaRex>	 been*
[23:41:40] <JohnFLewis>	 ^ that
[23:41:59] <MaxSem>	 if the bot hasn't pinged me, it didn't happen:P
[23:42:23] <MatmaRex>	 https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20140818T2300
[23:42:33] * MatmaRex stabs jouncebot
[23:42:36] <JohnFLewis>	 Hm.
[23:42:56] <JohnFLewis>	 MatmaRex: let's move the window 1 hour back and poke MaxSem in 18 minutes :D
[23:42:58] <MaxSem>	 eh, only 18 minutes left
[23:43:41] <MatmaRex>	 MaxSem: more like 15 hours, there's nothing scheduled afterwards :D
[23:43:43] <grrrit-wm1>	 (03PS1) 10Dzahn: ishmael behind varnish, make neon a backend [operations/puppet] - 10https://gerrit.wikimedia.org/r/154969 
[23:44:05] <MaxSem>	 greg-g, ^
[23:44:25] <Thehelpfulone>	 JohnFLewis: old list info at https://meta.wikimedia.org/wiki/Mailing_lists/Old_list_info
[23:46:10] <Thehelpfulone>	 JohnFLewis: so that UTF-8 one is the only actionable one left, http://validator.w3.org/check?uri=https%3A%2F%2Fmailman.wmflabs.org%2Fmailman%2Flistinfo%2Ftest&charset=%28detect+automatically%29&doctype=Inline&group=0&user-agent=W3C_Validator%2F1.3+http%3A%2F%2Fvalidator.w3.org%2Fservices - any idea how to fix that?
[23:48:41] <Vogone>	 Thehelpfulone: is that mailman patch going to be merged now? or somewhen later?
[23:48:59] <JohnFLewis>	 Vogone: why?
[23:49:04] <Thehelpfulone>	 Vogone: we could send through a request for translations first if that's what you're thinking?
[23:49:20] <grrrit-wm1>	 (03PS1) 10Dzahn: switch ishmael over to misc-web-lb.eqiad [operations/dns] - 10https://gerrit.wikimedia.org/r/154970 
[23:49:35] <JohnFLewis>	 Vogone: There is nothing stopping it being merged now apart form translation stuff which is actually a major thing right now
[23:49:53] <grrrit-wm1>	 (03CR) 10Dzahn: [C: 04-1] "needs Change-Id: I1e7d16349e29" [operations/puppet] - 10https://gerrit.wikimedia.org/r/154969 (owner: 10Dzahn)
[23:50:09] <JohnFLewis>	 Thehelpfulone: could you do something about that? Request translation etc.
[23:50:20] <Vogone>	 k
[23:50:36] <Thehelpfulone>	 JohnFLewis: yes, I can send notifications to translators
[23:50:47] <Vogone>	 not to me, please
[23:50:47] <Thehelpfulone>	 but before I do that can we fix this utf-8 encoding?
[23:51:02] <JohnFLewis>	 Thehelpfulone: sure I guess :p
[23:51:04] <Thehelpfulone>	 Vogone: I'd use the tool on Meta to do it
[23:51:28] <Vogone>	 yeah, and then my talk page gets fuller and fuller :(
[23:52:04] <grrrit-wm1>	 (03PS1) 10Jdlrobson: Get MediaWiki UI in front of people [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154972 
[23:52:09] <grrrit-wm1>	 (03CR) 10Dzahn: [C: 04-1] "needs Change-Id: I653e1b303d76f5e" [operations/dns] - 10https://gerrit.wikimedia.org/r/154970 (owner: 10Dzahn)
[23:53:18] <Thehelpfulone>	 Vogone: https://mailman.wmflabs.org/mailman/listinfo/test
[23:53:24] <Thehelpfulone>	 at the bottom of that page is a translate link
[23:53:31] <Vogone>	 Thehelpfulone: so what are the most important languages for now? German and Spanish I guess?
[23:53:33] <Thehelpfulone>	 do you think it'd be better in the side bar on the left?
[23:53:48] <Thehelpfulone>	 i.e. would more people see it then?
[23:54:10] <Vogone>	 sidebar would be more effective, i guess
[23:54:11] <grrrit-wm1>	 (03CR) 10Dzahn: [C: 04-2] "gitblit is already behind misc. varnish, so instead we should delete the entire SSL part of the Apache config because Apache doesn't handl" [operations/puppet] - 10https://gerrit.wikimedia.org/r/153985 (owner: 10Dzahn)
[23:55:12] <mutante>	 to select most important languages, here's a list sorted by number of users
[23:55:15] <mutante>	 http://wikistats.wmflabs.org/display.php?t=wp&s=users_desc
[23:55:36] <mutante>	 Spanish,German,French,Chinese,Portugese,Russian,Italian,Japanese
[23:55:59] <JohnFLewis>	 Thehelpfulone: can we just push for translators now? the fix will just be a change out of translation so we can fix that after translation anyway
[23:56:17] <Thehelpfulone>	 yes JohnFLewis, I'll just fix this one thing about translation in side bar
[23:56:27] <JohnFLewis>	 okay :)
[23:56:36] <grrrit-wm1>	 (03CR) 10Mattflaschen: [C: 04-1] "Beta Labs is meant to be very similar to production (basically, let me run what's going to be in production in ~1 week)." [operations/mediawiki-config] - 10https://gerrit.wikimedia.org/r/154972 (owner: 10Jdlrobson)
[23:56:40] <grrrit-wm1>	 (03Abandoned) 10Dzahn: gitblit - use ssl_ciphersuite [operations/puppet] - 10https://gerrit.wikimedia.org/r/153985 (owner: 10Dzahn)
[23:59:18] <MatmaRex>	 MaxSem: eh, no deployments then? :/
[23:59:36] <MatmaRex>	 life was simpler before swat, at least when you asked people directly you knew things are not going to get quietly ignored