[00:02:58] <Nemo_bis>	 Reedy, why everywhere? how many wikis change count method?
[00:03:09] <Nemo_bis>	 I don't know of any procedure
[00:05:51] <Reedy>	 Said bug asks for "Run updateArticleCount.php on all Wikisources and Wiktionaries"
[00:07:02] <Nemo_bis>	 Reedy, yes, so what's the problem?
[00:07:19] <Reedy>	 You said why everywhere
[00:07:26] <Nemo_bis>	 that's not everywhere
[00:07:26] <Reedy>	 that's quite a number of wikis
[00:07:29] <Nemo_bis>	 the count method was changed because of incorrect results on those wikis
[00:07:44] <Nemo_bis>	 but it's still a limited number, and for a specific (one-time) reason
[00:07:47] <Reedy>	 There's other bugs still open asking for the same thing to be done
[00:08:04] <Nemo_bis>	 after a method change?
[00:08:54] <Reedy>	 https://bugzilla.wikimedia.org/buglist.cgi?title=Special%3ASearch&quicksearch=updatearticlecount&list_id=78653
[00:09:52] <Nemo_bis>	 if you mean ksh, that wasn't a method change but a massive deletion
[00:10:59] <Nemo_bis>	 and that bug doesn't even ask the script to be run
[00:11:25] <Nemo_bis>	 nor does https://bugzilla.wikimedia.org/show_bug.cgi?id=27256 , at least not very clearly
[00:39:22] <logmsgbot>	 !log neilk synchronized wmf-config/CommonSettings.php 
[00:39:24] <morebots>	 Logged the message, Master
[00:41:53] <neilk_>	 Sorry I forgot to add a commit message to the configchange ... 
[00:42:15] <neilk_>	 that was just a fix so we can do faster banner editing on testwiki, should have zero effect elsewhere.
[00:42:21] <Ryan_Lane>	 add it via !log
[00:44:23] <neilk_>	 !log neilk just added config change to set caching for banners on testwiki to 0. Should have no effect anywhere else.
[00:44:24] <morebots>	 Logged the message, Master
[01:31:38] <Ryan_Lane>	 !log powercycling hooper
[01:31:41] <morebots>	 Logged the message, Master
[01:51:50] <Ryan_Lane>	 !log installing php-apc on hooper
[01:51:52] <morebots>	 Logged the message, Master
[01:51:54] <Ryan_Lane>	 !log installing tidy on hooper
[01:51:56] <morebots>	 Logged the message, Master
[01:52:39] <Ryan_Lane>	 !log installed w3 total cache in wordpress on hooper
[01:52:41] <morebots>	 Logged the message, Master
[01:54:37] <nagios-wm>	 PROBLEM - Puppet freshness on spence is CRITICAL: Puppet has not run in the last 10 hours  
[02:06:00] <logmsgbot>	 !log LocalisationUpdate completed (1.18) at Tue Jan 17 02:06:00 UTC 2012
[02:06:02] <morebots>	 Logged the message, Master
[02:23:51] <nagios-wm>	 PROBLEM - MySQL replication status on storage3 is CRITICAL: CHECK MySQL REPLICATION - lag - CRITICAL -  Seconds_Behind_Master : 1724s  
[02:29:33] <Ryan_Lane1>	 !log temporarily disabled puppet, since the apache configuration was manually modified
[02:29:35] <morebots>	 Logged the message, Master
[02:29:48] <Ryan_Lane1>	 !log that last message was in regards to hooper
[02:29:50] <morebots>	 Logged the message, Master
[02:34:30] <nagios-wm>	 RECOVERY - MySQL replication status on storage3 is OK: CHECK MySQL REPLICATION - lag - OK -  Seconds_Behind_Master : 0s  
[03:10:58] <Shambler[Bishop>	 how do I download wikipedia in a html-viewable format?
[03:11:11] <Shambler[Bishop>	 this page has some links for that, but they are broken: https://en.wikipedia.org/wiki/Wikipedia:Database_download
[03:12:21] <Prodego>	 ah well I believe the answer is you can't, you need to download the database and import it in to mediawiki
[03:12:51] <Shambler[Bishop>	 okey hmm
[04:18:09] <nagios-wm>	 RECOVERY - Disk space on es1004 is OK: DISK OK  
[04:18:41] <Ryan_Lane>	 !log installing varnish on hooper
[04:18:43] <morebots>	 Logged the message, Master
[04:18:48] <nagios-wm>	 RECOVERY - MySQL disk space on es1004 is OK: DISK OK  
[04:35:26] <nagios-wm>	 RECOVERY - Puppet freshness on spence is OK: puppet ran at Tue Jan 17 04:34:59 UTC 2012  
[04:37:45] <CloudDispenser>	 Is it an oversight that more than 50 pages of wikitext can be request with a single API call?
[04:38:12] <Prodego>	 eh probably isn't a problem
[04:38:21] <Prodego>	 now that means I can do 5000, right?
[04:38:31] <Prodego>	 that might be a bit much
[04:38:43] <CloudDispenser>	 only 500
[04:38:50] <Prodego>	 oh that's not as cool
[04:39:31] <CloudDispenser>	 Might be different if you have the higher limits flag
[04:43:16] <nagios-wm>	 PROBLEM - MySQL slave status on es1004 is CRITICAL: CRITICAL: Slave running: expected Yes, got No  
[04:58:38] <gerrit-wm>	 New patchset: Ryan Lane; "Adding blog to marmontel and allowing .htaccess in blogs" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1927
[04:59:18] <gerrit-wm>	 New review: Ryan Lane; "(no comment)" [operations/puppet] (production); V: 0 C: 2;  - https://gerrit.wikimedia.org/r/1927
[04:59:18] <gerrit-wm>	 Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1927
[08:18:57] <StuMBP>	 any Wikimedia sysadmins around? The monthly donation page doesn't seem to be working… Error: ERR_ACCESS_DENIED
[08:24:05] <nagios-wm>	 RECOVERY - Puppet freshness on brewster is OK: puppet ran at Tue Jan 17 08:23:40 UTC 2012  
[09:12:58] <gerrit-wm>	 New review: Dzahn; "about cron jobs running every minute. see:" [operations/puppet] (production); V: 0 C: 0;  - https://gerrit.wikimedia.org/r/1926
[09:25:03] <gerrit-wm>	 New patchset: Hashar; "testswarm: explicitly set cron schedule" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1928
[09:25:18] <gerrit-wm>	 New patchset: Hashar; "testswarm: job to wipe clients idling" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1926
[09:25:41] <gerrit-wm>	 New review: Hashar; "Change https://gerrit.wikimedia.org/r/1928 explicitly define the agenda :)" [operations/puppet] (production) C: 0;  - https://gerrit.wikimedia.org/r/1926
[09:26:02] <hashar>	 mutante: hi :)  change 1928 add the "minutes" to testswarm cronjobs
[09:26:10] <hashar>	 made a second change by mistake :/
[09:44:05] <nagios-wm>	 PROBLEM - Disk space on es1004 is CRITICAL: DISK CRITICAL - free space: /a 451161 MB (3% inode=99%):  
[09:45:55] <nagios-wm>	 PROBLEM - MySQL disk space on es1004 is CRITICAL: DISK CRITICAL - free space: /a 445685 MB (3% inode=99%):  
[10:06:09] <mutante>	 hashar: hi
[10:06:23] <hashar>	 mutante: hello :)
[10:06:50] <gerrit-wm>	 New review: Dzahn; "yep, says "Done" after a few seconds when opening that URL" [operations/puppet] (production); V: 1 C: 2;  - https://gerrit.wikimedia.org/r/1926
[10:06:50] <gerrit-wm>	 Change merged: Dzahn; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1926
[10:07:45] <gerrit-wm>	 New review: Dzahn; "yea, as the commit message says" [operations/puppet] (production); V: 1 C: 2;  - https://gerrit.wikimedia.org/r/1928
[10:07:46] <gerrit-wm>	 Change merged: Dzahn; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1928
[10:08:28] <mutante>	 hashar: done
[10:10:31] <mutante>	 hashar: it's not like ?state=wipe is then just starting another external script, right
[10:10:53] <hashar>	 \o/
[10:11:04] <hashar>	 ?state=wipe just call some PHP magic
[10:11:31] <mutante>	 but inside the application, so we need to go through curl and the webserver
[10:11:42] <mutante>	 k
[10:11:53] <hashar>	 yes. There is no console script for that
[10:12:10] * mutante  nods

[10:18:13] <hashar>	 thanks for the merges mutante : )
[10:19:04] <b_jonas>	 Why doesn't the recent changes api seem to go back further than a few months?
[10:19:16] <b_jonas>	 I mean, the old revisions are still all there in the database, and public.
[10:19:32] <apergos>	 90 days I guess, we flush older changes
[10:19:41] <hashar>	 see $wgRCMaxAge
[10:19:42] <mutante>	 hashar: yw
[10:20:09] <apergos>	 rc is meant to keep only the last so many
[10:20:58] <b_jonas>	 I see
[10:21:09] <hashar>	 and we keep them for 30 days ( http://noc.wikimedia.org/conf/highlight.php?file=CommonSettings.php =  $wgRCMaxAge = 30 * 86400; )
[10:21:40] <apergos>	 ah woops, I wonder why I always think it's 90
[10:21:49] <apergos>	 maybe that's the defaul setting or something
[10:21:56] <hashar>	 the default is 13 weeks :-b
[10:22:07] <apergos>	 close enough
[10:22:09] <apergos>	 :-P
[10:25:54] <logmsgbot>	 !log neilk synchronized wmf-config/CommonSettings.php  'added CongressLookup require'
[10:25:56] <morebots>	 Logged the message, Master
[10:26:30] <b_jonas>	 Does the recent changes api find page deletions and page moves like the recent changes page does?
[10:26:49] <b_jonas>	 I guess I should try...
[10:28:55] <logmsgbot>	 !log neilk synchronized wmf-config/InitialiseSettings.php  'added CongressLookup to InitialiseSettings'
[10:28:57] <morebots>	 Logged the message, Master
[10:30:39] <logmsgbot>	 !log neilk synchronizing Wikimedia installation... : deploying CongressLookup. We are not deploying to any live wiki, just test, but this is to make i18n work
[10:30:41] <morebots>	 Logged the message, Master
[10:32:40] <nagios-wm>	 PROBLEM - ps1-d2-sdtpa-infeed-load-tower-A-phase-Z on ps1-d2-sdtpa is CRITICAL: ps1-d2-sdtpa-infeed-load-tower-A-phase-Z CRITICAL - *2463*  
[10:34:30] <nagios-wm>	 RECOVERY - MySQL slave status on es1004 is OK: OK:  
[10:34:55] <b_jonas>	 yep, it definitely shows deletions
[10:34:59] <logmsgbot>	 sync done.
[10:36:02] <b_jonas>	 then I presume it would also show page renames, though I haven't tested that
[11:04:38] <logmsgbot>	 !log neilk synchronized wmf-config/extension-list  'added CongressLookup to extension-list for i18n'
[11:04:40] <morebots>	 Logged the message, Master
[11:05:19] <logmsgbot>	 !log neilk synchronized wmf-config/ExtensionMessages-1.18.php  'added CongressLookup to ExtensionMessages-1.18 for i18n'
[11:05:20] <morebots>	 Logged the message, Master
[12:15:40] <nagios-wm>	 PROBLEM - Puppet freshness on db1045 is CRITICAL: Puppet has not run in the last 10 hours  
[13:04:40] <simon_lucy>	 hi, if this is a well known thing then just point me at it, but will the api be affected by the blackout, and if so in what way?
[13:05:13] <apergos>	 no edits
[13:05:35] <simon_lucy>	 yep that makes sense, but will content be returned as normal?
[13:05:39] <apergos>	 I *think* so
[13:05:44] <simon_lucy>	 :-)
[13:05:48] <apergos>	 not sure though
[13:06:09] <apergos>	 I didn't look at the code for that soo I could be full of b.s.
[13:06:17] <simon_lucy>	 np
[13:13:24] <simon_lucy>	 I guess no one else has a definitive answer either...
[13:13:34] <apergos>	 ask in um
[13:13:42] <apergos>	 #wikimedia-sopa 
[13:13:50] <simon_lucy>	 ah, cheers
[13:56:42] <comp1089>	 hello, I've just created bug 33769, I don't know if I did everything right...
[13:57:10] <comp1089>	 the link is wrong :o
[13:57:50] <comp1089>	 https://bugzilla.wikimedia.org/show_bug.cgi?id=33769
[14:09:35] <saper>	 comp1089: normally it's only stewards
[14:11:29] <comp1089>	 saper, do you mean I wrote in the wrong place?
[14:11:53] <saper>	 no, normally it's done only by stewards, on few wikis I know
[14:16:40] <comp1089>	 saper: so, what should I do?
[14:17:48] <Reedy>	 if the community wants it, that's fine
[14:20:25] <apergos>	 yay it looks like it's working tentatively
[14:20:43] <Reedy>	 what're you upto?
[14:20:48] <apergos>	 9 digi zip
[14:21:05] <Reedy>	 ah
[14:22:51] <apergos>	 and found a bug in the deployed one :-D
[14:23:00] <apergos>	 (on test that is)
[14:23:14] <Reedy>	 just the one? :p
[14:23:21] <apergos>	 for a minute yeah
[14:23:28] <apergos>	 ignoring things like mising data
[14:23:31] <apergos>	 *missing
[14:23:56] <apergos>	 I guess I need to look at trimZip a bit
[14:28:38] <apergos>	 hmm
[14:28:53] <apergos>	 no, maybe I need to fix it in getSenators, that's better I guess
[14:29:49] <apergos>	 grr indecision
[14:47:38] <^demon>	 apergos: Do we really need 9-digit zip? Most people in the US don't know the last 4 digits, and the first 5 should be plenty sufficient for finding your representatives.
[14:48:13] <apergos>	 yeah but they aren't for a pile of districts
[14:48:30] <^demon>	 Oh :(
[14:48:33] <apergos>	 yep
[14:48:47] <apergos>	 I think at this point I'm just finding weird stuff with the data
[14:49:57] <^demon>	 I tested it out on test.wp a little while ago. It gave me my correct representative :)
[14:50:02] <apergos>	 yay
[14:51:26] <^demon>	 Robert Scott (everyone calls him Bobby, even his campaign signs iirc)
[14:53:33] <jeremyb>	 where do i see the +4 form? http://test.wikipedia.org/wiki/Main_Page?banner=blackout gives me 5-digit
[14:54:08] <jeremyb>	 anyway, if possible we should offer to geocode an address instead of sending them to the usps
[14:54:59] <^demon>	 I wonder if the USPS site could handle the traffic we might send their way ;-)
[14:56:04] <apergos>	 um geocoding at this point, not even 
[14:56:26] <apergos>	 the specialpage can take 9 digits, the current version just throws away the end
[14:57:45] <jeremyb>	 huh. well i just got the wrong rep back for me
[15:02:43] <apergos>	 well I need to get my test finished up here and then I guess commit a pile of crap and see what folks think
[15:02:55] <apergos>	 there's this one zero padding bug I'm having trouble with
[15:05:47] <jeremyb>	 apergos: for e.g. 02631?
[15:05:53] <apergos>	 ah it looks ok now
[15:06:02] <apergos>	 I coldn't get any senators for PR :-D
[15:06:49] <apergos>	 that one came out ok for me
[15:06:58] <apergos>	 with and without padding. yay
[15:07:08] <apergos>	 I think my code is prolly ok
[15:07:29] <apergos>	 huh wonder if I oughta check it in :-P
[15:09:17] <Reedy>	 Might be worth it to get some CR ;)
[15:10:32] <apergos>	 yeah guess so
[15:11:01] <tashir>	 and now, a message from Google about HTTP status code 503: https://plus.google.com/115984868678744352358/posts/Gas8vjZ5fmB
[15:55:41] <nagios-wm>	 PROBLEM - Auth DNS on ns2.wikimedia.org is CRITICAL: CRITICAL - Plugin timed out while executing system call  
[15:59:16] <nagios-wm>	 RECOVERY - Host db43 is UP: PING OK - Packet loss = 0%, RTA = 0.26 ms  
[16:07:47] <nagios-wm>	 RECOVERY - Auth DNS on ns2.wikimedia.org is OK: DNS OK: 5.599 seconds response time. www.wikipedia.org returns 208.80.152.201  
[16:10:26] <nagios-wm>	 PROBLEM - Squid on brewster is CRITICAL: Connection refused  
[16:15:08] <sumanah>	 http://en.planet.wikimedia.org/ hasn't updated in about 4 days
[16:33:05] <gerrit-wm>	 New patchset: Jgreen; "adjusted notification recipient for offhost_backups script" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1930
[16:33:40] <gerrit-wm>	 New review: Jgreen; "(no comment)" [operations/puppet] (production); V: 1 C: 2;  - https://gerrit.wikimedia.org/r/1930
[16:33:40] <gerrit-wm>	 Change merged: Jgreen; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1930
[16:34:09] <nagios-wm>	 RECOVERY - Squid on brewster is OK: TCP OK - 0.000 second response time on port 8080  
[16:48:16] <nagios-wm>	 PROBLEM - HTTP on ekrem is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[17:01:46] <nagios-wm>	 RECOVERY - HTTP on ekrem is OK: HTTP OK HTTP/1.1 200 OK - 453 bytes in 6.174 seconds  
[17:05:53] <IvPetr>	 Hello! Hope, all of you are doing great! :)
[17:07:46] <IvPetr>	 I have a problem that I've trying to solve. I would like to integrate the menu tab (together with the header) as a mediawiki logo. Can someone please advise how to this?
[17:09:56] <Nemo_bis>	 IvPetr, looks like a question for #mediawiki
[17:11:13] <IvPetr>	 ok, thanks
[17:24:51] <nagios-wm>	 PROBLEM - Squid on brewster is CRITICAL: Connection refused  
[17:58:29] <Nemo_bis>	 Platonides, nice stats
[17:58:50] <Nemo_bis>	 should they be put on https://meta.wikimedia.org/wiki/Mirroring_Wikimedia_project_XML_dumps despite the title perhaps?
[18:57:48] <kabir>	 i'm firoz interested in Volunteering....
[19:00:14] <kabir>	 hi
[19:02:18] <Prodego>	 kabir: well mediawiki could always use more developers
[19:03:01] <DarkoNeko>	 zzz
[19:04:05] <kabir>	 @prodego : could u please help me in that
[19:04:28] <Prodego>	 help you with what?
[19:05:51] <kabir>	 could u help me in how can i find out any opportunity in develpment...
[19:07:45] <kabir>	 @prodego : could u help me in how can i find out any opportunity in develpment... 
[19:08:08] <Prodego>	 http://www.mediawiki.org/wiki/MediaWiki
[19:20:38] <mutante>	 kabir: User:Sumanah is the volunteer coordinator 
[19:22:20] <kabir>	 @mutante : thanks...can u please tell me how to contact him...
[19:23:28] <mutante>	 kabir: it's a she. you can find her on #mediawiki currently
[19:23:56] <mutante>	 kabir: but exactly what you're asking for "helping volunteers get started with development activities (coding, testing, documentation, wrangling) and match volunteers to opportunities "
[19:24:52] <mutante>	 kabir: http://www.mediawiki.org/wiki/User:Sumanah/TechVolunteersCanDo
[19:26:05] <kabir>	 mutante : thanks a lot for that help....
[19:26:19] <mutante>	 kabir: your welcome
[19:26:41] <mutante>	 you're
[19:27:23] <kabir>	 mutante : sorry didnt get u..
[19:28:12] <mutante>	 kabir: just "no problem" / "de rien"
[19:28:56] <bawolff>	 It appears en.planet.wikimedia.org hasn't been updated since the 13th
[19:29:09] <Brownout>	 topic^
[19:29:22] <logmsgbot>	 !log reedy synchronized php-1.18/extensions/ArticleFeedbackv5/modules/jquery.articleFeedbackv5/jquery.articleFeedbackv5.js  'r109186'
[19:29:24] <morebots>	 Logged the message, Master
[19:30:06] <bawolff>	 ? that's not in the topic (or was that directed to someone other then me)
[19:31:25] <Brownout>	 "blog slowdowns"
[19:31:37] <jeremyb>	 Brownout: i think that's irrelevant
[19:31:46] <Brownout>	 ok...
[19:31:57] <mutante>	 bawolff: besides the update problem, i'll test to replace the outdated planet version with "planet-venus"
[19:32:24] <bawolff>	 :)
[19:32:29] <mutante>	 http://intertwingly.net/code/venus/
[19:33:04] <mutante>	 i was going to test that in labs.. hmm, not sure about the update issue right now
[19:33:13] <bawolff>	 Right now probably isn't the best time for planet not to be working, given all the current SOPA related stuff that we want to reach far and wide
[19:34:52] <mutante>	 that's right. i'll check
[19:36:49] <Ryan_Lane>	 !log added Cite extension to labscosnole
[19:36:51] <morebots>	 Logged the message, Master
[19:37:17] <multichill>	 Does anyone know how the api disabling at enwp is going to be implemented? Is it going to give a clean error?
[19:37:27] <multichill>	 (something my bot can parse)
[19:43:46] <Daniel_WMDE>	 mark: you there? nosy is getting nervous, she needs access to the colo...
[19:44:04] <Daniel_WMDE>	 or is mark en route to sf?
[19:44:32] <LeslieCarr>	 have not heard from mark today
[19:45:09] <Daniel_WMDE>	 mutante: do you know where mark has gotten to?
[19:45:23] <Daniel_WMDE>	 LeslieCarr: thanks... so he may be traveling
[19:45:38] <mutante>	 Daniel_WMDE: no, i talked to nosy earlier and yea, he may be travelling
[19:45:44] <multichill>	 Daniel_WMDE: I can give to myself, not others :S
[19:49:23] <multichill>	 The whole SOPA thing is just a cover to do toolserver maintenance! :P
[19:50:08] <LeslieCarr>	 hahaha
[19:50:41] <Daniel_WMDE>	 hehe...
[19:50:50] <Daniel_WMDE>	 good opportunity for replication to catch up :)
[19:51:24] <Daniel_WMDE>	 hmhm
[19:51:44] <Daniel_WMDE>	 multichill, mutante: thanks guys
[19:55:22] <nagios-wm>	 PROBLEM - Mobile WAP site on ekrem is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[19:56:50] <multichill>	 Daniel_WMDE: Do you know when they're leaving? We're having a big event on Saturday in Haarlem
[19:57:26] <Daniel_WMDE>	 multichill: who? leaving? where? huh?
[19:57:48] <gerrit-wm>	 New patchset: Pyoungmeister; "cleanup. removing a nrpe.cfg that's no longer used." [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1931
[19:58:04] <gerrit-wm>	 New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1931
[19:58:33] <multichill>	 dab and Nosy are going to the datacenter right? The datacenter is in Haarlem. 
[19:59:19] <logmsgbot>	 !log reedy synchronized php-1.18/includes/Feed.php  'r109197'
[19:59:20] <morebots>	 Logged the message, Master
[19:59:38] <Daniel_WMDE>	 multichill: they are not going unless they can get mark to authorize access
[19:59:48] <Daniel_WMDE>	 which is the problem
[20:00:08] <multichill>	 Did you try calling him?
[20:00:29] <Daniel_WMDE>	 i don't think i have his number
[20:00:48] <Daniel_WMDE>	 could you try?
[20:00:49] <Reedy>	 Daniel_WMDE, if you ask nicely, people can get you it ;)
[20:01:04] <Daniel_WMDE>	 ...or of course, give me his number :)
[20:01:56] <Reedy>	 M ark is listed as being in SF from saturday
[20:02:03] <Reedy>	 Daniel_WMDE, see PM
[20:02:19] <gerrit-wm>	 New review: Pyoungmeister; "(no comment)" [operations/puppet] (production); V: 0 C: 2;  - https://gerrit.wikimedia.org/r/1931
[20:02:20] <gerrit-wm>	 Change merged: Pyoungmeister; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1931
[20:04:29] <nagios-wm>	 PROBLEM - Puppet freshness on gallium is CRITICAL: Puppet has not run in the last 10 hours  
[20:07:22] <nagios-wm>	 RECOVERY - Mobile WAP site on ekrem is OK: HTTP OK HTTP/1.1 200 OK - 1642 bytes in 8.835 seconds  
[20:12:48] <Daniel_WMDE>	 multichill: nosy sais she's leaving saturday morning. too bad.
[20:13:47] <mutante>	 !log en.planet updates were stuck. reason was corrupted cache causing "bsddb.db.DBPageNotFoundError" which broke update script. solution was to kill stuck updates, delete files in cache dir and run update manually
[20:13:48] <morebots>	 Logged the message, Master
[20:14:00] <mutante>	 http://en.planet.wikimedia.org/
[20:25:05] <gerrit-wm>	 New patchset: Bhartshorne; "added new SOPA filter to emery" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1932
[20:25:20] <gerrit-wm>	 New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1932
[20:25:58] <gerrit-wm>	 New review: Bhartshorne; "(no comment)" [operations/puppet] (production); V: 1 C: 2;  - https://gerrit.wikimedia.org/r/1932
[20:25:59] <gerrit-wm>	 Change merged: Bhartshorne; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1932
[20:37:40] <Tito|lab>	 will the enwiki blackout be implemented with $wgReadOnly or in another way?
[20:37:46] <vvv>	 Another
[20:37:52] <vvv>	 Permission config
[20:38:00] <vvv>	 +banner via JS
[20:38:04] <vvv>	 [00:37:46] <vvv> Another
[20:38:04] <vvv>	 [00:37:53] <vvv> Permission config
[20:38:21] <Tito|lab>	 heh
[20:38:55] <Tito|lab>	 I imagine it is not the first time you've heard that question today?
[20:39:51] <vvv>	 Not sure
[20:39:55] <vvv>	 This channel is silent
[20:40:07] <vvv>	 Most are in #wikimedia-sopa
[20:42:53] <jeremyb>	 vvv: FYI, /quit Changing host doesn't leave any notable opportunity for a missed message. it happens whenever you identify if you have a cloak to be set
[20:43:39] <vvv>	 jeremyb: freenode's ircd requires quit for that?
[20:43:41] <vvv>	 Didn't know
[20:43:43] <vvv>	 Thanks
[20:54:42] <logmsgbot>	 !log reedy synchronized wmf-config/InitialiseSettings.php  'Bug 33769 - Allow bureaucrats to remove sysop rights at Bashkir Wikipedia'
[20:54:44] <morebots>	 Logged the message, Master
[21:00:59] <Merlissimo>	 i got a mail with <placeholder> content again from dewiki and lang de
[21:03:35] <Merlissimo>	 mail at 7:10 pm utc was ok, mail at 8:34 not
[21:06:50] <nagios-wm>	 PROBLEM - Disk space on srv223 is CRITICAL: DISK CRITICAL - free space: / 167 MB (2% inode=60%): /var/lib/ureadahead/debugfs 167 MB (2% inode=60%):  
[21:07:50] <DaBPunkt>	 Merlissimo: so they fix it in 1h? ;)
[21:07:59] <DaBPunkt>	 fix → fixed
[21:09:27] <Merlissimo>	 DaBPunkt: there is no log message after the error, so i don't think so
[21:11:49] <Tito|lab>	 anyone here knows about this? http://en.wikipedia.org/wiki/Wikipedia_talk:SOPA_initiative/Action#Impact_on_mobile_site.3F
[21:26:31] <nagios-wm>	 PROBLEM - Puppet freshness on spence is CRITICAL: Puppet has not run in the last 10 hours  
[21:28:23] <nagios-wm>	 RECOVERY - Disk space on srv223 is OK: DISK OK  
[21:54:58] <YairRand>	 quick question: will the enwp blackout take effect for users with javascript disabled?
[21:57:43] <gerrit-wm>	 New patchset: Jgreen; "adding file_mover@emery to logmover account class (used on storage3)" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1933
[21:58:00] <gerrit-wm>	 New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1933
[21:58:16] <gerrit-wm>	 New review: Jgreen; "(no comment)" [operations/puppet] (production); V: 1 C: 2;  - https://gerrit.wikimedia.org/r/1933
[21:58:16] <gerrit-wm>	 Change merged: Jgreen; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1933
[22:02:19] <YairRand>	 anyone?
[22:04:33] <Reedy>	 I think it will, yes
[22:04:39] <Reedy>	 Ask in #wikimedia-sopa
[22:05:23] <vvv>	 Well
[22:07:55] <Ryan_Lane>	 !log installing memcache on marmontel
[22:07:57] <morebots>	 Logged the message, Master
[22:16:30] <nagios-wm>	 RECOVERY - Puppet freshness on spence is OK: puppet ran at Tue Jan 17 22:16:16 UTC 2012  
[22:20:00] <gerrit-wm>	 New patchset: Ryan Lane; "Adding support to modify memcached's bind ip, and adding memcached to marmontel" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1934
[22:20:16] <gerrit-wm>	 New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1934
[22:21:15] <gerrit-wm>	 New patchset: Asher; "prep for throwing varnish in front of single server blog" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1935
[22:21:30] <gerrit-wm>	 New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1935
[22:22:21] <gerrit-wm>	 New review: Asher; "(no comment)" [operations/puppet] (production); V: 0 C: 2;  - https://gerrit.wikimedia.org/r/1935
[22:22:22] <gerrit-wm>	 Change merged: Asher; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1935
[22:24:40] <nagios-wm>	 PROBLEM - Puppet freshness on db1045 is CRITICAL: Puppet has not run in the last 10 hours  
[22:25:08] <gerrit-wm>	 New review: Bhartshorne; "(no comment)" [operations/puppet] (production); V: 0 C: 1;  - https://gerrit.wikimedia.org/r/1934
[22:25:43] <gerrit-wm>	 New review: Ryan Lane; "(no comment)" [operations/puppet] (production); V: 0 C: 2;  - https://gerrit.wikimedia.org/r/1934
[22:25:44] <gerrit-wm>	 Change merged: Ryan Lane; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1934
[22:32:39] <gerrit-wm>	 New patchset: Asher; "reorg probes to prevent error on unused bits probe" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1936
[22:32:53] <gerrit-wm>	 New review: gerrit2; "Lint check passed." [operations/puppet] (production); V: 1 - https://gerrit.wikimedia.org/r/1936
[22:33:00] <gerrit-wm>	 New review: Asher; "(no comment)" [operations/puppet] (production); V: 0 C: 2;  - https://gerrit.wikimedia.org/r/1936
[22:33:01] <gerrit-wm>	 Change merged: Asher; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1936
[22:41:22] <gerrit-wm>	 New patchset: Asher; "blog: swap varnish and apache between ports 80, 81" [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1937
[22:43:48] <gerrit-wm>	 New review: Asher; "(no comment)" [operations/puppet] (production); V: 0 C: 2;  - https://gerrit.wikimedia.org/r/1937
[22:43:49] <gerrit-wm>	 Change merged: Asher; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1937
[22:48:49] <gerrit-wm>	 New review: Bhartshorne; "(no comment)" [operations/puppet] (production); V: 0 C: 1;  - https://gerrit.wikimedia.org/r/1918
[22:49:31] <gerrit-wm>	 New review: Lcarr; "(no comment)" [operations/puppet] (production); V: 0 C: 2;  - https://gerrit.wikimedia.org/r/1918
[22:49:32] <gerrit-wm>	 Change merged: Lcarr; [operations/puppet] (production) - https://gerrit.wikimedia.org/r/1918
[23:20:10] <LH_>	 There is a cosmetical problem with the german SOPA-Banner: It is also shown at the site it links to. 
[23:28:35] <gerrit-wm>	 New review: Bhartshorne; "(no comment)" [operations/software] (master); V: 0 C: 2;  - https://gerrit.wikimedia.org/r/1908
[23:28:35] <gerrit-wm>	 Change merged: Bhartshorne; [operations/software] (master) - https://gerrit.wikimedia.org/r/1922
[23:28:36] <gerrit-wm>	 Change merged: Bhartshorne; [operations/software] (master) - https://gerrit.wikimedia.org/r/1908
[23:35:28] <Carmilla>	 Hello, I have a problem with an user who was renamed a month ago, most of his edits were transfered to the new account, but about 500 edits remained in the old account
[23:35:52] <Carmilla>	 http://es.wikipedia.org/w/index.php?title=Especial%3ARegistro&page=Usuario%3AErick1984&uselang=en
[23:38:43] <apergos>	 Carmilla: if you submit a report to bugzilla and assign it to me (ariel@wikimedia.org) I'll get to it in the next few days
[23:40:20] <Carmilla>	 okay
[23:45:14] <DaBPunkt>	 It seems there is a problem with a mail-filter on lily. My email to a mailing-list hanged there for nearly 20 minutes
[23:47:19] <apergos>	 sleep time for me
[23:47:28] <DaBPunkt>	 gn8 apergos
[23:47:35] <apergos>	 need to be awake to watch things fall over in the morning :-D
[23:47:36] <apergos>	 tah!
[23:56:47] <syddraf>	 I'm not sure if this is the right channel for this, but has Wikimedia ever considered adding support for access over the I2P and Tor darknets without having to use the clearnet tunnels?