[02:18:14] <logmsgbot>	 !log reedy synchronized wmf-config/CommonSettings.php  'Enable SpecialCite everywhere'
[02:18:18] <morebots>	 Logged the message, Master
[02:22:02] <logmsgbot>	 !log LocalisationUpdate completed (1.20wmf3) at Thu May 17 02:22:02 UTC 2012
[02:22:05] <morebots>	 Logged the message, Master
[02:48:02] <logmsgbot>	 !log LocalisationUpdate completed (1.20wmf2) at Thu May 17 02:48:02 UTC 2012
[02:48:06] <morebots>	 Logged the message, Master
[03:41:45] <logmsgbot>	 !log asher synchronized wmf-config/db.php  'returning db12 and db46'
[03:41:48] <morebots>	 Logged the message, Master
[04:07:20] <ragecore>	 aaaaaaa
[05:03:44] <warmy>	 hi
[05:04:51] <Matthew_>	 warmy: Hi!
[08:09:02] <Pine>	 Does anyone know when toolserver will be backup?
[08:09:09] <Pine>	 * back up?
[08:10:07] <jeremyb>	 Pine: after you ask in #wikimedia-toolserver ;)
[08:10:07] <jeremyb>	 unless you don't mean toolserver
[08:10:56] <Pine>	 I just saw, thanks
[08:19:42] <hashar>	 tired of seeing the left/join stuff
[08:20:39] <Pine>	 hashar: are you also an op in #wikimedia-toolserver? Same problem there, although I think a freenode staffer may deal with it if a chanop doesn't
[08:20:59] <hashar>	 Pine: I am not op there :-(
[08:21:07] <hashar>	 I guess I will contact freenode staff
[08:21:17] <Pine>	 hashar: already done, but thanks :)
[08:21:40] <hashar>	 Pine: in #freenode ?
[08:22:35] <Pine>	 I pinged an op and one has come to #wikimedia-toolserver.
[08:23:35] <hashar>	 which reminds about sending an email to get the various IRC channels rights to be tweaked
[08:47:23] <logmsgbot>	 !log hashar synchronizing Wikimedia installation... : 
[08:47:27] <morebots>	 Logged the message, Master
[08:47:40] <jeremyb>	 and no msg...
[08:52:31] <basile>	 [5e64d544] 2012-05-17 08:52:19: Fatal exception of type MWException
[08:52:32] <basile>	 meh
[08:53:38] <Wiki13>	 hai
[08:53:50] <Wiki13>	 i got some strange error here
[08:54:09] <Wiki13>	 which i�ve never seen before
[08:55:01] <Sid-G>	 are there server problems currenlty?
[08:55:02] <Sid-G>	 *currently
[08:55:22] * p858snake|l  looks at hashar

[08:55:23] <guillom>	 I'm getting a reproducable "[652f9b05] 2012-05-17 08:54:51: Fatal exception of type MWException" each time I want to mark all watchlist pages as visited.
[08:55:27] <Wiki13>	 [ee34d09f] 2012-05-17 08:53:09: Fatal exception of type MWException
[08:55:30] * guillom  blames hasha.

[08:55:34] <Wiki13>	 me too
[08:55:47] <Sid-G>	 me too
[08:55:48] <Wiki13>	 what does it mean?
[08:55:51] * hashar  looks at p858snake|l 

[08:55:57] <logmsgbot>	 sync done.
[08:56:16] <Sid-G>	 i'm getting the exception on pagemoves
[08:56:27] <hashar>	 arrgggggg
[08:56:28] <hashar>	 damn sync
[08:56:33] <Wiki13>	 ugm
[08:56:40] <Wiki13>	 i get it with editing
[08:56:42] <Wiki13>	 -.-
[08:56:47] <hashar>	 I had a bad feeling when running that scap
[08:56:55] <Qcoder00>	 Good morning
[08:57:05] <Qcoder00>	 Was their an upgrade planned for this morning ?
[08:57:22] <Qcoder00>	 I get this - "[424032b1] 2012-05-17 08:54:17: Fatal exception of type MWException" when trying to save pages...
[08:57:32] <Qcoder00>	 at English Wikisource
[08:57:38] <jeremyb>	 Qcoder00: yah, everywhere apparently
[08:57:42] <Wiki13>	 me too
[08:57:51] <Qcoder00>	 Where are you based Wiki13?
[08:57:51] <Wiki13>	 and Sid-G too
[08:57:55] <Wiki13>	 ehm
[08:58:02] <Wiki13>	 netherlands here
[08:58:05] <p858snake|l>	 We are aware of the issue, and it's being worked on.
[08:58:07] <jeremyb>	 Qcoder00: not part of the world. *everywhere*
[08:58:26] <Wiki13>	 What doest that error mean?
[08:58:29] <Wiki13>	 -t
[08:58:31] <Qcoder00>	 OK, It's that in the past I've had issues which are limited to a particular cluster
[08:58:33] <simonshek>	 Hello everyone,
[08:58:38] * hashar  working on it

[08:58:41] <logmsgbot>	 !log hashar synchronized wmf-config/CommonSettings.php 
[08:58:44] <morebots>	 Logged the message, Master
[08:58:49] <Qcoder00>	 Wiki13: It means something 'went erong'
[08:58:50] <paravoid>	 hashar: if I can do anything to help, shoot.
[08:58:52] <Qcoder00>	 *wrong
[08:58:55] * Sid-G  takes a wikibreak till hashar figures this one out :D

[08:59:03] <hashar>	 try again?
[08:59:15] <jeremyb>	 Sid-G: short break!
[08:59:20] <simonshek>	 I can't save an edit on Chinese Wikipedia. After I clicked "submit", it appeared "[54f6a257] 2012-05-17 08:57:07: Fatal exception of type MWException"
[08:59:26] <Wiki13>	 ty
[08:59:27] <hashar>	 simonshek: try again I caused an issue
[08:59:29] <Wiki13>	 fixed
[08:59:35] <Wiki13>	 i can edit here
[08:59:38] <hashar>	 !log Broken the cluster by having an invalid global set
[08:59:41] <morebots>	 Logged the message, Master
[09:00:23] <Sid-G>	 jeremyb:I couldn't take a long break. It'd be too hard on me :P
[09:00:34] <hashar>	 wfErrorLog()
[09:00:36] <hashar>	 seriously
[09:00:38] <hashar>	 grrr
[09:00:57] <Sid-G>	 fixed :D
[09:01:03] <simonshek>	 and it's working now...:)
[09:01:06] <Qcoder00>	 Site is coming back - slowly
[09:01:22] <simonshek>	 thanks, bye
[09:01:48] <Sid-G>	 thanks hashar, bye
[09:04:03] <hashar>	 !log Site outage was due to our custom wfLogXFF() which uses wfErrorLog().  $wmfUdp2logDest not being global there, caused exception to be shown.
[09:04:06] <morebots>	 Logged the message, Master
[09:06:15] <hashar>	 bahh 
[09:07:06] <hashar>	 looks like I can do straight push in gerrit repo :-D
[09:10:51] <jeremyb>	 yes
[09:10:55] <jeremyb>	 for now
[09:11:39] <jeremyb>	 hashar: https://gerrit.wikimedia.org/r/gitweb?p=operations/mediawiki-config.git;a=commit;h=d064232d8913ad8e9825e1f7b7efdff1186051f0
[09:32:11] <hashar>	 jeremyb: thanks for the gitweb link 
[09:32:25] <hashar>	 jeremyb: I will let Roan and Ryan fix it up so :-]
[10:21:06] <closedmouth>	 db12 is being naughty
[10:26:08] <jeremyb>	 closedmouth: elaborate?
[10:26:17] <jeremyb>	 @replag
[10:26:19] <dbbot-wm>	 jeremyb: [s1] db12: 43s; [s5] db44: 1s; [s6] db46: 2s
[10:26:50] <closedmouth>	 been sitting around 30-40 seconds for a while now
[10:33:51] <jeremyb>	 can someone take a gander at db12?
[10:33:52] <jeremyb>	 gah
[10:34:05] <jeremyb>	 anyway, http://ganglia.wikimedia.org/latest/?r=day&cs=&ce=&m=&c=MySQL+pmtpa&h=db12.pmtpa.wmnet&tab=m&vn=&mc=2&z=medium&metric_group=ALLGROUPS
[10:34:28] <jeremyb>	 was just repooled ~7 hrs back it seems
[10:35:59] <jeremyb>	 it is consistently >10 secs lagged per the api. but ganglia thinks it's not lagged. (idk how that measures)
[10:36:36] <jeremyb>	 also there's something weird with the mysql_slave_running graph for db12
[11:01:19] <ToAruShiroiNeko>	 could a dev tell me the setup for this wiki?
[11:01:20] <ToAruShiroiNeko>	 http://sd.wikipedia.org/w/index.php?title=%D8%AE%D8%A7%D8%B5:%D8%A7%DA%BB_%D8%B2%D9%85%D8%B1%D8%A7%D9%8A%D9%84_%D8%B9%DA%AA%D8%B3&limit=500&offset=0
[11:01:37] <ToAruShiroiNeko>	 is the site logo Wiki.jpg, Wiki.JPG, or Wiki.png?
[11:01:46] <ToAruShiroiNeko>	 I am guessing png but I want to avoid assumptions
[11:02:19] <ToAruShiroiNeko>	 its actually .jpg / .PNG / .png
[11:02:21] <p858snake|l>	 upload.wikimedia.org/wikipedia/sd/b/bc/Wiki.png
[11:02:37] <ToAruShiroiNeko>	 Wiki.png it is, thanks :)
[11:09:16] <jeremyb>	 that could use some transparency
[11:09:55] <jeremyb>	 ToAruShiroiNeko: https://bugzilla.wikimedia.org/36876
[11:11:02] <jeremyb>	 huh, i wonder how Snowolf got added to cc there
[11:11:30] <jeremyb>	 oh, he's in default cc
[11:11:35] <jeremyb>	 that should be made clearer
[11:15:10] <jeremyb>	 maybe ToAruShiroiNeko could at least ACK?
[11:30:34] <ToAruShiroiNeko>	 ACK
[11:30:38] <ToAruShiroiNeko>	 happy? :p
[11:30:55] <ToAruShiroiNeko>	 actually I wish these were better marked
[11:31:07] <ToAruShiroiNeko>	 would it be worth to file a bug for it?
[11:31:08] <jeremyb>	 elaborate?
[11:31:16] <ToAruShiroiNeko>	 if a file is the site logo it should have an automatic notice
[11:31:38] <jeremyb>	 can't you just edit the description page to say so?
[11:31:50] <ToAruShiroiNeko>	 not if the page is prtected as it typically is
[11:31:57] <jeremyb>	 i meant 36876 though
[11:32:08] <jeremyb>	 so, editprotected it then
[11:32:12] <ToAruShiroiNeko>	 I mean on file description pages
[11:32:20] <ToAruShiroiNeko>	 I dont have sysops access on any small wiki
[11:32:52] <ToAruShiroiNeko>	 The importance of wiki.png isnt obvious to local communities
[11:33:53] <jeremyb>	 anyway, the list is pretty straightforward https://gerrit.wikimedia.org/r/gitweb?p=operations/mediawiki-config.git;a=blob;f=wmf-config/InitialiseSettings.php;h=c5fedfc25195641f52edae36dc1164ae9b8c253d;hb=HEAD#l342
[11:34:16] <jeremyb>	 ToAruShiroiNeko: again, editprotected it then
[11:34:54] <ToAruShiroiNeko>	 I can't
[11:35:29] <ToAruShiroiNeko>	 I am not a sysop
[11:35:39] <ToAruShiroiNeko>	 we are talking about all wikis here
[11:35:57] <ToAruShiroiNeko>	 If I were a steward it would be over 600 edits
[14:15:18] <Quentinv57>	 Hello Reedy. I wonder if I can ask you if a specific account has registered an email address in his settings
[14:15:43] <Quentinv57>	 We're ask to rename the last user, so I prefer to be sure this field has been left empty, so there's no way to contact him at all
[15:20:55] <Betacommand>	 Quentinv57: PM me
[15:31:18] <logmsgbot>	 !log dzahn synchronized php/cache/interwiki.cdb  'Updating interwiki cache'
[15:31:21] <morebots>	 Logged the message, Master
[16:00:48] <StevenW>	 Hey folks: we're starting an office hours about Wikipedia Zero and other mobile work in #wikimedia-office, if you're interested. 
[16:42:23] <robla>	 on commons village pump: When making edits, I have started encountering error messages of the following type: "[7299ab2b] 2012-05-17 08:51:48: Fatal exception of type MWException". Looks like things are back to normal, though. — Cheers, JackLee –talk– 09:05, 17 May 2012 (UTC)
[16:44:06] <robla>	 oh, nm....I see the admin log
[18:08:04] <logmsgbot>	 !log aaron synchronized php-1.20wmf3/includes/filerepo  'deployed 103efda39dd57bc22898bd0e69932982c1cfd588'
[18:08:07] <morebots>	 Logged the message, Master
[18:13:11] <logmsgbot>	 !log aaron synchronized wmf-config/swift.php 
[18:13:14] <morebots>	 Logged the message, Master
[18:39:58] <logmsgbot>	 !log catrope synchronizing Wikimedia installation... : ArticleFeedbackv5 updates
[18:40:01] <morebots>	 Logged the message, Master
[19:10:56] <logmsgbot>	 sync done.
[19:11:20] <Reedy>	 31 minutes? :/
[19:19:15] <RoanKattouw>	 Reedy: Yeah. Things are hella slow with -F5
[19:19:47] <Reedy>	 What's been set to 5?
[19:36:44] <jeremyb>	 Reedy: forklimit?
[19:36:54] <Reedy>	 yes
[19:36:56] <Reedy>	 but hwat script
[19:37:00] <Reedy>	 I'd set numerous others to 30
[20:03:35] <logmsgbot>	 !log aaron synchronized wmf-config/swift.php  'Enabling new purge hook on testwikis again.'
[20:03:39] <morebots>	 Logged the message, Master
[20:09:57] <logmsgbot>	 !log aaron synchronized wmf-config/swift.php 
[20:10:00] <morebots>	 Logged the message, Master
[20:10:16] <logmsgbot>	 !log aaron synchronized wmf-config/CommonSettings.php 
[20:10:19] <morebots>	 Logged the message, Master
[20:25:39] <logmsgbot>	 !log aaron synchronized wmf-config/swift.php  'Enabled thumb copy hook for testwikis and mw.org'
[20:25:42] <morebots>	 Logged the message, Master
[20:34:33] <jeremyb>	 Reedy: wmf-puppet$ git grep -I -- -F5
[20:34:33] <jeremyb>	 files/misc/scripts/scap:        dsh -F5 -cM -g mediawiki-installation -o -oSetupTimeout=10 '/usr/bin/scap-1' || true
[20:40:52] <logmsgbot>	 !log aaron synchronized wmf-config/swift.php 
[20:40:55] <morebots>	 Logged the message, Master
[20:42:21] <AaronSchulz>	 wah wah :)
[20:44:30] <Reedy>	 I think 5 is rather over strict
[20:44:38] * Reedy  hands AaronSchulz a tissue

[20:44:52] <AaronSchulz>	 yeah, 30 forever!
[20:45:58] <Reedy>	 If -F30 is fine for sync-ing the l10nc cache files..
[20:56:13] <logmsgbot>	 !log aaron synchronized wmf-config/swift.php  '+itwiki'
[20:56:16] <morebots>	 Logged the message, Master
[20:56:45] <AaronSchulz>	 maplebed: I'll need to revert that
[20:57:20] <maplebed>	 grr... switching channels....
[20:57:22] <maplebed>	 how come?
[20:57:30] <maplebed>	 I mean how come you'll need to revert it?
[20:58:33] <logmsgbot>	 !log aaron synchronized wmf-config/swift.php  'revert change to itwiki'
[20:58:36] <morebots>	 Logged the message, Master
[21:09:22] <logmsgbot>	 !log aaron synchronized wmf-config/swift.php  '+commonswiki'
[21:09:25] <morebots>	 Logged the message, Master
[21:20:58] <logmsgbot>	 !log catrope synchronized php-1.20wmf2/extensions/ArticleFeedbackv5/ArticleFeedbackv5.php  'Deploy 24ddcdf507e615b1942147654ccde1bdc4ea4bfa'
[21:21:01] <morebots>	 Logged the message, Master
[21:21:10] <logmsgbot>	 !log catrope synchronized php-1.20wmf3/extensions/ArticleFeedbackv5/ArticleFeedbackv5.php  'Deploy 24ddcdf507e615b1942147654ccde1bdc4ea4bfa'
[21:21:13] <morebots>	 Logged the message, Master