[00:06:18] <Dereckson>	 andre__: do you have created a repository for Bugzilla or applied by hand the Wikimedia edits?
[00:11:40] <andre__>	 Dereckson, there is https://gerrit.wikimedia.org/r/gitweb?p=wikimedia%2Fbugzilla%2Fmodifications.git;a=summary
[00:11:46] <andre__>	 but it is NOT 100% what is on the server.
[00:12:06] <andre__>	 so I think the next step is to make the gerrit export the same as on the server.
[00:12:40] <andre__>	 and this is something where I have to ask mutante how this currently works, or what would make sense here.
[00:13:00] <andre__>	 e.g. we have applied the fix for https://bugzilla.wikimedia.org/show_bug.cgi?id=42695 on the server
[00:13:09] <andre__>	 but it's not in gerrit/git. and this feels wrong.
[00:20:15] <Dereckson>	 Okay, I cloned this repo. What the client directory is?
[00:20:58] <Dereckson>	 and I can work peacefully, attachment/createformcontents.html.tmpl isn't customized :)
[00:42:19] <K4-713>	 !log synchronized payments cluster to f2c33676270c
[00:42:27] <morebots>	 Logged the message, Master
[05:02:52] <Jasper_Deng_busy>	 Krenair: poke
[05:05:51] <jeremyb>	 Jasper_Deng_busy: no, it was so peaceful here!
[05:07:28] <jeremyb>	 @replag all
[05:07:30] <dbbot-wm>	 jeremyb: [s1] db63: 0s, db38: 0s, db32: 0s, db59: 0s, db60: 0s, db36: 0s; [s2] db54: 0s, db52: 0s, db53: 0s, db57: 0s; [s3] db34: 0s, db39: 0s, db64: 0s, db66: 0s
[05:07:31] <dbbot-wm>	 jeremyb: [s4] db31: 0s, db33: 0s, db51: 0s, db65: 0s; [s5] db45: 0s, db35: 0s, db44: 0s, db55: 0s; [s6] db47: 0s, db43: 0s, db46: 0s, db50: 0s; [s7] db37: 0s, db58: 0s, db68: 0s
[05:07:35] <jeremyb>	 @replag
[05:07:37] <dbbot-wm>	 jeremyb: No replag currently. See also "replag all".
[05:07:42] <jeremyb>	 danke dbbot-wm
[05:12:01] <Jasper_Deng_busy>	 yeah I think I broke something on mw.org
[05:12:15] <Jasper_Deng_busy>	 after I nuked 23 files, Special:Nuke/Ppsg-office still lists those files
[07:17:26] <Nemo_bis>	 Jasper_Deng_busy: did you file a bug or something? it's still like that
[07:17:33] <Jasper_Deng_busy>	 Nemo_bis: no
[07:17:38] * Jasper_Deng_busy  is going to bed

[07:21:47] <Nemo_bis>	 ok
[07:22:25] <Nemo_bis>	 !log job queue snapshot for bug 42614: en.wiki 285k still raising steadily, Commons 111k, fr.wiki 4M, pt.wiki 40k, other tops 5k at most
[07:22:34] <Nemo_bis>	 only pl ant pt improving
[07:22:38] <morebots>	 Logged the message, Master
[07:23:42] <shuaib_>	 Hi heres someone?
[07:24:32] <shuaib_>	 urdu wikipedia has witdh issues.
[07:27:56] <apergos>	 yeah I noticed that fr is still unhappy and actually the backlog is larger than yesterdya
[07:28:42] <Nemo_bis>	 shuaib_: what do you mean?
[07:28:52] <shuaib_>	 what should we do?
[07:29:15] <shuaib_>	 its right menu and logo have width issues.
[07:29:34] <shuaib_>	 broader than other wikis
[07:30:01] <Nemo_bis>	 ah, it's a Vector only thing
[07:31:27] <shuaib_>	 yes yes
[07:37:22] <vvv>	 What sort of Linux distro we ran back in 2005?
[07:39:57] <Nemo_bis>	 Shirik: could it be https://ur.wikipedia.org/w/index.php?title=Template:UR_SCRIPT&action=edit in the sitenotice?
[07:40:05] <Shirik>	 eh?
[07:40:19] <Nemo_bis>	 sorry, was for shuaib who just left
[08:01:14] <Nemo_bis>	 shuaib_: you left -> could it be https://ur.wikipedia.org/w/index.php?title=Template:UR_SCRIPT&action=edit in the sitenotice?
[08:01:51] <Nemo_bis>	 also, if you have problems with fonts etc. you should instal the UniversalLanguageSelector aka WebFonts+Narayam
[08:02:12] <shuaib_>	 should I delete it?
[08:02:57] <Nemo_bis>	 you could try and remove it from the sitenotice, no idea; I no nothing of HTML
[08:03:14] <Nemo_bis>	 https://www.mediawiki.org/wiki/Extension:WebFonts#Supported_languages Urdu is not supported yet, but if you find a free font you like it can be added
[08:03:43] <shuaib_>	 No No, only right menu and logo,
[08:04:43] <shuaib_>	 I added this template some days ago,
[08:05:32] <shuaib_>	 but this prblem remains since years.
[09:31:47] <Seddon>	 Nemo_bis, unless I am waking up in the middle of my sleep to send translation notifications.......... which would be pretty damn weird, the notification extension is broken
[09:32:09] <saper>	 Seddon: wrong timestamp?
[09:33:10] <Seddon>	 saper: people are getting multiple notifications. one guy I saw got 4 notifications spread over a period of days
[09:33:46] <saper>	 Seddon: do you have some links?
[09:33:53] <Seddon>	 yeah one sec
[09:34:11] <Platonides>	 Seddon, the "you get notifications with the wrong email content when someone reviews your translation" bug ?
[09:34:34] <Seddon>	 no, talk page
[09:34:36] <Seddon>	 http://meta.wikimedia.org/wiki/User_talk:Vladimir_Penov
[09:34:53] <Seddon>	 this guy have 4 versions of one notification, 3 of another and two of the most recent
[09:35:09] <Seddon>	 I checked my contributions and I apparently sent out two batches of notifications
[09:39:09] <Seddon>	 I wonder...........
[09:44:24] <saper>	 Seddon: https://meta.wikimedia.org/w/index.php?title=User_talk:Vladimir_Penov&diff=4751313&oldid=4748846 and https://meta.wikimedia.org/w/index.php?title=User_talk:Vladimir_Penov&diff=4754445&oldid=4751313 ?
[09:45:18] <Seddon>	 saper: Thats the latest instance of it yeah.... I couldn't have sent the second version cause at the time I was asleep
[09:45:52] <saper>	 byte count is also identical, module one or two digit day
[09:46:32] <Seddon>	 https://meta.wikimedia.org/w/index.php?title=Special%3ALog&type=notifytranslators&user=&page=&year=&month=-1&tagfilter=&hide_patrol_log=1
[09:46:46] <Seddon>	 only two requests here as well
[09:47:34] <saper>	 Seddon: can I quote you in the bug report?
[09:48:02] <Seddon>	 is it.... and maybe I am talking out of my arse..... but could it be in anyway related to the cause of the backlong..... jobs getting duplicated which would explain why the backlog exists but at the same time why old requests are getting queued up....
[09:48:27] <saper>	 might be, I looked at this code long time ago so I would have to dig again
[09:48:31] <Seddon>	 saper: yeah of course you can, I was gonna file one but if you fancy doing it that would be cool :)
[09:54:41] <Seddon>	 saper: can you add me to the cc list for the bug?
[10:07:27] <saper>	 Seddon: wikimedia or gmail?
[10:07:35] <Seddon>	 wikimedia :)
[10:09:45] <saper>	 !b 42715
[10:09:45] <wm-bot>	 https://bugzilla.wikimedia.org/show_bug.cgi?id=42715
[10:12:28] <Seddon>	 Best excuse eliminating user error: I was asleep :D
[10:14:59] <Seddon>	 saper: Ill bet money its related to the problems with the jobrunners we have been having
[10:15:49] <saper>	 yes
[10:15:53] <saper>	 probably
[10:15:54] <saper>	 but still
[10:20:05] <saper>	 Seddon: do you like that warm, cozy feeling after the bug report is filed? One feels like having solved 75% of the problem already.
[10:31:10] <Seddon>	 Saper: yep :) people know of it, are aware of it, and there is even a potential cause for the problem
[10:38:04] <DanielK_WMDE>	 saper: that's the warm feeling of it now being Someone Elses Problem ;)
[10:39:13] <Seddon>	 +1
[10:39:30] <Seddon>	 Its not entirely not my problem :P My job revolves around the use of the tool :P
[10:40:14] <Seddon>	 Its just damn lucky that the i18n fundraiser got moved to april.... I would not be being as calm and collected as I am had that not been the case :P
[11:30:57] <Jarry1250>	 Was AFTv5 -> dewiki yesterday its first non-enwiki deployment?
[12:37:30] <andre__>	 Jarry1250: yes, see "wmgUseArticleFeedbackv5" in https://noc.wikimedia.org/conf/InitialiseSettings.php.txt
[12:38:55] <Jarry1250>	 andre__: Ah yes, well done, you passed the test
[12:38:59] <Jarry1250>	 :P
[12:41:28] <Jarry1250>	 (also thanks :) )
[14:51:07] * jeremyb  waves at chrismcmahon

[14:51:28] <jeremyb>	 are you east coast? it's a bit early for SF people ;-)
[14:51:39] <jeremyb>	 chrismcmahon: i thought http://bugs.debian.org/695195 might interest you
[14:52:18] <chrismcmahon>	 hi jeremyb I'm Mountain, but I like to start early 
[14:52:30] <jeremyb>	 oh, right colorado
[14:52:34] <jeremyb>	 you and mgrover iirc
[14:54:02] <jeremyb>	 ITP==intent to package
[14:54:30] <chrismcmahon>	 jeremyb: if I read that right, there are a lot of tools that do that.  oldest one I know is http://httpunit.sourceforge.net/
[14:54:52] <jeremyb>	 chrismcmahon: yeah, idk. just looked relevant ;)
[15:00:03] * jeremyb  stabs the greylist

[15:54:33] <Alchimista>	 mediawiki on pt.wikipedia was upgraded yesterday?
[15:56:57] <jeremyb>	 Alchimista: see the !log ?
[15:57:29] <Alchimista>	 !log
[15:57:31] <Alchimista>	 ?
[15:57:55] <Alchimista>	 Ah, let me check it
[15:57:56] <jeremyb>	 err, don't do that
[15:58:17] <Alchimista>	 oops, sorry :s
[15:58:41] <Alchimista>	 jeremyb: isn't the command restricted to a usergroup? o.O
[15:58:51] <jeremyb>	 no
[15:59:04] <jeremyb>	 it's restricted socially by we'll ban you if you abuse
[15:59:49] <Alchimista>	 bah, when i rule on universe i'll abolish that rule :P
[16:01:41] <jeremyb>	 > ptwiki php-1.21wmf4 *
[16:01:49] <jeremyb>	 Alchimista: so it's still on the old version
[16:02:54] <Alchimista>	 jeremyb: some system messages are now in english, when they used to be on portugese
[16:03:08] <Alchimista>	 so something had to change :P
[16:03:36] <jeremyb>	 l10nupdate?
[16:03:46] <jeremyb>	 or just a deploy to multiple versions
[16:04:12] <Reedy>	 ptwiki isn't due to be upgraded for 3 hours or so
[16:05:00] <Reedy>	 !log THIS DOESN'T WORK IN HERE
[16:05:09] <morebots>	 Logged the message, Master
[16:05:09] <Reedy>	 l10nupdate says it has run... But I'm sure someone said somewhere earlier that it's broken. Maybe.
[16:05:26] * jeremyb  pats morebots

[16:05:36] * jeremyb  hands Reedy a cookie

[16:06:12] <jeremyb>	 note the bot doesn't say where it heard what it heard...
[16:06:13] <Alchimista>	 hum.. where are the messages for special:logs? the user right log is using the english version
[16:06:14] <jeremyb>	 http://identi.ca/notice/98284181
[16:07:09] <Reedy>	 o_0
[16:07:41] <Alchimista>	 Loool
[16:09:09] <Reedy>	 Thou shalt not speak of teh morebots
[16:16:10] <^demon>	 People still use identi.ca?
[16:16:18] <^demon>	 I thought that fad had kinda died.
[16:17:45] <jeremyb>	 ^demon: it's alive and well. sumanah and siebrand and lydia at least use it. surely there's more i'm fogetting
[16:17:49] <jeremyb>	 forgetting*
[16:18:02] <^demon>	 I stopped using it because nobody else was using it.
[16:18:09] <^demon>	 And the spam had gotten *really really* bad.
[16:18:17] <jeremyb>	 spams not so bad now i think
[16:18:27] <jeremyb>	 but maybe that's just my experience
[16:18:28] <siebrand>	 nope, not that much spam.
[16:18:41] <siebrand>	 But also not really something I like.
[16:18:52] <siebrand>	 I use it because it's easy to hit the button in tweetdeck.
[16:18:56] <siebrand>	 otherwise, I wouldn't use it.
[16:56:15] <andre__>	 ^demon, Qaiku died. Identi.ca isn't.
[18:25:26] <Nemo_bis>	 do the new HTML bugmails make "bug X" in comments/dependencies clickable? that's the only thing I miss in the plain text mails
[18:36:08] <Krenair>	 Nemo_bis, seems to, yes
[18:36:15] <Nemo_bis>	 hmm
[18:36:42] <Krenair>	 Well, in comments. Didn't check dependencies
[18:36:46] <Nemo_bis>	 let's see if future versions will remove a bit of crap around it
[18:36:48] <Nemo_bis>	 ok
[18:37:20] <Nemo_bis>	 it might be easier to install that Thunderbird plugin which makes them clickable
[18:40:37] <Krenair>	 Nemo_bis, what, is it not working for now?
[18:40:41] <Krenair>	 you*
[18:40:54] <Nemo_bis>	 Krenair: I don't like the HTML version
[18:41:15] <Nemo_bis>	 too much stuff I don't need, have to scroll for km, ugly table
[19:28:46] <sumanah>	 andre__: how goes the deployment?
[19:29:02] <andre__>	 I'm watching de, fr and cs Village Pumps. I haven't seen a mob with torches yet.
[19:29:35] * chrismcmahon  looks around for a lighter

[19:31:25] <Nemo_bis>	 sumanah: did someone warn people about the new account creation welcome message?
[19:31:31] <Nemo_bis>	 spagewmf: ^
[19:32:05] <andre__>	 huh? context?
[19:32:20] <Nemo_bis>	 https://www.mediawiki.org/wiki/User:S_Page_%28WMF%29 etc.
[19:32:32] <Nemo_bis>	 "Interesting. Yeah, I clearly need to set up a global notification for the
[19:32:35] <Nemo_bis>	 relevant projects. :)"
[19:32:37] <Nemo_bis>	 http://lists.wikimedia.org/pipermail/wikitech-l/2012-December/064804.html
[19:32:42] * Nemo_bis  didn't see anything

[19:32:50] <sumanah>	 Nemo_bis: hi there. I believe Steven Walling did some notifications on wikimedia-l? I could be wrong
[19:33:31] <sumanah>	 Nemo_bis: I'm sorry, I have to head to lunch, feel free to ask on wikimedia-l?
[19:33:32] <Nemo_bis>	 sumanah: I don't see anything and it wouldn't be a valid notification
[19:33:39] <sumanah>	 or on wikitech-ambassadors
[19:33:46] <Nemo_bis>	 no, I guess I'lll just do the notification myself
[19:34:00] <Nemo_bis>	 stealing spagewmf's page
[19:34:17] <sumanah>	 sorry. back in 90 min or so
[19:38:21] <^demon|away>	 andre__: "This result was limited to 500 bugs. See all search results for this query." :(
[19:39:18] <andre__>	 ^demon|away: but your goal is just one click away, isn't it?
[19:39:46] <^demon|away>	 After I scroll all the way to the bottom, see that my results were truncated, and then click.
[19:40:45] <andre__>	 Dunno. Defaults.
[19:40:51] <hasharEating>	 !g I6a35774ae7799a237866cfa6ef43b14f7c2c7b6a
[19:40:51] <wm-bot>	 https://gerrit.wikimedia.org/r/#q,I6a35774ae7799a237866cfa6ef43b14f7c2c7b6a,n,z
[19:41:15] <andre__>	 ^demon|away, I can imagine it makes sense if you accidentially query for a result with 35000 bugs and you have to kill your badly coded browser.
[19:41:35] * andre__  wonders if Mozilla Bugzilla developers use Mozilla Firefox ;)

[19:41:51] <^demon|away>	 andre__: I have a couple of saved searches that return 1000+ results that I've been using for years. I'm going to find this setting and investigate.
[19:42:03] <andre__>	 hmm. Yeah, I see
[19:42:20] <andre__>	 I have no idea if it can be switched off
[19:42:26] <andre__>	 sorry for the hassle
[19:43:56] <^demon|away>	 I'll raise the limit. Our usual standard is 5000 for most users, but I doubt we can configure it between anon/logged in.
[19:44:56] <^demon|away>	 Ah, there's already max_search_results, which is 10k. So I don't think we have to worry about the mythical 30k+ result search.
[19:47:57] <p858snake|l>	 i think i've hit it once accidently
[19:48:32] <p858snake|l>	 cant remember if it was the mw bzor not
[19:48:59] <^demon|away>	 max_search_results is mainly to keep the server from crapping out before it can complete the search.
[19:50:04] <^demon|away>	 andre__: Did we discuss whether we're going to default to HTML e-mails, or put the default back to text how it was before?
[19:50:39] <andre__>	 ^demon|away, I was surprised it's HTML by default. My idea was: If somebody is annoyed by it, somebody will start a discussion. ;)
[19:50:58] <^demon|away>	 We've had more than one person go "omg what happened to the e-mails?"
[19:51:53] <andre__>	 I see... Anybody is welcome to post a followup to my "OMG, BZ4.2" message on wikitech-l. Obviously I don't have any strong opinion on it.
[19:52:59] <andre__>	 Whoever wants to discuss HTML vs. Plaintext in bugmail can do so. I'll wait until there's a decision, and then I can change any default to any non-default.
[19:53:46] <^demon|away>	 I started the thread.
[19:54:21] <andre__>	 Thanks. Hope there won't be too much bikeshedding. ;)
[19:58:02] <multichill>	 andre__: How good are you at importing sourcforge bugs in Bugzilla? ;-)
[20:00:02] <andre__>	 multichill, show me a script and I might try it.
[20:02:01] <multichill>	 Hehe, we still have all the Pywikipedia bugs there. We should probably move it some day to bugzilla
[20:03:17] <MaxSem>	 Notice:  Undefined variable: wmgArticleFeedbackv5CTABuckets in /home/wikipedia/common/wmf-config/CommonSettings.php on line 2260
[20:03:22] <andre__>	 multichill, Pretty much depends on the amount. There might be scripts out there, but I've never tried
[20:03:37] <andre__>	 but I'd be in for that, on "some day" :)
[20:04:08] <MaxSem>	 matthiasmullie, ^^^
[20:04:36] <Jarry1250>	 brion: Hi. Two things really, first that I'd really appreciate a review for https://gerrit.wikimedia.org/r/#/c/25838/ -- you commented on the bug that motivated that patch (the test fails are because there's no librsvg on gallium); and secondly, I was at the svg-edit community call, pretty interesting stuff there
[20:04:51] <multichill>	 Let's see 185 open bugs, 96 open feature requests and 23 open patches, 
[20:05:10] <brion>	 Jarry1250: ah great, i missed it cause of my jury duty :P. what's the fun news?
[20:07:08] <Jarry1250>	 brion: Well basically it was just a three hour run-though of current svg-edit use cases, many had hacked better UIs which they'd be feeding back "soon". Well, fingers crossed anyway.
[20:07:53] <brion>	 nice
[20:08:12] <brion>	 Jarry1250: main thing i was near-term is getting them set up on translatewiki or something else. was there any localization discussion?
[20:09:10] <Jarry1250>	 brion: Not much, I have to say, though there were a few devs who doubled up as translators on the call, so it seems - and you probably know more about this than I do - that they have a pretty regular setup already, which bodes well.
[20:09:34] <brion>	 good news. i'll get in touch on the mailing list when time permits :)
[20:09:51] <andre__>	 multichill, hmm that's a lot
[20:10:30] <Jarry1250>	 brion: Yes. I mean, the short term negative is the evident frustration some reusers have had trying to reskin svg-edit; basically it's very hacky at the moment.
[20:11:43] <brion>	 yeah, i don't care about skinning it myself though, maybe make some style tweaks :)
[20:11:54] <brion>	 i just want it working, embeddable, and with good localizations :D
[20:12:22] <brion>	 Jarry1250: noticed a minor issue with some of the parameter passing, otherwise looks ok. i'll review it again with actual testing later :)
[20:12:49] <brion>	 bbiab
[20:13:03] <Jarry1250>	 brion: Thanks for the review :)  I was thinking more in terms of hiding some controls (apparently even that is pretty difficult); plus, believe me, some of the reusers had made it look *fantastic* by comparison
[20:13:59] <Jarry1250>	 e.g. http://method.ac/
[20:15:04] <matthiasmullie>	 MaxSem: thanks; that's on testwiki? - https://gerrit.wikimedia.org/r/#/c/37058/ should fix that
[20:15:28] <MaxSem>	 matthiasmullie, thanks!
[20:19:33] <multichill>	 andre__: It's quite an active with over 10.000 commits (after we switched from cvs)
[20:19:46] <andre__>	 whou. nice.
[20:42:16] <Dereckson>	 Hello Isarra :)
[20:44:16] <chrismcmahon>	 Reedy: are you doing today's deploy?  UW is busted for IE7 (at least) on test2 just now. https://bugzilla.wikimedia.org/show_bug.cgi?id=42736 (cc andre__)
[20:44:35] <chrismcmahon>	 checking IE9
[20:46:45] <Reedy>	 Who broke stuff?
[20:46:46] <Reedy>	 PHP Notice:  Undefined variable: wmgArticleFeedbackv5CTABuckets in /home/wikipedia/common/wmf-config/CommonSettings.php on line 2260
[20:48:33] <^demon|away>	 Reedy: https://gerrit.wikimedia.org/r/#/c/37058/ might fix it?
[20:48:55] <Reedy>	 I just commented the line out onf fenari
[20:50:38] * Isarra  hugs Dereckson.

[22:14:22] <YairRand_>	 Question: Is there any way at all of having community-defined javascript in the head?
[22:15:42] <Krenair>	 YairRand_, you mean like through common.js/the skin js files?
[22:15:54] <YairRand_>	 yes
[22:31:15] <Nemo_bis>	 http://ganglia.wikimedia.org/latest/graph.php?r=month&z=large&c=Miscellaneous+pmtpa&h=spence.wikimedia.org&v=326200&m=enwiki_JobQueue_length&jr=&js=
[22:41:54] <Krenair>	 AaronSchulz, are you aware of that? ^
[22:42:04] <AaronSchulz>	 yes
[22:42:22] <jeremyb>	 YairRand_: errr, can't we have that already?
[22:42:22] <MatmaRex>	 hello everyone
[22:42:31] <Krenair>	 hey MatmaRex 
[22:42:37] <MatmaRex>	 pl.wiki is having issues with the new h2/h3 headings as well :(
[22:42:43] <MatmaRex>	 different ones than those on enwiki, though
[22:42:48] <jeremyb>	 wunderbar
[22:42:52] <MatmaRex>	 and it's a RL issue, then don't show up with debug=true
[22:43:00] <MatmaRex>	 e.g. https://pl.wikipedia.org/wiki/Wikipedia:Kawiarenka/Kwestie_techniczne , logged in
[22:43:20] <MatmaRex>	 at the bottom of the page, the h2 saying "Menu nawigacyjne" is visible
[22:43:26] <YairRand_>	 jeremyb: what?
[22:44:16] <jeremyb>	 05 22:14:22 < YairRand_> Question: Is there any way at all of having community-defined javascript in the head?
[22:45:17] <YairRand_>	 jeremyb: common.js loads at the bottom of the body
[22:45:20] <MatmaRex>	 could somebody possibly go and touch the CSS files? this fixed the issue the last time
[22:45:31] <MatmaRex>	 (when it was happening on enwiki)
[22:46:06] <jeremyb>	 YairRand_: and?
[22:46:17] <jeremyb>	 kaldari: MatmaRex ^
[22:47:27] <YairRand_>	 jeremyb: it doesn't load in the head. nor does skin.js, afaik
[22:47:36] <jeremyb>	 YairRand_: and?
[22:47:59] <YairRand_>	 jeremyb: I am confused...
[22:48:07] <jeremyb>	 [[mediawikiwki:Special:Nuke/Ppsg-office]] is still out of date or something
[22:48:11] <jeremyb>	 YairRand_: why is that a problem?
[22:48:14] <jeremyb>	 Jasper_Deng_away: ^
[22:48:57] <kaldari>	 what's the exact problem on pl.wiki? Since you say it's different than the one that occured on en.wiki?
[22:49:19] <kaldari>	 I don't see anything obvious there mysel
[22:49:21] <kaldari>	 myself
[22:49:32] <YairRand_>	 jeremyb: you're asking why is it a problem that there isn't any way (?) to have any community-defined js in the head?
[22:49:36] <MatmaRex>	 kaldari: when logged in, there is this huge h3 heading visible at the bottom of some pages
[22:49:40] <MatmaRex>	 kaldari: e.g. https://pl.wikipedia.org/wiki/Wikipedia:Kawiarenka/Kwestie_techniczne#Menu_nawigacyjne
[22:49:46] <jeremyb>	 YairRand_: just tell us what you're trying to do?
[22:49:47] <MatmaRex>	 which incidentally is out technical village pump
[22:49:55] <MatmaRex>	 huge h2 heading*
[22:50:01] <jeremyb>	 anyway, bbl
[22:50:17] <MatmaRex>	 kaldari: it doesn't seem to happen when you're logged out
[22:50:38] <MatmaRex>	 also, see the screenshot links in that section, people reporting some issues on monobook
[22:51:31] <kaldari>	 I see, that looks like the same bug
[22:51:44] <MatmaRex>	 yes, and seems like a RL issue, since it's okay with debug=true
[22:51:59] <MatmaRex>	 interestingly, i don't see this on any other wiki i tried
[22:52:10] <Krenair>	 hoo, you want me to put something in the release notes for this?
[22:52:14] <kaldari>	 seems there is a server caching problem, as we even pre-emptively deployed the new CSS a day before the new code
[22:52:23] <YairRand_>	 ah, I'm trying to implement my "tabbed languages" gadget on wiktionary without enormous delays before the thing runs, which includes adding some conditional css before the body starts loading, as well as probably some other stuff that needs to run early if possible
[22:53:00] <MatmaRex>	 kaldari: yeah, i saw that, great idea, and thanks
[22:53:03] <hoo>	 Krenair: Sounds sane, yes... and maybe have a look at the En and Qqq description for the userrights-interwiki right
[22:53:18] <Krenair>	 ugh
[22:53:28] <kaldari>	 chrismcmahon: just to make sure you stay busy today: pl.wiki is reporting the 42452 bug
[22:53:40] <kaldari>	 :)
[22:53:46] <kaldari>	 I mean :(
[22:53:59] <kaldari>	 http://iv.pl/images/90157415975042120178.jpg
[22:54:08] <chrismcmahon>	 oh yay.  I was hoping to get some code checked in today, but that's starting to look unlikely. 
[22:54:38] <MatmaRex>	 kaldari: it's pretty weird, since myself I only see the misplaced h2 heading
[22:54:43] <MatmaRex>	 the h3 are styles correctly
[22:54:49] <MatmaRex>	 h3s are styled*
[22:55:04] <kaldari>	 yes, it seems to be inconsistant
[22:55:15] <kaldari>	 probably depending on what squid server you're hitting
[22:55:28] <chrismcmahon>	 I'm not seeing it either in my Chrome
[22:55:35] <kaldari>	 I don't see it either myself
[22:55:43] <Krenair>	 hoo, btw, I have another change which should fix up some other aspects of the cross-wiki rights UI
[22:56:47] <kaldari>	 chrismcmahon: from the description though it sounds identical: formatting broken for logged in user, works fine with debug=true.
[22:57:55] <hoo>	 Krenair: Feel free to CC me, though I don't have tons of time atm
[22:58:05] <Krenair>	 It's ok
[22:58:06] <YairRand_>	 oy, the headers everywhere bug again? why didn't anyone revert the html change before it was deployed and add it to the next version?
[22:58:13] <kaldari>	 MatmaRex: the H2 might be a local CSS issue due to the HTML changes
[22:58:36] <MatmaRex>	 kaldari: i checked local CSS immediately when the change was merged
[22:58:42] <MatmaRex>	 (i'm a sysop at pl.wiki)
[22:58:55] <Krenair>	 I don't intend to put up anything new user rights-related until the log fix is merged
[22:59:03] <MatmaRex>	 also, well, it works with debug=true
[22:59:05] <kaldari>	 I'm not seeing the H2 issue myself. is it reliably reproducable?
[22:59:43] <MatmaRex>	 for me, yes, but not on every page
[23:00:07] * MatmaRex  is digging

[23:00:51] <kaldari>	 do you have a URL that it always happens for you on?
[23:02:08] <MatmaRex>	 yes, here it always happens: https://pl.wikipedia.org/wiki/Wikipedia:Kawiarenka/Kwestie_techniczne
[23:02:13] <MatmaRex>	 and e.g. here it never does: https://pl.wikipedia.org/wiki/Carlo_Ciattini
[23:02:17] <MatmaRex>	 and here are the URLs of the relevant load.php calls:
[23:02:24] <MatmaRex>	 https://bits.wikimedia.org/pl.wikipedia.org/load.php?debug=false&lang=pl&modules=ext.flaggedRevs.basic%7Cext.gadget.AjaxQuickDelete%2CDirect-link-to-Commons%2CGolabPocztowy%2CHotCat%2CReferenceTooltips%2Cdelete%2CdisFixer%2Cedit-buttons%2Cedit-first-section%2Cedit-summary-warning%2Cenhanced-search%2Cenhanced-upload%2Cfeatured-articles-links%2Cgeonotice%2Cheading-icons%2Cmap-toggler%2Cmaps%2Cmark-disambigs%2Cmark-redirs%2Cmodify-
[23:02:24] <MatmaRex>	 section-style%2Coldreviewedpages%2Cpurge-tab%2CrefToolbar%2Crevisiondelete%2Csearchbox%2Csmall-references%2Cwikibugs%2Cwikidebug%2Cwp_sk%7Cext.wikihiero%7Cmediawiki.legacy.commonPrint%2Cshared%7Cmw.PopUpMediaTransform%7Cskins.vector&only=styles&skin=vector&* - good
[23:02:26] <kaldari>	 MatmaRex: can you let people on pl.wiki know that this issue is being tracked at bugzilla bug 42452?
[23:02:28] <Krenair>	 (Which is https://gerrit.wikimedia.org/r/#/c/33878/ by the way. It'd be nice if someone merged that)
[23:02:30] <MatmaRex>	 https://bits.wikimedia.org/pl.wikipedia.org/load.php?debug=false&lang=pl&modules=ext.gadget.AjaxQuickDelete%2CDirect-link-to-Commons%2CGolabPocztowy%2CHotCat%2CReferenceTooltips%2Cdelete%2CdisFixer%2Cedit-buttons%2Cedit-first-section%2Cedit-summary-warning%2Cenhanced-search%2Cenhanced-upload%2Cfeatured-articles-links%2Cgeonotice%2Cheading-icons%2Cmap-toggler%2Cmaps%2Cmark-disambigs%2Cmark-redirs%2Cmodify-section-style%2Coldrevie
[23:02:30] <MatmaRex>	 wedpages%2Cpurge-tab%2CrefToolbar%2Crevisiondelete%2Csearchbox%2Csmall-references%2Cwikibugs%2Cwikidebug%2Cwp_sk%7Cext.wikihiero%7Cmediawiki.legacy.commonPrint%2Cshared%7Cmw.PopUpMediaTransform%7Cskins.vector&only=styles&skin=vector&* - bad
[23:02:33] <MatmaRex>	 arghhhhh
[23:03:26] <MatmaRex>	 kaldari: http://pastebin.com/Q9akK1v6
[23:03:47] <chrismcmahon>	 MatmaRex: fwiw, https://pl.wikipedia.org/wiki/Wikipedia:Kawiarenka/Kwestie_techniczne looks fine for me, logged in, with Chrome
[23:03:47] <MatmaRex>	 URLs of relevant load.php calls, the one serving good and the one serving bad css
[23:04:47] <chrismcmahon>	 aha
[23:05:41] <chrismcmahon>	 something to do with flaggedRevs then?  
[23:05:47] * chrismcmahon  is learning... 

[23:06:17] <MatmaRex>	 possible
[23:06:58] <kaldari>	 I get the updated CSS for both of those URLs
[23:07:33] <kaldari>	 let's compare output on the bad URL...
[23:07:42] <MatmaRex>	 kaldari: i just refreshed them again and got correct CSS
[23:07:53] <MatmaRex>	 the cache key part changed on the "bad" one
[23:08:03] <MatmaRex>	 but i'm afraid i didn't save the old one
[23:08:09] <kaldari>	 that's OK
[23:08:30] <kaldari>	 I can guess what the differences were
[23:08:44] <MatmaRex>	 did you do anything, or did it magically fix itself?
[23:08:50] <kaldari>	 magic
[23:09:03] <kaldari>	 although I suspect it isn't fixed for everyone
[23:11:33] <kaldari>	 chrismcmahon: those CSS files have 5 minute cache expiry on the client-side (thus the "5 minutes of doom"), so it has to be a server-side cache issue
[23:11:56] <chrismcmahon>	 ok
[23:12:00] <chrismcmahon>	 understood
[23:12:57] <kaldari>	 This is outside my realm of knowledge, but we might want to escalate to Ops to take a look into this problem
[23:13:42] <kaldari>	 it sucks it's so difficult to reproduce though
[23:14:09] <kaldari>	 well at least reproduce reliably
[23:18:19] <kaldari>	 chrismcmahon: do you think I should bump the priority on this bug back to Highest?
[23:18:44] <kaldari>	 hmm
[23:18:55] <kaldari>	 chrismcmahon: do you think I should bump the priority on this bug back to Highest?
[23:19:28] <chrismcmahon>	 kaldari: I'm not sure.  my first reaction is no, since it seems to settle over time. 
[23:19:56] <MatmaRex>	 kaldari: it's past midnight in poland now, so i say let's way till morning ;)
[23:20:03] <MatmaRex>	 kaldari: i've seen no other wiki report this now
[23:20:30] <MatmaRex>	 not sure about the priority, but at least for a few hours now the severity would be 'minor' ;)
[23:22:47] <kaldari>	 Personally, I'm worried the underlying issue is going to cause a major breakage at some future deployment, even if it does fade out on it's own
[23:24:57] <MatmaRex>	 yeah, to me it looks like my broken code highlighted something weird deeper in the structure
[23:25:34] <MatmaRex>	 thanks for the help and responsiveness, guys :)
[23:26:00] <MatmaRex>	 i'm off to sleep, hoping this will fix itself by morning :)
[23:26:34] <kaldari>	 MatmaRex: Thanks for translating for us!
[23:44:36] <andre__>	 kaldari: there are folks in the forums for who bypassing the browser cache and adding ?action=purge to the URL still makes them see huge strings because of the CSS changes. What do I recommend to them?
[23:44:41] <andre__>	 (in case you have an idea)
[23:45:37] <kaldari>	 I can try touching and syncing the files again, but I'm leaning towards this being a problem that has to be solved by Ops
[23:46:24] <kaldari>	 I wish I was able to reproduce this problem myself
[23:46:55] <kaldari>	 andre__: the best I can say is that the problem will probably go away on it's own within a day or so
[23:47:01] <andre__>	 kaldari, there is one user in https://de.wikipedia.org/wiki/Wikipedia:Fragen_zur_Wikipedia#Navigationsmen.C3.BC at least (German)... I just wonder what to say. Or what other info that user could provide to help track this down
[23:47:14] <andre__>	 kaldari, because of cache syncs?
[23:47:24] <andre__>	 in that case I can ask him/her to wait a day and try again, sure :)
[23:47:29] <kaldari>	 the cache headers on the bits files would be most useful
[23:47:40] <kaldari>	 but that's a bit technical for more people
[23:47:48] <kaldari>	 more=most
[23:48:44] <andre__>	 oh well, if you can come up with instructions (and if that doesn't take too long to write them) somebody could give it a try
[23:48:58] <andre__>	 don't want to waste your time though, so maybe let's wait a day and see who can still reproduce the problem
[23:57:01] <kaldari>	 in a meeting...