[00:04:58] OrenBochman: hi, how are you doing? [00:05:30] i'm ok [00:05:34] how are you ? [00:05:57] I'm okay - glad the storm has passed here in NYC [00:06:12] ;-) [00:06:25] I'm glad u got power! [00:08:37] Thanks! [00:08:48] ori-l: I laughed at your line about a choice of UI disasters [00:09:04] anyhow I should be getting a new machine soon [00:09:15] oh, nice [00:10:36] sumanah: i'm one of those people who pushes elevator buttons multiple times when i'm in a rush, as though that makes the elevator faster. i think eclipse might serve the same purpose for me. you can't turn it into a nice environment, but you have lots of configuration controls and knobs to channel frustration into. [00:10:43] HA [00:11:07] * sumanah considers the multiple meanings of the verb "tweaking" [00:11:10] err eclipse is hackable [00:11:24] ori-l: little topic switch: could the event logging stuff have had an effect on the job queue? [00:11:47] here's the job queue graph: https://gdash.wikimedia.org/dashboards/jobq/deploys . look at the second to last graph on this page [00:12:04] robla: at the risk of hubris, no [00:12:08] job handling fell off a cliff right around the time THM and the Event logging code went out [00:12:27] nothing's using it to log events and all the php code does is declare the JS bits as an RL module [00:12:38] I suspect it's probably TMH-related, but I figured I better ask [00:13:42] it's probably a bad sign that i'm the go-to guy when mysterious bugs crop up [00:13:56] but really, no -- i can't see any point of connection between the two [00:14:41] ori-l: well, the problem starting showing about 3 minutes after the event logging deployment. However, it happened 1 minute after the second of two TMH deployments [00:16:23] so...not entirely grasping at straws :) [00:17:18] i'm tempting the furies by rejecting this strenuously, but i honestly can't come up with even an implausible story about how the two are related. it's possible that some other aspect of the deployment triggered it, but i can't see how the eventlogging code would be related. do you have a hunch? [00:19:47] I think Aaron and Asher are discussing in #wikimedia-operations now [00:20:56] robla: what we're discussing is the new jobqueue implementation, which needs some fixing [00:21:08] but its only live on wikidatawiki and test/test2wikis [00:21:15] yeah, just trying to catch up on the backlog [00:22:39] robla: just catching up here.. are you concerned about the drop in overall job activity based on the graph or on user reports? [00:23:16] binasher: the drop in activity combined with a creeping backlog on enwiki [00:23:23] http://ganglia.wikimedia.org/latest/graph_all_periods.php?c=Miscellaneous%20pmtpa&h=spence.wikimedia.org&v=506&m=enwiki_JobQueue_length [00:23:48] that has usually been the telltale sign that the job runners aren't running jobs [00:23:48] robla: how do the job runners handle multiple mediawiki versions? [00:24:22] well, now that you mention it, possibly quite poorly [00:24:44] min(job_timestamp) on enwiki is 20121030002259 [00:24:46] it may rely on the previously true fact that the job runners didn't change much [00:25:11] when did 1.21wmf3 go out? [00:25:19] AaronSchulz: ^^ [00:25:27] a day or so earlier [00:25:35] so I suppose that's probably not likely [00:25:44] (not the likely cause, that is) [00:27:11] Aaron|home: ^^ [00:28:33] monday [00:29:21] binasher: Oct 29 - 19:36 logmsgbot_: reedy rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki and mediawikiwiki to 1.21wmf3 [00:29:48] 15:41 logmsgbot_: reedy rebuilt wikiversions.cdb and synchronized wikiversions files: test2wiki to 1.21wmf3 [00:29:48] 15:40 logmsgbot_: reedy synchronized php-1.21wmf3 'Initial file sync-out' [00:32:49] am i officially not a witch? i have a giant code review to complete [00:33:28] ori-l: not officially, but we're postponing the drowning test [00:33:43] :) [00:33:43] :) [00:34:41] ori-l: you really need to stop writing so much php code [00:36:35] you joke, but those ten-odd lines are ten more than i would have it [00:37:25] Copy paste it all into MediaWiki:Common.js [00:47:19] Aaron|home: I think, based on chrismcmahon's comments, that we're probably going to need to postpone the TMH deployment, even if j^'s fix is deployed and confirmed to fix the thumb problem [00:48:47] unfortunately, the only viable time available is right during the wikidata sync up [00:49:02] (without postponing until next week) [00:50:10] ah hah [00:50:28] binasher: hm? [00:50:38] enwiki jobs are running, but only enotifNotify jobs [00:51:02] most of what's in the queue are refreshLinks2 jobs [00:51:36] this was the last time one of those were started: [00:51:36] 2012-10-30 16:38:06 fenari enwiki: refreshLinks2 Wikipedia:Administrator_intervention_against_vandalism/TB2 [00:51:55] it never finsihed [00:52:04] everything at the start is also for Wikipedia:Administrator_intervention_against_vandalism [00:52:09] note that job was started from fenari [00:52:20] Most likely me, I think [00:53:46] So all teh job runners decided to stop doing anything that isn't enotif jobs at midnight? [00:53:54] oh no, my bad [00:53:59] 2012-10-31 00:40:49 mw9 enwiki: enotifNotify Wikipedia:Administrator_intervention_against_vandalism/TB2 editor=HBC [00:54:33] hexmode: i think you misunderstood my email.. [00:54:55] oh, look, there I am ;) [00:55:09] ori-l: completely possible [00:55:15] sorry? [00:55:28] i have no special love for eclipse; i suggested it precisely because it works with gerrit. gerrit is where your reviews end up; they're viewable / editable from the web interface. [00:55:38] np! [00:56:09] ori-l: I only skimmed and didn't see thta you said that. [00:56:22] Reedy: oh, that was enotifNotify for that vandalism thingy.. yeah, no enwiki refreshLinks2 jobs have run since 2012-10-30 16:38:06 fenari enwiki: refreshLinks2 Wikipedia:Administrator_intervention_against_vandalism/TB2 table=templatelinks [00:56:52] which I guess is why the first job in the enwiki queue is timestamped about 00:30 [01:07:50] ahh [01:10:23] no wiki at all has run refreshLinks2 jobs from an actual jobrunner since 2012-10-30 00:33:23 [01:16:39] htmlCacheUpdate is broken too [01:17:23] the job runners make no attempt at all to run any of these [01:17:40] so the "default queue" jobs are broke but the priority ones work? [01:18:23] * binasher stares at TimedMediaHandler [01:19:57] I guess we could disable TMH for a bit... [01:20:01] and then revert it back to the start of time [01:21:16] the first part is at least worth trying now :) [01:21:27] and on that note, i need to take off [01:22:10] let me know somehow if that gets the jobs jobbing [01:26:41] Looks like it's still only doing enotifNotify jobs... [01:48:06] XMLHttpRequest cannot load http://meta.wikimedia.org/wiki/Special:RecordImpression?banner=2012EditorSu…rvey2012&userlang=en&db=wikidatawiki&sitename=Wikidata&country=GB&bucket=1. Origin http://www.wikidata.org is not allowed by Access-Control-Allow-Origin. [01:48:30] Reedy: i beat you by several minutes :P [01:48:45] proudest moment of my life [01:48:49] Say who where what now? [01:49:00] i want to thank my parents, .. [01:49:33] on #wikimedia-fundraising. using document.createElement('img').src = "http://..." works. [01:50:06] I did not see it, ergo there is no proof. [01:50:07] * Reedy grins [01:51:04] * ori-l shakes fist. [01:51:24] And on HTTPS it gives Uncaught TypeError: Cannot read property 'name' of undefined [01:51:59] I'll let you make people fix it then ;) [01:52:17] there's an old bugzilla ticket to send CORS headers [01:52:50] as a more general solution to requests across wmf properties [01:56:21] * robla reads backlog after learning that TMH was disabled... [01:57:36] Reedy: TMH doesn't seem to be the culprit based on my read of things, and we really need to have it in production [01:58:38] https://gdash.wikimedia.org/dashboards/jobq/ [01:58:48] We've got a lot more jobs suddently queued.. :/ [01:59:00] I'll re-enable it [02:01:01] Reedy: hrm....well....let's hold off a little bit I guess [02:01:21] said 1 second before it completed... [02:01:22] lol [02:01:35] Reedy: well, I'm waffling anyway [02:01:39] it was off nearly 40 minutes [02:01:51] yeah, that's what occurred to me right after I typed that [02:02:13] we're probably seeing a normal enotif spike [02:02:52] 750 is still low by normal standards [02:07:15] Reedy: go ahead and get some sleep. TimStarling: we might need you to poke at this for a little bit [02:08:10] gotta get out of the office myself in a few minutes, but I'll get back online later [11:30:01] so spent the morning trying to cleanup our newParserTests [11:30:11] that is a real mess and I give up :-] [11:30:18] too manyh hacks [11:30:56] <^demon> Been there. Tried that. [11:31:13] might just rewrite it from scratch [11:31:54] anyway I found out it setup a whole environment before each tests [11:31:54] and delete it after [11:32:08] including clearing any caches / setup a filerepo etc ... [11:32:08] definitely slow :( [11:36:37] hi hashar, ^demon [11:38:16] <^demon> Hey DanielK_WMDE_ [12:25:54] ^demon: does the Gerrit debian packages contains the openstack patch ? [12:26:01] or did you install a new war manually ? [12:26:58] <^demon> Our last two installs have been custom wars, not from debian (which is why we swapped it for ensure => present instead of pinning the version) [12:27:07] <^demon> All built from our stable-2.4-wmf branch [12:27:25] I thought we had a Gerrit package [12:27:40] any idea where I can get the production .war from? [12:27:50] <^demon> We do, but it does practically nothing other than create the gerrit2 user. [12:28:08] <^demon> I had a copy on noc. Lemme stash it there again for you. [12:30:28] <^demon> hashar: http://noc.wikimedia.org/~demon/gerrit-2.4.2-2-ge9a1970.war [12:31:35] <^demon> hashar: If you're ever interested in building our custom war, you can clone gerrit.wm.o/operations/gerrit -b stable-2.4-wmf && mvn package -Dgerrit.include-documentation=1 -Dgwt.style=pretty [12:32:00] ^demon: is that on wikitech ? ;-] [12:32:04] Hmm. Changeset 16872 depends on another changeset that still has issues, and "Gerrit Code Review" is spamming the log trying to submit it and failing every half hour. Is there a way to "unsubmit" in Gerrit, or some other way to handle this? [12:32:13] (note to self, check dependencies next time) [12:32:26] <^demon> hashar: Nope. I plan on making some auto-build thingie for jenkins at some point. Just haven't gotten around to it. [12:32:35] <^demon> anomie: Change your review to -2 [12:32:45] <^demon> (Or otherwise remove your +2) [12:33:26] ^demon- thanks [12:33:39] <^demon> The "automatic retrying" is kind of nice behavior, if it didn't spam. [12:33:56] I didn't know whether that would work, and I thought I'd just ask instead of fooling around hoping something would work. [12:38:52] <^demon> hashar: Gitblit plugin passed review upstream and will be usable for 2.5 :) [12:39:06] <^demon> As did the -based "network graph" (a la Github) [12:39:11] nice!! [12:39:19] can't wait for them [12:39:37] <^demon> Me too. I've been trying to find a way around the LDAP issue so we're not still blocked on upgrade. [12:39:42] ^demon: apt-get install gerrit does provide me a gerrit.war in /var/lib/gerrit2 :-] [12:39:49] probably outdated though [12:40:04] <^demon> 2 versions behind. [12:40:18] can't we update the deb package to ship the new war ? [12:40:31] <^demon> Bug Ryan :\ [12:40:36] * hashar gives up [13:10:58] ^demon: I did a very minor edit on wikitech https://wikitech.wikimedia.org/view/Gerrit#Custom_package [13:11:33] <^demon> I'm going to tweak, minor difference. [13:13:26] and kudos on replicating the extensions to GitHub [13:13:46] 448 repos, 11 members [13:13:47] doh [13:21:21] <^demon> JeroenDeDauw: I've created SemanticExtraSpecialProperties for you (empty). If you want to go ahead and push the existing github history, that'd be great. [13:21:35] <^demon> (Not having a HEAD will make L10n-bot explode) [14:00:28] <^demon> hashar: https://gerrit-review.googlesource.com/#/c/38952/ \o/ [14:00:33] <^demon> About. Time. [14:00:53] ^demon: the java gc ? [14:01:07] <^demon> Yeah. jgit 2.1.0 supports gc now :) [14:01:16] nice [14:16:08] aww despite what above, after reading http://lists.wikimedia.org/pipermail/wikitech-l/2012-October/064160.html for a moment I thought ^demon fixed https://bugzilla.wikimedia.org/show_bug.cgi?id=40331 [14:16:45] <^demon> If I'm talking about replication, I mean git replication. [14:16:52] <^demon> I haven't done anything re: 40331. [14:20:36] DanielK_WMDE: you want haz review https://gerrit.wikimedia.org/r/#/c/30984/ [14:20:52] ^demon: ok, I'll do that now [14:21:01] Don't want Nikerabbit and siebrand to lynch me to much :) [14:21:15] <^demon> :) [14:35:12] ^demon: got a Gerrit question for ya :-] [14:35:37] * ^demon hides [14:35:40] <^demon> What's up? :) [14:35:42] ^demon: with zuul, whenever a change is submitted, it will fetch the change, merge it on latest master and push the result to refs/for/refs/zuul/ [14:35:56] with the amount of changes we have, I am afraid it can fill up the git database very quickly [14:36:16] but will let us fetch the code Jenkins actually tested [14:36:39] pushing the refs/for/refs/zuul/ back in Gerrit is optional though, I could disable it if that might be a problem [14:36:57] <^demon> I don't see a problem, but I'm not entirely sure what the purpose is. [14:37:34] once the refs is pushed, jenkins will grab it from Gerrit repository iirc [14:38:32] <^demon> I'm still not understanding. Is there some documentation for this? [14:38:55] http://ci.openstack.org/zuul/triggers.html#zuul-references [14:39:09] I will disable it [14:39:23] zuul already keep a copy in the local file system [14:39:28] and I have setup the Jenkins jobs to use that [14:39:38] less troubles this way [14:39:55] <^demon> Yeah, let's not push it back to gerrit. [14:40:02] <^demon> Then I'd have to configure replication to skip it. [14:40:42] <^demon> If it becomes necessary, I can't see a huge problem in us turning it on space-wise (we're only 13% full on ./review_site/git) [14:41:48] I agree [14:41:52] we can turn that on later [14:43:14] <^demon> Haha, so two of my ideas to improve the project listing page (show projects you've used recently & add a search box) both just got pushed to master for review upstream. [14:43:18] <^demon> Great minds think alike? [14:43:56] <^demon> I should pull & try it out [15:00:29] i guess there is little we can do about the gitweb speed is there ? [15:00:55] <^demon> Replace it. [15:01:01] <^demon> (Which we're doing as soon as we upgrade to 2.5) [15:01:11] with what ? [15:01:11] <^demon> Gitblit. [15:01:25] <^demon> Live demo: https://demo-gitblit.rhcloud.com/ [15:02:02] ah, that's what github uses ? [15:02:42] <^demon> I don't believe so. [15:03:29] <^demon> We are going to use a new network graph plugin (which is very much like the github network graph) [15:04:47] JeroenDeDauw: :O [15:04:52] why would I lunch you [15:05:16] <^demon> thedj[work]: As far as "speeding up gitweb" -- I'm not sure it's even possible. Gitweb it a piece of crap :( [15:16:02] Can someone please review this one line timestamp-related fix? https://gerrit.wikimedia.org/r/#/c/24301/ [15:18:56] ^demon: zuul on labs: http://integration.wmflabs.org/zuul/status ;-] [15:19:09] ^demon: will show up what Zuul is doing :-D [15:21:59] Krenair: done [15:22:33] Raymond_, thank you [15:22:44] you are welcome [15:56:16] I have so far not written any MW extension and have no idea of the best way to do the following: ... [15:57:30] Tuxedo_, ..? [15:57:46] I have a fairly small bit of JS in placed in Common.js and would to add an option to place some kind of markup on any pages which calls the function with parameters. It's a fairly trivial and minimial js that just affects/toggles some on-page visuals, so even if the availability of the function loads on all pages of my wiki, it makes no difference. [15:58:08] What is the best method? Callback functions, hooks, magic words or simply a template? Or some existing extension? ... [15:58:47] Any pointers in a right direction would be appreciated. [16:05:54] Tuxedo_: you should probably ask again in about 30-60 minutes, most of the people who can help you will be appearing on IRC in a little while [16:06:22] Ahh, thanks for the tip. [16:07:12] Tuxedo_: no problem! I wish I were more help, but I'm not an expert and I'd hate to tell you the wrong thing [16:37:29] Nikerabbit: o_O [17:04:06] I've not written any MW extension before and I just need some general directions before I go wondering in all the wrong directions: [17:04:06] I have a small bit of JS added in Common.js and would to the option of placing some kind of wiki-markup on selected pages to call the js-function with parameters. It's a trivial and minimial JS-block. The output is non-language specific, just a universally recognisable graphic click-on symbol which dynamically affects/toggles some on-page visual through js/css manipulation where needed on specific article pages. [17:04:06] Even if the function loads in the Common.js file that is returned across the whole wiki it's no major issue, as it's only small bit of code. [17:04:07] What is the best method for acheiving this? Callback functions, hooks, magic words or/and a template? Or the use of some existing extension? If so, which? [17:04:08] Many thanks for any pointers! [17:05:20] Tuxedo_: could you simply add to your script some code to add an element to the page? [17:06:07] JeroenDeDauw: what?? [17:07:40] ori-l: Yes, by identifying the document.location.href, but I still don't know how to call the script from a onclick function on the page. [17:09:05] Tuxedo_: can you paste your JS code somewhere? dpaste.de perhaps? (not the channel) [17:09:07] I can't just add ori-l: I haven't written it yet. [17:10:08] Tuxedo_: no, you'd have click me!, and then $('.tuxedo-button').on('click', function () { /* do stuff! */ }); [17:10:43] * ori-l waits patiently for someone to chastise him for breaking the meaning of hyperlinks and not using