[10:00:36] addshore: people with pitchforks are asking what the ticket for the phabricator ui revert is? [10:00:44] HAH [10:00:59] well the upgrade as https://phabricator.wikimedia.org/T128009 [10:01:00] *was [10:01:28] and the ticket for getting the old look back is https://phabricator.wikimedia.org/T133825 [10:25:54] I'll never understand the trend towards bigger pages with more wasted space and more scrolling [10:26:21] I can't say I've ever looked at a page and thought "this page would be more satisfying if only it had more scrolling" :P [11:38:41] Lydia_WMDE! [11:39:04] hm. combining discovered by and invented by into a single property gives strange results using autodesc.js... "asteroid by Karl Wilhelm Reinmuth" sounds like he created the asteroid, not discovered it [11:41:17] I wonder why it's a single property anyway, they don't seem like the same concept to me [11:59:09] * YuviPanda wants to just note that he's finished deploying a large complete rewrite of the tools webservice infrastructure over the last 24h, and everything seems to have gone well. Do report if any of your favorite tools are out! Thanks [12:00:58] woo! [12:06:06] coming soon is 'webservice' support for kubernetes, which should improve stability and offer newer versions of software more easily (php 5.6 might be first thing to come) [12:42:32] addshore: ? [13:30:56] Hey folks. I'm looking to set up a mw.config variable on Wikidata for customizing the configuration of systems that use ORES. [13:31:05] What would be the Right(TM) way to do that? [13:31:16] The variable would be called "ScoredRevisionsThresholds" [13:37:06] $this->getOutput()->addJsConfigVars( 'ScoredRevisionsThresholds', 'value' ) [13:39:29] Reedy, would I do this in some global.js file? [13:39:35] =o [13:39:40] FWIW, most of the users of this gadget are loading code from meta [13:39:43] That's PHP :P [13:39:45] So I can't put the config there [13:39:46] lol [13:39:55] I should have seen the -> [13:40:28] Depending on what exactly you want to do, and where you want it to be configurable from... And by who.. [13:40:34] I imagine that this addJsConfigVars() method will interperet an associative array. [13:41:59] Reedy, I would like my team to have the flexibility to update the thresholds when we deploy new models. [13:42:16] I'd also like for the wikidata patrollers to be able to tweak the setting. [13:42:30] (in a perfect world) [13:45:49] Maybe we should just set this up as a proper gadget and set the config in the local gadget JS code [13:46:15] e.g. (1) set config vars (2) load script from meta, done. [13:46:26] Then people can enable in their prefs. [13:46:35] We'd lose the globalness of global.js though [13:46:36] hmmm [13:46:52] Also, the ORES extension is coming soon, I assume. [13:47:05] (we've been blocked for a long time there) [14:39:16] * yurik pokes Lydia_WMDE [16:56:46] * yurik pokes Lydia_WMDE again and wonders why the channel is so quiet ... my non-existing parenting skills tell me that kids are up to no good... :-P [17:25:30] who knows how the wikidata dumps are set up? I have a suspicion something is going wrong there [17:26:51] namely, some entities are missing from the dump. Also, the dump size dropped from 20160411 to 20160425 quite significantly [17:27:41] aude, jzerebecki, addshore: any ideas? ^ [17:29:40] SMalyshev: looks like only the rdf dumps dropped in size? [17:29:49] if that's any clue [17:30:03] i don't know what changed [17:39:15] aude: maybe something with partitions? like one of the partitions missing? [17:39:34] I don't even really know how those are set up... [17:42:54] we deployed new code after april 11 [17:43:18] and april 18 dump also appears affected [17:43:38] aude: yes [17:43:53] all afther 12 (which was probably started on 11) are smaller [17:44:06] so possible it's a bug [17:45:02] i would try to compare 2 dumps and find out some of the items missing [17:45:07] maybe [17:45:39] aude: filed T133924 [17:45:39] T133924: Wikidata dump is missing entities - https://phabricator.wikimedia.org/T133924 [17:45:42] thanks [17:46:23] if there is something obvious about the missing entities or we can try to debug on terbium with specific items [17:46:29] I'll check if json one has them... the problem it's almost 10G files even downloading them takes forever [17:46:41] json dumps are not smaller [17:46:43] aude: is terbium where they are hosted? [17:47:03] no, but we can manually run the dump scripts there [17:47:55] we also switched data centers but can't see how it's a problem for just rdf dumps [17:47:55] aude: do you know how the dumps are setup? I can't find where are the scripts that actually run the dumps [17:48:03] they are configured in puppet [17:48:31] https://github.com/wikimedia/operations-puppet/blob/733a15cb4a553df6eb51acf6ad1e60a601cf53d2/modules/snapshot/files/cron/dumpwikidatattl.sh [17:48:45] aha [17:50:43] aude: the script doesn't seem to change that much [17:51:23] brb... [18:21:33] SMalyshev: Is it possible that the query service is corrupt? [18:21:52] I noticed some of my reports suddenly becoming much smaller [18:22:03] multichill: See https://phabricator.wikimedia.org/T133924 [18:31:14] SMalyshev: Ah, I think Magnus might have run into the same problem. The old WDQ started returning zero results for some queries [18:34:23] SMalyshev, have you heard any update from Lydia? [18:34:31] yurik: about? [18:34:37] wdq for graphs [18:34:52] i don't understand the reason for the block - we already allow it for the regual usage [18:37:57] yurik: ah, I didn't hear anything new. [18:38:12] meh [18:40:55] yurik: I think we need to talk about it. Unfortunately, right now I'm dealing with a fire on wdqs... [18:41:11] sure, go ahead and put it out :) [22:24:19] aude: is there any way to repeat the dump script run on real data? there seems to be some unusual condition leading to it... [22:29:00] i have no idea which entity it failed on [22:29:08] i think we can add logging for this [22:30:13] probably something like this: https://gerrit.wikimedia.org/r/#/c/286083/ [22:31:01] * aude needs to eat... [22:34:31] aude: yeah logging would help a lot [22:51:59] * aude wonders if addshore or hoo are around? [22:52:14] ohia [22:52:31] i would like https://gerrit.wikimedia.org/r/#/c/286087/ in swat [22:52:42] but have to eat and not sure i can be around [22:52:46] (i might) [22:53:10] i can just add it witha note, and if i am not around, then i'll do it myself later [22:53:31] i have litereally just got intpo bed ;0 [22:53:37] ok [22:53:43] i will probably do it myself [22:53:44] so no swatting for me ;0 [22:53:49] ok, that's fine [22:53:52] night! [22:54:06] i see we have wmf21 wikidata + wmf22 core [22:54:25] good night [22:55:59] it seems to be some case of subject/predicate deduplication going wrong, but without actual data very hard to understand what happens :( [23:25:51] SMalyshev: i can try to find out what entity fails [23:26:06] aude: if you can this would be a huge help, thanks! [23:26:16] ok