[09:51:46] sjoerddebruin: hey, my bad. It got fixed. I thought I fixed it because it worked in my console [09:51:50] I hope it works now [09:51:54] let's wait and see [09:52:31] Amir1: fixed here [09:52:42] ugh I hate the confirmation window for purge now [09:53:00] :D [10:26:46] aude is it possible to import a whole wikidata dump? [10:49:04] DanielK_WMDE_: Thiemo_WMDE: Hey, please check out: https://phabricator.wikimedia.org/T127929#2563590 [10:49:40] and/or https://gerrit.wikimedia.org/r/299284 [10:49:41] :D [10:49:45] thanks [11:19:48] Lydia_WMDE: https://phabricator.wikimedia.org/T127929#2567107 [11:22:20] Amir1: --^ [11:22:51] Amir1: teh api module looks good, but i want to test it manually. not sure i'll get around to that today. [11:23:46] Thanks DanielK_WMDE_ [11:24:33] Amir1: for the db level test, you would probably insert something into the test db, and then check that the api module returns the right thing. [11:25:56] DanielK_WMDE_: is there a test as an example? [11:26:10] The tests I saw did it indirectly [11:26:22] like using methods in the codebase [11:26:46] Amir1: SqlChangeDispatchCoordinatorTest and DispatchStatsTest. both are not very nice, but you should get the idea [11:26:54] note that such tests should always have @group Database [11:27:39] Okay, thanks. I take a look at [11:27:57] DanielK_WMDE_: Can we merge this and I improve tests in another change set? [11:28:01] It's already too big [11:28:25] and lots of patchsets [11:28:54] Amir1: yes, but it would be nice to have the patch with the tests on gerrit first, as a follow-up [11:29:03] Amir1: also note the use of $this->tablesUsed[] btw. [11:29:25] Amir1: oh, a nice and simple example is PagePropsEntityIdLookupTest [11:29:40] Awesome [11:29:45] I can do it later today [11:29:54] thanks :D [11:42:47] Amir1: what kind of new API do you need to do the unbounded quantity conversion? [11:43:08] it seems to me we already have everything we need [11:43:47] something that gets a statement GUID and change it to unboundary method [11:44:04] if it's there, I check it. Is it deployed? [11:44:44] DanielK_WMDE_: ^ [11:44:55] Amir1: there is wbsetclaimvalue. the bot should read the old value, change it, and write the new value [11:45:10] Amir1: to find statements to change, the bot needs to run a sparql query [11:45:19] That part is okay [11:45:31] I was worried about changing part [11:45:44] so you say we can do it using wbsetclaimvalue [11:45:45] that [11:45:51] *that's great [11:46:05] changing means removing two fields from a map. unset( $value['upperBound'] ); unset( $value['lowerBound'] ). [11:46:49] detecting *if* the statement needs changing is a bit tricky in the +/-1 case. for +/-0 it's trivial: upperBound === lowerBound. [11:48:11] I start doing obvious ones and makes it more complicated until it's so small that humans can do it [11:53:14] Amir1: ok. +/-1 is also trivial for the integer case. The most tricky one is detecting things like 12.740 with bounds 12.739 and 12.741. Not horrible either. [11:54:09] yeah, I guess it can be done easily [11:54:43] Jonas_WMDE: not yet afaik [11:54:48] 1699 and 1701 sounds easy too [12:02:47] Thiemo_WMDE: Thanks for looking into the Scribunto issue! What do you think about my comment on https://gerrit.wikimedia.org/r/305499? [12:02:51] Worth a shot? [12:40:53] or DanielK_WMDE_ ^ [12:43:25] This is just silly, does VIAF use our data to combine them later? https://www.wikidata.org/wiki/Q14518221#identifiers [12:45:49] sjoerddebruin: they could :) [13:03:14] Hi ! [13:03:19] Hello! [13:06:37] DanielK_WMDE_: Code review of my Lua-related patches would be appreciated [13:06:47] I want to do further work there, but am blocking myself right now [13:11:53] if I have a list of wikidata items (Q1, Q2, Q3) , and a list of properties (P1, P2) and I want to generate the map representing if the given property has a value for the item {"Q1":{"P1":True,"P2":False},"Q2":{"P1":True,"P2":False}} where should I look ? Wikidata API, pywikibot, else ? [13:18:17] (or alternatively, can I use a Wikidata query service on a given list of items instead of all the database ?) [13:24:53] Lena_: https://www.wikidata.org/w/api.php?action=help&modules=wbgetclaims [13:25:21] i'm sure pywikibot has something for that [13:30:24] aude : thanks ! pywikibot has all I need \o/ [13:32:44] :) [14:00:35] Lena_ alternatively, http://tinyurl.com/hwyaado :p [14:02:06] (and yes, the three OPTIONAL are needed, otherwise if one is false, everything is considered false) [14:02:57] aude is there a way your import tool could also import the constraints? [14:11:28] Amir1: the same error is showing up at properties with coordinates datatype [14:14:36] Okay, That's probably easily fixable [14:14:44] I will do it later [14:14:50] \o/ [14:16:11] :) [15:35:12] I'm currently doing a study on wikidata relating to quality. Can anyone tell me whats the relation between Wikidata properties and OWL or if any correlation b/w exists or not? [15:38:21] http://wikiba.se/ontology-1.0.owl [16:00:22] thanks! [16:42:31] good evening. Does anyone know if people are working on the Olympic Games? Quite an influx of new items [17:10:55] Lydia_WMDE: See https://phabricator.wikimedia.org/T143435 , that makes the merge gadget quite anoying to use [17:11:36] multichill: Will ahve a look [17:12:11] hoo: Someone thought it would be cool to only use POST when purging a page.... [17:12:46] Ignoring the fact that many people and user use action=purge to make sure after some updates that they're seeing the latest status [17:13:49] Maaaaaaaaaaaaaaaaaaaaaaany such things are being removed as part of https://phabricator.wikimedia.org/T92357 [20:45:08] Hi, does anyone know if there is a database tracking wikipedia links to wikidata objects? [20:51:37] kjschiroo I am interested to know about that as well... [20:52:52] GhassanMas I'm figuring there must be something somewhere to efficiently update the text when the backing data has changed. [20:53:05] Comparing dumps? [20:53:29] Will take a while, but trustable. [20:53:42] sjoerddebruin, I don't follow [20:55:19] There are incremental dumps, that feature all changes in the last 24 hours. https://www.wikidata.org/wiki/Wikidata:Database_download [20:57:23] kjschiroo do you mean something like syncing wikipedia article with it's corrsponding wikidata item? [20:58:10] Yeah. I know there are templates that will pull in information from wikidata if it isn't explicitly set. [20:58:32] Oh, you want to see what Wikipedia articles use Wikidata data? [20:58:39] Yeah [20:58:42] There is a API coming up [20:58:59] https://phabricator.wikimedia.org/T103091 [20:59:57] kjschiroo yeah but i also mean the other way around from wikipedia to wikidata [21:01:30] sjoerddebruin that ticket says the data is kept in a database table. Do you know which one it is? [21:02:09] kjschiroo: not really, you should ask Amir1 if he comes online [21:05:17] SMalyshev: any idea why changes like https://www.wikidata.org/w/index.php?title=Q61606&type=revision&diff=363356262&oldid=355521298 aren't processed by SPARQL yet [21:05:56] sjoerddebruin: I'll check [21:12:47] SMalyshev the sandbox item is showing up in the cats query :) [21:13:12] Jonas_WMDE: well, if somebody adds it to cats, then it'll show up [21:13:31] Ah, Jonas_WMDE. You're here, I'll leave the page open then. See Phab. [21:27:04] hmm looks like changes in rcstream appear in very weird order... [21:27:16] that's the only reason I can think that this update might be missed [21:32:04] SMalyshev: is there a weekly sync with the dumps though? [21:32:15] no [21:32:25] So these will never disappear from my reports? [21:32:35] I can do manual update, it's easy [21:32:44] per item? [21:32:53] I just don't want to do it until I investigate, but I can do it once I'm done [21:33:06] well, I have a script. So if you have IDs, it's easy to update them [21:33:47] just give me the IDs [21:35:44] Q61606, Q2280476, Q2320892, Q2280454, Q2280417, Q2280393 [21:35:54] those are showing up in my report atm, more could be coming [21:38:25] Q2280441 too [21:40:02] sjoerddebruin, I think I found the table, wikidatawiki_p.wbc_entity_usage. Are there any docs for the schema? [21:40:24] You shouldn't ask me, I don't know anything about that. [21:45:49] sjoerddebruin: ok, updated those [21:46:09] thanks <3