[00:07:48] jzerebecki: Thanks :) [00:15:42] !nyan [00:15:42] ~=[,,_,,]:3 [07:53:02] hi Lydia_WMDE [07:53:13] is there a common Phab tag for Wikidata? [07:53:13] aharoni: hey [07:53:16] yes [07:53:18] wikidata [07:53:30] it might not show up in your suggestion list unfortunately [07:53:35] let me get you the hack [07:54:07] That would make sense, but when I type "wikidata", it's autocompleted to "§ Wikidata-Sprint-2015-01-21". [07:54:21] should I "join the project" or something? [07:55:04] aharoni: no that won't help unfortunately. it is a bug in phabricator. workaround at https://phabricator.wikimedia.org/T76732#847844 [07:55:17] (03PS9) 10Henning Snater: Renamed FingerprintView to EntityTermsView [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/184856 [07:55:37] (03PS15) 10Henning Snater: entitytermsview: Inject link to help page [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/184907 (https://phabricator.wikimedia.org/T86191) [07:55:43] (03PS5) 10Henning Snater: Added Special page to set label, description and aliases at once [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/187423 (https://phabricator.wikimedia.org/T72174) [07:55:50] * aharoni Still. Loves. Phabricator. Despite. All. The. Bugs. [07:55:54] :D [07:55:56] me too [07:56:03] but this one is super annoying for me tbh [07:57:40] Lydia_WMDE: Thanks! It works. (Even though the situation is nonsense.) [07:57:47] :) [07:57:48] agreed [08:07:25] (03PS5) 10Henning Snater: snakview: Refactored drawing mechanism [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189018 [08:16:15] (03PS6) 10Henning Snater: snakview: Refactored drawing mechanism [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189018 [08:53:41] (03PS7) 10Henning Snater: snakview: Refactored drawing mechanism [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189018 [08:58:16] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Frontend JS should not re-render qualifiers and references upon load. - https://phabricator.wikimedia.org/T88425#1024212 (10Snaterlicious) Update: The change set got updated to also not re-render the `Variation` on initialization. (`SnakTypeSelector` actually w... [09:11:17] 3Wikidata, MediaWiki-extensions-ContentTranslation: Red links in the article as entry points for translation - https://phabricator.wikimedia.org/T88580#1024231 (10Amire80) [09:15:13] 3MediaWiki-extensions-ContentTranslation, Wikidata, Language-Engineering: Link cards are not showing equivalent articles - https://phabricator.wikimedia.org/T85989#1024250 (10Amire80) [09:16:13] 3Wikidata, MediaWiki-extensions-ContentTranslation: Adapt red links on the translation - part 2 - https://phabricator.wikimedia.org/T78134#1024254 (10Amire80) [09:17:22] 3Wikidata, MediaWiki-extensions-ContentTranslation: When creating a new page, suggest doing a translation instead - https://phabricator.wikimedia.org/T88600#1024255 (10Amire80) [09:17:43] 3Wikidata, MediaWiki-extensions-ContentTranslation: Link translated articles with other languages through Wikidata automatically - https://phabricator.wikimedia.org/T87410#1024258 (10Amire80) [09:22:19] 3Wikidata, Wikidata-Quality: convert dump information to importable format - https://phabricator.wikimedia.org/T88961#1024259 (10Tamslo) 3NEW [09:22:51] Hi! Can someone help to build a wikidata api query to get the list of the countries and a query to get the list of the cities of particular selected country? [09:24:06] 3Wikidata, Wikidata-Quality: validation through external databases - https://phabricator.wikimedia.org/T86514#1024265 (10Tamslo) [09:24:38] http://wdq.wmflabs.org/api?q=tree%5B2%5D%5B17%5D does not work I thought that I'll query ITEMS of Q2 ROOT PROPERTY P17 [09:25:18] 3Wikidata, Wikidata-Quality: Take ranks and exceptions into account - https://phabricator.wikimedia.org/T88963#1024273 (10Jonas.keutel) 3NEW [09:25:24] I want to import a multi-lingual list of countries and their cities into local db. [09:25:48] 3Wikidata, Wikidata-Quality: validation through external databases - https://phabricator.wikimedia.org/T86514#969933 (10Tamslo) [09:25:50] 3Wikidata, Wikidata-Quality: use statements on properties - https://phabricator.wikimedia.org/T88679#1024279 (10Tamslo) 5Open>3declined [09:26:16] 3Wikidata, Wikidata-Quality: dumps - https://phabricator.wikimedia.org/T88677#1024281 (10Tamslo) [09:26:31] 3Wikidata, Wikidata-Quality: data types - https://phabricator.wikimedia.org/T88674#1024282 (10Tamslo) [09:27:51] 3Wikidata, Wikidata-Quality: error handling - https://phabricator.wikimedia.org/T88673#1024293 (10Tamslo) [09:28:49] 3Wikidata, Wikidata-Quality: Clarify semantics of constraints - https://phabricator.wikimedia.org/T88966#1024302 (10Jonas.keutel) 3NEW [09:30:42] 3Wikidata, Wikidata-Quality: implement time value - https://phabricator.wikimedia.org/T88676#1024310 (10Tamslo) [09:33:30] Example: tree[30][150][17,131] returns all items that are in the country (P17) or administrative unit (P131) of the U.S.A. (Q30), or sub-units thereof (P150) But there is no page: https://www.wikidata.org/wiki/P17 also what's the "country of the USA"? A US state? [09:35:25] 3Wikidata, Wikidata-Quality: Composite Constraints - https://phabricator.wikimedia.org/T88968#1024327 (10Jonas.keutel) 3NEW [09:40:17] despens: not much, there is currently work underway to get something like that set up and into production. see https://www.mediawiki.org/wiki/Wikibase/Indexing . btw. rdf dumps exit, perhaps they could be imported in marmotta... [09:41:29] also there is wdq.wmflabs.org already working most of the time [09:43:17] QuestPC: properties are in their own namespace https://www.wikidata.org/wiki/Property:P17 [09:45:57] QuestPC: such a statement would read "Foo is in the country of the USA" (the country property does not denote that the subject is a country but that the subject is in the country of the object, so object is a country). [09:47:20] * jzerebecki thinks [09:47:20] subject item of this property (P1629) [09:47:33] is confusingly worded... [09:47:59] jzerebecki: Yes maybe the API documentation could be improved.. It's a bit too short. [09:49:55] jzerebecki: But we already know that Q30 is a root property (the country, not something inside country), no? [09:51:42] jzerebecki: Also when objects and properties are in their separate namespaces, P / Q prefix is not necessary. [09:52:33] QuestPC: your questions where not related to the api of wdq.wmflabs.org , so not sure what you mean with that it needs improvement [09:54:37] jzerebecki: There is too much of magic to me. For example instances (P31) of subclasses (P279) why these are entities. Instance is Q, why there is P31 for it? subclass is a P:P relation, no? [09:55:04] jzerebecki: Speaking of documentation, good SQL books are much more verbose and clearly written. [09:56:37] jzerebecki: I thought that building query of all countries of the Earth then query of all cities of particular country is easy but cannot figure it out. Even though maybe I am stupid. [09:57:45] 3Wikidata, Wikidata-Quality: Take ranks and exceptions into account - https://phabricator.wikimedia.org/T88963#1024363 (10Lydia_Pintscher) Also look into the concept of "best statement" for ranks and see if you need to take it into account. [09:58:06] QuestPC: Q30 is the root of the query, so it tries to find a tree of items starting with Q30 and going toward branches to items connected over P150 and going to more roots via P17 and P131 [09:58:56] QuestPC: items and properties are both entites, see https://www.wikidata.org/wiki/Wikidata:Glossary for a general introduction to the datamodel [09:59:45] https://www.mediawiki.org/wiki/Wikibase/DataModel/Primer has a more technical view, but might be a bit out of date except for the summary [10:00:44] QuestPC: subclass of as instance of is for item to item relations [10:00:48] jzerebecki: Why we need such complex thing as P150: "contains administrative territorial entity". Cannot we just find Q_city_ inside Q_country_? [10:00:49] 3Wikidata, MediaWiki-extensions-ContentTranslation: When creating a new page, suggest doing a translation instead - https://phabricator.wikimedia.org/T88600#1024370 (10Lydia_Pintscher) We should also figure out how this fits together with https://www.wikidata.org/wiki/Wikidata:Article_placeholder_input best. [10:01:36] jzerebecki: For example it is not obvious which P_belongs_to_ I need to use for each particular case. [10:02:02] QuestPC: because there are not only cities and countries, some countries have 7 or more administrative hirachies [10:02:15] JeroenDeDauw: Please reply to https://gerrit.wikimedia.org/r/181718 or I might remove your -1 at some point [10:02:18] jzerebecki: Suitable P's seems a hard thing to me. [10:05:13] 3Wikidata, MediaWiki-extensions-ContentTranslation: Red links in the article as entry points for translation - https://phabricator.wikimedia.org/T88580#1024379 (10Lydia_Pintscher) That's also an important discussion for us unrelated to translations. I'd love to brainstorm more about this. At the hackathon? [10:08:07] 3Wikidata: Migrate all relevant Lua modules from mw.wikibase.getEntity to mw.wikibase.getEntity - https://phabricator.wikimedia.org/T88950#1024385 (10Lydia_Pintscher) p:5Triage>3High [10:08:18] 3Wikidata: Migrate all relevant Lua modules from mw.wikibase.getEntity to mw.wikibase.getEntity - https://phabricator.wikimedia.org/T88950#1023934 (10Lydia_Pintscher) [10:14:16] QuestPC: wdq is something put together with a hot needle, so it has problems. but i'm thankfull that we at least have that. its documentation assumes you already know the wikibase data model and understand the properties on wikidata.org . the documentation for a querylanguage will not be able to fully cover understanding the properties, but i understand what you mean. for property documentation you need to look at: https://www.wikidata.org/wiki/W [10:17:26] 3Wikidata, MediaWiki-extensions-ContentTranslation: Red links in the article as entry points for translation - https://phabricator.wikimedia.org/T88580#1024393 (10Amire80) >>! In T88580#1024379, @Lydia_Pintscher wrote: > That's also an important discussion for us unrelated to translations. I'd love to brainstorm... [10:18:20] (03CR) 10Tamslo: [C: 032 V: 032] Some tweaks as result of the i18n review [extensions/WikidataQuality] - 10https://gerrit.wikimedia.org/r/189320 (owner: 10Raimond Spekking) [10:22:20] QuestPC: for your query you could just look at any item that has the property country, but there probably will be incomplete and incorrect data. so you might get more releavant items and/or a more correct result set by also using other property. and the result set will be big, not sure if it will be too big. [10:22:33] (03CR) 10Thiemo Mättig (WMDE): [C: 04-1] "-1 for the moment to prevent an to early merge. This shouldn't be merged before Ic4d3aa0, which seems to don't give enough reason for the " [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189209 (owner: 10Gerrit Patch Uploader) [10:23:05] (oh and then only keep the results that have instance of city or something that is subclass of city) [10:24:06] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Redesign header - https://phabricator.wikimedia.org/T75654#1024413 (10Lydia_Pintscher) [10:24:09] 3Wikidata, MediaWiki-extensions-WikibaseRepository: "other language" boxes overlaps with site links for long aliases - https://phabricator.wikimedia.org/T88293#1024411 (10Lydia_Pintscher) 5Open>3Resolved a:3Lydia_Pintscher [10:24:23] Lydia_WMDE: Branch tomorrow? [10:24:56] hoo: need to talk to tobi after meeting about that [10:26:34] Ok. Let me know! [10:26:41] 3Wikidata-Sprint-2015-01-08§, § Wikidata-Sprint-2015-02-03, Wikidata-Sprint-2014-12-09§, Wikidata, § Wikidata-Sprint-2015-01-21: File based caching: Implement new interface based on pre-generated files - https://phabricator.wikimedia.org/T77993#1024428 (10Lydia_Pintscher) Patch @daniel mentioned was abandoned. [10:27:24] 3§ Wikidata-Sprint-2015-02-03, Wikidata, MediaWiki-extensions-WikibaseRepository: different styling for label/alias and description input - https://phabricator.wikimedia.org/T87576#1024432 (10Lydia_Pintscher) [10:27:36] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Redesign header - https://phabricator.wikimedia.org/T75654#1024435 (10Lydia_Pintscher) [10:27:37] 3§ Wikidata-Sprint-2015-02-03, Wikidata, MediaWiki-extensions-WikibaseRepository: different styling for label/alias and description input - https://phabricator.wikimedia.org/T87576#1024433 (10Lydia_Pintscher) 5Open>3Resolved a:3Lydia_Pintscher [10:29:02] 3§ Wikidata-Sprint-2015-02-03, Wikidata, MediaWiki-extensions-WikibaseRepository: rename language list to more languages or similar - https://phabricator.wikimedia.org/T87577#1024449 (10Lydia_Pintscher) [10:29:15] 3§ Wikidata-Sprint-2015-02-03, Wikidata, MediaWiki-extensions-WikibaseRepository: rename language list to more languages or similar - https://phabricator.wikimedia.org/T87577#1024452 (10Lydia_Pintscher) 5Open>3Resolved a:3Lydia_Pintscher [10:29:17] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Redesign header - https://phabricator.wikimedia.org/T75654#769722 (10Lydia_Pintscher) [10:34:33] Tobi_WMDE_SW, Lydia_WMDE: i'm online for the daily [10:34:41] DanielK_WMDE: cool :) [10:40:25] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Draft a computer-assisted translation system for Wikidata labels/descriptions - https://phabricator.wikimedia.org/T64695#1024489 (10Magnus) For descriptions, automated translation makes little sense (and manual translation even less). Alternative: http://magnus... [10:41:34] why is test2wiki added to prod-wikidatawiki? [10:42:27] it is shown on https://www.wikidata.org/wiki/Special:DispatchStats [10:43:00] Merlissimo: Good catch [10:43:03] and oh crap [10:45:17] DanielK_WMDE: ok ready? [10:45:47] hoo: Merlissimo: argh. are you taking care of it hoo? [10:45:51] thx Merlissimo [10:45:58] Lydia_WMDE: Yes [10:46:04] thanks! [10:46:37] now. [10:46:52] "Ein Problem ist aufgetreten". super :P [10:47:31] Merlissimo: Lydia_WMDE: Fixed [10:47:41] Trying to find out how that happened in the first place [10:47:43] Lydia_WMDE: in general i am having problems with not updated langlink table rows. [10:48:03] hoo: shouldn't we have been notified by icinga because of the high median lag? [10:48:09] that's why i have looked at the dispatcher replag [10:48:21] jzerebecki: How high was the median? [10:48:28] 2hours [10:48:35] then yes [10:50:30] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Draft a computer-assisted translation system for Wikidata labels/descriptions - https://phabricator.wikimedia.org/T64695#1024505 (10Nikerabbit) @Magnus I like your idea but I don't agree with your conclusion that manual translation does not make sense. I am yet... [10:50:58] i have done 29000 nulledit last night on different wikis because of possible wrong content at langlinks table. after this run there were only 21000 results. so there must be langlinks of 8000 pages not updated correctly [10:51:25] Yeah :/ [10:51:42] hoo: perhaps the problem was not there yet at 2015-02-09 10:34:01 which was the last check [10:51:44] But those weren't article with items changed recently [10:53:23] jzerebecki: "median":[^}]*"lag":[1-5]?[0-9] [10:53:29] that regexp looks flawed [10:53:46] Merlissimo: Those happened during the initial HHVM testings [10:55:11] $ curl 'https://www.wikidata.org/w/api.php?action=query&meta=siteinfo&format=json&siprop=statistics' | egrep -o '"median":[^}]*"lag":[1-5]?[0-9]' [10:55:14] looks weird [10:59:19] 3Wikidata, wikidata-query-service, MediaWiki-Core-Team: Deploy a Wikidata complex query service into production - https://phabricator.wikimedia.org/T85159#1024547 (10faidon) [10:59:21] 3operations, Wikidata, wikidata-query-service: Wikidata Query Service hardware - https://phabricator.wikimedia.org/T86561#1024545 (10faidon) 5Open>3stalled Based on what we heard regarding Titan/WQS lately, I think we can safely put this on hold and mark it as stalled, correct? [10:59:26] hoo: its not anchored at the end, who did that happen? [10:59:35] s/who/how/ [11:00:22] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Draft a computer-assisted translation system for Wikidata labels/descriptions - https://phabricator.wikimedia.org/T64695#1024562 (10Magnus) @Nikerabbit 13M items x 287 languages = 4 //billion// descriptions to fill in manually. For simple one-line description,... [11:00:24] jzerebecki: No idea [11:00:44] All I saw so far it seems like that check essentially just checks whether the API responds [11:01:24] 3operations, Wikidata, wikidata-query-service: Wikidata Query Service hardware - https://phabricator.wikimedia.org/T86561#1024564 (10Joe) Yes, I was waiting for this evening's WQS meeting before reassessing priority/status, but marking it stalled is fair. [11:08:49] db1bd7834eb72d6eafbe2cfc366b3d91eacf2f94 and d7450b2c6d1286bd6879232322c883eb1b767fd0 caused the test wikis to show up in the dispatch lag [11:08:52] so nothing to worry about [11:09:05] But the icinga check seems essentially broken [11:09:11] jzerebecki: Has it ever worked? [11:14:13] (03PS2) 10Gerrit Patch Uploader: Remove line under headings [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189209 [11:14:14] "The wiki is currently in read-only mode" [11:14:15] (03CR) 10Gerrit Patch Uploader: "This commit was uploaded using the Gerrit Patch Uploader [1]." [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189209 (owner: 10Gerrit Patch Uploader) [11:14:31] sjoerddebruin: Wikidata? [11:14:40] Yes. [11:14:40] (03CR) 10Fomafix: [C: 04-1] "Do not merge before Ic4d3aa0 is merged." [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189209 (owner: 10Gerrit Patch Uploader) [11:15:05] for the record: I'm no longer "playing" with the DB [11:15:19] Want to add P1477 > "Bernardus Petrus Jozef Broos" [NL] to https://www.wikidata.org/wiki/Q816447 [11:15:27] just got the same [11:15:31] crap [11:16:06] "Due to high database server lag, changes newer than 149 seconds may not be shown in this list." on watchlist [11:16:49] wth is going on? ;-) [11:21:27] Killed change dispatching [11:22:10] :) [11:23:10] ok editing is possible again [11:23:21] but no dispatching, hoo? [11:23:55] DELETE /* Wikibase\PruneChanges::pruneChanges */ FROM `wb_changes` WHERE (change_time < '20150206110001') [11:24:07] That query was putting us into lag [11:33:35] 3Wikidata: Investigate whether the Icinga check for the Wikidata dispatch lag works - https://phabricator.wikimedia.org/T88980#1024637 (10hoo) 3NEW [11:34:01] away for real now :P [11:34:08] Watch list doesn't seem to load. [11:34:37] Problem in a nutshell was: We keep highest dispatch lag + 3 days worth of changes in that table [11:34:49] 3Wikidata: Investigate whether the Icinga check for the Wikidata dispatch lag works - https://phabricator.wikimedia.org/T88980#1024644 (10JanZerebecki) The regexp is broken. [11:35:01] And after I removed the wikis from it, the threshold significantly changed [11:35:02] 3Wikidata, § Wikidata-Sprint-2015-02-03: Investigate whether the Icinga check for the Wikidata dispatch lag works - https://phabricator.wikimedia.org/T88980#1024645 (10JanZerebecki) [11:35:02] and boom [11:35:09] fixing that is easy [11:35:11] will do it later on [11:36:05] 3Wikidata, § Wikidata-Sprint-2015-02-03: Investigate whether the Icinga check for the Wikidata dispatch lag works - https://phabricator.wikimedia.org/T88980#1024654 (10hoo) As far as I see was also don't compare against anything, so even a working regexp, wouldn't really help [11:39:56] 3Wikidata, § Wikidata-Sprint-2015-02-03: Investigate whether the Icinga check for the Wikidata dispatch lag works - https://phabricator.wikimedia.org/T88980#1024660 (10JanZerebecki) Yes it would as the regexp was initially written to only match on numbers smaller than 120. [11:48:36] When I got some Q id's how can I fetch their local names? https://www.wikidata.org/w/api.php?action=wbgetentities&format=xml&props=sitelinks&ids=Q61301,Q61302,Q61306 does not work. And fetching by single Q id is slow. [11:50:07] https://www.wikidata.org/w/api.php?action=wbgetentities&format=xml&props=sitelinks&ids[0]=Q61301&ids[1]=Q61302&ids[2]=Q61306 also does not work [11:51:12] (03PS1) 10Tamslo: Added constraint checks, DataValueComparer and adapted locales. [extensions/WikidataQuality] - 10https://gerrit.wikimedia.org/r/189462 [11:51:21] https://www.wikidata.org/w/api.php?action=wbgetentities&format=xml&props=sitelinks&ids=Q61301|Q61302|Q61306 seem to work. Is that reliable way to get available local item names? [11:52:24] 3Wikidata, § Wikidata-Sprint-2015-02-03: Investigate whether the Icinga check for the Wikidata dispatch lag works - https://phabricator.wikimedia.org/T88980#1024683 (10Lydia_Pintscher) FYI: A few days ago I did get a notification when the whole site was down. [11:55:15] Ok, found it: https://www.wikidata.org/w/api.php?action=wbgetentities&props=labels&format=xml&ids=Q3849466|Q61301|Q61302|Q61306 [12:02:03] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: keyboard selector hiding site id input - https://phabricator.wikimedia.org/T88417#1024703 (10Lydia_Pintscher) Yes. Let's try class="noime" for now on the siteid input field. @amire80: do you have a better solution for the future f... [12:03:02] (03CR) 10Jonaskeutel: [C: 032 V: 032] Added constraint checks, DataValueComparer and adapted locales. [extensions/WikidataQuality] - 10https://gerrit.wikimedia.org/r/189462 (owner: 10Tamslo) [12:25:26] (03PS8) 10Henning Snater: snakview: Refactored drawing mechanism [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189018 [13:07:20] 3Wikidata, § Wikidata-Sprint-2015-02-03: Investigate whether the Icinga check for the Wikidata dispatch lag works - https://phabricator.wikimedia.org/T88980#1024729 (10JanZerebecki) a:3JanZerebecki [13:16:36] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: make Wikibase\PruneChanges::pruneChanges not cause too much db replication lag - https://phabricator.wikimedia.org/T88981#1024732 (10JanZerebecki) 3NEW [13:40:45] aude: i'm working on T88358 and T88357. Still trying to figure out what is going on. [13:41:13] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseClient: entity usage is incorrectly updated when moving a page - https://phabricator.wikimedia.org/T88358#1024744 (10daniel) a:3daniel [13:41:16] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseClient: when i move a Wikibase client page, subscriptions are not updated - https://phabricator.wikimedia.org/T88357#1024745 (10daniel) a:3daniel [13:44:02] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: make Wikibase\PruneChanges::pruneChanges not cause too much db replication lag - https://phabricator.wikimedia.org/T88981#1024747 (10JanZerebecki) 5Open>3Resolved [13:44:12] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: make Wikibase\PruneChanges::pruneChanges not cause too much db replication lag - https://phabricator.wikimedia.org/T88981#1024732 (10JanZerebecki) 5Resolved>3Open [13:44:36] 3Wikidata, § Wikidata-Sprint-2015-02-03: Investigate whether the Icinga check for the Wikidata dispatch lag works - https://phabricator.wikimedia.org/T88980#1024750 (10JanZerebecki) 5Open>3Resolved [13:48:22] hoo|away: remove my -1? you did not even modify the commit, so you should not remove it [13:49:57] hoo|away: I'm also not very inclined to solve this for you, though am willing to solve this with you by means of pair programming [13:51:26] (03CR) 10Jeroen De Dauw: "Don't add new responsibilities to the interface for starters" [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/181718 (https://phabricator.wikimedia.org/T87238) (owner: 10Hoo man) [13:54:05] (03CR) 10Hoo man: "So you want a new MultiEntityRevision lookup interface? What do the others think about that?" [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/181718 (https://phabricator.wikimedia.org/T87238) (owner: 10Hoo man) [14:25:30] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseClient: entity usage is incorrectly updated when moving a page - https://phabricator.wikimedia.org/T88358#1024774 (10daniel) 5Open>3Invalid This seems to work as designed: * page 1315 is moved to the new title, and all usage entries for t... [14:25:54] aude, hoo, Lydia_WMDE: ---^ [14:27:58] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseClient: when i move a Wikibase client page, subscriptions are not updated - https://phabricator.wikimedia.org/T88357#1024777 (10daniel) My first guess is that this is due to slave lag. Detection of "unused" entities that the client wiki should... [14:30:05] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseClient: Use master DB when checking entity usage during updates - https://phabricator.wikimedia.org/T88984#1024787 (10daniel) 3NEW a:3daniel [14:32:08] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseClient: ConnectionManager should safeguard against slave lag. - https://phabricator.wikimedia.org/T88985#1024796 (10daniel) 3NEW a:3daniel [14:34:56] 3Wikidata: Avoid inconsistencies due to slave lag - https://phabricator.wikimedia.org/T88986#1024803 (10daniel) 3NEW [14:35:18] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseClient: ConnectionManager should safeguard against slave lag. - https://phabricator.wikimedia.org/T88985#1024811 (10daniel) [14:35:19] 3Wikidata: Avoid inconsistencies due to slave lag - https://phabricator.wikimedia.org/T88986#1024810 (10daniel) [14:44:16] Lydia_WMDE: https://gerrit.wikimedia.org/r/#/c/187423/ [14:47:28] (03PS1) 10Daniel Kinzler: Use false instead of null to indicate local wiki DB. [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189486 [15:05:00] (03PS1) 10Daniel Kinzler: ConnectionManager: do not return slave connection after returning master conenction. [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189489 (https://phabricator.wikimedia.org/T88985) [15:09:15] 3Wikidata, MediaWiki-extensions-WikibaseRepository: indicate that label is a fallback - https://phabricator.wikimedia.org/T85105#1024847 (10Lydia_Pintscher) 5Open>3Resolved a:3Lydia_Pintscher [15:09:17] 3Wikidata, MediaWiki-extensions-WikibaseRepository, MediaWiki-extensions-WikibaseClient: language fallback - https://phabricator.wikimedia.org/T76216#1024849 (10Lydia_Pintscher) [15:09:58] Lydia_WMDE: Going live tomorrow? ^ [15:10:31] sjoerddebruin: no i think that's only in the next branch [15:11:12] Hm [15:21:53] (03PS1) 10Tobias Gritschacher: New Wikidata Build - 2015/02/09 [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/189491 [15:24:55] jzerebecki: We should really also get notifications in case of general s5 replag [15:25:05] (03CR) 10Tobias Gritschacher: [C: 032] New Wikidata Build - 2015/02/09 [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/189491 (owner: 10Tobias Gritschacher) [15:25:08] Preferably via sms [15:25:16] (03CR) 10Tobias Gritschacher: [V: 032] New Wikidata Build - 2015/02/09 [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/189491 (owner: 10Tobias Gritschacher) [15:26:22] 3Wikidata, MediaWiki-extensions-WikibaseRepository: elements in the "in other languages" table lack relevant lang and dir attributes - https://phabricator.wikimedia.org/T48736#1024892 (10Nemo_bis) > A useful feature introduced several weeks shows a table of item titles and descriptions in the user's languages ab... [15:27:38] (03PS1) 10Daniel Kinzler: Move connection manager to Lib [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189492 [15:32:04] hoo: yes. ticket please. do you have your phone number already set for your icinga contact? if not ask someone from operations to add you. [15:32:32] No, I didn't yet [15:32:47] but will probably do later on [15:41:54] 3Wikidata, MediaWiki-extensions-WikibaseRepository: RFC: Unit Localization - https://phabricator.wikimedia.org/T86528#1024913 (10JanZerebecki) Btw. there are already special items configured in: $wgWBClientSettings['badgeClassNames'] [15:57:42] jzerebecki: thanks! how can i create an RDF dump of my own wikibase? in the provided maintainance directory there is one for json dumps [15:58:48] 3Wikidata, Datasets-General-or-Unknown: improve Wikidata dumps - https://phabricator.wikimedia.org/T88991#1024968 (10Lydia_Pintscher) 3NEW [15:59:48] 3Wikidata, Datasets-General-or-Unknown, MediaWiki-extensions-WikibaseRepository: provide "latest" link for JSON dumps - https://phabricator.wikimedia.org/T72247#1024976 (10Lydia_Pintscher) [16:00:12] 3Wikidata, Datasets-General-or-Unknown, MediaWiki-extensions-WikibaseRepository: provide incremental JSON dumps for Wikidata - https://phabricator.wikimedia.org/T72246#1024979 (10Lydia_Pintscher) [16:02:48] 3Wikidata, Datasets-General-or-Unknown: link to json dump documentation from dump site - https://phabricator.wikimedia.org/T87328#1024981 (10Lydia_Pintscher) [16:03:32] 3Wikidata, Datasets-General-or-Unknown, MediaWiki-extensions-WikibaseRepository: provide "latest" link for JSON dumps - https://phabricator.wikimedia.org/T72247#1024995 (10Lydia_Pintscher) [16:03:34] 3Wikidata, Datasets-General-or-Unknown: link to json dump documentation from dump site - https://phabricator.wikimedia.org/T87328#988939 (10Lydia_Pintscher) [16:03:35] 3Wikidata, Datasets-General-or-Unknown, MediaWiki-extensions-WikibaseRepository: provide incremental JSON dumps for Wikidata - https://phabricator.wikimedia.org/T72246#1024994 (10Lydia_Pintscher) [16:03:36] 3Wikidata: Wikidata dumps should have revision ID or other sequence mark - https://phabricator.wikimedia.org/T87283#1024998 (10Lydia_Pintscher) [16:03:37] 3Wikidata: update and consolidate json dump documentation - https://phabricator.wikimedia.org/T87329#1024999 (10Lydia_Pintscher) [16:03:38] 3Wikidata: improve dump documentation - https://phabricator.wikimedia.org/T85407#1024996 (10Lydia_Pintscher) [16:03:40] 3Wikidata, wikidata-query-service: create index for each dump - https://phabricator.wikimedia.org/T85101#1024997 (10Lydia_Pintscher) [16:03:41] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Introduce setting to allow import of entities from XML dumps. - https://phabricator.wikimedia.org/T85133#1025001 (10Lydia_Pintscher) [16:03:42] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Partial RDF dumps - https://phabricator.wikimedia.org/T46581#1025002 (10Lydia_Pintscher) [16:03:43] 3operations, Wikidata, Datasets-General-or-Unknown: Wikidata dumps contain old-style serialization. - https://phabricator.wikimedia.org/T74348#1025000 (10Lydia_Pintscher) [16:03:45] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Script for creating RDF dumps of all entities - https://phabricator.wikimedia.org/T46580#1025004 (10Lydia_Pintscher) [16:03:46] 3Wikidata, MediaWiki-extensions-WikibaseRepository: add script for stitching json dump shards - https://phabricator.wikimedia.org/T70366#1025003 (10Lydia_Pintscher) [16:03:49] 3Wikidata, Datasets-General-or-Unknown: improve Wikidata dumps - https://phabricator.wikimedia.org/T88991#1024992 (10Lydia_Pintscher) [16:04:28] hoo|away: DanielK_WMDE: please add if you have more: https://phabricator.wikimedia.org/T88991 [16:11:25] Lydia_WMDE: Wow... that's a lot. Looks complete at a glance [16:11:33] cool [16:12:34] Lydia_WMDE: the description should make clear if this covers XML and/or JSON dumps [16:12:47] DanielK_WMDE: all dumps [16:13:07] yeah, RDF as well [16:14:05] Lydia_WMDE: i can think of two more things: "expanded" values (full urls, normalized quantities, etc), and fixing the serialization of EntityidValues. [16:14:10] let me see if I can find them [16:14:19] DanielK_WMDE: ok [16:14:31] oh, RDF - well, than we need to finished the mapping, too [16:14:34] despens: rdf dumps are created with this https://www.mediawiki.org/wiki/Wikidata_Toolkit from the json dump [16:14:46] (03CR) 10Ricordisamoa: ConnectionManager: do not return slave connection after returning master conenction. (031 comment) [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189489 (https://phabricator.wikimedia.org/T88985) (owner: 10Daniel Kinzler) [16:15:05] jzerebecki: we have our own rdf generation code. which is incomplete. [16:15:39] (03CR) 10Daniel Kinzler: ConnectionManager: do not return slave connection after returning master conenction. (031 comment) [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189489 (https://phabricator.wikimedia.org/T88985) (owner: 10Daniel Kinzler) [16:15:42] DanielK_WMDE: yes and no way to store them as a dump [16:16:03] jzerebecki: that's the smallest problem [16:16:18] yes [16:16:21] just copy & modify what we do for json [16:17:58] anyway the only thing that works now is wikidata toolkit, thus my answer to the question how to generate rdf dumps from ones own wikibase installation [16:18:55] jzerebecki, DanielK_WMDE: thanks for the info [16:19:03] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseClient: when i move a Wikibase client page, subscriptions are not updated - https://phabricator.wikimedia.org/T88357#1025081 (10daniel) Oh, and of course: if you create a redirect while moving, the item is still used by the redirect page (whic... [16:20:24] (03PS1) 10Daniel Kinzler: Re-use connection manager. [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189503 (https://phabricator.wikimedia.org/T88357) [16:25:03] Lydia_WMDE: hoo how about a machine readable listing (e.g. json) of what json dumps are available? [16:25:29] currently https://www.mediawiki.org/wiki/Wikidata_Toolkit#Download_and_installation does not work [16:25:36] aude: that'd be nice [16:25:40] because the format of the json dump page somehow changed [16:25:43] I still like my idea of putting all that into a MediaWiki extension [16:25:45] -.- [16:25:52] hoo: can you open a bug for that? [16:25:53] but if you use the lates snapshot (from master), then the toolkit works [16:26:07] * aude wasted a bunch of time figuring this all out this weekend :/ [16:26:11] :( [16:26:18] should update the wiki [16:26:21] Lydia_WMDE: That needs more toughts... and would be a very large change. [16:26:25] But a sane thing to do :P [16:26:37] I'll file a bug to investigate [16:26:40] hoo: sure. but a ticket is a good first step :D [16:26:45] * aude just wants a stable format that lists the dumps [16:26:51] toolkit is screen scraping :( [16:26:55] outsch [16:27:14] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: Feature switch for using subscription mechanism for change propagation. - https://phabricator.wikimedia.org/T88419#1025131 (10daniel) a:3daniel [16:27:16] but once one gets it to work, it's nice [16:29:01] or Lydia_WMDE can we find out when markus is making a new release of toolkit? [16:29:37] aude: i think he said on the mailinglist that he'd get started again now after baby break [16:29:42] aude: In pruneChanges: Only delete up to N rows per run and then stop or delete -> waitforslave -> delete -> ... in a loop [16:29:44] both will work [16:29:45] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: Feature switch for using subscription mechanism for change propagation. - https://phabricator.wikimedia.org/T88419#1025133 (10daniel) [16:32:25] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: Feature switch for using subscription mechanism for change propagation. - https://phabricator.wikimedia.org/T88419#1025144 (10daniel) [16:32:25] https://www.mediawiki.org/wiki/Wikidata_Toolkit#Download_and_installation [16:32:29] Lydia_WMDE: ok [16:32:46] hoo: i would do both [16:32:57] add a batch size, process batch, wait for slaves [16:33:08] do next batch (limit 1000) e.g. [16:33:13] aude: mh [16:33:37] Will we get troubles in production if the cron starts a new instance while the old one is running? [16:33:41] thanks aude :) [16:33:44] $pidfile = Utils::makePidFilename( 'WBpruneChanges', wfWikiID() ); [16:33:51] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: Feature switch for using subscription mechanism for change propagation. - https://phabricator.wikimedia.org/T88419#1011281 (10daniel) I propose to drop this from the sprint, since we do not yet have code that uses the new subscript... [16:34:01] hoo: how often do the cronjobs run? [16:34:07] Tobi_WMDE_SW, Lydia_WMDE --^^ [16:34:08] Every 15 minutes [16:34:12] ah [16:34:15] but seems like we have pidfile to protect us [16:34:16] DanielK_WMDE: thx [16:34:18] not sure taht works [16:34:35] 3Wikidata, Wikibase-DataModel-JavaScript, MediaWiki-Vendor, Librarization: Add data-values/javascript 0.6.0 to mediawiki/vendor - https://phabricator.wikimedia.org/T88436#1025151 (10JanZerebecki) In the long run it might be a good idea to make mediawiki-vendor a build result of the composer run in wmf branches o... [16:34:53] maybe N rows configurable? [16:35:04] Yeah, that's what I was thinking about [16:35:09] delete up to 50k rows at once [16:35:14] aude: regarding usage tracking / subscriptions when moving pages: can you confirm that the problem does not exist when not creating redirects? [16:35:16] that's still a lot, but wont break anything [16:35:31] DanielK_WMDE: no idea [16:35:40] Or maybe only 25k would suffice [16:35:46] 25k sounds good [16:36:05] aude: basically, I think it's working as designed. the redirect "uses" the item. [16:36:05] Yeah, that's still around 72M rows/ month [16:36:08] DanielK_WMDE: needs more investigating [16:36:15] :) [16:36:32] * Lydia_WMDE is off for some time - back at 8:30ish probably [16:36:41] aude: i spend three hours on this today. seems to work, except for a race condition / slave lag issue. patch for that is up. [16:37:17] would be great if you could double check some time this week [16:37:20] hoo: maybe it could do multiple batches? [16:37:30] up to some limit? [16:37:34] if we need more [16:37:39] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Feature switch for using subscription mechanism for change propagation. - https://phabricator.wikimedia.org/T88419#1025154 (10Lydia_Pintscher) [16:37:41] I could make a limit and then splice that up in 5k batches [16:38:04] yeah, then it could be 50k (maybe) [16:39:29] That whole class has no tests :S [16:39:43] Think I'll rather keep it simple then [16:39:48] don't feel like refactoring that today [16:40:43] hoo: PruneChanges? [16:40:47] yeah [16:40:52] i could look into that tomorrow. it [16:40:59] ...it's my mess :/ [16:42:06] at least factor into separate class... [16:42:14] or whatever... [16:42:16] Lydia_WMDE: re https://phabricator.wikimedia.org/T86530 <-- the RFC is "done", but the actual task isn't. shall we keep the ticket open and drop it from the sprint? [16:43:39] 3Wikidata, § Wikidata-Sprint-2015-02-03, MediaWiki-extensions-WikibaseRepository: Tracking: replace wb_terms table with more specialized mechanisms for terms - https://phabricator.wikimedia.org/T86530#1025166 (10daniel) For Wikidata-Sprint-2015-02-03 we picked this up as an RFC. The RFC part is "done" now, per t... [16:44:41] (03PS1) 10Hoo man: Only delete up to 25k rows in pruneChanges [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) [16:45:30] That's my stab at it [16:50:42] (03CR) 10Aude: "nitpicks" (032 comments) [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [16:52:06] 3Wikidata, Wikibase-DataModel-JavaScript, MediaWiki-Vendor, Librarization: Add data-values/javascript 0.6.0 to mediawiki/vendor - https://phabricator.wikimedia.org/T88436#1025189 (10bd808) >>! In T88436#1025151, @JanZerebecki wrote: > In the long run it might be a good idea to make mediawiki-vendor a build resul... [17:03:17] (03PS2) 10Hoo man: Only delete up to 25k rows in pruneChanges [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) [17:03:55] (03CR) 10Hoo man: Only delete up to 25k rows in pruneChanges (032 comments) [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [17:04:08] (03CR) 10Hoo man: "Addressed Aude's comments" [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [17:11:09] 3Wikidata, MediaWiki-extensions-WikibaseClient: Track multi-lingual label usage - https://phabricator.wikimedia.org/T89002#1025240 (10daniel) 3NEW [17:11:56] 3Wikidata, MediaWiki-extensions-WikibaseClient: Track multi-lingual label usage - https://phabricator.wikimedia.org/T89002#1025252 (10daniel) [17:11:58] 3Wikidata, MediaWiki-extensions-WikibaseClient: Allow accessing data from an item not connected to the current page - arbitrary access (tracking) - https://phabricator.wikimedia.org/T49930#1025251 (10daniel) [17:14:00] 3Wikidata, MediaWiki-extensions-WikibaseRepository: EntityIdValues should be serialized as strings, not type/number structures. - https://phabricator.wikimedia.org/T56085#1025261 (10daniel) [17:14:01] 3Wikidata, Datasets-General-or-Unknown: improve Wikidata dumps - https://phabricator.wikimedia.org/T88991#1025260 (10daniel) [17:15:04] 3Wikidata, MediaWiki-extensions-WikibaseRepository: JSON should (optionally) contain full URIs for referenced external entities - https://phabricator.wikimedia.org/T73992#1025269 (10daniel) [17:15:05] 3Wikidata, Datasets-General-or-Unknown: improve Wikidata dumps - https://phabricator.wikimedia.org/T88991#1024968 (10daniel) [17:22:24] 3Wikidata, MediaWiki-extensions-WikibaseRepository: JSON should (optionally) contain full URIs for referenced external entities - https://phabricator.wikimedia.org/T73992#1025287 (10daniel) Proposed representation in JSON: "mainsnak": { "snaktype": "value", "property": "P214",... [17:29:10] 3Wikidata: JSON should (optionally) contain expanded/normalized values. - https://phabricator.wikimedia.org/T89005#1025305 (10daniel) 3NEW [17:29:22] 3Wikidata, MediaWiki-extensions-WikibaseRepository: JSON should (optionally) contain full URIs for referenced external entities - https://phabricator.wikimedia.org/T73992#1025313 (10daniel) [17:29:24] 3Wikidata: JSON should (optionally) contain expanded/normalized values. - https://phabricator.wikimedia.org/T89005#1025312 (10daniel) [17:46:47] * hoo attempts to bribe aude into code review with CHOCOLATE! [17:47:07] heh [17:47:43] * aude is doing evil bureaucracy stuff now [18:01:55] are the results of https://plus.google.com/105776413863749545202/posts/SVQnWrZGLJC available somewhere? [18:02:56] Mineo: You mean the code used to do that? [18:03:22] well, either that or the differences between wd and mb in a nice format :) [18:03:57] (03CR) 10Aude: [C: 04-1] "is the connection manager wikibase-specific?" [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189492 (owner: 10Daniel Kinzler) [18:04:28] Lydia_WMDE: I think you might be able to help [18:04:53] I think the extension taht does that is named WikidataQuality [18:05:10] https://github.com/wikimedia/mediawiki-extensions-WikidataQuality [18:05:25] Mineo: hoo i think the students will spend more time on it in the next months [18:05:36] e.g. don't have classes and will have more time for the project [18:06:01] they might have something on labs already [18:13:42] (03CR) 10Aude: [C: 032] Use false instead of null to indicate local wiki DB. [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189486 (owner: 10Daniel Kinzler) [18:13:56] ok, I'll keep my eyes open then [18:16:36] (03Merged) 10jenkins-bot: Use false instead of null to indicate local wiki DB. [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189486 (owner: 10Daniel Kinzler) [18:21:19] Mineo: you can click "join" and then "watch" on this page to receive updates https://phabricator.wikimedia.org/project/view/989/ [18:22:25] (03PS3) 10Thiemo Mättig (WMDE): Introduce TemplateFactory::getDefaultInstance [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/187127 [18:22:27] (03PS2) 10Thiemo Mättig (WMDE): Merge TemplateRegistry into TemplateFactory [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/187343 [18:22:29] (03PS2) 10Thiemo Mättig (WMDE): Introduce TemplateFactory::getTemplates [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/187129 [18:22:31] (03PS2) 10Thiemo Mättig (WMDE): Drop TemplateRegistry::getDefaultInstance [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/187130 [18:23:06] 40 % of the reports in this component are "tracking" bugs. https://phabricator.wikimedia.org/maniphest/query/HM8e5G8TT4y./#R [18:23:17] I doubt this makes sense. [18:23:22] (03PS3) 10Thiemo Mättig (WMDE): Fix type hints in UpdateRepo classes [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189002 [18:28:56] (03CR) 10jenkins-bot: [V: 04-1] Fix type hints in UpdateRepo classes [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189002 (owner: 10Thiemo Mättig (WMDE)) [18:57:50] (03CR) 10Aude: [C: 032] Fix @return docs in WikibaseLuaBindings [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189325 (owner: 10Hoo man) [19:01:01] (03Merged) 10jenkins-bot: Fix @return docs in WikibaseLuaBindings [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189325 (owner: 10Hoo man) [19:19:07] Mineo: nothing to really show yet but it'll develop over the next weeks/months and show up on wikidata this summer if all goes as planned [20:17:32] 3Wikidata, Wikibase-DataModel-JavaScript, MediaWiki-Vendor, Librarization: Add data-values/javascript 0.6.0 to mediawiki/vendor - https://phabricator.wikimedia.org/T88436#1025775 (10JanZerebecki) I forgot for a moment that core pulls in externally maintained dependencies via composer. I distracted from the main... [20:29:42] can someone please have a look at the main page? https://www.wikidata.org/wiki/Wikidata:Main_Page [20:29:53] for me the link to twitter and co are messed up [20:31:32] they are [20:33:26] it has been marked for translation and variables (links) are lost [20:33:41] https://www.wikidata.org/w/index.php?title=Wikidata:Main_Page/Contact needs to be updated in all languages :( [20:35:29] Fixed for now [20:35:52] I just love the simplicity of the Translate extension... it's just so intuitive :P [20:36:04] thanks hoo [20:37:10] have you noticed how man test edits are coming from Spanish IP's these days? [20:38:56] matej_suchanek: i have not. interesting. [20:39:56] it happens to me sometimes that I visit eswiki and I can see their infoboxes having a link to Wikidata saying "edit in Wikidata", maybe this is the reason... [20:42:00] grrrr.... have to disable CategoryTree :/ [20:42:32] matej_suchanek: probably is why [20:43:03] matej_suchanek: oh interesting. can you send me a link next time you see it? [20:43:11] aude: uh uh? on wikidata? [20:43:15] Lydia_WMDE: i see them in duolingo all the time [20:43:24] hah [20:43:25] really? [20:43:28] wow [20:43:35] cute [20:43:40] Lydia_WMDE: just locally, problem with special page translations (conflicts) in kurdish [20:43:51] ah [20:43:51] ok [20:44:16] e.g. https://www.duolingo.com/translation/f43a9565977a76767264a3720a1fa618 :) [20:44:35] Lydia_WMDE: see what? [20:44:36] https://es.wikipedia.org/wiki/Pac-Man [20:44:44] [editar datos en Wikidata] [20:45:13] matej_suchanek: an article with "edit on wikidata" but aude already linked one so all good :) [20:45:26] (03CR) 10Daniel Kinzler: "It's something that could potentially go into core, yes." [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189492 (owner: 10Daniel Kinzler) [20:45:30] aude: wow i didn't know they had that [20:45:40] we do also in cswiki [20:46:03] * Lydia_WMDE tries to figure out if the infobox actaully uses any wikidata data though [20:46:10] but that is only a note saying "some data may come from Wikidata" with link to the associated item [20:46:14] many do [20:46:31] nice! [20:46:42] WHY DID NOONE TELL ME? :D [20:46:43] and also if a Czech label is missing, there is a link to the item [20:46:50] matej_suchanek: sweet [20:47:01] that was my idea :) [20:47:40] \o/ [20:48:06] 3§ Wikidata-Sprint-2015-02-03, Wikidata, MediaWiki-extensions-WikibaseClient: when i move a Wikibase client page, subscriptions are not updated - https://phabricator.wikimedia.org/T88357#1025910 (10daniel) The patch above addresses the issue by making sure that after we remove entries from the wbc_entity_usage t... [20:48:53] notably for the coordinates [20:49:13] * aude sure must have told lydia before [20:49:28] impossible! :D [20:50:03] 3Wikidata, wikidata-query-service: Propose query syntax for simple query language - https://phabricator.wikimedia.org/T86017#1025929 (10daniel) a:5daniel>3None Unassigning myself, since I have no idea what the scope of this ticket is. [20:52:41] https://es.wikipedia.org/wiki/Plantilla:Ficha_de_serie_de_televisi%C3%B3n [20:53:33] thx aude [20:53:57] sure [21:02:48] 3Wikidata, MediaWiki-extensions-WikibaseRepository: maintenance/importDump.php fails for wikidatawiki XML incremental dump files - https://phabricator.wikimedia.org/T72898#1025986 (10daniel) Please read the actual error message: "To avoid ID conflicts, the import of Wikibase entities is currently not supported."... [21:02:56] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Introduce setting to allow import of entities from XML dumps. - https://phabricator.wikimedia.org/T85133#939601 (10daniel) [21:02:57] 3Wikidata, MediaWiki-extensions-WikibaseRepository: maintenance/importDump.php fails for wikidatawiki XML incremental dump files - https://phabricator.wikimedia.org/T72898#1025988 (10daniel) [21:03:40] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Introduce setting to allow import of entities from XML dumps. - https://phabricator.wikimedia.org/T85133#1025990 (10daniel) a:3daniel [21:17:37] (03CR) 10JanZerebecki: "Why not put a limit in the delete instead? For the normal path it takes quite a long time to find that there are not too many rows. Otherw" [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:26:36] (03CR) 10Hoo man: "@JanZerebecki: The trick is not to use SELECT * ..., but SELECT change_time ..." [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:33:11] (03CR) 10JanZerebecki: "That improves it a bit: 1 row in set (4.95 sec)" [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:34:31] jzerebecki: On which server are you testing? [21:34:36] Weird that it's so slow for you [21:34:51] on the analytics slave [21:34:52] I mean it's certainly nasty to use offsets, but shouldn't be that bad [21:35:28] especially as the case with more rows is faster [21:37:19] hoo: you think the 5s query will pose a problem? otherwise I'll merge. [21:37:58] hoo: btw. when is that job executed? [21:38:07] Once every 15m [21:38:53] on the beefy MariaDB 10 slave it ran in less than 1s (first exec on that table from me, so not extra cached) [21:39:05] Using offsets is always nasty :/ [21:40:12] it really shouldn't if you have an index, as it is just an byte offset i.e. pointer math and your at the target row. [21:40:33] hello! i have my own wikibase instance running ... and i can create properties. but i cannot seem to add any statements to them or edit the description, etc [21:40:50] jzerebecki: I guess it's not properly optimized [21:41:04] i have changed myself to 'wbeditor', but still i do not get an 'edit' option [21:41:39] (03CR) 10JanZerebecki: [C: 032] Only delete up to 25k rows in pruneChanges [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:41:57] btw, did you test it... because I didn't [21:42:23] :P [21:42:26] You tricked me [21:42:34] oh, come on [21:42:38] that's nasty... [21:42:46] You need to quote strings [21:42:48] -.- [21:42:52] (03CR) 10JanZerebecki: [C: 04-2] Only delete up to 25k rows in pruneChanges [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:43:33] Can't believe I didn't see it :P [21:44:14] i missed that one, too :( no more merging today [21:44:30] (03CR) 10Hoo man: "Doh... got fooled here... in the above queries the timestamps also aren't quoted (they are strings)... that's the actual problem :P" [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:44:59] Sometimes you fail to see the obvious [21:45:04] at least I do [21:46:06] Why'd you -2 and not just remove the +2? Anything broken? [21:47:36] hoo: to prevent gerrit from accepting a submission, no experience with it, if a removing the +2 is sufficient... feel free to remove [21:48:16] (03CR) 10JanZerebecki: "Feel free to remove my -2 it was just to prevent submission of that version." [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:49:00] jzerebecki: It is... the bot checks for +2s again before merging [21:49:14] ah good [21:49:37] (03CR) 10JanZerebecki: [C: 04-1] Only delete up to 25k rows in pruneChanges [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:50:26] So... why the -1? [21:51:04] hoo: because of the problem you found :) [21:51:25] $dbr->addQuotes( wfTimestamp( TS_MW, $until ) ) ) [21:52:25] hoo: and $this->pruneLimit ? [21:53:15] mh no [21:53:41] anyway its too late for me, wanted to go hours ago [21:54:21] questions in spanish? [21:54:39] that's an actual offset [21:54:39] so integer [21:55:01] jzerebecki: No? [21:55:17] Might be that my message didn't make it through before, sorry [21:55:27] My crappy network over here keeps dying :S [21:56:08] * aude having fun with language fallbacks... with kurdish [21:56:52] I need to upload a photo to my profile wikipedia [21:57:23] in pixels which should be the size? [21:57:48] Just remove your -1 and add that the next reviewer should look at it like a yet unreviewed change? [21:57:58] I am new at this [21:58:42] (03CR) 10JanZerebecki: Only delete up to 25k rows in pruneChanges [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189511 (https://phabricator.wikimedia.org/T88981) (owner: 10Hoo man) [21:59:06] Thanks :) [22:10:11] 3Wikidata, MediaWiki-extensions-WikibaseRepository: css margin for wb-language-fallback-indicator is inconsistent in rtl and ltr - https://phabricator.wikimedia.org/T89047#1026202 (10aude) [22:13:01] My network is lovely today... I only lost connection a couple of times... in the last hours -.- [22:13:14] dear colleagues, how can i edit my own properties in my own wikibase instance? [22:13:31] despens: Like on Wikidata, essentially [22:13:34] (03PS1) 10Aude: Fix wb-language-fallback-indicator css for mixed rtl/ltr fallback [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189595 (https://phabricator.wikimedia.org/T89047) [22:13:57] yes, but the 'edit' links don't show up on property pages [22:14:59] it is as if i am logged out. to edit anything else is not a problem [22:17:02] since on wikidata the property editors are a small group, do i need to create a special group in my own wikibase? [22:17:14] No... try purging that page [22:17:20] also check for JS errors [22:17:44] purge = hard reload? [22:17:57] append action=purge to the URL [22:19:27] i restarted php5-fpm and now the edit links show up ... [22:19:46] what does the action 'purge' do? [22:20:12] It purges the ParserCache [22:20:20] ! ok thank you [22:20:24] will try next time [22:20:25] 3Wikidata, MediaWiki-extensions-WikibaseRepository: Show language variants in "other languages" box - https://phabricator.wikimedia.org/T89048#1026224 (10aude) 3NEW [22:26:24] (03PS1) 10Hoo man: Add our additional user rights to $wgAvailableRights [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189599 [22:27:05] Think I should write some kind of core test to ensure all extensions do that properly [22:54:29] (03CR) 10Hoo man: "See also: https://gerrit.wikimedia.org/r/189607" [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/189599 (owner: 10Hoo man)