[07:23:59] Hi, long time no join! I got a weird Wikidata related bug, so visible that I doubt I am the first / only one who has seen it. [07:24:24] In my ca.wiki watchlist, all the Wikidata items relating to different items have the same number. [07:24:40] m D 00:37 Diego Abad de Santillán‎ (Q1335) (dif | hist) . . Jmmuguerza (discussió | contribucions) (‎Anullacion de la revision 517405200 per 179.24.213.152 (disc.) : vandalism) [07:24:40] m D 00:37 Florencio Sánchez‎ (Q1335) (dif | hist) . . Jmmuguerza (discussió | contribucions) (‎Anullacion de la revision 517405200 per 179.24.213.152 (disc.) : vandalism) [07:24:59] Note that these two entires have both (and link both to) Q1335 [07:25:12] I have dozens of entries only today, all linking to Q1335 [07:25:54] And I don't know whether this is a good place to report this, but here I am, happy to do whatever you tell me. :) [08:10:56] Just in case an image explains the problem better: https://phabricator.wikimedia.org/F8701610 [08:11:07] As you can see, yesterday at some point (new deployment?) a "(Q....)" appeared next to each Wikidata entry, being the number always the same: Q1335 [08:15:09] Doh, sorry for the noise. It seems that all these entries are indeed related to an act of vandalism to Q1335 (Montevideo). It's just that the way it is presented in the watchlist is not intuitive (IMHO). [08:17:16] I don't get why one edit on a Wikidata entry causes a dozen events in my watchlist, when I am not watching the Wikidata entry or its associated Catalan Wikipedia page. https://www.wikidata.org/w/index.php?title=Q1335&type=revision&diff=517420498&oldid=517405200 [08:17:25] But that's all I had to say. Me goes silent again. [08:58:26] HELLO [09:10:31] Hello there, is there a way to extract the subset of Wikidata related to the life sciences? [10:01:03] Lydia_WMDE: map done [10:59:24] hello, why sometime a wikidata entry is both a class and an instance? (e.g., https://www.wikidata.org/wiki/Q17853226) [11:16:30] Ciccio: I don't know anything about that one, but sometimes we have both instance and subclass because it depends how you look at it [11:16:53] like with instance of car model + subclass of car, or instance of taxon + subclass of dog [11:31:36] nikki: so it's perfectly legal to have such kind of entities. Cool! (even if it may lead to undecidability in reasoning tasks, but that's not the purpose of Wikidata) [11:33:37] https://grafana.wikimedia.org/dashboard/db/wikidata-dispatch?refresh=1m&orgId=1 :( [11:33:54] Lydia_WMDE: are you working on this? ^ [11:36:35] addshore: so improvements in south america, north of europe and asia... [11:36:57] Oh, and we can see a bit of Africa now... [12:26:56] WikidataFacts: oh, another thing I don't like about the icons is that they're right next to where I'm looking when typing... makes it instantly feel a lot more cluttered to me [12:53:06] sjoerddebruin: indeed [12:56:57] nikki: did you see the option to make the editor full-screen? does that help? [13:13:51] WikidataFacts: can't see the results when using that :/ [13:18:28] I just resorted to even more custom css, it doesn't look as good as before but at least I don't have to look at the icons any more :P [14:52:46] Hello, where can I discuss about the integration of new data sources (Phabricator)? [15:11:21] probably not phabricator [15:11:23] https://www.wikidata.org/wiki/Wikidata:Data_Import_Hub maybe? [15:11:33] Ciccio: Perhaps here: https://www.wikidata.org/wiki/Wikidata:Partnerships_and_data_imports [15:18:49] nikki: Ainali thank you! [15:37:37] addshore: \o/ [15:37:39] thank you! [15:37:58] sjoerddebruin: i am traveling in china atm and internet is .... [15:37:59] not good [15:38:09] rip [15:38:11] i had not seen the issue yet but there seems to be a ticket already [15:38:24] i'll ping people if it doesn't move [15:38:35] I've searched for a ticket yesterday, I think. [15:38:47] was filed today afaics [15:41:14] Can't find it. [15:42:04] Is it related to https://phabricator.wikimedia.org/T164173? [15:51:03] sjoerddebruin: ah i thought you meant the fact that the boards are not updating [15:51:37] the lag is nothing we can do anything about. the high reate editing on wikidata needs to stop (and i hope it has now and the dispatching only needs to catch up now) [15:51:59] https://phabricator.wikimedia.org/T170282 is what i meant [15:54:43] Ok [17:31:31] addshore: ping? [17:42:43] SMalyshev: pong [17:43:29] addshore: hi! could you check whether backups for wikidata are running normally now? the ttl one is still not there but I wonder whether it's because it's slow or because something happened to it [17:43:52] it should be there by now, judging from past times, but it's not so I'm worried [17:47:49] hmmm [17:49:17] I can't remember where to look ;) [17:50:02] I think it's snapshot1007 or somethign like that [17:50:51] definitely one of the snapshot ones, let me see the logs back [17:51:05] yeh, looks like I was on 1007 last time [17:51:15] in /var/log/wikidatadump I still only see things for the json logs [17:51:28] huh that's not good [17:51:28] also truthy-BETA but thats beta... i guess... [17:51:39] all ttl ones are BETA [17:51:46] but they still should run [17:51:51] aaah *looks* [17:52:17] there are a bunch of logs for dumpwikidatattl-wikidata-20170710-all-BETA [17:52:41] ah, good [17:52:53] so is it still running? [17:53:03] https://usercontent.irccloud-cdn.com/file/cWX3dBeU/image.png [17:53:23] yup, shard 3 is still spitting stuff into the logs [17:53:42] addshore: ahh ok then, then it's just slower then usual. I'll wait. Thanks for checking :) [17:53:49] no worries :) [18:43:38] Hello! Anyone from WMDE/other WIkidata team dev. in here? [18:44:23] I've made outreach contact with EoL, and would like to discuss with someone from the Wikidata team as well [18:44:48] o/ [18:46:55] Hello! :D [18:47:41] Hello! [18:47:49] I've been discussing with someone over at EoL about data donations, and how they may be able to use our data over API (or something). Do we have a wikipage about something like this? [18:48:19] For data donations see https://www.wikidata.org/wiki/Wikidata:Data_donation [18:49:00] hope it helps :) [18:49:53] ah, thanks! And if someone over there want to talk (ver the phone/email with someone (who is good at otreach), who cna I direct them to? [18:50:52] https://wikimedia.de/wiki/Mitarbeitende and look for "Jens Ohlig" if it is data donation specific. There is an email there. [18:51:32] Auregann_WMDE << is also on IRC :) and I expect one of them may also be able to sort out something over the phone / a call too! [18:51:42] Ah thanks! [18:57:07] Lydia_WMDE: https://phabricator.wikimedia.org/T153546 <- we might need to explain how to file a task? [18:59:37] Hi Josve :D [19:34:06] Hi sjoerddebruin :) [19:34:44] <3 [19:50:43] addshore: do you know what's up with https://phabricator.wikimedia.org/T169539 ? [19:54:38] legoktm: yes, probably [19:54:42] we have to manually merge the builds [19:54:47] they have been failing for a while [19:55:03] generally aude is the only one that merges them / fixes them, and possible hoo sometimes [19:55:08] :( [19:55:23] so code is just being merged without it being deployed? [19:55:24] https://gerrit.wikimedia.org/r/#/c/364397/ [19:56:04] things landing in Wikibase does not mean it will be deployed the following week [19:56:20] bleh [19:56:23] ok, how can I help? [19:56:34] I also need my Wikibase patches to be deployed :/ [19:57:49] haha [19:57:52] *looks at the tests* [19:58:21] WikibaseQuality\ExternalValidation\Tests\Api\RunCrossCheckTest::testExecuteMissingParams [19:58:26] Failed asserting that exception message 'A parameter that is required was missing.' contains 'A parameter that is required was missing. (Either provide the ids of entities or ids of claims, that should be cross-checked.)'. [19:58:30] in https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm-jessie/17746/console [19:58:53] that looks like that needs a patch to fix the test in WikibaseQualityExternalValidation [19:59:12] but WikibaseQualityExternalValidation isn’t live on Wikidata afaik [19:59:18] is it part of the build but then disabled via config? [19:59:46] bah, this build step is so foobar currently :D [20:01:06] It looks like wmf.7 was built on June 27th by aude so that ticket legoktm saying it hasn't been updated since 2017-06-19 isnt strictly true [20:02:02] It looks like .8 was skipped / the whole train skipped .8 anyway [20:02:16] addshore: except I think aude did that in wmf.7 and not in master [20:02:37] Should we stick that in master too? [20:02:39] master itself was last merged in https://gerrit.wikimedia.org/r/#/c/359917/ [20:02:40] yes [20:02:44] I think that fixes anomie's problem [20:02:53] okay, we can do that. [20:03:10] and fair point, master should be updated whenever a branch is otherwise beta falls out of sync / is behind [20:04:49] hm I don't think it's cherry-pick-able :( [20:04:51] ++$wgWBRepoSettings["sharedCacheKeyPrefix"] = "wikibase_shared/_mediawiki_extension_wikidata"; [20:04:51] ++======= [20:04:51] ++$wgWBRepoSettings["sharedCacheKeyPrefix"] = "wikibase_shared/wikidata_1_30_0_wmf_6"; [20:05:19] which file is that in? [20:05:37] changing it back to _mediawiki_extension_wikidata should be fine afaik, as long as that is what is in master [20:05:49] I was trying to cherry-pick the wmf.6 commit aude made over to master [20:07:15] that was WikibaseRepo.settings.php [20:10:50] legoktm: https://gerrit.wikimedia.org/r/#/c/364520/ ? [20:10:52] might work [20:11:24] should probably fix a few tiny things like the gitreview file, but lets see what jenkins says first [20:11:36] did you delete all of extensions/{ExternalValidation,MediaInfo} on purpose? [20:11:48] I just copied exactly what was on .7 [20:12:30] * legoktm crosses fingers [20:12:41] as long as they are not on beta *checks* [20:13:01] nope [20:13:42] legoktm: failing for some other reason https://integration.wikimedia.org/ci/job/mwext-testextension-hhvm-jessie/10743/console [20:13:47] best bet is to wait for aude [20:16:10] legoktm: a dupe? https://phabricator.wikimedia.org/T169598 [20:16:59] yep [20:17:10] I'll merge them [20:17:46] Right, I'm gonna have a hot choc and then think about this [20:24:50] also, we really need to split up the build [20:39:58] legoktm: split it up, as in? :P [20:40:08] get rid of it! there's a ticket somewhere [20:40:21] composer dependencies should go in mediawiki/vendor, and extensions get deployed the normal way [20:41:16] legoktm: yeh i can't find the ticket :D I swear there is one too [20:42:26] does the vendor repo get bundled in the tarball legoktm ? [20:42:32] yep [20:42:52] hm,, so extensions deployed the normal way *looks at what we currently deploy* [20:42:55] at some point once the wmf dependencies overwhelm the core dependencies we need to re-think that [20:43:36] so, that would mean we have to put the deps of every single wikibase extension into the vendor repo [20:44:37] are there that man? [20:44:39] many* [20:45:47] wikibase/* data-values/* serialization/serialization diff/diff [20:46:06] all the wikimedia/* ones are already in vendor [20:46:13] ack [20:46:44] serialization hasn't been changed in 3 years heh. [20:47:13] im surprised there isnt a nice toll to list all deps of a package, hmmm [20:47:19] or can I just not find it [20:47:51] ahh wait, got it [20:48:07] https://usercontent.irccloud-cdn.com/file/VtjLwaP6/image.png [20:48:24] `composer licenses` [20:48:33] or...that [20:48:59] if only it was an animation [20:52:33] legoktm: https://s10.postimg.org/rdj7ahm2x/1806538_1.gif xD [20:52:49] ah perfect, that'll make it so much easier [20:53:03] yup [20:53:08] I know exactly all the dependencies now! [20:53:14] oh, it’s beautiful [20:53:35] also super easy patches: https://gerrit.wikimedia.org/r/#/c/364554/ https://gerrit.wikimedia.org/r/#/c/364558/ [20:54:58] ty [20:55:01] [= [20:55:40] we should probably wait for the build to get fixed before tearing it apart I suppose [20:56:08] Looking at that spining gif, we have 7 deployed extensions I think [20:56:53] ArticlePlaceholder, PropertySuggester, Wikibase, WikimediaBadges, Wikidata.org, WikibaseQuality, WikibaseQualityConstraints [20:58:41] WikimediaBadges and Wikidata.org should be easy to split out, they're pretty small [20:58:52] im making a full list now [21:00:58] legoktm: https://etherpad.wikimedia.org/p/wikidatabuild [21:02:56] there you go, that sums it all up [21:03:19] I just approved https://gerrit.wikimedia.org/r/#/c/359055/ [21:03:29] nice [21:03:43] also there's a bunch of settings stuff in the build too right? [21:04:36] oooh, legoktm thats not event the full list [21:05:15] there's more? [21:05:23] okay, apparently i missed 1 ;) [21:05:30] * legoktm phew [21:07:52] aah legoktm https://github.com/wikimedia/wikidata-build-resources/blob/master/build/tasks/updatecomposer.js#L20 [21:08:11] Now I have found that I might be able to make a master build without those 2 extensions, maybe [21:08:27] sigh [21:14:44] legoktm: lets see https://gerrit.wikimedia.org/r/#/c/364597/ [21:15:11] nope, CI already says no [21:15:26] :( [21:15:31] Fatal error: require(/home/jenkins/workspace/mwext-testextension-hhvm-jessie/src/extensions/Wikidata/extensions/Wikibase/repo/config/EntityPrefixSearchProfiles.php) [21:15:38] File not found in /home/jenkins/workspace/mwext-testextension-hhvm-jessie/src/extensions/Wikidata/extensions/Wikibase/repo/Wikibase.php on line 1026 [21:15:54] 21:14:51 Fatal error: require(/home/jenkins/workspace/mwext-testextension-hhvm-jessie/src/extensions/Wikidata/extensions/Wikibase/repo/config/EntityPrefixSearchProfiles.php): File not found in /home/jenkins/workspace/mwext-testextension-hhvm-jessie/src/extensions/Wikidata/extensions/Wikibase/repo/Wikibase.php on line 1026 [21:16:00] oh yeah [21:19:33] Apparently I just missed a bunch of stuff in the commit [21:19:53] git add . ? [21:20:02] yup, see PS2 [21:21:11] progress! [21:21:25] Progress is my middle name!!!! [21:21:30] shame my first name is slow.... [21:21:30] haha [21:22:21] wow, I didn’t know addshore was Mayor Goldie Wilson ;) [21:23:06] git is funny sometimes: [21:23:06] rename from extensions/ExternalValidation/CODE_OF_CONDUCT.md [21:23:06] rename to vendor/wikibase/javascript-api/CODE_OF_CONDUCT.md [21:23:39] hah [21:24:02] how many cookies does this get me? [21:24:06] ;) [21:25:28] 21:24:05 Fatal error: Undefined interface: CirrusSearch\Search\ResultsType in /home/jenkins/workspace/mwext-testextension-hhvm-jessie/src/extensions/Wikidata/extensions/Wikibase/repo/includes/Search/Elastic/ElasticTermResult.php on line 17 [21:25:56] 21:19:48 + zuul-cloner --color --verbose --map /srv/deployment/integration/slave-scripts/etc/zuul-clonemap.yaml --workspace src --cache-dir /srv/git https://gerrit.wikimedia.org/r/p mediawiki/core mediawiki/vendor mediawiki/extensions/Wikidata mediawiki/extensions/Elastica mediawiki/extensions/GeoData mediawiki/extensions/Scribunto mediawiki/extensions/cldr [21:26:01] no CirrusSearch in that list [21:26:41] ElasticTermResult is new [21:27:00] legoktm make a patch for adding that dep to the CI list of extensions? [21:27:11] already on it [21:27:14] :) [21:27:14] addshore: +1 https://gerrit.wikimedia.org/r/364601 Wikidata extension depends upon CirrusSearch [21:27:40] {{done}} [21:27:40] How cool, addshore! [21:27:44] AsimovBot: I know! [21:28:03] legoktm: I'll let you do that and recheck, I'm gonna grab a drink and look for some flights [21:28:21] oh wow, I didn't realize you were coming here for your cookies. I better go buy some [21:29:16] xD [21:31:32] 21:31:16 + zuul-cloner --color --verbose --map /srv/deployment/integration/slave-scripts/etc/zuul-clonemap.yaml --workspace src --cache-dir /srv/git https://gerrit.wikimedia.org/r/p mediawiki/core mediawiki/vendor mediawiki/extensions/Wikidata mediawiki/extensions/BetaFeatures mediawiki/extensions/CirrusSearch mediawiki/extensions/Cite mediawiki/extensions/Elastica mediawiki/extensions/GeoData mediawiki/extensions/MwEmbedSupport mediawiki/extensions/ [21:31:32] PdfHandler mediawiki/extensions/Scribunto mediawiki/extensions/SiteMatrix mediawiki/extensions/TimedMediaHandler mediawiki/extensions/VisualEditor mediawiki/extensions/cldr [21:31:39] pulls in a ton more extensions, oh well [21:32:20] :D [21:33:23] there's like 2k more tests [21:37:39] addshore: all passed :)) [21:37:43] cool [21:37:50] Well, I'm fine wwith hitting +2 for you [21:37:58] un draft it? [21:38:01] let me just give it a better commit name [21:38:05] lol [21:40:44] right, lets watch the tests pass 1 more time then I'll +2 it, and then write and email to the rest of WMDE saying what I did and why! [21:41:07] <3 [21:41:37] I should be able to easily make the daily build do what I just did too, but need to ask the team first, as I'm pretty sure there is a reason thats not being done [21:59:09] addshore: it has V+2 now :) [21:59:21] +2ed [22:07:55] legoktm: looks like its merged [22:07:58] let me know if beta explodes [22:08:11] I'll keep an eye out [22:08:18] thanks again :D [22:08:23] np :)