[02:26:54] Can someone help me with proposing a new data field? [03:36:03] !admin Can someone help me with a proposal for a new property? [03:36:03] Attention requested  HakanIST sjoerddebruin revi [03:39:44] what’s your question [03:40:02] seems (unless it’s actually creating it ) others might be able to help you as well [03:40:28] (and no, I can’t create a property for you now since I’m on a vacation and have no desktop access) [07:30:25] W [07:30:31] Wonder what's causing the event bump https://grafana.wikimedia.org/dashboard/db/wikidata-datamodel-statements?refresh=30m&panelId=3&fullscreen&orgId=1&from=now-7d&to=now [07:31:32] In other news, we almost recovered from last cebwiki import on average sitelinks: https://grafana.wikimedia.org/dashboard/db/wikidata-datamodel?refresh=30m&panelId=16&fullscreen&orgId=1&from=now-6M&to=now [09:51:22] Hello, I got this error during an update through a bot: {'error': {'code': 'internal_api_error_DBQueryError', 'info': '[WvI-VwpAEDcAAG14s8AAAAAJ] Database query error.'}, 'servedby': 'mw1290'} [09:51:48] is that a temporary problem? [09:52:13] Floatingpurr: I'll check [09:53:18] thanks [09:58:46] Floatingpurr: I can't find this error in the logs [09:59:25] was that on Wikidata or testwikidata? [09:59:32] Wikidata [09:59:47] that somehow didn't make it into the logs [10:00:02] I see [10:00:11] But given it was "just" a query error, I'd say ignore for now and go ahead [10:01:21] can it be a problem of mine? guess not. I'm executing the same insert query maaany times. [10:03:57] No, certainly a bug/ infrastructure issue on our side [10:05:49] ok, thanks hoo! [10:56:36] PROBLEM - wikidata.org dispatch lag is higher than 300s on www.wikidata.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - pattern not found - 1962 bytes in 0.096 second response time [10:56:57] :S [11:07:06] RECOVERY - wikidata.org dispatch lag is higher than 300s on www.wikidata.org is OK: HTTP OK: HTTP/1.1 200 OK - 1953 bytes in 0.097 second response time [11:21:09] hoo: More servers or better logic? Or both maybe? :-) [11:26:11] Well, we can rather easily bump the resources for this… but I'm worried this might move the bottleneck somewhere else [11:26:14] where it hurts more [11:26:21] but fixing dispatching as such is easy [11:27:09] What would the next bottleneck be? Do you have enough metrics to do some sort of educated guess? [11:55:15] hoo: Or no clue? [13:04:00] PROBLEM - wikidata.org dispatch lag is higher than 300s on www.wikidata.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - pattern not found - 1967 bytes in 0.123 second response time [13:09:01] RECOVERY - wikidata.org dispatch lag is higher than 300s on www.wikidata.org is OK: HTTP OK: HTTP/1.1 200 OK - 1978 bytes in 0.109 second response time [14:29:29] Technical Advice IRC meeting starting in 30 minutes in channel #wikimedia-tech, hosts: @CFisch_WMDE & @Tonina_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [16:01:01] sjoerddebruin2: Around? [16:04:11] multichill: https://www.wikidata.org/wiki/Q50733264 seems your bot had some unicode problems [16:04:22] dunno if there are any other affected items [16:13:38] nikki: I think that was one of the ones where the source website messed it up [16:14:54] I use python requests and that takes care of all the utf-8 stuff [16:18:08] Reminds me that I still need to split up https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Collection/National_Gallery_of_Australia [16:33:57] What is the status of protection of pages in Wikidata? [17:50:25] PROBLEM - wikidata.org dispatch lag is higher than 300s on www.wikidata.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - pattern not found - 1960 bytes in 0.087 second response time [17:55:36] RECOVERY - wikidata.org dispatch lag is higher than 300s on www.wikidata.org is OK: HTTP OK: HTTP/1.1 200 OK - 1961 bytes in 0.103 second response time [18:13:03] multichill: i am now [18:23:01] Hello folks, I'm trying to load data with a bot but I continue experiencing problems like this one: {'error': {'code': 'internal_api_error_DBQueryError', 'info': '[WvM0NApAMEMAADtSlpwAAADA] Database query error.'}, 'servedby': 'mw1232'} [18:23:29] are there any known problems in this hours? [18:28:00] No, but this time it made it into the logs [18:28:40] I'll take a look in a bit [18:28:52] ok! [19:05:06] Do children that died during pregnancy count for "number of children"? [19:08:52] hm [19:09:22] (this one was 8 months, so I would say yes) [19:11:05] sjoerddebruin: What do the sources say? ;-) [19:11:16] Mostly three. :) [19:12:45] Mostly working on nlwiki without birthdate now. :) [19:12:51] less than 2k with excluding some ancient people [19:12:56] I'd expect not, but I guess maybe if they got some religious death rites that counts? [19:13:06] For their religion's people at least [19:13:13] Dunno. Just source both options? :p [19:13:44] hoo: Do you think it's feasible to include the number of (unique) references in rdf output? It's already consolidated by hash [19:14:14] Global or per entity? [19:14:24] Per entity [19:14:46] https://www.wikidata.org/wiki/Special:EntityData/Q50626475.rdf - so two for this one [19:14:51] " What is the status of protection of pages in Wikidata?" [19:14:51] that as.. odd [19:15:00] http://tinyurl.com/ycasu99y [19:16:04] hoo: Would be an interesting metric to get an idea about the depth of an item [19:21:00] multichill: Sounds good to me… could be either done as a SERVICE (not very efficient for queries, though) [19:21:13] or we could just include it in the source RDF [19:23:01] So we just put it in a page property [19:23:09] And that ends up in the rdf anyway :-) [19:24:46] Not per default… but it can be mapped very easily, yes [19:26:44] You sure? Look at how I closed https://phabricator.wikimedia.org/T144476 ;-) [19:39:09] hoo: https://phabricator.wikimedia.org/T194305 ? [19:43:46] Looks good to me [19:48:46] sjoerddebruin: Hebben we dat wel eens tegen dbpedia aangehouden? [19:48:54] multichill: niet dat ik weet [19:49:18] Is er een SPARQL query (zonder time out) die de items geeft? [19:53:28] sjoerddebruin: ? [19:54:45] SELECT ?item WHERE { ?wiki0 ?item . ?wiki0 . ?item wdt:P31 wd:Q5 . OPTIONAL { ?item wdt:P569 ?dummy0 } FILTER(!bound(?dummy0)) } [19:56:47] Maar 7281, dat is niet veel :-) [19:57:29] more than enough :x [19:58:02] But I just filter ones in ancient related categories or with work period out. [19:58:41] what to do with this property now? https://www.wikidata.org/wiki/Property_talk:P1946#Links_broken [20:00:46] Nah, I doubt anything useful will still be in there [20:01:30] sjoerddebruin: Do you use any tool to extract dates like on https://nl.wikipedia.org/wiki/Veronique_Storme / [20:01:51] Not atm, it has been a while since you did a import [20:02:10] Dates are always hard [20:02:32] Yeah, we have a lot of ways to write circa for example [20:02:45] That's why the date game was so good :) [20:03:53] And I like to add everything, it takes some time but that way we are good for years. ;) [20:05:10] sjoerddebruin: https://www.wikidata.org/w/index.php?title=Q26212056&type=revision&diff=676685712&oldid=625210913 [20:05:26] harvest templates? ;) [20:05:33] https://tools.wmflabs.org/pltools/harvesttemplates/ yup [20:06:16] I wonder how much % of nlwiki related items I've edited so far. :P [20:10:26] Floatingpurr: https://phabricator.wikimedia.org/T194299 [20:13:29] that was fast [20:15:29] https://www.wikidata.org/wiki/Q111 commons media thumbnails for audio+video+3d now work properly! :) [20:15:38] (purge maybe needed for other items) [20:17:04] Just poured a beer for that! :P [20:17:15] Nice :D [20:19:38] Did someone explore bars around the venue yet, hehe? [20:19:42] (next week) [20:35:21] thanks hoo PS: I'm really lucky I got it twice in the last 12h :D [20:35:44] Yeah, apparently… [20:36:34] honestly I'm loading 65k+ item, therefore the probability is higher then the common [20:36:35] :D [20:45:07] sjoerddebruin: It's in the middle of nowhere I think ;-) [20:45:12] University campus [20:45:15] Yeah, it seems... [20:45:26] I see a IKEA and McDonald's on the other side of the highway :P [20:49:39] * abian will try to stretch his arm :/ [20:52:01] Hmm? [20:52:01] sjoerddebruin: Dumped the list at https://nl.wikipedia.org/wiki/Gebruiker:Multichill/Kladblok . Should be able to query the database now to see the most use templates so you know what to harvest [20:53:08] * abian will be near, but not so near to meet you :( [20:54:34] :( [20:58:05] where is it? (: [20:58:20] Somewhat near Barcelona [20:59:18] sounds cool, count me out :) [21:02:07] Well... the distance is like the length of the Netherlands... but that's relatively near :D [21:04:17] Do you expect to eat at the IKEA? o.O [21:04:50] Well, I don't know what to expect for dinner. [21:04:57] Just the fact that it'll be late. [21:05:03] So I'll pack a lot of stroopwafels! [21:05:16] Yeah [21:06:03] And I hope for good coffee. [21:09:13] sjoerddebruin: https://tools.wmflabs.org/multichill/queries/nlwp/top_infobox_geen_geboortedatum.txt geen vetpot [21:09:41] multichill: dat verwachte ik al wel, zijn nog veel lastige gevallen [21:09:57] "Infobox_artiest" is meestal leeg door Grashoofdbot [21:50:24] https://phabricator.wikimedia.org/T194316 [21:50:31] ^ Wikidata breaking Special:UnusedFiles [22:37:15] i wished there was a better merging process. [23:02:01] Reedy: Oops [23:02:04] my fault [23:02:14] heh [23:04:59] Reedy: https://gerrit.wikimedia.org/r/432318 as trivial as it could be [23:05:59] cheers [23:06:23] Do you plan to/ will you backport that? [23:07:07] I need to go to bed as I'm travelling tomorrow... [23:07:22] It would make sense to, definitely [23:07:25] SWAT is going on ;) [23:09:27] Ask Roan nicely? :P [23:09:37] Sure no problem [23:10:25] RoanKattouw: Very easy to test. Check https://en.wikibooks.org/wiki/Special:UnusedFiles for no exceptions :)