[00:22:08] PROBLEM - Check systemd state on wdqs1006 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed. [00:22:50] hm, I wished I could have an english UI for foreign language wikis (: [01:14:34] bleh, totally hateable when two persons have the same name and are born in the same year [04:58:25] RECOVERY - Check systemd state on wdqs1006 is OK: OK - running: The system is fully operational [10:33:06] <[1997kB]> !admin https://www.wikidata.org/w/index.php?limit=50&title=Special%3AContributions&contribs=user&target=46.60.253.0%2F22&namespace=&tagfilter=&start=&end= [10:33:06] Please visit https://www.wikidata.org/wiki/WD:AN [10:53:54] hi! I was wondering if there was any known issue with WDQS at the moment? [10:55:20] trying a simple query such as https://tinyurl.com/yyj92xnb returns 10 empty results rows [10:55:40] ooops sorry my query is wrong >_< [10:56:30] forget about that ^^ [12:43:08] does anyone know where the subset of language codes that work as labels on wikidata live? [12:43:16] i.e. I know there's https://www.wikidata.org/wiki/Help:Wikimedia_language_codes/lists/all but that seems too complete. [12:43:24] i.e. has en-us which isn't a valid label [12:44:03] also can monolingual snaks accept any of those language codes or only the ones valid for labels? [12:45:14] mvolz: if I am not wrong, the set of language codes accepted form terms (labels, descriptions and aliases) is not the same as those accepted for monolingual snaks [12:45:28] mvolz: you can use the wbcontentlanguages API [12:45:30] https://www.wikidata.org/wiki/Special:ApiSandbox#action=query&format=json&meta=wbcontentlanguages&formatversion=2&wbclcontext=term&wbclprop=code%7Cautonym%7Cname [12:46:16] i was going to suggest https://stackoverflow.com/questions/46507037/how-to-get-all-allowed-languages-for-wikidata/46562061#46562061 too [12:46:30] (maybe that gives a different set of results?) [12:46:56] the backing code is https://github.com/wikimedia/mediawiki-extensions-Wikibase/blob/master/lib/includes/WikibaseContentLanguages.php [12:47:27] pintoch: hm, should I add another answer to that question? (wbcontentlanguages didn’t exist yet in 2017) [12:47:51] Lucas_WMDE: I would happily upvote it ;) [12:47:55] okay :) [12:49:34] ah very helpful, is there are way to get fallbacks too? i.e. if I set a monolingual snak to en-US but then I want to add a label and I want to get en? [12:49:49] set en* [12:50:22] oh yes it would be very useful to have an up to date, machine-readable representation of the fallback graph [12:51:14] I remember looking into that a while ago and could not find anything except by parsing myself all the localization files to extract the relations [12:52:39] pintoch: sample anywhere? [12:54:05] mvolz: it is described here: https://www.mediawiki.org/wiki/Manual:Language#Fallback_languages [12:54:37] you need to parse all the languages/messages/MessagesXX.php and extract the parent language somehow [12:55:23] (if I remember correctly I had the feeling that this field was not consistently formatted, so it was curiously not that easy, but I probably got something wrong as I don't see how it could work without consistent formatting) [12:55:31] pintoch, mvolz: https://stackoverflow.com/a/54906010/1420237 [12:55:48] I’m not aware of anything for the fallback graph though [13:00:40] ? https://phabricator.wikimedia.org/rSVN93968 [13:03:18] oh! okay :) [13:05:42] hm, I can’t figure out how that works [13:05:53] action=query&meta=siteinfo&siprop=general gives me a 'fallback', but it’s an empty array [13:06:04] yeah me neither :) [13:06:37] oh, it gives you the fallbacks of the *content* language [13:06:43] so that’s why &uselang=… doesn’t change anything [13:06:46] eek [13:07:21] yep, on portuguese wikipedia I get fallbacks https://pt.wikipedia.org/wiki/Especial:ApiSandbox#action=query&format=json&meta=siteinfo&formatversion=2&siprop=general [13:10:12] okay, so to find the fallback languages for fifty language codes, all you have to do is find fifty wiki installations with those content languages and make fifty separate API calls to them. child’s play, really [13:10:26] (perhaps we could add a ”fallbacks” property to the wbcontentlanguages API? feel free to open a task) [13:10:39] :D [13:11:08] yeah sounds like it could be made more efficient [13:11:25] although I guess I can just query them individually any time it comes up [13:11:55] I'm not sure content language is always the right fallback though... [13:12:00] for my use case [13:12:18] better than doing it myself though at this point [13:14:00] are there label languages that don't have a corresponding wiki or vice versa? [13:14:08] or is that guaranteed to be 1-to-1? [13:14:38] for sure there are label languages without a wiki [13:15:13] nooo [13:15:23] there’s no de-formal Wikipedia [13:16:52] so I can't get good fallbacks for those programmatically, maybe strip anything after the - will work for some of those... [13:17:57] Lucas_WMDE: if I open a ticket to expose the fallback graph, should it be against MediaWiki or Wikibase? [13:19:28] (maybe that's actually something that would be discussed on the ticket itself rather than here, I guess ^^) [13:20:22] add tons of tags and if the product managers don't like them they can remove them ;) [13:22:38] definitely at least mediawiki [13:23:01] I officially neither endorse nor denounce mvolz’ comment :D [13:23:21] depends on where the fallbacks go… we can add them to wbcontentlanguages, then it’s a Wikibase task [13:23:39] or they could go somewhere in the general MediaWiki API, not sure where, then it’s a MediaWiki task [13:23:49] could probably be discussed there, yeah [13:24:21] ok :-D [13:26:42] related? https://phabricator.wikimedia.org/T197255 [13:29:51] https://phabricator.wikimedia.org/rGMOA23f86ae89592aaac696983b35fe046a390b388a2 backend of this might be helpful? [13:31:47] i.e. using the accept-language fallbacks [13:40:18] Lucas_WMDE, mvolz: done here: https://phabricator.wikimedia.org/T217239 [13:41:05] curiously I can't figure out how to add the correct tags on that (I thought there was a catch-all Wikibase tag, but I can't find it. Same for MediaWiki) [13:47:31] i added the wikidata umbrella, but tha'ts probably not correct [14:20:35] I think wikidata is the only catch-all we have [15:01:41] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @bmansurov & @Thiemo_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:07:47] Reedy: hi again; could you please give a hint on desired crawling rate for wikidata? [15:07:57] ? [15:08:35] Reedy: maximum or desired requests per second for crawling wikidata with search engine bot [15:09:13] What do you mean by crawling? Doing what sort of requests to what endpoint? [15:09:14] https://www.mediawiki.org/wiki/API:Etiquette [15:10:22] Reedy: GET on https://www.wikidata.org/wiki/Q* [15:24:04] AMDmi3: In most cases, if you're just doing requests for the pages, you should be requesting cached pages, so they're relatively cheap for us [15:26:29] Reedy: so, 10 rps? 100? [15:30:02] AMDmi3: For reference, https://meta.wikimedia.org/wiki/User-Agent_policy [15:51:22] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @bmansurov & @Thiemo_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [16:34:23] Lucas_WMDE: should we merge https://gerrit.wikimedia.org/r/c/wikidata/query/gui/+/493114 or maybe roll back bootstrap for a bit? Because short url is not working and people are complaining [16:35:32] Bootstrap also introduced some minor, possibly undesired visual changes [16:35:59] For example, some gray borders in the wizard [16:36:45] SMalyshev: let’s merge that, I just didn’t want to +2 my own patch set [16:36:51] but the other tooltips can definitely wait [16:37:02] ok [16:37:05] (I think most of them don’t use HTML anyways) [16:37:13] Lucas_WMDE: I can hit the button if you want [16:37:17] please do :) [16:37:35] I’ve +1ed it to give some support ^^ [21:28:56] PROBLEM - Check systemd state on wdqs1005 is CRITICAL: CRITICAL - degraded: The system is operational but one or more units failed.