[00:00:31] hoo: I've almost done [00:00:53] just one question, more related to SQL than to wikidata [00:01:24] last time I've made a query is more than 10 years ago :-P [00:01:45] :D [00:01:56] I've obtained the result that I need grouping by ips_item_id [00:02:13] I've shown also ips_site_page, ips_site_id [00:02:57] but for easiness I'd like to show only the ips_site_page related to ips_site_id='enwikivoyage' [00:03:17] currently it show (I think) just the first occurrence of the group [00:03:26] how can I force it? [00:03:30] Can you paste me your query? [00:03:34] ok [00:03:36] On pastebin.com for example [00:04:00] oh, ok [00:04:27] Large pasts don't play nice on IRC [00:04:31] http://pastebin.com/6r4mVyM0 [00:04:35] right ;-) [00:05:23] No need to join against wb_entity_per_page in that query [00:06:00] ? [00:06:15] Well, that query doesn't make use of wb_entity_per_page, so no need to use it in there [00:06:19] but doesn't matter here [00:07:02] ahhh [00:07:16] do you mean that all the fields come from the other table [00:07:30] yeah [00:07:44] I've thought that wb_entity_per_page.epp_entity_type = "item" was important... [00:07:58] no idea on its use [00:08:12] but you told me, and I've add it :-P [00:08:34] It is, if you need the information from wb_entity_per_page [00:08:37] otherwise it's not [00:09:42] right, I've thought that it was needed to filter something on the other table [00:09:45] however [00:09:49] doesn't matter [00:10:06] yeah [00:10:08] now I'm wondering if it's possible to force a specific value on the grouping [00:10:24] I guess you will need a sub query for what you're trying to do [00:10:46] you want the IDs of the top wikivoyage articles that don't exist on it.wikivoyage, right? [00:10:56] right [00:10:59] ah [00:11:01] IDs of the items of wikivoyage areticles [00:11:17] I what to restrict the search on NS:0 [00:11:26] yes [00:11:33] *want [00:12:03] We don't have namespaces in Wikidata as such [00:12:28] you could restrict the page titles to not contain a colon, I guess... if that's good enough [00:13:18] I mean NS:0 on Wikivoyage, but yes, the absence a colon should be ok [00:14:03] ips_site_page NOT LIKE '%:%' is fine, right? [00:17:07] yeah, will be slow, though [00:18:00] any alternative? [00:18:13] Nothing that's easy to implement [00:18:27] k [00:20:44] hoo: I've changed into http://pastebin.com/4sYapiR6 but it seem that adding the order by, everything has became very slow [00:21:21] Not surprising, because it has to generate the whole list in memory and then sort it [00:21:39] But also, that will include things that already exist on itwikivoyage [00:22:04] ? [00:22:16] it's not enough ips_site_id <> 'itwikivoyage' ? [00:22:41] That will only make links to itwikivoyage not count [00:23:21] oh gosh [00:23:42] I need to select only the Qxxx that are not present on itvoy [00:24:12] but you are right in that way I just discarded the relevant row [00:24:30] should I make a sub select with ips_site_id <> 'itwikivoyage' ? [00:24:39] yeah, you need a subquery [00:25:09] let me try [00:34:14] hoo: the only idea that comes up to my mind is to select all the itwikivoyage with a select and all the *wikivoyage with another select, and then choose from the second only the ones not contained in the first one .... but it seems slow [00:34:18] what do you think? [00:34:47] yeah, that sounds about right [00:37:02] can you recall me how can I state: "not in"? [00:37:40] Well, several ways [00:38:07] you can go "SELECT … WHERE ips_item_id NOT IN(SELECT ips_item_id … WHERE ips_site_id = 'itwikivoyage')" [00:38:12] I mean (SELECT ips_item_id ....) as Qit, (SELECT ips_item_id ....) as Qall WHERE Qall.ips_item_id "....not in..." Qit.ips_item_id [00:38:31] ahhhh ok [00:49:45] hoo: http://pastebin.com/kyi2EGvK [00:49:57] running is quite slow... however, do you think it's fine? [00:50:43] Looks like it's going to work [00:52:03] any idea on how to select only the ips_site_page related to envoy? [00:52:24] another subquery? [00:52:47] You mean to additionally show it in the results? [00:52:57] In that case, yes [00:53:48] previously it showed ips_site_page, ips_site_id of the first occurrence (I think), but I'd like to force envoy [00:54:50] Yeah, you will need a small subquery for that [00:55:14] k [01:15:29] hoo: done! [01:15:36] thanks a lot for your support [01:15:43] Cool, great :) [01:15:57] now I deserve a sleep... considering that is more than 2AM :-P [01:16:06] goodnight :-) [01:16:19] good night [04:25:15] How are you fags doing tonight? [10:23:02] Damn. https://www.wikidata.org/wiki/Special:Contributions/Vargenau [13:17:11] hoo: https://www.wikidata.org/wiki/Wikidata:Contact_the_development_team#Lag [13:18:25] sjoerddebruin: Maybe stuff can't cope with the up to 30 edits per second we have [13:18:36] Could be. [13:50:42] has there been a sudden increase in edits? it seems that sparql and wdq both started having problems at the same time [13:51:01] When was that= [13:51:03] ? [13:52:03] I don't know exactly, I noticed yesterday morning that wdq wasn't returning up to date results, and I saw someone ask about sparql not being up to date not long after that [13:52:16] We had a lot of edits yesterday [13:52:43] and wdq is apparently still only at 3am yesterday... [13:52:54] it was at 5am when I went to bed, I have no idea how it managed to go backwards [13:53:09] hm... WDQ is clustered [13:53:16] it might have gone split brain [13:53:52] We had 1.5M edits yesterday and 400k today until now [13:54:02] That's a lot, but we had that before [13:59:52] =o [14:00:12] Is anyone else not able to get to phabricator? [14:00:15] addshore: do we have # of edits in the dashboard? [14:00:17] or is it just me :/ [14:00:25] not just you :( [14:00:33] aude: not on our ones yet [14:04:02] http://wikidata-metrics.wmflabs.org/?t=wikidata_daily_edits_delta hm? [14:04:28] o_O [14:05:27] We had more edits than yesterday before [14:29:06] Over a million edits a day! Remarkable. [14:29:09] Hello, #1 ;-) [14:29:28] hi harej :D [14:35:44] <3 [14:36:17] I presented on Wikidata to a group of US government people, including the people who run Data.gov [14:36:25] nice [14:36:45] meh, battery is giving up [14:53:27] Guys, I think we broke Wikidata. https://www.wikidata.org/wiki/Wikidata:Property_proposal/Natural_science#Pocket_guide_to_Chemical_Hazards [14:53:54] As I understand it the error is caused by too many expensive functions, so we need to find a way to archive some of these. [15:05:49] Lydia_WMDE: https://phabricator.wikimedia.org/P2327 and https://phabricator.wikimedia.org/P2326 [15:10:39] SuccuBot needs to pay to edit. ;) [15:22:41] Lydia_WMDE: check out the right hand side of https://grafana.wikimedia.org/dashboard/db/wikidata ;) [15:22:55] sjoerddebruin: :P [15:23:05] addshore: <3 [15:25:32] Lydia_WMDE: what are all of the other dashboard you have currently been lookinga t then? [15:25:44] including that magic one you have bookmarked but we couldnt remember! [15:25:56] https://vital-signs.wmflabs.org/#projects=wikidatawiki/metrics= [15:26:04] ahh, of course! [15:26:06] https://tools.wmflabs.org/wikidata-primary-sources/status.html [15:26:19] http://phragile.wmflabs.org/projects/wikidata [15:26:30] yeah those [15:26:50] https://tools.wmflabs.org/wikidata-primary-sources/status.html seems faily.... empty... [15:26:55] faily / fairly... :P [15:26:55] reload [15:26:59] it sometimes does that [15:41:15] Lydia_WMDE: hey [15:41:25] benestar: huhu [15:41:34] @ the merge patch: we need to fix the messages anyways [15:41:48] all of them aren't translatable at the moment (not sure why we did it that way= [15:42:53] so I think making them translatable and more verbose is another task [15:42:55] Lydia_WMDE: please, please, please, tell me that https://phabricator.wikimedia.org/T117524 will be resolved soon? :p [15:43:25] we really want to use wikidata on wikinews https://phabricator.wikimedia.org/T109780 [15:43:25] Harmonia_Amanda: looking [15:43:45] Harmonia_Amanda: i am going to send announcement later today. dec. 2nd [15:43:57] thank you! [15:44:00] benestar: ok [15:44:20] * Harmonia_Amanda is happy [15:44:23] :D [15:44:25] \o/ [15:44:30] * Lydia_WMDE loves making people happy [15:44:39] though i think i made some sad already today [15:44:52] well that mean I'll have wikidata before the sled dog racing season [15:44:57] Lydia_WMDE: so you'd like "The two items cannot be merged because one of them links to the other using property {$statement->getPropertyId()}" as a message? [15:44:57] so it works for me :p [15:45:14] benestar: sounds good to me [15:45:59] Lydia_WMDE: and messages should be translatable, right? [15:46:17] benestar: if we show it to users in the UI then yes imho [15:46:32] We do in the special page at least [15:47:08] so meeeeeeeeerge!!! :D [15:47:41] !m 253583 | addshore [15:47:42] addshore: merge merge merge MERGEEEEEEEEEEEEE 253583 [15:47:43] SMalyshev: so it seems the updater is not limited by cpu nor io. any idea why it started lagging days ago? [15:47:47] :/ [15:47:48] !merge 253583 | addshore [15:47:48] addshore: merge merge merge MERGEEEEEEEEEEEEE https://gerrit.wikimedia.org/r/#/c/253583/ [15:47:52] that one :D [15:48:21] lol [15:48:34] Lydia_WMDE: succu is adding russian labels in latin script? o_O [15:49:00] no idea how they handle species/taxa [15:49:03] so might be ok [15:49:08] i stay out of that field [15:49:14] and usually he does good stuff [15:49:42] Always feel like I'm the only vandalism fighter. https://www.wikidata.org/w/index.php?title=Q937&action=history [15:50:09] Always... https://www.wikidata.org/w/index.php?title=Q2681562&action=history [15:50:26] * Lydia_WMDE hugs sjoerddebruin [15:51:01] sjoerddebruin: I watch my watchlist but that's all, I confess [15:51:43] My patrol work is blocked by https://phabricator.wikimedia.org/T105189 [15:52:39] :/ [15:52:50] seems like this is something that needs fixing in core [16:13:32] Lydia_WMDE: epic dashboard homepage now ;) https://grafana.wikimedia.org/dashboard/db/wikidata [16:14:02] addshore: wohoooooooooooo! [16:14:11] got a logo and everything.... [16:18:14] addshore: did you finally find out where the wbgetclaims api calls come from? [16:21:27] aude knows :) [16:30:54] benestar: want a fun fact? [16:32:17] on 11-11-2015 http://www.wikidata.org/wiki/Q20898410 was the 3rd most viewed page on wikidata :O [16:33:01] damn [16:33:37] you know, I think we should organise votes for https://www.wikidata.org/wiki/Wikidata:Showcase_items [16:33:55] like, five users in favor => showcase item [16:34:02] The showcase item process is so time consuming... Waiting forever. [16:34:23] because no one know how to validate a showcase item right now [16:38:34] Damn. https://www.wikidata.org/w/index.php?title=Wikidata%3AShowcase_items&type=revision&diff=185655268&oldid=184850175 [16:41:26] sjoerddebruin: I'm not sure who validate the showcases items [16:41:42] It seems like one person only needs to validate it. [16:48:27] sjoerddebruin: Harmonia_Amanda: yes! let's get some rules and make it actually work [16:48:43] i agree that the lack of rules for promotion is an issue with it [16:48:53] something simple [16:49:02] yeah [16:49:06] I think the requirements could also be adjusted. [16:49:11] probably a list a criteria which must be met [16:49:17] these are there [16:49:18] Don't think sitelinks are a pro anymore. [16:49:20] and after the list is checked [16:49:21] but could be changed [16:49:35] three users agreeing without opposition [16:49:51] sjoerddebruin: if the item doesn't need them that is ok. i think that is what the criteria us supposed to convey. [16:49:51] or 75% approval in a week-period ? [16:49:56] like add all that are relevant [16:50:00] The best items I've created don't contain sitelinks. [16:50:08] yeah that is ok then [16:50:14] yes, sitelinks should be optional [16:50:15] (Just to be sure it doesn't get deleted :P) [16:50:30] they are yeah - maybe needs to be clarified in the wording [16:51:03] "Ordered adequately" isn't possible anymore [16:51:20] sjoerddebruin: maybe we can work in a subpage about our proposal? [16:51:21] 10 statements should exclude identifiers [16:51:36] Would be great! [16:51:45] I don't have much time now, need to go to a meeting. [16:51:51] And have to travel, in the rain. :( [16:51:54] https://www.wikidata.org/wiki/User:Harmonia_Amanda/Showcase_items [16:52:03] Harmonia_Amanda: i did most of the stuff that is there. feel free to edit directly [16:52:06] (will watch that) [16:52:52] Harmonia_Amanda: when you are done i can add it to the weekly summary also to get some more people to work on showcase items [16:53:01] Lydia_WMDE: ok [16:53:02] and maybe we should add some to the frontpage? [16:53:12] yes that would be great ! [16:53:17] There should be a section with a random showcase item. [16:53:22] maybe when we have a procedure running [16:53:23] *nod* [16:53:27] jep [16:53:33] we can add a section "showcase item of the week" [16:53:35] Pretty sure we can make that look great now with arbitrary acces right? [16:53:43] should be possible yeah [16:53:50] and then just swap the ID? [16:53:55] Yeah [16:54:20] Also, the homepage should be more dynamic. [16:54:38] It's all about names and the Mount Everest since the refresh [16:54:48] And the most dynamic section, the news, is at the bottom. :/ [16:54:57] agreed [16:55:07] i think most people don't see it [16:55:10] which is a bit sad [16:56:38] https://www.wikidata.org/wiki/User:Harmonia_Amanda/Showcase_items what do you think? [16:57:01] I confess I never go on any homepages... [16:57:14] will have a look in 5 mins [16:57:27] I go directly to my watchlist/userpage/or community talkpages [16:57:45] yeah but i think it is still important for all the new people [16:57:50] yes [16:58:07] it's really important for the people not yet wikidatians [17:00:24] right [17:00:31] * Lydia_WMDE looks at your page [17:01:27] Harmonia_Amanda: short and sweet. like it [17:01:32] ^^ [17:03:05] I will also give the showcase page itself a refresh [17:04:02] sjoerddebruin: do you agree with my proposal? [17:04:08] @Lydia_WMDE prefix schema: [17:04:08] SELECT * WHERE { schema:dateModified ?y} [17:05:07] sjoerddebruin: Harmonia_Amanda: you deserve cookies [17:05:19] ooohhh cookies! [17:06:25] Nothing weird, right? [17:06:28] https://www.wikidata.org/wiki/Wikidata:Project_chat#data_access_for_Wikispecies.2C_MediaWiki.2C_Meta_and_Wikinews_is_coming cookies! :p [17:06:58] "A reasonable set (~10) of completed translations : labels, descriptions and properties" and "Aliases when appropriate, in each language;" sounds weird though. [17:07:09] Most properties already have translations [17:07:20] And what is "each language"? :) [17:07:33] sjoerddebruin: I copied from the actual page [17:07:41] but you can edit for clarifying [17:07:50] Harmonia_Amanda: :P [17:08:04] Yeah, I think it could just be "A reasonable set (~10) of completed translations: labels, descriptions and aliases (when appropriate);" [17:08:14] *nod* [17:08:16] sjoerddebruin: ok [17:08:26] edit it:) [17:08:38] I'm packing for my lovely meeting.... [17:08:46] ok, I do it [17:08:59] done [17:10:39] * Lydia_WMDE heads home [17:10:40] laters [17:10:46] :) [17:13:40] I end up on the homepage all the time, 'cause I keep clicking the logo to open a new tab [17:14:02] which is what annoys me about the sparql site, there's no link back to the main page with an empty query :P [17:14:14] ^^ [17:14:15] (hasn't annoyed me quite enough to go report it to anyone yet though) [17:17:39] Harmonia_Amanda: by "an hundred editions" do you mean edits? [17:17:46] yes [17:17:58] nikki: correct it please? [17:18:33] done [17:18:51] thank you [17:21:56] "destitution of status" sounds a bit weird too... removal of status, maybe? [17:22:04] ok [17:22:12] anyway, it looks good to me too :) [17:22:36] English isn't my native language so sometimes I write it weirdly [17:29:52] that's ok :) [17:30:41] I'm used to things being worded strangely in english anyway, I'm a native english speaker living in a country where english isn't the native language :D [17:33:06] :) [17:54:19] Lydia_WMDE: should the newly announced things be added to https://www.wikidata.org/wiki/Wikidata:Arbitrary_access? [18:26:35] DanielK_WMDE_: \o/ re dispatching [18:27:03] nikki: i think not - it is more of a regular data access rollout. but it also doesn't hurt there if you want [18:27:54] ah, wasn't sure which one it was [18:28:18] Lydia_WMDE: lesson learned: make sure we know who's responsible for getting critical fixes into swat. [18:28:27] k [18:28:33] the fix was on master for a week. [18:28:38] -.- [18:29:27] is johannesk_wmde around? [18:32:24] yurik: usually not in this channel [18:32:31] dunno if he is somwehere else [19:10:35] Lydia_WMDE: i've noticed my watchlist on wikidata loads *very* slowly (moreso lately) [19:10:56] aude: hmmmmm [19:11:02] * aude admits to having a big watchlist :P [19:11:04] {"wgBackendResponseTime":50038,"wgHostname":"mw1245"} [19:11:09] aude: do you already have an idea why or should we investigate? [19:11:14] but it's not been this slow [19:11:24] i don't have an idea yet [19:11:34] ok [19:11:35] or if it's wikidata-speicific [19:12:12] if others report issues, then maybe it's more a real issue (than just me) [19:12:18] *nod* [19:12:31] 4,939 pages on your watchlist :o [19:12:32] so far i have heard nothing but maybe people are just not complaining [19:12:42] every item i edit is added automatically [19:13:02] You have 3,783 pages on your watchlist (for enwiki) [19:13:09] I have problem loadings pages since a few days [19:13:15] ({"wgBackendResponseTime":4026,"wgHostname":"mw1109"}) [19:13:21] but it's not wikidata specific [19:13:23] so very quick [19:13:29] I have the same problems on wikipedia [19:13:30] Harmonia_Amanda: hmmm [19:13:51] * aude has "show wikidata" changes enabled on wikipedia [19:14:32] anyway, something to keep an eye on and investigate if the problem persists [22:17:15] addshore: around? [22:19:24] benestar: he is, but hiding in the TCB room, and refusing to install http://zero-k.info/ [22:20:07] lol [22:20:15] that game looks fun ^^ [22:25:14] benestar: it is fun, check https://www.youtube.com/watch?v=iTiwmgrhZ0o [22:25:54] benestar: you should totally get it - it's free and open source [22:27:11] JeroenDeDauw: do you meet in person or do you have a teamspeak server up running? [22:28:19] benestar: SKAIP [22:28:26] * JeroenDeDauw hides [22:28:51] It's not running on mah linooks anyway, so can just as well go all the way evil :) [22:28:52] k :D [22:35:07] Benestar I'm just on my way home [22:35:15] k [22:35:22] What's up? :) [22:35:33] it's about the merging changeops [22:35:55] Yoy need the review or a general question? :) [22:36:04] I'd like the Exception messages to be translatable and wondered if I should use ItemMergeException instead of ChangeOpException [22:36:26] or if there is a better mechanism/we need a better mechanism to make ChangeOpException translatable [22:36:46] Mhhm, off the top of my head they should not be translatable, but caught and usage exceptions thrown? [22:37:15] Which are then translatable? [22:38:55] legoktm: can you email me that extdist stuff you wanted? Else it will likely disappear into the ether! [22:39:31] addshore: the messages that there was a conflict with descriptions, sitelinks or statements should be shown to the user [22:39:40] currently it is only hardcoded in the ChangeOpException in English [22:41:10] Well, afaik there is already some i18n stuff for ezceptions ( I think mainly usage exceptions if not exclusively? ) but I really havnt looked at it in a long while! [22:43:08] addshore: yes, there is class ItemMergeException extends MessageException [22:43:16] but that is used by ItemMergeInteractor only [22:43:31] addshore: ok, will do [22:43:34] That interactor catches a ChangeOpException and turns it into an ItemMergeException [22:44:36] Bah jt raining, putting phoe away, back in a sec [22:59:50] benestar: back! [23:07:42] benestar: the changeops could probably throw more specific exceptions tbh [23:15:32] addshore: the question is mainly: Do we want to throw ItemMergeException in ChangeOpsMerge or do we need another type of exception there? [23:16:22] well ItemMergeException is in the iteractor NS is it not? [23:16:38] so it shouldnt be thrown in a changeop imo [23:20:57] yeah :S [23:27:57] night all!