[00:40:33] hi can I please get MdupontDataBot unblocked [00:41:13] mdupont: Did you resolve the issues noted in the block? [00:41:33] hoo, I am going to go into read only mode and debug them [00:41:44] ok, if you have that set, I can do it [00:41:47] otherwise I need to rewrite the code to not even log in [00:42:05] I wont add any more pages until i find and fix the issue [00:42:10] ok [00:42:15] going to run in dry run mode [00:42:34] really I dont know yet how it got into the speedy deletion territory [00:42:37] oh… you're not having a cloak [00:42:46] what do you mean [00:42:49] i can cloak [00:42:52] hold [00:44:46] hmm it looks like my account is no longer active [00:44:49] hm [00:45:08] on freenode [00:45:12] hold on [00:45:20] sure [00:47:55] hoo, ok, my account is reregistered [00:48:39] But it's not linked to any Wikimedia account AFAICT [00:49:04] it's probably a bit silly to be so strict here [00:49:15] but impersonators are a thing :/ [00:49:45] did you state on wiki taht the account is ok to be unblocked? [00:49:49] hoo, well my bot and main account are linked to jamesmikedupont@gmail.com [00:49:55] let me see [00:51:10] https://www.wikidata.org/w/index.php?title=User_talk:MdupontDataBot&oldid=301421783 [00:51:12] just now [00:52:43] Ok :) Done [00:55:11] hoo, thanks, i am running in dry run now [00:55:19] will watch the pages and manually validate them [00:55:19] thanks [00:56:57] so I have about 1 million open source projects that I want to eventually add to wikibase [00:57:16] but of course I will start with the top ones :D [00:57:24] and get a consensus [00:57:37] oO [00:57:40] Like software? [00:57:53] yes [00:58:02] https://en.wikipedia.org/wiki/User:Mdupont/Open_content [00:58:08] this is my project description [00:58:15] Nice, we often lack crucial information there [00:58:16] i am collecting metadata from all these sources [00:58:24] i have a full dump of github [00:58:29] bitbucket [00:58:33] the free software directory [00:58:35] python [00:58:38] nodejs [00:58:41] etc etc [00:58:48] right now the data is on archive.org [00:59:01] i need to figure out how to process this into wikibase properly [00:59:14] i am going carfully, first working on wikidata categories [00:59:19] then the wikipedia pages [00:59:36] and then from there I want to add a github property for existing pages [00:59:56] and then start adding in well referenced projects that are not on wikipedia [01:00:06] but ones that have a few mentions in the datasets [01:00:13] i dont want to add every fork on github [01:00:24] that sounds like a good idea [01:00:32] having every repo is overkill [01:00:45] but getting the most major things sounds worthwhile [01:00:48] https://archive.org/details/@h4ck3rm1k32 [01:00:53] yes [01:01:00] here are some of my dumps [01:01:08] i dont want to turn wikidata into a junkyard [01:01:17] but i have the sf.net rankings [01:01:18] I once did queries against Wikidata for software by programming languages… the results were very poor [01:01:28] and the openhub.net [01:01:33] we can use that for ranking [01:01:48] for example, take the first 200 pages of the sf.net project by ranking [01:02:08] anyway, I am at the beginning of this [01:02:20] but I have code to process all these dumps [01:02:30] i was importing them into mongodb on my machine [01:02:34] but i filled up my disk [01:02:49] so I figure that wikidata has more space [01:02:53] and some of this might be relevant [01:03:52] hi, I'm able to do querries based on https://wdq.wmflabs.org/api_documentation.html, I even starting writing code to do that. [01:04:01] hi GNUtoo-irssi [01:04:32] I don't want to overwhelm you right away, but we also have a SPARQL query end point at https://query.wikidata.org/ [01:04:35] so If I do that querry: "http://wdq.wmflabs.org/api?q=claim[31:610398]&props=*" [01:04:51] which is more powerful, more stable and has better support [01:04:59] hoo: yes, can I use SPARQL without javascript [01:05:14] like from vala or something like that [01:05:24] GNUtoo-irssi: Sure, one second [01:05:44] My main issue is accesibility (I don't run javascript, I use Tor etc...) [01:05:58] so if the tool works my way, that's nice [01:06:34] I see [01:06:45] You can use https://query.wikidata.org/bigdata/namespace/wdq/sparql?query=… [01:06:53] but there's no real nice UI for it [01:06:53] My goal is not to write tools though, it's to contribute data [01:07:05] (that's GET only) [01:07:18] I tried the examples with SPARQL on the web page, it never worked within my browser [01:07:38] but if I can just GET, that's fine [01:08:29] :) [01:08:45] I also wrote a stupid interactive cli tool in PHP during a hackathon: https://github.com/mariushoch/asparagus [01:09:09] that's 4am hackathon code… but it works for playing [01:09:12] in https://www.mediawiki.org/wiki/Wikidata_query_service/User_Manual there is: [01:09:24] Example, showing the list of US presidents and their spouses: [01:09:33] yes [01:09:49] I see no result when I click on "Try it" (no javascript) [01:10:18] I don't think the UI works without JS [01:10:22] but haven't tested that yet [01:10:23] ok [01:10:44] so I should paste the querry inside https://query.wikidata.org/bigdata/namespace/wdq/sparql?query=? [01:10:58] yes [01:11:06] hoo, i found the problem [01:11:16] mdupont: Nice :) [01:11:22] i was importing all the pages from https://en.wikipedia.org/wiki/Category:Wikipedia_April_Fools%27_Day_2011 [01:11:29] which contains all this just [01:11:39] i am going to exclude all wikipedia pages from my cat list [01:11:49] ah nice [01:11:50] and also check the dry run for any other deletion [01:11:50] thanks a lot [01:12:01] i suppose I should just make a name filter [01:12:12] is there some cool vala API to use for all that? [01:12:12] anything with Wikipedia: I will skip [01:12:24] 2) I got some contribution issue [01:12:39] Vala? Probably not [01:12:39] (my goal is to contribute, not to write tools) [01:12:42] ok [01:12:56] Just using the SPARQL endpoint is dead simple, get requests and it even has multiple output formats [01:13:27] https://wiki.blazegraph.com/wiki/index.php/REST_API#MIME_Types [01:13:44] (we might have documentation for that ourselves, I don't know) [01:14:22] https://www.wikidata.org/wiki/Q82516 <- Theses are SOCs [01:14:44] instead there is "subclass of" "microprocessor" [01:15:01] I didn't manage to change that [01:15:18] To try with javascript, I've to launch a vm on another physical machine [01:15:24] (I contribute from my main computer) [01:15:27] GNUtoo-irssi: hm… guess you also have JavaScript disabled on Wikidata? [01:15:36] I see [01:15:56] (system on a chip is https://www.wikidata.org/wiki/Q610398 ) [01:15:57] yes [01:16:08] well, this is really sad... we have no mechanism to edit statements in Wikidata via some form of UI without JS [01:16:16] no remote code execution on my main computer, even if sandboxed [01:16:20] you can of course use the API [01:16:25] ok [01:16:27] but that sucks [01:16:35] how esay is that? [01:16:57] depends on how much you looked into the JSON representation, yet [01:17:07] ok [01:17:11] there are also external tools that can help there [01:17:19] yes, that's more interesting [01:17:38] My use case is to describe hardware [01:17:48] For PHP there's addshor.e's addwiki, for python you probably want to use pywikibot [01:17:53] take the I.Mx SOC for instance, I'd map its blocks and so on [01:18:01] the goal is to start from the SOC and its blocks [01:18:07] if you want to do mass editing, you will probably have to use some form of that anyway [01:18:15] and map hardware that way from bottom (SOC) to top (computer, phone) [01:18:42] that sounds cool [01:18:44] This is to document hardware, to then, externally, map hardware freedom [01:19:27] pywikibot is probably doable, I already looked at some pywiki-something in the past [01:19:40] Some of that could even be done on Wikidata, I imagine [01:19:54] yes, I'd start simple first [01:20:41] Example of complexities when it comes to software: [01:20:58] you have a reference board from a SOC vendor, you then end up with tons of free software bootloaders [01:21:16] and tons of forks of them too [01:22:08] and some might only work with certain revisions… [01:22:33] indeed [01:22:45] Example: take the sabreSD from Freescale [01:22:50] you get the vendor forks [01:22:55] Freescale's uboot etc... [01:23:03] then you get upstream (uboot, barebox, etc...) [01:23:09] and you probably get community forks of both [01:23:20] and specific forks too (Android support) [01:25:02] not sure that's suitable for Wikidata, even [01:26:02] indeed, that's the point of mapping only hardware for now [01:26:13] software can be done manually and externally [01:26:21] like on a separate wiki instance [01:26:29] which would call wikidata [01:26:58] sounds good, there are vague plans for federated Wikibase, using Wikidata as a hub [01:27:10] but you can of course just link to Wikidata right now [01:27:48] very general things, like "this foo is supported in Linux(libre) since 2.6.32" or so could probably be in Wikidata, though [01:27:51] if there are good sources [01:28:19] Thanks a lot, I'll go to sleep [01:28:33] You're welcome… and I should do the same, I guess [01:28:35] I'll look in pywikibot and how to do SPARQL querries in vala [01:29:07] yes, that's easy enough (support since commit in ) [01:29:45] Since hardware is mapped, that should be unambiguous [01:30:00] Example: no 3D support => 3D engine not supported [01:30:05] but 2D engine is [01:30:27] So it would be specific to each block [01:31:12] My main issue is to be able to contribute efficently given my setup constraint (no javascript) [01:31:24] bbl [01:31:31] thanks a lot for the help [09:00:20] it's a JeroenDeDauw :) [10:37:06] Lydia_WMDE: around? [10:45:16] Lydia_WMDE: I prefer their posts on offline things like https://www.feverbee.com/bridges/ https://www.feverbee.com/million/ [12:57:35] Hm, should start editing. I'm not wearing my Wikidata shirt for nothing. :) [15:52:52] benestar|cloud: naaaaaaaaaaaw [15:53:08] wow, people speaking [15:53:44] * JeroenDeDauw hides from the evil scray sjoerddebruin [15:53:55] Can't argue with that. [16:24:43] hey JeroenDeDauw and sjoerddebruin ;) [16:30:00] JeroenDeDauw: maybe it would be a good idea to start cleaning up ChangeOps first? [16:36:32] addshore: Ping? [16:37:54] haha, JeroenDeDauw just broke jenkins :P [16:38:18] (meh) Whenever around… was looking at office hours log from the other day, something Nick said about making a ‘list of references’ for journal articles to use for checking references. [16:38:58] The NASA Astrophysics Data System actually has something essentially like that, at least for Astronomy and Physics. [16:39:10] http://adswww.harvard.edu/ [16:40:29] https://en.wikipedia.org/wiki/Bibcode <- the object identifiers they use. [17:03:38] benestar: wtf? [17:05:01] JeroenDeDauw: to compensate, you can review https://gerrit.wikimedia.org/r/#/c/268953/ ;) [17:06:49] benestar: changeops, that lovely pile of tech debt no one really wants to touch [17:07:11] ha, I did ^^ [17:07:17] was just too easy [17:07:29] benestar: that means there is something WRONG with you! ;) [17:07:30] * benestar wonders why that patch wasn't already submitted half a year ago [17:07:38] lol [17:31:41] JeroenDeDauw: so merge all my stuffz ^^ [17:49:38] benestar: first send me all the bitcoins! [17:50:11] * benestar haz no bitcoinz [17:50:34] why is phpstorm so silly? [17:50:48] function foo( EntityDocument $entity ) [17:50:59] if ( $entity instanceof FingerprintHolder ) ... [17:51:11] then I get an error that $entity does not have the getId and getType methods... [17:51:33] doesn't phpstorm know that objects can implement several interfaces? [17:51:41] benestar: https://youtrack.jetbrains.com/issue/WI-12654 [17:52:49] it says its fixed tho... [17:54:08] hah, perhaps I should update my phpstorm? ^^ [17:56:00] JeroenDeDauw: my licence key is expiring in a month or two, how do I get a new one? [17:56:13] I think I got my current one from you once I was in Berlin last year [18:56:21] benestar: mailed you [18:57:07] thanks, apparently I already registered it =o [19:01:29] !panic | benestar [19:01:29] benestar: https://dl.dropboxusercontent.com/u/7313450/entropy/gif/omgwtf.gif [19:01:51] :O [19:02:44] haha, that's exactly me atm [20:17:01] DanielK_WMDE: hey, are you around? [20:55:16] benestar: only if it's urgent ;) [20:55:42] not urgent ;) [21:14:50] DanielK_WMDE: Hi, i was having and email discussion about this project [21:15:04] https://phabricator.wikimedia.org/T118463 [21:15:18] Will you like to or know anyone who will like to mentor it? [21:52:40] d3r1ck: the phabricator ticket isn't very elaborate. can you send me an email with some more details on what you want to do? daniel.kinzler at wikimedia.de [21:53:09] d3r1ck: tbh, it's unlikely that i'll find time to mentor the project, but i would certainly be cool to have. let me see what i can do. [21:53:32] *it would be cool to have, of course [23:56:05] hi,