[07:24:37] <addshore>	 la la la
[09:46:16] <addshore>	 hoo: I made a patch after what we discussed last night
[09:47:28] <hoo>	 addshore: Ok... just told Thiemo and he also made a patch
[09:47:36] <hoo>	 but he removes it entirely from getentities
[09:47:41] <hoo>	 two approaches
[09:48:25] <addshore>	 ahh okay
[09:48:28] <addshore>	 link to his?
[09:48:56] <addshore>	 got it!
[09:53:00] <addshore>	 hoo: Thiemo_WMDE I think I would probably be happy with that approach too.
[09:55:42] <addshore>	 oh wait, but Thiemo_WMDE, you prefer the caching way? :)
[11:57:11] <despensr>	 dear colleagues, where is a good place to ask about lua + wikibase?
[11:58:05] <Amir1>	 One question: how long it would take to make 100K items in Wikidata?
[11:58:33] <Amir1>	 not me
[11:58:36] <Amir1>	 people
[11:58:52] <Amir1>	 i.e. I want growth speed of Wikidata
[12:03:33] <Amir1>	 nvm. I got it. it's about a week
[13:50:40] <despensr>	 how would i get an interable of wikibase items from lua?
[14:30:26] <despensr>	 how would i create an interable over several wikidata items in lua?
[14:30:40] <addshore>	 Does anyone by any chance have a dump downloaded from january of this year? :d
[14:30:42] <addshore>	 :D
[14:40:15] <Reedy>	 addshore: not one on labs
[14:40:16] <Reedy>	 ?
[14:40:29] <addshore>	 nope, that are already gone
[14:40:33] <addshore>	 (a JSON one) ;)
[14:43:32] <aude>	 addshore: think i do
[14:43:53] <addshore>	 aude: one from as close to 1st jan as possible would be great!!!!
[14:44:57] <aude>	 jan 11
[14:45:10] <aude>	 it will take a few minutes to upload it from the office
[14:46:17] <aude>	 also have one from march 2015 and one from june 2015
[14:46:30] <addshore>	 awesome, the jan one would be amazing :)
[14:46:53] <aude>	 will take ~12 minutes to upload
[14:47:05] <addshore>	 okay!
[15:01:41] <aude>	 addshore: still says 9 minutes :(
[15:01:49] <aude>	 wmde internetz is sloooooooooooow
[15:01:53] <addshore>	 haha, thats okay!
[15:02:01] <addshore>	 it'll probably take me just as long to download it
[15:02:09] <addshore>	 just give me a ping / link when it done :)
[15:07:33] <aude>	 addshore: how urgent do you need this?
[15:07:43] <addshore>	 today would be epic
[15:07:52] <aude>	 think i misread and it's 9 hours :(
[15:07:59] <addshore>	 aaahhhh xD
[15:08:03] <addshore>	 then tommorrow is fine :P
[15:08:23] <aude>	 ok, maybe i can let this run tonight from my hostel :)
[15:08:31] <addshore>	 :D
[15:08:35] <aude>	 maybe their internetz are faster
[15:08:47] <addshore>	 if not I can also give you the thing to run!
[15:09:12] <aude>	 111 kb/s
[15:09:16] <aude>	 really not fast
[15:11:10] <addshore>	 aude: https://github.com/wikimedia/analytics-wmde-toolkit-analyzer-build
[15:12:08] <aude>	 if uploading tonight isn't faster, then i cna run this
[15:12:17] <addshore>	 okay :)
[15:12:26] <aude>	 just not sure how it all works and would like to make the dumps available anyway
[15:12:58] <addshore>	 java -Xmx2g -jar toolkit-analyzer.jar Metric ~/data 20160111
[15:13:05] <aude>	 ok
[15:14:21] <addshore>	 would be how you run it and you have to put the dump in ~/data/dumpfiles/json-20160111/20160111-all.json.gz
[15:14:25] <addshore>	 I think ;)
[15:14:57] <aude>	 yeah, that's where i have it already
[15:18:37] <aude>	 addshore: it tries to download the dump and then quits when it finds a dump already there
[15:18:51] <addshore>	 hmmm?
[15:18:54] <aude>	 i will try to upload
[15:18:59] <addshore>	 okay!
[15:19:21] <aude>	 java.nio.file.FileAlreadyExistsException
[15:19:26] <addshore>	 I should make it so you can just pass the path of a dump to run in too :P
[15:19:31] <addshore>	 oh, interesting
[15:19:31] <aude>	 yeah
[15:19:44] <addshore>	 it should try this.dataDirectory + "/dumpfiles/json-" + dumpDate + "/" + dumpDate + "-all.json.gz" first
[15:19:48] <aude>	 and i don't want anything bad to happen to my dump file, though i have backups in the US
[15:20:21] <aude>	 i have the dumps for use with wikidata toolkit so should have them in an appropriate place
[15:28:14] <aude>	 addshore: the dump will be on http://dumps.filbertkm.com/ (and want to setup https on my domain)
[15:28:59] <addshore>	 aude: ahh, well my code may have diverged from the toolkit stuff slightly
[15:29:09] <aude>	 hmmm
[15:29:09] <addshore>	 as it all looks for local dumps on the cluster and labs
[15:29:15] <aude>	 i see
[15:29:19] <addshore>	 you need to pass the data directory in when you run the script
[15:29:54] <addshore>	 and if the data directory is ~/data then the dump needs to be at ~/data/dumpfiles/json-" + dumpDate + "/" + dumpDate + "-all.json.gz"
[15:30:31] <aude>	 i had stuff in ~/dumps/dumpfiles ... but tried to move them to ~/data/dumpfiles... and didn't work
[15:31:21] <addshore>	 hmm okay, I might need to double check that does still work then (it doesnt get run that often) as usually it just grabs the dumps from labs
[15:32:10] <addshore>	 what was the stacktrace with java.nio.file.FileAlreadyExistsException ?
[15:32:12] <aude>	 i don't want it to somehow accidentally delete my file
[15:32:22] <aude>	 until i upload a copy, at least
[15:32:33] <aude>	 else we have to wait until thursday when i am back in the US
[15:34:07] <addshore>	 it wont delete it ;)
[15:34:22] <addshore>	 it never deletes anything :D
[15:34:37] <DanielK_WMDE_>	 addshore: mmmeeeeerrrge https://gerrit.wikimedia.org/r/#/c/270020/28
[15:34:54] <addshore>	 ooooh DanielK_WMDE_ awesomeee!! :D
[15:36:14] <addshore>	 DanielK_WMDE_: is this the kind of way you envisioned it being used? https://gerrit.wikimedia.org/r/#/c/281915/2/tests/phpunit/MediaWikiTestCase.php
[15:44:30] <DanielK_WMDE_>	 addshore: yes, something like this. Perhaps overrideMwServices should just take a map map services as the first arguement.
[15:45:13] <addshore>	 yeh perhaps, it's also quite nice to be able to do them one by one
[15:45:36] <addshore>	 I'll keep work again on my patch before I merge yours to make sure it all feels right ;)
[15:46:13] <DanielK_WMDE_>	 addshore: ok, but let's keep this going. I'm a bit blocked on this one
[15:48:46] <addshore>	 yeh, DanielK_WMDE_ I just need to figure out why the random special page test is failing, it almost seems like the service isn't being set back again after the test though :/
[16:07:59] <DanielK_WMDE_>	 addshore: it probably is, but the special page instance may still be around, and may have a reference to a stale service instance...
[16:08:13] <addshore>	 mhhhm, ill have a dig!
[21:07:08] <Josve05a>	 Stupid tool... adding the same claim that already exists :/ https://www.wikidata.org/w/index.php?title=Q3523054&diff=320048304&oldid=320048023