[00:42:03] <bd808>	 ToAruShiroiNeko: there isn't a way to make quarry queries run longer. The kill time is from the backend mysql servers.
[01:54:30] <ToAruShiroiNeko>	 bd808: "This query took longer than 30 minutes to execute and was killed."
[01:54:45] <ToAruShiroiNeko>	 Dont kill my query bro
[01:55:56] <bd808>	 the time limit is the same across all of the Labs replicas to try and keep the servers from being monopolized.
[01:56:44] <bd808>	 there are some new servers coming that may let us make a "long query" pool available. I think there is a phab task about it
[01:58:09] <ToAruShiroiNeko>	 I am trying to juggle commons
[01:58:15] <ToAruShiroiNeko>	 we have 35 million files
[01:59:16] <bd808>	 can you split the query into batches based on something that is indexed to get a more reasonable query?
[01:59:27] <ToAruShiroiNeko>	 how?
[01:59:38] <ToAruShiroiNeko>	 https://quarry.wmflabs.org/query/14423
[01:59:51] <ToAruShiroiNeko>	 I tried simplifying it more
[02:00:06] <bd808>	 all those distincts are expensive
[02:00:24] <ToAruShiroiNeko>	 How can I make them cheap?
[02:00:32] <ToAruShiroiNeko>	 I have distincts to pull less rows
[02:01:18] <bd808>	 on the server side a distinct makes the server collect all of the rows and then throw away the dups. that costs ram and time
[02:01:53] <ToAruShiroiNeko>	 I wish I could run queries based on quarry results
[02:02:38] <ToAruShiroiNeko>	 that would be of great help
[02:02:49] <ToAruShiroiNeko>	 Do you know if thats possible?
[02:03:22] <bd808>	 I don't think we have support for temp tables in quarry which is what you would need
[02:03:30] <MaxSem>	 looks like none of the distincts is really needed
[02:03:43] <MaxSem>	 as well as subqueries
[02:03:50] <bd808>	 I don't see how this will actually match anything
[02:04:16] <bd808>	 you are joining on page_title=img_name and then looking for img_name=NULL
[02:04:29] <bd808>	 so it would be the same as page_title=NULL
[02:04:42] <ToAruShiroiNeko>	 no
[02:04:45] <MaxSem>	 also, are you sure that missing images have their image table rows missing ToAruShiroiNeko ?
[02:04:50] <bd808>	 or is that what you want? images without pages?
[02:04:57] <ToAruShiroiNeko>	 yes
[02:05:04] <ToAruShiroiNeko>	 images without files
[02:06:22] <MaxSem>	 hmmm "Using where; Using index; Not exists"
[02:06:35] <MaxSem>	 that's for my modfied query though
[02:07:59] <MaxSem>	 https://quarry.wmflabs.org/query/14498
[02:09:41] <bd808>	 yeah, that looks better
[02:10:01] <bd808>	 I wrote pretty much the same thing
[02:10:14] <bd808>	 https://quarry.wmflabs.org/query/14501
[02:10:31] <bd808>	 it still may be too big to finish all at one
[02:10:34] <bd808>	 *once
[02:11:21] <MaxSem>	 mine's only 24M rows, should fit in 30 mins :P
[02:12:08] <ToAruShiroiNeko>	 ONLY 24M
[02:12:10] <bd808>	 one way to split it up would be to add page_id ranges to the where clause
[02:12:30] <bd808>	 where page_id >= X and page_id <= Y
[02:12:58] <MaxSem>	 ToAruShiroiNeko, yours is closer to 200M rows :]
[02:19:19] <ToAruShiroiNeko>	 lies
[02:19:35] <ToAruShiroiNeko>	 https://quarry.wmflabs.org/query/14500
[02:19:38] <ToAruShiroiNeko>	 simplified
[02:20:03] <ToAruShiroiNeko>	 https://quarry.wmflabs.org/query/14499
[02:21:01] <ToAruShiroiNeko>	 bd808 hmm yes
[02:21:10] <ToAruShiroiNeko>	 but I am clueless of where the mid point is
[02:21:33] <ToAruShiroiNeko>	 I have this querry too: https://quarry.wmflabs.org/query/14418
[02:22:06] <bd808>	 ToAruShiroiNeko: seriously, stop putting DISTINCT on everything :)
[02:22:33] <ToAruShiroiNeko>	 SELECT DISTINCT bd808 WHERE DISTINCT=TRUE;
[02:23:28] <ToAruShiroiNeko>	 bd808 I distinctly remember distincting you
[02:24:26] <bd808>	 ToAruShiroiNeko: https://quarry.wmflabs.org/query/14502
[02:24:38] <bd808>	 min 26 max 53728249
[02:24:53] <bd808>	 max will of course continue to change over time
[02:26:05] <ToAruShiroiNeko>	 You want me to take an average?
[02:26:44] <ToAruShiroiNeko>	 is 14500 expensive?
[02:27:12] <bd808>	 yen? dollars? pesos?
[02:27:34] <ToAruShiroiNeko>	 syrian dinars
[02:27:41] <bd808>	 oh select distinct img_name
[02:27:51] <bd808>	 yeah, it is
[02:27:52] <ToAruShiroiNeko>	 sorry syrian pound
[02:28:03] <ToAruShiroiNeko>	 WHY is it expensive
[02:28:09] <ToAruShiroiNeko>	 I just want a list of filenames
[02:28:14] <bd808>	 because of how a database works
[02:28:22] <ToAruShiroiNeko>	 make them work better
[02:28:31] <ToAruShiroiNeko>	 Make databases great again!
[02:28:49] <bd808>	 distinct says gather all the results, sort them, and then discard duplicates
[02:31:08] <ToAruShiroiNeko>	 whats so bad about that
[02:31:26] <ToAruShiroiNeko>	 real men sort their results and slap raw steak into computer fans
[02:31:41] <ToAruShiroiNeko>	 :p
[02:56:57] <bd808>	 ToAruShiroiNeko: https://quarry.wmflabs.org/query/14501 finished
[02:57:14] <bd808>	 906 of them apparently
[02:57:52] <ToAruShiroiNeko>	 will process the list
[02:57:56] <ToAruShiroiNeko>	 to drain the swamp
[03:00:43] <ToAruShiroiNeko>	 bd808 but its wrong?
[03:01:26] <ToAruShiroiNeko>	 https://commons.wikimedia.org/wiki/User_talk:とある白い猫/Sandbox_2
[03:01:41] <ToAruShiroiNeko>	 some are with files
[03:01:43] <ToAruShiroiNeko>	 whats going on?
[03:20:42] <ToAruShiroiNeko>	 bd808 why do you think is that?
[04:24:06] <p_d>	 The command "php maintenance/update.php" says "A copy of your installation's LocalSettings.phpmust exist and be readable in the source directory.Use --conf to specify it." What to do in order to update database tables.
[04:29:14] <p_d>	 Also do we need to have all those packages as mentioned in "INSTALL" file of Core? I have only LAMP server.
[09:01:27] <jubo2>	 Hiya and thanks for the wonderfully purrring systems
[09:01:46] <jubo2>	 What method of processing .php do you use / recommend ?
[12:44:06] <p_d>	 Anyone knows when andre__ will come? I need to extend my task deadline!
[12:56:13] <Reedy>	 p_d: which task?
[12:56:24] <p_d>	 Reedy, GCI
[12:56:32] <Reedy>	 Yes, I know it's GCI
[12:56:38] <Reedy>	 But which task on GCI
[12:56:42] <Reedy>	 So I've got a chance to find it
[12:56:45] <p_d>	 https://codein.withgoogle.com/dashboard/task-instances/4883381703671808/
[12:57:11] <p_d>	 only about half an hour left
[12:57:20] <Reedy>	 p_d: What's the reason for needing an extension? :)
[12:57:38] <p_d>	 vagrant
[12:57:53] <Reedy>	 That doesn't make sense
[12:57:59] <Reedy>	 Have you been having problems with it?
[12:58:32] <p_d>	 i have wasted more than 2 days just to install vagrant infact I have reinstalled ubuntu but again it gives some dependencies error.
[12:58:43] <Reedy>	 Ok, that's fine
[12:58:48] <Reedy>	 "vagrant" tells me nothing
[12:58:57] <p_d>	 I have installed mediawiki now and almost about to add extension
[12:58:58] <Reedy>	 Is one day enough?
[12:59:10] <p_d>	 ya more than enough
[12:59:21] <Reedy>	 It's the smallest unit it'll let me add ;)
[12:59:52] <Reedy>	 p_d: Done
[12:59:57] <p_d>	 Oh..thanks 
[13:00:01] <p_d>	 :)
[13:02:43] <p_d>	 Reedy, I am cloning a extension but it gives some error please view it- http://pastebin.com/Yb8ESCap
[13:02:59] <Reedy>	 Did other things clone fine?
[13:03:05] <p_d>	 ya
[13:03:10] <Reedy>	 Did you load your public key into your ssh-agent again?
[13:03:51] <p_d>	 ya i forget the passphrase i re-generated it and added the key again
[13:04:05] <Reedy>	 Did you upload the new one to gerrit?
[13:04:13] <p_d>	 ya
[13:04:15] <p_d>	 no
[13:04:50] <Reedy>	 heh
[13:06:02] <p_d>	 actually when I was re-genrating the passphrase it says -.ssh/id_rsa already exists.Overwrite (y/n)? y  ..so I overwrite
[13:06:13] <p_d>	 but I uploaded the key again
[13:09:42] <p_d>	 Let me try with other extension
[13:10:33] <jubo2>	 Hello. Got a question.. You are using Apaches for web server, right? Which method of processing .php do you use? I understand there are many competing methods to process .php files for Apache to serve
[13:14:24] <p_d>	 Well I just enter the file address in url
[13:15:53] <p_d>	 ex- I use http://localhost/mediawiki/index.php/ to access my wiki project
[13:16:15] <p_d>	 Reedy, same problem with other extensions too
[15:05:47] <Betacommand>	 anyone able to figure out where the 6,435 revisions restored on https://en.wikipedia.org/w/index.php?title=Special:Log&page=South+Africa came from? I cannot find a corresponding deletion log
[15:39:17] <snitch>	 [[Tech]]; F3ar13ss; /* Help with installing Common.css and Common.js */ new section; https://meta.wikimedia.org/w/index.php?diff=16124319&oldid=16100178&rcid=8633196
[17:33:50] <p_d>	 How to Navigate to Special:Version on our wiki? as mentioned under Installation section of- https://www.mediawiki.org/wiki/Extension:InputBox
[17:38:42] <p_d>	 Where is this Special:Version page?
[17:59:06] <Stryn>	 p_d: .../wiki/Special:Version
[17:59:50] <p_d>	 Stryn, I got it now its under special pages
[18:01:31] <p_d>	 Now according to the task - https://codein.withgoogle.com/dashboard/task-instances/4883381703671808/ ..What I'm supposed to do? To use create something with it? Or just capture the screen which shows all the "Installed Version"? I'm confused :/
[18:04:07] <p_d>	 I've installed the extension InputBox
[18:08:13] <p_d>	 "Installed Extensions" I mean there above^
[18:22:34] <Nemo_bis>	 p_d: most people can't open that URL; you should name your mentor
[18:29:15] <p_d>	 oh.. andre__ isn't here
[18:32:03] <p_d>	 Nemo_bis, in case if you want to check the task -http://pastebin.com/D8pMrFcE
[18:36:31] <Nemo_bis>	 p_d: you're not supposed to paste tasks publicly, otherwise they'd be public (as they used to be)
[18:38:49] <p_d>	 Oh sorry I didnt about that
[19:32:44] <snitch>	 [[Tech]]; Killiondude; /* Help with installing Common.css and Common.js */ [[mw:Project:Support desk]]; https://meta.wikimedia.org/w/index.php?diff=16124618&oldid=16124319&rcid=8633816
[21:26:58] <snitch>	 [[Tech]]; F3ar13ss; /* Help with installing Common.css and Common.js */; https://meta.wikimedia.org/w/index.php?diff=16124742&oldid=16124618&rcid=8633987
[21:27:30] <snitch>	 [[Tech]]; F3ar13ss; /* Help with installing Common.css and Common.js */; https://meta.wikimedia.org/w/index.php?diff=16124744&oldid=16124742&rcid=8633989
[21:33:23] <Yvette>	 [13:36] <Nemo_bis> p_d: you're not supposed to paste tasks publicly, otherwise they'd be public (as they used to be)
[21:33:28] <Yvette>	 Is that a Google rule or something?
[21:33:35] <Yvette>	 It sounds weird and anti-Wikimedia.
[21:35:26] <Nemo_bis>	 Google made the tasks private to "counter cheating"
[21:36:00] <Nemo_bis>	 The task description itself is not a problem (we edit those on the wiki or Phabricator too)
[21:37:01] <snitch>	 [[Tech]]; MZMcBride; /* Help with installing Common.css and Common.js */ +reply; https://meta.wikimedia.org/w/index.php?diff=16124746&oldid=16124744&rcid=8633993
[21:37:06] <Yvette>	 Cheating!
[21:37:07] <Yvette>	 Wow.
[21:37:15] <Yvette>	 I'd love cheaters.
[21:37:19] <Yvette>	 How do we recruit those?
[21:37:31] <Yvette>	 If people are competing to fix bugs, that sounds like a dream.
[21:40:21] <Nemo_bis>	 Indeed that was not the issue.