[00:22:58] (PS1) Chad: Clean up easily removed $wgTitles [extensions/SemanticPageMaker] - https://gerrit.wikimedia.org/r/109792 [01:18:22] why will PageSchema not generate forms, templates and properties for me? The jobs are in the jobs table, but not executed [01:20:56] anyone familiar with the Job Queue and how it retries (or not) because when I run runJobs.php and showJobs.php I get nothing [01:21:05] and there are no errors in the wiki debug log [01:37:56] I'm a sysop, so I automatically have the generatePages priv [18:20:46] [travis-ci] SemanticMediaWiki/SemanticMediaWiki#751 (language-tests - dcbfe02 : mwjames): The build has errored. [18:20:46] [travis-ci] Change view : https://github.com/SemanticMediaWiki/SemanticMediaWiki/compare/8e96d630cb48...dcbfe02902d3 [18:20:46] [travis-ci] Build details : http://travis-ci.org/SemanticMediaWiki/SemanticMediaWiki/builds/17783577 [20:19:20] I can define default forms for category. What happens if I have a category that is in another category and both categories have default forms? [20:19:55] oh wait, ignore me. I'll just define the defaults in the templates [20:21:52] sven^_: what form extension are you using? [20:23:05] SemanticForms [20:24:08] I just have a rather complicated template/form setup with lots of inheriting between templates/classes [20:24:34] and I remembered having problems with messages like "this page has multiple forms assigned to it" or something like that [20:24:46] but I should be fine if I don't do it category-wise but in each template [20:26:35] you're way ahead of me. good luck :) [20:40:03] sparr: ;) [20:42:33] I'm still figuring out queries [20:42:36] and subobjects [20:51:03] ah well, subobjects can be nice.. [20:51:10] or they give you a headache [21:41:19] I'm the sysadmin of webplatform.org and I have an issue with my job queue. My job run dies with a few tasks left and when I start it back again, it re-populates jobs and dies with a few jobs left... always in a similar loop [21:43:19] So, when I look at http://docs.webplatform.org/t/api.php?action=query&meta=siteinfo&siprop=statistics I have a number of issues. [21:43:37] When I run on my master database server: select COUNT(*) from job; [21:43:41] I get the same count. [22:09:07] renoirb: that question might be better suited for the #mediawiki channel. [22:09:22] :/ [22:09:54] Is it save to truncate the job table [22:10:06] I am asking according to https://www.mediawiki.org/wiki/Job_queue_redesign [22:10:18] And the jobs are all related to SMW [22:10:45] Yaron: ^ [22:10:47] I thought you were talking about statistics, though. [22:10:53] Or are those two separate issues? [22:10:58] Same issue. [22:11:19] WebPlatform.org, we are using extensively SMW for our developer documentation [22:11:40] Oh, I get it... it's the job count in the statistics. [22:11:54] Yes, I know about WebPlatform - I helped create it. :) [22:12:07] Most of the job_cmd are: refreshLinks2 [22:12:15] :) [22:12:30] Right - is it the same thing that dies every time, or a different job? [22:12:56] the job dies with about 130 jobs left [22:13:18] Ryan Lane suggested me to "truncate the jobs queue" [22:13:29] That's a fair approach. [22:13:30] but I want to be SURE that what he means is what I understood [22:13:53] So, when I look at the appropriate wiki db [22:14:01] select COUNT(*) from job; [22:14:06] i get 133 [22:14:12] like on the stats view [22:14:31] (I commented the job runner, so it won't start unless I uncomment it) [22:14:56] its been 4 times that when I re-start it... it fills up to a higher number of jobs count. [22:15:09] And then, dies around 100-ish jobs left. [22:16:22] So, for sanity Yaron ... what is your feeling about it? Should I just make a mysqldump of the job table, then do 'TRUNCATE job;' [22:16:39] One sec. [22:16:47] ok [22:22:57] * renoirb is reading around in Job_queue/For_developers [22:23:05] https://www.mediawiki.org/wiki/Manual:Job_queue/For_developers ^ [22:26:05] renoirb: refreshLinks can really expand quickly - any time a template is changed, all the pages that include that template get a refreshLinks job created for them, which I'm guessing is what happened here. [22:26:34] If you remove all the jobs and some pages don't get their links/properties refreshed, it's not the end of the world. [22:26:41] probably. They are heavily working on page templates for JavaScript documentation pages. [22:26:50] Ah. [22:27:01] Something must have fallen through a crack [22:27:30] I just did a mysqldump of the job table [22:27:59] When the number of pages reaches a certain point, it's good to start using "test" templates and pages, to try out changes there first and avoid overloading the job queue. [22:28:44] Its only refreshLinks2 [22:28:50] (just checked again) [22:29:18] ok. [22:29:26] We have two wikis BTW. [22:29:31] One test, and the live one. [22:30:02] http://docs.webplatform.org/test/ IS NOT the same MW installation as http://docs.webplatform.org/wiki/ [22:30:13] Which one has the jobs problem? [22:30:19] separate files, separate db connection. [22:30:21] The test wiki. [22:30:30] Ah - who cares, then. :) [22:30:34] i know. [22:30:46] Truncate away! [22:30:48] But. when something is problematic, I gotta fix it :) [22:30:50] ok then! [22:31:16] Worse case, I made a mysqldump [22:31:33] That does sound like the worst case. :) [22:31:47] truncate is done. [22:40:02] No way! [22:40:28] I truncated. 0 jobs. Then edited a template. 2 jobs. [22:40:41] When I run the job runner. It jumps to 500 new jobs! [22:40:44] Yaron: ^ [22:49:54] renoirb: that's pretty bad! [22:50:46] I don't think it's the calling of refreshLinks on a template that triggers all of the other refreshLinks jobs, but I could be wrong... [22:51:08] That certainly appears to be the case from what you're describing. [22:51:20] This really would be a question for the #mediawiki channel. [22:57:50] ok [22:57:57] Yaron: meet eliezerb [22:58:07] Hello. [22:58:19] eliezerb: volunteers with us on the JavaScript templates project [22:58:41] Hello. Shalom (?) [22:58:43] Hello Yaron [22:59:12] Do you think, Yaron, that a template calling an other template might create recursive loops? [22:59:34] It's possible... I thought about that, but I would think MediaWiki would be smart enough to avoid such things. [23:00:04] ok. [23:00:23] Actually, thinking about it now, it seems impossible for there to be a loop of templates calling each other in the first place. [23:00:34] Since that would lead to an infinitely-sized page. [23:00:54] A reassuring thing is that its the test wiki and as far as the current import is over. We can just throw away all the test wiki database. [23:01:12] uhm. ok [23:01:21] I'll mail the mailing list about the issue then. [23:01:29] Cool. [23:05:54] ok, did you ever participate to webplatform mailings Yaron ? [23:06:03] No. [23:06:09] only IRC? [23:06:20] Not that, either, as far as I can remember. [23:06:30] Mind if I put you on a mail thread about it? [23:06:35] ... with Ryan [23:06:38] Sure, no problem. [23:06:49] can you send me in private an email I can use? [23:07:09] I should note (in case it wasn't obvious) that I'm really not an expert on the whole job queue/page refreshing thing. [23:07:39] Ryan would know quite a bit more about that than I do, I think... just in terms of dealing with performance stuff. [23:07:50] It's yaron57@gmail.com. [23:07:53] ok! [23:08:46] it was obvious Yaron. I just want to find the problem and if you can see the cause, it might help you. [23:09:02] obvious == I understood what you mean about it. [23:09:03] Alright, then. [23:09:34] Er, what? :) [23:11:08] Anyway, it doesn't seem like a big issue in the first place - as long as the job queue isn't stuck and constantly growing, it's not a huge deal, I would say. [23:23:08] [travis-ci] SemanticMediaWiki/SemanticMediaWiki#753 (master - 65c8e70 : Jeroen De Dauw): The build has errored. [23:23:08] [travis-ci] Change view : https://github.com/SemanticMediaWiki/SemanticMediaWiki/compare/b5767292d786...65c8e70da416 [23:23:08] [travis-ci] Build details : http://travis-ci.org/SemanticMediaWiki/SemanticMediaWiki/builds/17801904 [23:30:09] so Yaron, I just sent the email. [23:30:17] But eliezerb just told me the job queue is over now. [23:30:23] Cool, I saw. [23:30:25] Oh. :( [23:30:39] Well, that's pretty anticlimactic. [23:30:39] so. false positive. [23:30:45] indeed :) [23:30:51] a phantomatic issue. [23:30:53] Prabably the server is rebuilding the inner templates [23:31:36] And this is making the task take so long [23:31:49] s/Prabably/Probably [23:33:32] Hey Yaron ... how to I "Regenerate SMW data" ? [23:33:57] Ryan just replied that to me... it is too vague [23:37:51] renoirb: either press the relevant button in the page Special:SMWAdmin, or call the SMW script SMW_refreshData.php. [23:38:59] Yaron: in maintenance/ ? [23:39:06] That sounds right. [23:39:53] But what if I truncated the job queue already [23:40:07] I mean. I truncated, we run the jobs. and now... we are at 0 [23:40:27] should I worry? (besides the fact that its a test wiki and therefore not critical) [23:42:16] Yaron: ^ [23:44:03] oh my. [23:44:09] I'll do it :) [23:45:52] Hello! [23:46:07] What's the question? I don't understand. [23:46:58] [travis-ci] SemanticMediaWiki/SemanticMediaWiki#740 (db-setup - 3e4bf4f : mwjames): The build is still failing. [23:46:58] [travis-ci] Change view : https://github.com/SemanticMediaWiki/SemanticMediaWiki/compare/714ce7a14e27...3e4bf4fd4aaa [23:46:58] [travis-ci] Build details : http://travis-ci.org/SemanticMediaWiki/SemanticMediaWiki/builds/17678386 [23:51:09] Hi Yaron, sorry for that! [23:51:25] I was asking if it was worth it that I run the SMW_refreshData.php [23:51:57] ... I started running it, and I just killed it. Should I fully run it with -v ... all along to refresh everything? [23:55:09] Sure, why not. [23:55:18] No harm in running it.