[07:39:52] 3Wikimedia Labs / 3tools: install tesseract command line tool and the associated language package - 10https://bugzilla.wikimedia.org/65354#c3 (10Yuvi Panda) 5PATC>3RESO/FIX Merged. [07:41:08] 3Wikimedia Labs / 3tools: Database inserts are slow at the replicated databases - 10https://bugzilla.wikimedia.org/48851#c12 (10Yuvi Panda) 5ASSI>3RESO/FIX Should be fixed now, since everything is in eqiad. Do re-open if this still exists. [07:42:52] 3Wikimedia Labs / 3tools: Start portgranter and provide portgrabber on every exec node - 10https://bugzilla.wikimedia.org/60240#c3 (10Yuvi Panda) Note that this is completely supported with the new nginx proxy/proxylistener. Just needs portgranter on every node. [07:45:08] 3Wikimedia Labs / 3tools: tools-webproxy's / is full - 10https://bugzilla.wikimedia.org/58141#c4 (10Yuvi Panda) Any update on this? Doesn't applying the 'biglogs' puppet class 'fix' the issue anyway? [07:50:03] (03PS3) 10Yuvipanda: become: Add --help option [labs/toollabs] - 10https://gerrit.wikimedia.org/r/119882 (https://bugzilla.wikimedia.org/62710) (owner: 10Tim Landscheidt) [08:31:29] hi [08:31:30] I deployed to /data/project/languagetool/public_tomcat/webapps/ltcommunity-0.1(.war) [08:31:41] already did webservice -tomcat (re)start [08:31:57] no error in the logs so I guess database configuration is not the issue (anymore) [08:32:07] http://tools.wmflabs.org/languagetool/ is 404 [08:32:17] so is http://tools.wmflabs.org/languagetool/lt-community-0.1 [08:44:15] Change on 12mediawiki a page Wikimedia Labs was modified, changed by Matthias M. link https://www.mediawiki.org/w/index.php?diff=1038699 edit summary: [-11] /* Proposals */ [[wikitech:Nova Resource:Tools/Help#Java webservice (Tomcat)]] seems to be already available [08:53:20] it works! [08:53:36] the .war name has to be exactly the tool account name [08:53:47] cp ltcommunity-0.1.war public_tomcat/webapps/languagetool.war [08:53:51] webservice -tomcat start [08:54:11] http://tools.wmflabs.org/languagetool [08:56:00] Time for the next error. It seems URL parameters don't work at all http://tools.wmflabs.org/languagetool/wikiCheck/pageCheck [08:59:12] ah wait it is a simple error: /home/languagetool/ltcommunity/corpus/ltcommunity/disabled_rules.properties (No such file or directory) [09:44:38] and it works :) http://tools.wmflabs.org/languagetool/wikiCheck/ [10:19:27] although quite slow [10:19:39] compared to community.languagetool.org [10:20:20] Hi, I can't run scripts on labs :/ [10:20:20] I have my own scripts of pywikipediabot on /data/project/cobain/public_html/pywikilab/ [10:20:20] how I can run these ones with shared compat ? [10:30:37] 3Tool Labs tools / 3[other]: Migrate https://toolserver.org/~erwin85/xcontribs.php to Tool Labs - 10https://bugzilla.wikimedia.org/60881#c2 (10Nemo) 5RESO/?>3VERI Confirmed working, see also https://jira.toolserver.org/browse/TS-1732 You could make the link blue in the sidebar now. :) [10:31:18] Mailaender: heya! can you document the issues you find, and perhaps file bugs for them? [10:31:22] re: tomcat [10:33:17] I documented the deployment https://github.com/languagetool-org/languagetool-community-website/pull/17 which was not too hrad. I have never worked with Grails/Tomcat before, but still managed to get things to work with your existing documentation. [10:34:42] Mailaender: :) cool. [10:34:55] so good work on that, not sure why it runs so slow [10:35:06] http://tools.wmflabs.org/?status#tools-webgrid-tomcat shows that the VM is not really crowded [10:36:36] we will have to rewrite most parts of the application though now that we have live access to the Wikimedia DB feeds [10:36:56] this is just a test deployment that went surprisingly well [10:37:45] Mailaender: :) nice! [10:38:07] 3Tool Labs tools / 3[other]: Migrate to Tool Labs: https://toolserver.org/~jyo this/tools/stewtools/stewac tion.php - 10https://bugzilla.wikimedia.org/61032 (10Sam Reed (reedy)) [10:38:23] Daniel Naber, the main developer is also on board so expect some changes there sometime soon [10:38:37] 3Tool Labs tools / 3[other]: Migrate to Tool Labs: https://toolserver.org/~jyo this/tools/stewtools/stewac tivty.php - 10https://bugzilla.wikimedia.org/61033 (10Sam Reed (reedy)) [10:38:47] anyone interested may want to meet him at https://wikimania2014.wikimedia.org/wiki/Submissions/Fixing_grammar_errors_semi-automatically [10:38:52] 3Tool Labs tools / 3[other]: Migrate to Tool Labs: https://toolserver.org/~emw/index.php%3Fc%3Dwikistats - 10https://bugzilla.wikimedia.org/61038#c2 (10Sam Reed (reedy)) And the account has expired [10:40:26] Mailaender: nice! is this pure java or scala/clojure? [10:40:52] 3Tool Labs tools / 3[other]: [tracking] toolserver.org tools that have not been migrated - 10https://bugzilla.wikimedia.org/58865#c2 (10Nemo) There are 14 (main) tools by Dispenser which have not been migrated nor filed in bugzilla. https://toolserver.org/~dispenser/view/Main_Page [10:44:09] 3Tool Labs tools / 3[other]: Migrate to Tool Labs: https://toolserver.org/~krinkle/MoreContributions/input.php - 10https://bugzilla.wikimedia.org/61036#c1 (10Nemo) 5NEW>3ASSI a:3Krinkle Krinkle said he's working with luxo on integrating it in guc. [10:44:22] 3Tool Labs tools / 3[other]: Migrate to Tool Labs: https://toolserver.org/~mzmcbride/yanker/ - 10https://bugzilla.wikimedia.org/61039#c1 (10Nemo) I use this regularly. :( [11:00:54] YuviPanda: mostly Groovy/Java. Have a look at the code yourself at https://github.com/languagetool-org/languagetool-community-website/ [11:05:34] Mailaender: English only? [11:06:09] I believe this was just due to the community.languagetool.org server running already at capacity [11:07:05] if we get more resources to http://tools.wmflabs.org/languagetool/ we can probably support all >20 https://languagetool.org/languages/ up and running [11:08:51] oh, I just noticed it is much faster now. Is this Java JIT performance optimisation that just need a WAR to be up and running to hit in? [11:11:17] ah no, we just raised the JAVA_OPTS="-Xmx500M" from 128 MB :) now it works smoothly [11:14:19] liangent: if you want support for Chinese, you will have to send a patch http://wiki.languagetool.org/adding-a-new-language and write some detection rules. [11:14:33] Mailaender: cool! you should email about your experience to the labs-l list as well, if you haven't already [11:14:33] https://github.com/languagetool-org/languagetool is still not very popular and pretty understaffed [11:16:52] I won't as I hate mailing lists :) [11:16:58] Mailaender: heh :) [11:17:08] Mailaender: but your nick starts with Mail! [12:32:25] 3Wikimedia Labs / 3deployment-prep (beta): Automate updating the puppet checkout - 10https://bugzilla.wikimedia.org/66683 (10Sam Reed (reedy)) s:5normal>3enhanc [12:37:53] 3Tool Labs tools / 3[other]: Migrate to Tool Labs: https://toolserver.org/~mzmcbride/yanker/ - 10https://bugzilla.wikimedia.org/61039 (10Sam Reed (reedy)) s:5normal>3enhanc [12:37:53] 3Tool Labs tools / 3[other]: Migrate to Tool Labs: https://toolserver.org/~krinkle/MoreContributions/input.php - 10https://bugzilla.wikimedia.org/61036 (10Sam Reed (reedy)) s:5normal>3enhanc [12:37:53] 3Wikimedia Labs / 3Infrastructure: root@ should email project admins - 10https://bugzilla.wikimedia.org/59142 (10Sam Reed (reedy)) s:5normal>3enhanc [12:38:53] 3Wikimedia Labs / 3Infrastructure: Create a cxserver user in labs LDAP - 10https://bugzilla.wikimedia.org/66575 (10Sam Reed (reedy)) s:5normal>3enhanc [12:43:44] why locale.setlocale(locale.LC_ALL, "ca_ES") doesn't works [12:43:55] ? [12:46:52] locale ca_ES is not installed [12:47:12] where I can request this installation? [13:37:50] https://bugzilla.wikimedia.org/show_bug.cgi?id=62269 [13:38:07] 3Wikimedia Labs: locale.setlocale(locale.LC_ALL, "ca_AD") doesn't work - 10https://bugzilla.wikimedia.org/62269#c1 (10Igor Betxí) Sorry, it it possible to get any answer about this topic? [13:44:19] coet|cawiki: create a new bug with whatever package you need? [14:20:52] 3Wikimedia Labs / 3Infrastructure: Create a cxserver user in labs LDAP - 10https://bugzilla.wikimedia.org/66575#c6 (10Niklas Laxström) The user was created, right? Can this bug be closed now? Do we need to make any changes to the already existing cxserver user&group on deployment-cxserver01? [14:27:10] 3Wikimedia Labs: generate language package for ca_ES.utf8 - 10https://bugzilla.wikimedia.org/66721 (10Igor Remolar @ Betxí) 3NEW p:3Unprio s:3normal a:3None Can some admin install locale ca_ES.utf8 ? [14:27:26] YuviPanda: done ^^ [14:27:31] thanks [16:47:49] twentyafterfour: The beta stuff I worked on yesterday is pretty typical. I logged most of it in SAL -- https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL#June_16 [16:48:26] The bit that didn't end up there was some work in operations/puppet to fix deployment-jobrunner01 [16:49:47] twentyafterfour: Those log entries are made by sending messages here that look like "!log deployment-prep " [16:52:03] bd808: neat. I like the !log thing that's handy [17:43:04] !ping [17:43:04] !pong [17:48:22] !ping [17:48:22] !pong [17:48:25] ok [17:49:05] !ping [17:49:05] !pong [19:13:52] 3Wikimedia Labs: generate language package for ca_ES.utf8 - 10https://bugzilla.wikimedia.org/66721#c1 (10Quim Gil) After a chat with the reporter on IRC, The point of this request is that some bots active in Catalan projects (ca.wiki...) and currently hosted in the toolserver require this locale. If it is not... [20:36:02] !log deployment-prep Upgraded elasticsearch to version 1.2.1 on deployment-logstash1 [20:36:04] Logged the message, Master [21:03:53] 3Wikimedia Labs: generate language package for ca_ES.utf8 - 10https://bugzilla.wikimedia.org/66721#c2 (10Igor Remolar @ Betxí) Three months ago I have reported this bug https://bugzilla.wikimedia.org/show_bug.cgi?id=62269 but it was forgotten. Today I wanted remember my post to community and YuviPanda on #wiki... [22:00:52] 3Wikimedia Labs: generate language package for ca_ES.utf8 - 10https://bugzilla.wikimedia.org/66721 (10Andre Klapper) p:5Unprio>3High [22:01:09] 3Wikimedia Labs / 3tools: generate language package for ca_ES.utf8 - 10https://bugzilla.wikimedia.org/66721 (10Andre Klapper) a:3Marc A. Pelletier [22:04:08] 3Wikimedia Labs / 3tools: Packages to be added to toollabs puppet - 10https://bugzilla.wikimedia.org/53704 (10Tim Landscheidt) [22:04:09] 3Wikimedia Labs / 3tools: generate language package for ca_ES.utf8 - 10https://bugzilla.wikimedia.org/66721#c3 (10Tim Landscheidt) a:5Marc A. Pelletier>3Tim Landscheidt The component "General" is for "issues surrounding set up of labs projects", while the setup of Wikimedia Tools is managed under the com... [22:05:24] 3Wikimedia Labs / 3tools: Packages to be added to toollabs puppet - 10https://bugzilla.wikimedia.org/53704 (10Tim Landscheidt) [22:05:25] 3Wikimedia Labs / 3tools: locale.setlocale(locale.LC_ALL, "ca_AD") doesn't work - 10https://bugzilla.wikimedia.org/62269 (10Tim Landscheidt) 5NEW>3ASSI a:3Tim Landscheidt [22:15:56] Anyone know what's up with the proxies? [22:16:03] I'm getting a 502 on http://growthdoc.wmflabs.org/GuidedTour/ [22:17:51] superm401: Works for cvn.wmflabs.org, so maybe the host serving growthdoc is down? [22:23:22] 3Wikimedia Labs / 3tools: locale.setlocale(locale.LC_ALL, "ca_AD") doesn't work - 10https://bugzilla.wikimedia.org/62269#c3 (10Tim Landscheidt) NB: On Ubuntu, the locales are named "ca_AD.UTF8" & Co.: | scfc@tools-dev:~$ LANG=ca_AD date | Tue Jun 17 22:20:21 UTC 2014 | scfc@tools-dev:~$ LANG=ca_AD.UTF8 date... [22:30:37] scfc_de, nope, 82 days uptime. [22:30:41] Will file [22:34:59] superm401: Are you admin in the project? Could you look if the web proxy entry is still there? [22:35:20] scfc_de, it's still in the list. [22:37:36] https://bugzilla.wikimedia.org/show_bug.cgi?id=66751 [22:37:39] 3Wikimedia Labs / 3Infrastructure: Proxy for growthdoc.wmflabs.org and proveit.wmflabs.org are down - 10https://bugzilla.wikimedia.org/66751 (10Matthew Flaschen) 3NEW p:3Unprio s:3normal a:3None http://growthdoc.wmflabs.org/GuidedTour/ (should be a HTTP redirect) and http://proveit.wmflabs.org/ (not... [22:39:56] superm401: What's the name of the host? [22:40:25] scfc_de, docs.eqiad.wmflabs [22:41:22] 3Wikimedia Labs / 3Infrastructure: Proxy for growthdoc.wmflabs.org and proveit.wmflabs.org are down - 10https://bugzilla.wikimedia.org/66751#c1 (10Matthew Flaschen) They proxy to docs.eqiad.wmflabs . [22:44:30] superm401: I can access http://docs.eqiad.wmflabs/ from Tools, so the webserver seems to be doing its job and the problem indeed lying with the proxy. (The webserver returns 404 for /, though, but that shouldn't cause the proxy to 502.) andrewbogott: ^ [22:45:23] 3Wikimedia Labs / 3(other): "Deprecated" error on devwiki/pagemigrationwiki (http://pagemigration.wmflabs.org/wiki/Special:RecentChanges) - 10https://bugzilla.wikimedia.org/66040#c1 (10PiRSquared17) I'm getting the same error on my local vagrant. [22:45:58] superm401: I will look, just a minute... [22:47:14] Thanks, andrewbogott [22:49:37] 3Wikimedia Labs / 3(other): "Deprecated" error on devwiki/pagemigrationwiki (http://pagemigration.wmflabs.org/wiki/Special:RecentChanges) - 10https://bugzilla.wikimedia.org/66040#c2 (10PiRSquared17) This is the same as bug 65776. Apparently one should suppress the warnings. [22:50:11] That's not good. /etc/apache2/sites-enabled/ got emptied out, and I have no idea how or by whom. [22:50:38] Is there some new Puppet manifest that would do that? [22:51:08] superm401: on what box? [22:51:11] sorry, still multitasking :( [22:51:17] Same one, docs.eqiad.wmflabs [22:51:54] superm401: I saw some recent changes by ori re apache2, but I don't know if they would affect you. [22:55:28] Yeah, they're being wiped out by puppet. [22:55:37] scfc_de, if you can add a link to the bug, that would be helpful. [22:56:31] http://tools-login.wmflabs.org/ is down? [22:56:47] superm401: ok, to confirm, this is not a toollabs project but a standalone, right? [22:56:55] andrewbogott, correct. [22:57:51] XXN: http://tools.wmflabs.org/ is up and running as is "ssh tools-login.wmflabs.org". [22:57:52] 3Wikimedia Labs: Puppet is erasing growthdoc.wmflabs.org and proveit.wmflabs.org sites-enabled - 10https://bugzilla.wikimedia.org/66751#c2 (10Matthew Flaschen) Upon further investigation, /etc/apache2/sites-enabled/ is now being affected by puppet. It is emptying these entires, but there is no "This directory... [22:58:43] superm401: ok… so not a proxy issue? [22:59:08] andrewbogott, correct, just a conflict with Puppet on the instance. [22:59:12] * andrewbogott will eventually catch up [22:59:24] And that's new&different puppet behavior? [23:03:38] 3Wikimedia Labs: Puppet is erasing growthdoc.wmflabs.org and proveit.wmflabs.org sites-enabled - 10https://bugzilla.wikimedia.org/66751#c3 (10Tim Landscheidt) I think ori refactored the apache* classes today. ori, could this be related? [23:04:44] superm401: ok, I'm going to go back to ignoring this for now :) [23:07:09] andrewbogott, yes it's new. Got to go. [23:23:37] 3Wikimedia Labs / 3deployment-prep (beta): Can't apply Puppet class role::mediawiki::videoscaler in beta - 10https://bugzilla.wikimedia.org/65569#c1 (10Bryan Davis) 5NEW>3RESO/FIX deployment-videoscaler01:~ bd808$ sudo puppet agent --test --verbose Info: Retrieving plugin Info: Loading facts in /var/lib/... [23:26:52] 3Wikimedia Labs / 3tools: locale.setlocale(locale.LC_ALL, "ca_AD") doesn't work - 10https://bugzilla.wikimedia.org/62269#c4 (10Igor Remolar @ Betxí) I have tried "LANG=ca_AD date" and it works fine. But when I type "locale -a", ca_AD and other stuffs don't appear. Then in python console when I type "import l... [23:32:07] 3Wikimedia Labs / 3deployment-prep (beta): Automate updating the puppet checkout - 10https://bugzilla.wikimedia.org/66683#c1 (10Bryan Davis) I have a bash script that seems to be working to automate this, but I'm not entirely sure of the best way to tie it into deployment-salt. We could do one of several thi... [23:38:28] Google Analytics is allowed right? [23:38:45] Dispenser: No. [23:39:01] Why not? [23:40:20] Because Labs/Tools offers about the same privacy expectations as Wikipedia. [23:45:52] They've sure changed it since last year. At a glance it seems like it still allows it. [23:55:32] Just need to add that third cookie notice that's seen on every EU site