[02:45:07] <legoktm>	 !log tools.gerrit-to-redis restarted to see if that's why grrrit-wm is broken
[02:45:13] <labs-morebots>	 Logged the message, Master
[03:16:26] <huh>	 anyone here?
[03:16:33] <huh>	 how to kill job that won't die??????
[03:17:20] <comets>	 poison?
[03:22:38] <legoktm>	 !log tools.lolrrit-wm huh moved config to config_moved-cuz-bug to stop if from spamming channels
[03:22:39] <labs-morebots>	 Logged the message, Master
[03:33:55] <wikibugs>	 3Tool Labs tools / 3[other]: grrrit-wm down and broken - 10https://bugzilla.wikimedia.org/72523 (10Kunal Mehta (Legoktm)) 3NEW p:3Unprio s:3normal a:3None Email I sent to Yuvi:  tl;dr: grrrit-wm is broken right now, it's not relying messages, and when we try and attempt to kill it with qdel, it goes...
[04:23:08] <wikibugs>	 3Tool Labs tools / 3[other]: grrrit-wm down and broken - 10https://bugzilla.wikimedia.org/72523#c1 (10MZMcBride) I reverted the config.yaml move and the bot is now connected to freenode and seems stable. The stream seems broken, though.
[16:41:25] <wikibugs>	 3Wikimedia Labs / 3tools: wikidata-todo webservice not working - 10https://bugzilla.wikimedia.org/72532 (10Magnus Manske) 3NEW p:3Unprio s:3blocke a:3Marc A. Pelletier The webservice for the wikidata-todo tool runs, but produces only blank pages, no matter if the page actually exists. I removed acces...
[19:10:52] <wikibugs>	 3Wikimedia Labs / 3tools: wikidata-todo webservice not working - 10https://bugzilla.wikimedia.org/72532#c1 (10Magnus Manske) Same thing for the "magnus-toolserver" tool.
[19:46:17] <valhallasw>	 !log tools.gerrit-to-redis grrrit-wm still not reporting anything; checking redis stream
[19:46:21] <labs-morebots>	 Logged the message, Master
[19:50:55] <valhallasw>	 !log tools.gerrit-to-redis gerrit-to-redis reconnects to gerrit every two hours, but does not push to clients (last 'pushed to 1 clients' message was 26-10-2014 04:00:41,241)
[19:50:56] <labs-morebots>	 Logged the message, Master
[19:51:33] <valhallasw>	 !log tools.gerrit-to-redis and gerrit-to-redis does not seem to be running ATM - qstat is empty
[19:51:35] <labs-morebots>	 Logged the message, Master
[19:53:31] <valhallasw>	 !log tools.gerrit-to-redis job resubmitted; now running on continuous@tools-exec-10; SSH and redis connections are open
[19:53:32] <labs-morebots>	 Logged the message, Master
[19:57:03] <valhallasw>	 !log tools.gerrit-to-redis "2014-10-26 19:56:30,333 Pushed to 1 clients"
[19:57:05] <labs-morebots>	 Logged the message, Master
[20:02:11] <valhallasw>	 !log tools.lolrrrit-wm 2014-10-26T20:01:00.911Z - error:  prefix=hitchcock.freenode.net, server=hitchcock.freenode.net, command=err_channelisfull, rawCommand=471, commandType=error, args=[grrrit-wm1, #wikimedia-growth, Cannot join channel (+l) - channel is full, try again later]
[20:02:12] <labs-morebots>	 tools.lolrrrit-wm is not a valid project.
[20:02:17] <valhallasw>	 !log tools.lolrrit-wm 2014-10-26T20:01:00.911Z - error:  prefix=hitchcock.freenode.net, server=hitchcock.freenode.net, command=err_channelisfull, rawCommand=471, commandType=error, args=[grrrit-wm1, #wikimedia-growth, Cannot join channel (+l) - channel is full, try again later]
[20:02:19] <labs-morebots>	 Logged the message, Master
[20:02:43] <valhallasw>	 !log tools.lolrrit-wm but I'm not sure if thta's the actual cause...
[20:02:45] <labs-morebots>	 Logged the message, Master
[20:11:05] <valhallasw>	 !log tools.lolrrit-wm kicked #wikimedia-growth from the config, let's see if that helps
[20:11:08] <labs-morebots>	 Logged the message, Master
[20:15:03] <valhallasw>	 !log tools.lolrrit-wm judging from the log, that seems to have been the issue indeed
[20:15:04] <labs-morebots>	 Logged the message, Master
[20:16:20] <valhallasw>	 !help log
[20:16:20] <wm-bot>	 !documentation for labs !wm-bot for bot
[20:17:32] <valhallasw>	 ?! why were those messages not logged?!
[20:17:44] <valhallasw>	 oh, it's a bot with a bot flag
[20:21:23] <wikibugs>	 3Tool Labs tools / 3[other]: grrrit-wm: runs into infinite loop if unable to join channels - 10https://bugzilla.wikimedia.org/72523#c2 (10Merlijn van Deen) So there were two issues currently:  1) gerrit-to-redis was not running. From https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.gerrit-to-redis/SAL...
[20:34:08] <wikibugs>	 3Tool Labs tools / 3[other]: grrrit-wm: runs into infinite loop if unable to join channels - 10https://bugzilla.wikimedia.org/72523#c3 (10Merlijn van Deen) I can't get the patch in from tools and the patch uploader has memory issues, so here's the patch:  commit 419e36d490f14d623633e79cf54dc46bb15dbd94 Autho...
[22:59:38] <wikibugs>	 3Wikimedia Labs / 3tools: wikidata-todo webservice not working - 10https://bugzilla.wikimedia.org/72532#c2 (10Magnus Manske) Update: Some functions of wikidata-todo now seem to work, after repeated webservice restart. magnus-toolserver seems to be still offline/loading forever.