[00:49:21] <bstorm>	 That is possible
[00:50:08] <bstorm>	 !log admin icinga-downtime cloudnet1004 for a week T271058
[00:50:11] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL
[00:50:12] <stashbot>	 T271058: cloudnet1004/cloudnet1003: network hiccups because broadcom driver/firmware problem - https://phabricator.wikimedia.org/T271058
[00:51:12] <bstorm>	 mutante: I can remove you if you want. You can also do it from the command line
[00:53:04] <mutante>	 bstorm: thank you, please remove me from just "wildcat"
[00:53:29] <bstorm>	 Will do
[00:53:31] <mutante>	 thx
[00:54:26] <bstorm>	 mutante: that should have done it
[00:55:35] <mutante>	 bstorm: confirmed! it's gone after switching to/from project
[00:55:41] <bstorm>	 👍🏻
[12:00:42] <tanny411>	 Hi, I have been running some queries in toolforge (grid) and it seems to fail for enwiki with `mysql connection got lost`error. Since the queries return lots of rows, I fetch 500 at a time. I reduced it to fetch 50, 10, even 2, but still get this error. Surprisingly the same query (with 500 limit) works perfectly fine in PAWS.  Code and ways to replicate are here (https://phabricator.wikimedia.org/T272822). 
[12:00:42] <tanny411>	 Can someone help troubleshoot why this is, I thought running in grid should be faster and better?
[14:52:42] <xaosflux>	 hi -cloud could anyone help with https://phabricator.wikimedia.org/T273048 ?
[14:54:29] <andrewbogott>	 xaosflux: are you associated with the globaleducation cloud-vps project?  That seems to be where that URL points
[14:56:34] <xaosflux>	 I'm not personally from the tech side, was reported on meta-wiki (https://meta.wikimedia.org/wiki/Talk:Programs_%26_Events_Dashboard#Error_accessing_dashboard)
[14:56:59] <xaosflux>	 no response there yet, directions on support say "Wiki Education staff are not available, try asking in #wikimedia-cloud on Freenode IRC"
[14:58:21] <andrewbogott>	 You can see a list of admins associated with that project here: https://openstack-browser.toolforge.org/project/globaleducation
[14:58:35] <andrewbogott>	 (I'm on that list but only because I'm a cloud admin, I don't otherwise have anything to do with the project)
[14:59:27] <xaosflux>	 ok - so guess we just have to wait for one of them to pick this up from phab?
[15:00:41] <andrewbogott>	 Or try email :)  It looks like the last person to touch that project was Sage Ross.
[15:01:08] <xaosflux>	 yea, thats who normally checks on it
[15:01:10] <xaosflux>	 thanks for the notes
[15:02:31] <xaosflux>	 part
[15:56:16] <qedk>	 seems that sage joined right as xaos left 
[16:05:00] <andrewbogott>	 ragesoss: this might be of interest https://phabricator.wikimedia.org/T273048
[16:21:33] <ragesoss>	 thanks
[16:42:18] <Urbanecm>	 Hello, is it possible to restart gridengine jobs from kubernetes cluster?
[16:42:52] <Urbanecm>	 I want to have a webservice that should allow trusted wiki users to restart continuous jobs, as they sometimes...break.
[16:44:03] <qedk>	 i've thought that many times as well, possibly should be implemented in tools admin interface itself
[17:44:47] <Amir1>	 bstorm: hey, if you have time, can you take a look at https://gerrit.wikimedia.org/r/658397? It's pretty straightforward and PCC is already happy and it's part of an OKR for upgrading to puppet 6, I'll make some more for wmcs, if you or anyone from the team is willing to help reviewing, please let me know
[17:44:51] <Amir1>	 Thank you
[17:45:38] <bstorm>	 Will do
[17:45:43] <Amir1>	 Thanks!
[17:45:57] <bstorm>	 I'm surprised that there are still hiera calls in there :) It would be in that profile...
[17:50:03] <Amir1>	 bstorm: thanks. It's just that since I'm no SRE, I can't merge it :( Sorry. Can you merge it too?
[17:50:12] <bstorm>	 Will do
[17:50:21] <Amir1>	 there's not much left, I think it's less than ten for wmcs
[17:50:51] <Amir1>	 80 in total (used to be around 500 a month ago)
[19:52:12] <wm-bot>	 !log tools.ranker <lucaswerkmeister> deployed 2fd1f5959d (move login banner)
[19:52:13] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL
[20:05:45] <wm-bot>	 !log tools.ranker <lucaswerkmeister> deployed c434d9994c (remember current page on login)
[20:05:47] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL
[20:11:24] <wm-bot>	 !log tools.lexeme-forms <lucaswerkmeister> deployed 03255e1408 (pop OAuth redirect target)
[20:11:25] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL
[20:26:54] <wm-bot>	 !log tools.lexeme-forms <lucaswerkmeister> deployed 1bc8d4232e (remove long-dead code about fixing the session cookie)
[20:26:56] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL
[22:26:29] <wm-bot>	 !log tools.lexeme-forms <lucaswerkmeister> deployed uncommitted test code to print current_url debug output
[22:26:31] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL
[22:38:51] <wm-bot>	 !log tools.lexeme-forms <lucaswerkmeister> deployed another version of test code
[22:38:53] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL
[22:39:54] <wm-bot>	 !log tools.lexeme-forms <lucaswerkmeister> deployed fixed version of test code, oops
[22:39:55] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL