[04:47:18] <madhuvishy>	 !log dumps Rebooting dumps-1 to resolve stuck NFS /home
[04:47:19] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Dumps/SAL
[07:12:10] <wikibugs>	 (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/422856 (owner: 10L10n-bot)
[13:08:20] <wikibugs>	 (03PS1) 10Andrew Bogott: labtestweb: add an additional dummy var [labs/private] - 10https://gerrit.wikimedia.org/r/422922
[13:44:15] <wikibugs>	 (03PS2) 10Andrew Bogott: labtestweb: add an additional dummy var [labs/private] - 10https://gerrit.wikimedia.org/r/422922
[13:44:26] <wikibugs>	 (03CR) 10Andrew Bogott: [V: 032 C: 032] labtestweb: add an additional dummy var [labs/private] - 10https://gerrit.wikimedia.org/r/422922 (owner: 10Andrew Bogott)
[14:30:28] <elukey>	 Hi everybody, I am trying to add a hiera param via horizon (project: deployment-prep) but I am getting either a 400 or a timeout (prefix puppet takes ages to save, then goes back to main page without saving the value)
[14:30:37] <elukey>	 is there anything ongoing with Horizon?
[14:33:47] <chasemp>	 elukey: not ot my knowledge but andrewbogott would be the best person to take a look, he should be around in a bit (this will ping him :)
[14:33:59] <elukey>	 chasemp: o/
[14:34:21] <chasemp>	 sorry that's giving you trouble
[14:36:00] <andrewbogott>	 elukey: I'll have a look.  What instance?
[14:36:55] <andrewbogott>	 elukey: also what param?
[14:37:50] <elukey>	 andrewbogott: hi! so I am trying to set "profile::zookeeper::prometheus_monitoring_enabled: true" in deployment-prep's prefix puppet for zookeeper, and I tried to do the same thing in project:analytics, keep getting the same weird behavior
[14:38:23] <elukey>	 ah no wait for analytics worked now
[14:38:44] <elukey>	 let's see deployment-prep
[14:38:53] <elukey>	 maybe the only fact that you were online scared horizon
[14:40:34] <andrewbogott>	 I see profile::zookeeper::prometheus_monitoring_enabled: true
[14:40:42] <andrewbogott>	 for the prefix in deployment-prep
[14:40:48] <elukey>	 yes now it works
[14:40:56] <andrewbogott>	 dang
[14:41:00] <elukey>	 it was returning 400 a while a go I swear :D
[14:41:03] <andrewbogott>	 well, sorry :)  I guess you're unblocked for now
[14:41:07] <andrewbogott>	 let me know if/when it happens again
[14:41:15] <elukey>	 sure thanks!
[17:18:49] <zhuyifei1999_>	 !log video upgraded youtube_dl in frontend from 2017.9.2 to 2018.3.26.1
[17:18:50] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL
[18:04:10] <wikibugs>	 (03CR) 10MarcoAurelio: "recheck" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/422988 (owner: 10Libraryupgrader)
[18:04:12] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] build: Updating mediawiki/mediawiki-codesniffer to 17.0.0 [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/422988 (owner: 10Libraryupgrader)
[18:05:01] <Hauskatze>	 https://gerrit.wikimedia.org/r/#/c/422988/ wtf
[18:05:13] <Hauskatze>	 the change is up to date but jenkins refuses to check
[18:06:33] <chicocvenancio>	 Hauskatze: I think that needs rebasing
[18:06:49] <Hauskatze>	 chicocvenancio: rebase says "change is already up-to-date"
[18:07:12] <Hauskatze>	 no changes have been merged in the repo for some time either
[18:07:19] <Hauskatze>	 so it shouldn't conflict imho
[18:07:32] <Hauskatze>	 I'll try to manually rebase, see what's wrong :/
[18:08:01] <wikibugs>	 (03CR) 10MarcoAurelio: "recheck" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/422988 (owner: 10Libraryupgrader)
[18:08:03] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] build: Updating mediawiki/mediawiki-codesniffer to 17.0.0 [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/422988 (owner: 10Libraryupgrader)
[18:13:53] <Hauskatze>	 $ git rebase origin/master
[18:13:53] <Hauskatze>	 Current branch review/libraryupgrader/bump-dev-deps is up to date.
[18:13:58] <Hauskatze>	 :/
[18:14:18] <Hauskatze>	 manually merged
[18:14:26] <wikibugs>	 (03CR) 10MarcoAurelio: [V: 032 C: 032] build: Updating mediawiki/mediawiki-codesniffer to 17.0.0 [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/422988 (owner: 10Libraryupgrader)
[18:16:36] <wikibugs>	 (03Draft1) 10MarcoAurelio: test [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423005
[18:16:39] <wikibugs>	 (03PS2) 10MarcoAurelio: test [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423005
[18:17:25] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] test [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423005 (owner: 10MarcoAurelio)
[18:18:13] <Hauskatze>	 chicocvenancio: ^^
[18:18:20] <Hauskatze>	 not even fresh changes
[18:18:36] <Hauskatze>	 looking at https://phabricator.wikimedia.org/diffusion/TSTW/ nothing looks weird
[18:18:39] <legoktm>	 er
[18:18:41] <legoktm>	 don't force merge
[18:18:42] <legoktm>	 :(
[18:19:57] <wikibugs>	 (03CR) 10MarcoAurelio: "recheck" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423005 (owner: 10MarcoAurelio)
[18:20:29] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] test [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423005 (owner: 10MarcoAurelio)
[18:21:39] <Hauskatze>	 legoktm: rebasing through gerrit and on my local machine gives that changes are up to date already
[18:22:01] <Hauskatze>	 and I can't see through the commit history any merging conflicts etc
[18:22:06] <Hauskatze>	 any idea?
[18:25:28] <chicocvenancio>	 I would take a look at the Jenkins config for the repo, but I am not an expert on git/gerrit/Jenkins 
[18:26:51] <wikibugs>	 (03PS1) 10MarcoAurelio: Revert "build: Updating mediawiki/mediawiki-codesniffer to 17.0.0" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423008
[18:26:53] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Revert "build: Updating mediawiki/mediawiki-codesniffer to 17.0.0" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423008 (owner: 10MarcoAurelio)
[18:27:18] <Hauskatze>	 it hasn't changed, not that I know of
[18:27:24] <wikibugs>	 (03CR) 10MarcoAurelio: [V: 032 C: 032] Revert "build: Updating mediawiki/mediawiki-codesniffer to 17.0.0" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423008 (owner: 10MarcoAurelio)
[18:27:26] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Revert "build: Updating mediawiki/mediawiki-codesniffer to 17.0.0" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423008 (owner: 10MarcoAurelio)
[18:27:44] <Hauskatze>	 okay this is ridiculous https://gerrit.wikimedia.org/r/#/c/423009/
[18:27:58] <wikibugs>	 (03Abandoned) 10MarcoAurelio: test [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423005 (owner: 10MarcoAurelio)
[18:29:15] <legoktm>	 Hauskatze: I mean, I would wait instead of force merging
[18:29:21] <wikibugs>	 (03Draft1) 10MarcoAurelio: test-2 [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423009
[18:29:26] <legoktm>	 it's probably a CI issue
[18:29:35] <legoktm>	 I would bet that the zuul-merger clone is broken
[18:29:46] <Hauskatze>	 zuul config is the same as before: https://github.com/wikimedia/integration-config/blob/master/zuul/layout.yaml#L1862
[18:29:56] <Hauskatze>	 legoktm: I'd say it's a zuul issue
[18:30:05] <Hauskatze>	 I've asked hashar but no answer
[18:31:03] <wikibugs>	 (03Abandoned) 10MarcoAurelio: test-2 [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423009 (owner: 10MarcoAurelio)
[18:31:29] <Hauskatze>	 https://gerrit.wikimedia.org/r/#/c/423010/ <-- reinstates the build update, but have not merged it
[18:31:51] <wikibugs>	 (03PS1) 10MarcoAurelio: Reinstate "build: Updating mediawiki/mediawiki-codesniffer to 17.0.0" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423010
[18:31:53] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Reinstate "build: Updating mediawiki/mediawiki-codesniffer to 17.0.0" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423010 (owner: 10MarcoAurelio)
[18:37:45] <Hauskatze>	 legoktm: filed T191077
[18:37:45] <stashbot>	 T191077: zuul merge cloner might be broken - https://phabricator.wikimedia.org/T191077
[18:44:53] <Hauskatze>	 chicocvenancio / bd808 -- did you see T191005 ?
[18:44:53] <stashbot>	 T191005: shinken.wmflabs.org is down with Error 502 Bad Gateway - https://phabricator.wikimedia.org/T191005
[18:44:54] <paladox>	 ah
[18:45:04] <paladox>	 i think sometimes there's an issue
[18:45:17] <paladox>	 deleting the repo on the zuul host should fix that
[18:45:32] <Hauskatze>	 on contint1001?
[18:45:39] <paladox>	 i think so
[18:46:00] <Hauskatze>	 I do not have access there
[18:47:01] <Hauskatze>	 (I must say that I don't know where the '1001' '2001' etc numbering comes from, its confusing)
[18:58:42] <chicocvenancio>	 Hauskatze: hadn't seen that, thanks for pinging
[19:00:26] <wikibugs>	 (03PS1) 10Bstorm: wiki replicas: working on getting the hiera data right [labs/private] - 10https://gerrit.wikimedia.org/r/423014
[19:01:32] <wikibugs>	 (03CR) 10Bstorm: [V: 032 C: 032] wiki replicas: working on getting the hiera data right [labs/private] - 10https://gerrit.wikimedia.org/r/423014 (owner: 10Bstorm)
[19:56:40] <chicocvenancio>	 !log tools several interactive jobs running in bastion-03. I am writing to connected users and will kill the jobs once done
[19:56:42] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[20:09:06] <chicocvenancio>	 !log tools killed interactive processes in tools-bastion-03
[20:09:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[20:09:19] <zhuyifei1999_>	 nice
[20:46:35] <paladox>	 Im wondering in shinken puppet class does it use puppetdb resources? or do hosts get manually added?
[20:47:44] <paladox>	 we should maybe do something like the fix for https://phabricator.wikimedia.org/T149376 for shinken too?
[22:11:12] <paladox>	 andrewbogott thanks, i can see https://horizon.wikimedia.org/project/floating_ips/ now :)
[22:11:31] <andrewbogott>	 paladox: and it works?  I haven't tested it in prod yet
[22:11:44] * paladox tests
[22:12:17] <paladox>	 andrewbogott yep works :)
[22:12:23] <andrewbogott>	 cool
[22:12:39] <andrewbogott>	 I'm sure this will break again with Neutron — enjoy the honeymoon :)
[22:16:00] <wikibugs>	 (03CR) 10MarcoAurelio: "recheck" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423010 (owner: 10MarcoAurelio)
[22:17:55] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Reinstate "build: Updating mediawiki/mediawiki-codesniffer to 17.0.0" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/423010 (owner: 10MarcoAurelio)
[22:21:27] <paladox>	 lol