[11:35:18] <arturo>	 anyone here using dumps NFS in their tools/bots running in toolforge?
[11:35:28] <arturo>	 (or in their own CloudVPS project?)
[12:50:07] <RhinosF1|NotHere>	 !log tools.zppixbot revoked Zppix access due to loss of access to replacement
[12:50:26] <RhinosF1|NotHere>	 !log tools.zppixbot-test synced access rights
[12:50:34] <RhinosF1|NotHere>	 stashbot_: hello!
[12:50:51] <MacFan4000>	 bd808: ^ stashbot is having issues
[12:54:24] <Majavah>	 afaik it would need its primary nick (stashbot not stashbot_) to do anything
[12:56:39] <arturo>	 let me restart it
[12:57:53] <arturo>	 !log tools.stashbot restarting bot to try correcting bad IRC nick
[12:57:56] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL
[12:58:01] <MacFan4000>	 !log tools.zppixbot <RhinosF1> revoked Zppix access due to loss of access to replacement
[12:58:02] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot/SAL
[12:58:35] <MacFan4000>	 !log tools.zppixbot-test <RhinosF1> synced access rights
[12:58:37] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot-test/SAL
[15:45:29] <arturo>	 !log admin [codfw1dev] connect virtual router cloudinstances2b-gw to vlan cloud-gw-transport-codfw (185.15.57.10) (T272963)
[15:45:32] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL
[15:45:33] <stashbot>	 T272963: cloudgw: develop HA setup - https://phabricator.wikimedia.org/T272963
[15:45:54] <arturo>	 !log admin [codfw1dev] drop subnet definition for cloud-instances-transport1-b-codfw (T272963)
[15:45:58] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL
[16:25:24] <arturo>	 !log admin [codfw1dev] rebooting all cloudgw200x-dev / cloudnet200x-dev servers (T272963)
[16:25:27] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL
[16:25:28] <stashbot>	 T272963: cloudgw: develop HA setup - https://phabricator.wikimedia.org/T272963
[18:59:56] <isaacj>	 not sure if this is the right place, but right now I get a "Internal Server Error" if I try to login to Quarry. any ideas?
[19:08:42] <Majavah>	 I can reproduce
[19:09:43] <Reedy>	 is it from quarry/labs or from the oauth part back to mediawiki?
[19:11:26] <Majavah>	 quarry side, it doesn't even redirect to mw
[19:13:14] <isaacj>	 thanks both for chiming in -- if I need to file a bug etc., just let me know
[19:14:24] <Reedy>	 >The last Puppet run was at Mon Feb  8 17:33:25 UTC 2021 (10180 minutes ago). Puppet is disabled. framawiki: test nginx config for sentry
[19:14:26] * Reedy squints
[19:15:41] <Reedy>	 Feb 15 19:15:32 quarry-web-01 uwsgi-quarry-web[2055]:     session['request_token'] = request_token
[19:15:41] <Reedy>	 Feb 15 19:15:32 quarry-web-01 uwsgi-quarry-web[2055]: NameError: name 'request_token' is not defined
[19:18:13] <Reedy>	 It is those changes from framawiki
[19:18:31] <Reedy>	 Fixed
[19:18:51] <Reedy>	 !log tools.quarry `git stash` framawiki changes as it was breaking login
[19:18:53] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quarry/SAL
[19:18:55] <isaacj>	 thanks Reedy ! confirmed
[19:19:40] <Majavah>	 isn't quarry a vps project and not a toolforge tool?
[19:20:23] <Reedy>	 meh
[19:20:28] <Reedy>	 !log quarry `git stash` framawiki changes as it was breaking login
[19:20:30] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL
[19:21:08] <Reedy>	 T274815 filed
[19:21:08] <stashbot>	 T274815: Login broken - https://phabricator.wikimedia.org/T274815
[19:21:28] <Reedy>	 !log re-enabled puppet on quarry-web-01.quarry.eqiad1.wikimedia.cloud as it had been disabled for a week
[19:21:28] <stashbot>	 Reedy: Unknown project "re-enabled"
[19:21:46] <Reedy>	 !log quarry re-enabled puppet on quarry-web-01.quarry.eqiad1.wikimedia.cloud as it had been disabled for a week
[19:21:47] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL
[19:22:07] <Reedy>	 !log quarry T274815 filed with the login failure traceback
[19:22:09] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL
[19:24:34] <Reedy>	 !log quarry stash'd patch saved to quarry-web-01.quarry.eqiad1.wikimedia.cloud:/root/T274815.patch T274815
[19:24:37] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL
[21:13:17] <Zppix>	 bd808: can i pm you regarding a question about access