[08:01:54] !log tools switch NFS from tools-nfs-2 to tools-nfs-3 - T404584 [08:02:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [08:02:02] T404584: [tools,nfs,infra] Address tools NFS getting stuck with processes in D state - https://phabricator.wikimedia.org/T404584 [08:39:32] !log expire tools-checker-5 nfs client on clouddumps1001 [08:39:36] !log tools expire tools-checker-5 nfs client on clouddumps1001 [08:57:03] wb stashbot [15:48:14] !log rebooting cloudcumin2001 [15:48:15] volans: Unknown project "rebooting" [15:48:24] !lod admin rebooting cloudcumin2001 [15:48:25] volans: you can use admin as the project [15:48:29] yep :) [15:48:43] muscle memory :D [15:59:49] !lod admin rebooting cloudcumin1001 [17:39:30] the cvn project has been getting puppet failure alerts for cvn-nfs-1. Is there something we should be doing about these? [17:39:55] ERR: Systemd start for networkd-ip-nfs-standalone failed! [18:03:14] AntiComposite: can you file a task with #cloud-vps? [18:03:27] sure [18:06:32] https://phabricator.wikimedia.org/T407151 [18:10:33] !log lucaswerkmeister@tools-bastion-15 tools.wd-image-positions deployed 041f0cc802 (l10n updates: ru) [18:10:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wd-image-positions/SAL [18:10:57] !log lucaswerkmeister@tools-bastion-15 tools.lexeme-forms deployed ffc43e9936 (l10n updates: lb) [18:10:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [18:11:49] thanks [18:12:56] !log lucaswerkmeister@tools-bastion-15 tools.bridgebot toolforge jobs restart bridgebot [18:12:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [18:14:55] !log lucaswerkmeister@tools-bastion-15 tools.bridgebot toolforge jobs restart bnc [18:14:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [18:16:02] !log lucaswerkmeister@tools-bastion-15 tools.bridgebot toolforge jobs restart bridgebot [18:16:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [18:16:18] * lucaswerkmeister still does not understand the bridgebot vs bnc jobs [18:16:43] bridgebot was the one that went quiet in its `kubectl logs`, but seemingly bnc was the one that needed a restart, except bridgebot needed a restart after that? [18:20:52] bnc sits between the bridgebot and irc, so if it goes down, everything breaks