[15:50:37] !log metricsinfra silencing all alerts from deployment-prep for 60 more days [15:50:39] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Metricsinfra/SAL [18:21:47] !log tools ran 'sudo systemctl stop getty@ttyS1.service && sudo systemctl disable getty@ttyS1.service' on tools-k8s-etcd-5 I have no idea why that keeps coming back. [18:21:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [18:31:55] bstorm: should we `systemctl mask` that unit? [18:34:25] legoktm: that might help, but it shouldn't even be there. I'm curious how it would get there on a recent VM. It suggests there's an issue with our images or something [18:34:48] andrewbogott: do you agree? ^ [18:35:21] I'm not sure — can you make me a task to investigate? [18:35:31] It might be on purpose to support virsh console [18:42:46] Sure :) [18:42:53] It was...but then it wasn't [18:42:57] I can re-open the old task [18:44:39] T244619 [18:44:40] T244619: Fix cloud VPS errors about ttyS1 - https://phabricator.wikimedia.org/T244619 [18:44:56] andrewbogott: ☝🏻 [18:58:59] Thx [20:37:20] Is it normal to get "Error: timed out waiting for the condition" when issuing a "kubectl logs job/test -f" per https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#Kubernetes_cronjobs ? [20:39:52] I'll try with different resource limits https://phabricator.wikimedia.org/P13646 [20:48:40] seems to be going well [20:55:10] Nemo_bis: looks like you got yourself on the right track to fixing? Using kubectl directly to make jobs is hard. Hopefully we will make time to work on some helper tools for that in the coming months. [20:57:02] bd808: thanks, I survived so far; the help page got me in the right direction :) I added a small note about what I just larned, check it makes sense [20:57:15] In https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#Kubernetes_cronjobs I mean [20:58:17] Nemo_bis: LGTM. Thank you for being the good kind of user that fixes up the docs too. :) [21:00:07] I'm wired that way ;) [21:00:20] I'm the first day at a new job and already I reported a few typos on the internal wiki :D [21:00:42] (Not fixed, sadly, as it's a rather locked down Confluence) [21:01:04] Nemo_bis: good luck surviving Confluence. ;) [21:01:51] bd808: thanks :) I've got some experience with it, I think I can handle it for basic usage :D [21:02:24] It actually has/used to have some nice features we should have some day, for instance import (and, tactically, not export :P ) [21:04:04] The instance at my $DAYJOB-1 was a wreck, but that may have had more to do with the controlling set of authors (internal HR) than the tech. ;) [21:13:12] Yeah, I think the issue might be that Confluence lets you do very stupid things if you want, e.g. for access control, while MediaWiki has the opposite problem of being rather opinionated (no ACL at all!)