[09:39:46] !log paws dropped the DNS wildcard record `*.paws.wmcloud.org IN A 185.15.56.57` and created concrete CNAME records for the FQDNs we actually use (T211096) [09:39:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [09:39:49] T211096: PAWS: Rebuild and upgrade Kubernetes - https://phabricator.wikimedia.org/T211096 [09:44:57] wow https://phabricator.wikimedia.org/T211096 is so large [09:49:05] yuvipanda: yeah, we put some work there! [09:49:11] specially bstorm! [09:49:11] <3 [09:49:16] yeah! bstorm <3 [11:52:09] wow, that looks amazing [13:39:45] !log codesearch restarting codesearch to pick up the new config (T231572) [13:39:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Codesearch/SAL [13:39:50] T231572: Index Wikibase JavaScript libraries - https://phabricator.wikimedia.org/T231572 [17:25:53] !log paws to force repulling of every image everywhere, uninstalling paws in the new cluster and reinstalling it T258812 [17:25:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [17:25:56] T258812: Fix the paws-public links in the new cluster! - https://phabricator.wikimedia.org/T258812 [19:15:17] !log admin ceph osd pool set compute pg_autoscale_mode on [19:15:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [19:15:42] !log admin ceph mgr module enable pg_autoscaler [19:15:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [20:06:06] !log tools Running cleanup script to delete all of the old toollabs-* images from docker-registry.tools.wmflabs.org [20:06:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [20:17:01] !log tools Forced garbage collection on docker-registry.tools.wmflabs.org [20:17:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [21:02:14] !log tools Running cleanup script to delete the non-sssd toolforge images from docker-registry.tools.wmflabs.org [21:02:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [21:20:53] would anyone know how i can get ssh working in my kubernetes container [21:21:01] on toolforge [21:21:31] @bd808 if you're around [21:22:23] qedk: what are you trying to accomplish? (hoping to avoid the XY problem) [21:23:11] i'm trying to use git commands [21:23:33] basically parse a page, update locally and push to github [21:24:29] ok. that sounds possible. And where does ssh come into this? [21:25:05] git requires the ssh to authorize and we are using an ssh-based deploy key [21:26:17] ok, so I think you are reporting that `git push` to an ssh origin fails from inside a Kubernetes container on Toolforge? [21:26:47] yep, basically it's ssh: command not found [21:26:57] when doing git pull/push [21:27:21] "error: cannot run ssh: No such file or directory" to be exact [21:27:58] and this git push is something that your tool would like to do directly. It's not an operation you can do manually from a bastion? [21:28:56] it's kind of an addon for the other tools which are all on kube, and since we would also have automatic deployment at some point (the codebase is now on 3.7.3 because kubernetes!) it's required :/ [21:30:10] adding an ssh client to the base images is probably pretty light, just trying to reason about why we haven't had anyone ask for it in the prior 3+ years :) [21:30:58] i think the current recommendation is for kube to be used for webservices rather than mainstream jobs (according to docs) [21:31:47] yeah, we are in the very beginning of folks running crontask objects on the kubernetes grid [21:31:50] i'm quite surprised that so many projects are picking up 3.6+ so fast, 4/20 in the current project already have switched [21:32:05] projects = python libraries* [21:34:34] qedk: https://phabricator.wikimedia.org/project/profile/3978/ is the tag to put on a phabricator task asking for software installs. Writing up the "why" in the task description is helpful [21:35:15] alright, will get one up in a bit [21:44:43] @bd808 here ya go: https://phabricator.wikimedia.org/T258841 :) [21:47:13] thanks [21:48:38] welcome o/ [22:02:08] !log tools.bridgebot Upgrade to matterbridge-1.18.0 and change nick to wm-bb [22:02:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [22:25:08] legoktm: grrrit doesn't use a custom Docker container on the Toolforge k8s cluster any more does it? [22:25:17] nope [22:25:19] * bd808 is looking for more stale containers to rm [22:25:23] cool [22:25:41] qedk: if you're just pushing to git, why not push over HTTPS? [22:26:35] also I think people are adopting 3.6+ really quickly because of f-strings, they're just too nice [22:27:10] I don't get the beauty of f-strings, but *shrug* [22:27:45] interpolation using arbitrary data in the current scope is their killer feature right? [22:30:21] I think it's just much nicer than .format() and %s string interpolation [22:33:10] I use all three [22:33:12] as well as string.Template [22:33:14] there is a proposal going around to make f-strings the default, which I think is a bad idea [22:33:21] !log tools Removed a few more ancient docker images: grrrit, jessie-toollabs, and nagf [22:33:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [22:47:28] I remember now, that docker image was a real problem [22:48:10] Yuvi converted grrrit to use k8s/docker, which was great, except at that time only roots could restart/modify it and it would break regularly [22:48:31] that was what motivated me to have wikibugs subsume it [23:02:03] heh. the danger of being an early adopter. I remember working on a docker container for striker too and then noping out of using it when I found out that only y.uvi would be able to start/stop the bot