[01:40:31] 10serviceops, 10SRE, 10ops-codfw, 10Patch-For-Review: decommission scb200[1-6].codfw.wmnet - https://phabricator.wikimedia.org/T275760 (10Papaul) 05Open→03Resolved complete [07:12:05] o/ [07:14:40] 10serviceops, 10SRE: Puppet TLS certs to renew - https://phabricator.wikimedia.org/T279410 (10elukey) [08:41:36] 10serviceops, 10Performance-Team, 10Release-Engineering-Team: Create warmup procedure for MediaWiki app servers - https://phabricator.wikimedia.org/T230037 (10Seb35) Link to {T240775} given this other one could be part of some warmup procedure. I mention also [[https://github.com/php-pm/php-pm|PHP-PM]], whi... [09:26:22] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Upgrade kubernetes clusters to a security supported (LTS) version - https://phabricator.wikimedia.org/T244335 (10JMeybohm) [09:26:24] 10serviceops, 10Prod-Kubernetes, 10Patch-For-Review, 10User-fsero: Set up PodSecurityPolicies in clusters - https://phabricator.wikimedia.org/T228967 (10JMeybohm) 05Open→03Resolved >>! In T228967#6938447, @JMeybohm wrote: > But wait, it's currently still not fully active and blocked by: T274262 > > Th... [09:26:26] 10serviceops, 10Prod-Kubernetes, 10User-fsero: Kubernetes clusters roadmap - https://phabricator.wikimedia.org/T212123 (10JMeybohm) [09:33:59] 10serviceops, 10SRE: Puppet TLS certs to renew - https://phabricator.wikimedia.org/T279410 (10jbond) 05Open→03Resolved a:03jbond I have now renewed all certs, thanks [10:12:21] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Upgrade kubernetes clusters to a security supported (LTS) version - https://phabricator.wikimedia.org/T244335 (10akosiaris) [10:12:29] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Clean up/Consolidate kubernetes related dashboards - https://phabricator.wikimedia.org/T275641 (10akosiaris) 05Open→03Resolved I 've deleted the 3 Staging specific dashboard and consolidated and made the rest more consistent. Now they all use a $cluster vari... [10:25:59] 10serviceops, 10Maps, 10Packaging: Packaging PostGIS 3.1 for the new Maps stack - https://phabricator.wikimedia.org/T277064 (10MSantos) >>! In T277064#6965279, @MoritzMuehlenhoff wrote: > @MSantos You can find a backport for buster at https://people.wikimedia.org/~jmm/postgis/ Can you run some tests whether... [15:19:29] 10serviceops, 10SRE, 10ops-codfw, 10Patch-For-Review: decom 8 codfw appservers purchased on 2016-06-02 - https://phabricator.wikimedia.org/T277780 (10Papaul) 05Open→03Resolved complete [16:28:20] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw: (Need By: TBD) rack/setup/install conf200[456].codfw.wmnet - https://phabricator.wikimedia.org/T275637 (10Papaul) [18:45:51] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE, 10Patch-For-Review, 10Release-Engineering-Team (CI & Testing services): replace doc1001.eqiad.wmnet with a buster VM and create the codfw equivalent - https://phabricator.wikimedia.org/T247653 (10Dzahn) 05Open→03Stalled replacement VMs wit... [18:51:18] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE, 10Patch-For-Review, 10Release-Engineering-Team (CI & Testing services): replace doc1001.eqiad.wmnet with a buster VM and create the codfw equivalent - https://phabricator.wikimedia.org/T247653 (10Dzahn) Maybe someone could run some tests from... [20:31:20] Am I allowed to run "kubectl exec -it" on a pod for the link recommendation service? [20:33:56] kostajh: I guess it matters more what you plan on executing inside the pod :p [20:34:01] maybe do it in the staging cluster? [20:35:00] legoktm: that could work.. not sure I have access though [20:35:35] I want to run a command that does a query -- same code paths as the publicly accessible API, but this would have some profiling data attached to it [20:36:15] seems reasonable to me [20:36:22] `User "linkrecommendation" cannot create resource "pods/exec" in API group` [20:42:55] uh, that's past my k8s knowledge, I'd ask j.ayme or a.kosiaris for what the right access level is supposed to be :/ [20:47:23] ok, will do tomorrow. thanks! [20:54:08] 10serviceops, 10SRE, 10Sustainability: Jobrunner on Buster occasional timeout on codfw file upload - https://phabricator.wikimedia.org/T275752 (10Legoktm) >>! In T275752#6948295, @fgiunchedi wrote: >>>! In T275752#6935663, @Legoktm wrote: >> @fgiunchedi could you re-run your analysis to see if mw1307 (10.64....