[07:39:19] 10serviceops, 10ChangeProp, 10Kubernetes, 10Sustainability (Incident Prevention): Investigate the iowait issues plaguing kubernetes nodes since 2020-05-29 - https://phabricator.wikimedia.org/T255975 (10JMeybohm) Thanks for writing this up @akosiaris! I think it would be nice to have the follow up tasks lin... [07:46:04] 10serviceops, 10Operations, 10SRE-swift-storage: Access to the thanos-swift cluster for ChartMuseum - https://phabricator.wikimedia.org/T256020 (10fgiunchedi) Generally LGTM as a use case. Is there PII/private data in the charts or you expect to? I'm pointing this out because while connections to the swift... [08:01:58] 10serviceops, 10Operations, 10SRE-swift-storage: Access to the thanos-swift cluster for ChartMuseum - https://phabricator.wikimedia.org/T256020 (10JMeybohm) We don't expect private data in the charts at all. In addition, they are already publicly accessible via https://releases.wikimedia.org/charts/ and http... [08:34:31] 10serviceops, 10Operations, 10Patch-For-Review, 10User-Elukey: Reimage one memcached shard to Buster - https://phabricator.wikimedia.org/T252391 (10elukey) Getting back to https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/595810/ - one thing that it would be useful before merging is to dump all the ke... [10:48:26] 10serviceops, 10Operations, 10SRE-swift-storage: Access to the thanos-swift cluster for ChartMuseum - https://phabricator.wikimedia.org/T256020 (10fgiunchedi) >>! In T256020#6247552, @JMeybohm wrote: > We don't expect private data in the charts at all. > In addition, they are already publicly accessible via... [12:58:46] 10serviceops, 10Operations, 10Kubernetes, 10Patch-For-Review, and 2 others: Support kubernetes Egress networkpolicies in our helm charts - https://phabricator.wikimedia.org/T249927 (10akosiaris) 05Open→03Resolved With the last 2 changes merged, the work on this has been completed. Many thanks @apakhomov ! [12:58:52] 10serviceops, 10Operations, 10Kubernetes, 10User-fsero, 10User-jijiki: Upgrade calico in production to version 2.4+ - https://phabricator.wikimedia.org/T207804 (10akosiaris) [15:34:03] 10serviceops, 10Operations, 10CPT Initiatives (Containerise Services): Migrate node-based services in production to node10 - https://phabricator.wikimedia.org/T210704 (10MSantos) [15:51:02] 10serviceops, 10Operations: Remaining nginx packages on some mw servers - https://phabricator.wikimedia.org/T255565 (10MoritzMuehlenhoff) A few gotchas on this one, noting on the task as it can happen to other roles currently using Nginx when moving to Envoy: * The nginx init scripts get marked as a conffile,... [16:33:59] 10serviceops, 10Operations, 10Patch-For-Review, 10User-Elukey: Reimage one memcached shard to Buster - https://phabricator.wikimedia.org/T252391 (10RLazarus) Side note: This question is also interesting from a DC switchover perspective (T243316) since that will also effectively be a Redis flush. In previou... [18:22:23] 10serviceops, 10observability, 10Developer Productivity, 10Patch-For-Review, 10Performance-Team (Radar): The "Server: mw•" response header is missing on mwmaint/noc.wm.o - https://phabricator.wikimedia.org/T255629 (10Krinkle) p:05Triage→03Medium [19:51:33] 10serviceops, 10Core Platform Team, 10Operations, 10Release Pipeline, and 5 others: Kask functional testing with Cassandra via the Deployment Pipeline - https://phabricator.wikimedia.org/T224041 (10WDoranWMF) [20:37:04] rzl: If I wanted to have a discussion about use of the k8s cluster for a project I'm starting next quarter with your team, would a phab task or direct email thread be "best". Basically I want to know if the k8s cluster is ready for non-MediaWiki python things to live there or if I need to plan on the horror of scap3 for a new django project. [20:38:55] bd808: I would say phab, and tag Alex and Janis in particular, but the answer is very probably k8s [20:39:13] excellent on both counts :) [20:41:42] rzl: is python already supported? Last I heard was that there was still some missing bits... [20:47:57] rzl: oh, I BOLD'ly edited your staff account's page on meta to have your new nick [20:50:30] bd808: oops, did I not? thanks [20:51:06] volans: "probably" and not "definitely" :) also "next quarter" [20:51:26] lol [20:51:38] I spotted all those keys :) [20:51:42] * volans subscribe for nes [20:51:45] *news [21:38:52] 10serviceops, 10Core Platform Team, 10Operations, 10Release Pipeline, and 5 others: Kask functional testing with Cassandra via the Deployment Pipeline - https://phabricator.wikimedia.org/T224041 (10Eevans) >>! In T224041#6229281, @jeena wrote: >>>! In T224041#6227592, @akosiaris wrote: >> However, up to no...