[01:47:33] 06serviceops, 10Release Pipeline, 06SRE, 06Release-Engineering-Team (Seen): Kask functional testing with Cassandra via the Deployment Pipeline - https://phabricator.wikimedia.org/T224041#11373148 (10Pppery) [01:57:49] 06serviceops, 10Prod-Kubernetes, 10Toolhub, 07Kubernetes: Maintenance environment needed for running one-off commands - https://phabricator.wikimedia.org/T290357#11373173 (10Pppery) Can this be closed as resolved now? [06:08:53] 06serviceops, 06MW-Interfaces-Team, 10Scap, 10WMF-JobQueue, and 2 others: Add a jobrunner server to the Scap canary pool - https://phabricator.wikimedia.org/T172480#11373318 (10Krinkle) I assume so, yes. Scap (hopefully) still has the concept of promoting the next image to a canary pool first, waiting some... [09:11:30] 06serviceops, 06MW-Interfaces-Team, 10Scap, 10WMF-JobQueue, and 2 others: Add a jobrunner server to the Scap canary pool - https://phabricator.wikimedia.org/T172480#11373510 (10akosiaris) 05Open→03Resolved a:03akosiaris >>! In T172480#11373318, @Krinkle wrote: > I assume Scap still has the concep... [10:46:36] 06serviceops, 06collaboration-services, 06Data-Platform-SRE, 10Prod-Kubernetes, and 2 others: Update Kubernetes clusters to 1.31 - https://phabricator.wikimedia.org/T341984#11373825 (10JMeybohm) [10:49:15] 06serviceops, 10Prod-Kubernetes, 13Patch-For-Review: PodSecurityPolicies will be deprecated with Kubernetes 1.21 - https://phabricator.wikimedia.org/T273507#11373842 (10JMeybohm) 05Stalled→03Open Now that the wikikube clusters have been migrated, we can start working on removing the PSP related code [10:55:50] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: sre.k8s.wipe-cluser JSONDecodeError in kubectl_version() - https://phabricator.wikimedia.org/T406200#11373870 (10JMeybohm) 05Open→03Resolved a:03JMeybohm [11:27:12] 06serviceops, 06MediaWiki-Platform-Team, 06MW-Interfaces-Team, 07OKR-Work: api-gateway chart: support rate limits for multiple time units - https://phabricator.wikimedia.org/T408132#11373982 (10JTweed-WMF) I think that this proves we should try a requests/second or requests/minute limit, to try and smooth... [13:04:19] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: kube-scheduler failed to start during sre.k8s.wipe-cluster - https://phabricator.wikimedia.org/T406201#11374217 (10JMeybohm) The kube-scheduler-config resource does have a `require` dependency to the k8s::package resource installing the master package (which con... [14:53:08] 06serviceops, 06Data-Engineering, 06Machine-Learning-Team: Enable ChangeProp to consume mediawiki.page_content_change.v1 - https://phabricator.wikimedia.org/T409469#11374466 (10JMonton-WMF) > @Ottomata, what work is required to produce mediawiki.page_content_change.v1 to Kafka main? I'm expecting just some h... [15:19:57] 06serviceops, 06Data-Engineering, 06Machine-Learning-Team: Enable ChangeProp to consume mediawiki.page_content_change.v1 - https://phabricator.wikimedia.org/T409469#11374579 (10dcausse) If pushing to kafka-main you might need to increase broker's `message.max.bytes` see T344688. [15:24:34] 06serviceops, 06Data-Engineering, 06Machine-Learning-Team: Enable ChangeProp to consume mediawiki.page_content_change.v1 - https://phabricator.wikimedia.org/T409469#11374597 (10tchin) Would we also need to explicitly create the topics in main? Is auto topic creation enabled there? [16:48:42] 06serviceops, 10Prod-Kubernetes, 10Toolhub, 07Kubernetes: Maintenance environment needed for running one-off commands - https://phabricator.wikimedia.org/T290357#11374921 (10bd808) >>! In T290357#11373173, @Pppery wrote: > Can this be closed as resolved now? The only maintenance environment is still the s... [17:35:28] 06serviceops, 06Data-Engineering, 06Machine-Learning-Team: Enable ChangeProp to consume mediawiki.page_content_change.v1 - https://phabricator.wikimedia.org/T409469#11375060 (10dcausse) >>! In T409469#11374597, @tchin wrote: > Would we also need to explicitly create the topics in main? Is auto topic creation... [21:53:51] 06serviceops, 10decommission-hardware: decommission wikikube-worker[2052-2054,2063,2079-2084,2096-2101].codfw.wmnet - https://phabricator.wikimedia.org/T409103#11375762 (10jasmine_) a:03jasmine_