[09:42:20] 06serviceops, 07Datacenter-Switchover: Northward Datacenter Switchover (March 2026; codfw to eqiad) - https://phabricator.wikimedia.org/T413974#11524217 (10Blake) p:05Triage→03Medium [09:42:50] 06serviceops, 03[MWI] FY2025-26 Q3, 07Epic, 07OKR-Work: [5.2.2c Epic]: API Gateway Rerouting Testing - https://phabricator.wikimedia.org/T413449#11524218 (10Blake) p:05Triage→03Medium [09:43:13] 06serviceops, 03[MWI] FY2025-26 Q3, 07Epic, 06MW-Interfaces-Team (MWI-Roadmap), 07OKR-Work: [Hypothesis] 5.2.2c: Reroute API Portal Endpoints - https://phabricator.wikimedia.org/T413438#11524219 (10Blake) p:05Triage→03Medium [09:43:52] 06serviceops, 06MediaWiki-Engineering, 10ServiceOps-Upgrades-Hardware: Migrate Wikimedia production from PHP 8.3 to PHP 8.4 or PHP 8.5 - https://phabricator.wikimedia.org/T413223#11524220 (10Blake) p:05Triage→03Medium [09:45:31] 06serviceops, 06MW-Interfaces-Team, 10ServiceOps-Services-Oids, 05FY2025-26 KR 5.1, and 2 others: rest gateway: support multiple rate limits per route - https://phabricator.wikimedia.org/T413186#11524235 (10Blake) p:05Triage→03Low [11:47:22] 06serviceops, 06MediaWiki-Engineering, 10ServiceOps-Upgrades-Hardware, 10ServiceOps new: Migrate Wikimedia production from PHP 8.3 to PHP 8.4 or PHP 8.5 - https://phabricator.wikimedia.org/T413223#11524541 (10Blake) [12:01:21] 06serviceops, 03[MWI] FY2025-26 Q3, 07Epic, 06MW-Interfaces-Team (MWI-Roadmap), and 2 others: [Hypothesis] 5.2.2c: Reroute API Portal Endpoints - https://phabricator.wikimedia.org/T413438#11524575 (10Blake) [12:01:51] 06serviceops, 03[MWI] FY2025-26 Q3, 07Epic, 06MW-Interfaces-Team (MWI-Roadmap), and 2 others: [Hypothesis] 5.2.2c: Reroute API Portal Endpoints - https://phabricator.wikimedia.org/T413438#11524577 (10Blake) I'm triaging this task from the ServiceOps perspective, but if the priority seems incorrect, please... [12:03:07] 06serviceops, 10ServiceOps-Services-Oids, 06Traffic, 10ServiceOps new, 05WE4.2 Bot detection: hcaptcha-proxy health checks should also depool sites if their upstream is unreachable - https://phabricator.wikimedia.org/T411191#11524579 (10jijiki) [12:03:45] 06serviceops, 10ServiceOps-Services-Oids, 10ServiceOps new: hcaptcha proxy: bump connection limits + stress test - https://phabricator.wikimedia.org/T411141#11524580 (10jijiki) [12:04:07] 06serviceops, 10ServiceOps-Services-Oids, 07Documentation, 10ServiceOps new, 05WE4.2 Bot detection: hcaptcha proxy: update wikitech page - https://phabricator.wikimedia.org/T411131#11524582 (10jijiki) [12:04:46] 06serviceops, 10ServiceOps-Services-Oids, 10ServiceOps new, 05WE4.2 Bot detection: hcaptcha extension, proxy: Define the backoff and retry strategies - https://phabricator.wikimedia.org/T411115#11524583 (10jijiki) [12:05:02] 06serviceops, 10ServiceOps-Services-Oids, 10ServiceOps new, 05WE4.2 Bot detection: hcaptcha extension, proxy: Define the backoff and retry strategies - https://phabricator.wikimedia.org/T411115#11524584 (10jijiki) p:05Triage→03Low [12:06:11] 06serviceops, 03[MWI] FY2025-26 Q3, 07Epic, 07OKR-Work, 10ServiceOps new: [5.2.2c Epic]: API Gateway Rerouting Testing - https://phabricator.wikimedia.org/T413449#11524587 (10Blake) [12:07:53] 06serviceops, 10ServiceOps-Services-Oids, 07Documentation, 10ServiceOps new, 05WE4.2 Bot detection: hcaptcha proxy: update wikitech page - https://phabricator.wikimedia.org/T411131#11524590 (10jijiki) p:05Medium→03High [12:09:57] 06serviceops, 07Datacenter-Switchover, 10ServiceOps new: Northward Datacenter Switchover (March 2026; codfw to eqiad) - https://phabricator.wikimedia.org/T413974#11524601 (10Blake) [12:27:50] 06serviceops, 06SRE, 07Kubernetes: Fix nginx config and caching for docker registry - https://phabricator.wikimedia.org/T256762#11524650 (10JMeybohm) 05Open→03Resolved a:03JMeybohm Since there is clearly no need for optimization here, I'll resolve this now. [16:01:50] 06serviceops, 06Release-Engineering-Team, 10Scap, 06SRE, 07Datacenter-Switchover: Add scap lock/unlock steps to sre.switchdc.mediawiki cookbook - https://phabricator.wikimedia.org/T330996#11525496 (10dancy) [16:03:20] 06serviceops, 06Release-Engineering-Team, 10Scap, 06SRE, 07Datacenter-Switchover: Add scap lock/unlock steps to sre.switchdc.mediawiki cookbook - https://phabricator.wikimedia.org/T330996#11525507 (10dancy) @Blake I've installed a new release of scap on the deploy servers. You can now use `scap lock --a... [18:34:27] 06serviceops, 06Abstract Wikipedia team (26Q3 (Jan–Mar)), 07OKR-Work: Set up DNS for abstract.wikipedia.org to be recognised - https://phabricator.wikimedia.org/T411724#11526013 (10Jdforrester-WMF) [18:34:58] 06serviceops, 10DNS, 06Abstract Wikipedia team (26Q3 (Jan–Mar)), 07OKR-Work: Set up DNS for abstract.wikipedia.org to be recognised - https://phabricator.wikimedia.org/T411724#11526014 (10Jdforrester-WMF) Hello there, SRE Service Ops. Tagging you in on this, though this might need Traffic/other SRE involve... [19:31:04] 06serviceops, 10DNS, 06SRE, 06Traffic, and 2 others: Set up DNS for abstract.wikipedia.org to be recognised - https://phabricator.wikimedia.org/T411724#11526184 (10ssingh) This is typically done as part of a new wiki creation process, but Traffic is happy to help as required. [19:56:15] 06serviceops, 10DNS, 06SRE, 06Traffic, and 2 others: Set up DNS for abstract.wikipedia.org to be recognised - https://phabricator.wikimedia.org/T411724#11526339 (10Jdforrester-WMF) >>! In T411724#11526184, @ssingh wrote: > This is typically done as part of a new wiki creation process, but Traffic is happy... [20:04:20] 06serviceops, 10decommission-hardware, 13Patch-For-Review: decommission wikikube-worker[2003-2004,2007-2010,2019-2032,2040,2043,2045,2048].codfw.wmnet - https://phabricator.wikimedia.org/T409102#11526343 (10jasmine_) [20:04:59] 06serviceops, 10decommission-hardware, 13Patch-For-Review: decommission wikikube-worker[2003-2004,2007-2010,2019-2032,2040,2043,2045,2048].codfw.wmnet - https://phabricator.wikimedia.org/T409102#11526349 (10jasmine_) a:05jasmine_→03None [20:05:17] 06serviceops, 06DC-Ops, 10decommission-hardware, 10ops-codfw, 13Patch-For-Review: decommission wikikube-worker[2003-2004,2007-2010,2019-2032,2040,2043,2045,2048].codfw.wmnet - https://phabricator.wikimedia.org/T409102#11526351 (10jasmine_) [21:47:17] 06serviceops, 10Release Pipeline, 06SRE, 06Release-Engineering-Team (Seen): Kask functional testing with Cassandra via the Deployment Pipeline - https://phabricator.wikimedia.org/T224041#11526839 (10Eevans) [21:49:07] 06serviceops, 06Data-Persistence, 13Patch-For-Review: Deploy instance of hoarde as artifact-cache(?) in k8s - https://phabricator.wikimedia.org/T414112#11526847 (10Eevans) [23:04:27] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q2:rack/setup/install wikikube-worker2332-56 - https://phabricator.wikimedia.org/T408757#11527136 (10Papaul) [23:13:13] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q2:rack/setup/install wikikube-worker2332-56 - https://phabricator.wikimedia.org/T408757#11527155 (10Papaul) [23:29:33] 06serviceops, 10decommission-hardware, 13Patch-For-Review: decommission wikikube-worker[2116-2123,2216-2241].codfw.wmnet - https://phabricator.wikimedia.org/T409104#11527189 (10jasmine_) a:03jasmine_