[00:01:22] <Krinkle>	 bd808: no, we did one on the MW side, and then copied to VCL, and then later updates were applied only there
[00:02:05] <Krinkle>	 At the end of the day we agreed that 1: there were future CSP updates we know we need to within a few days (such as the one you linked) and 2: we'd do that one on the MW side and sync it up while at it.
[00:02:10] <Krinkle>	 it looks like that wasn't done
[00:02:51] <bd808>	 :nod: I was mostly asking because of the cached headers aspect.
[00:16:17] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Acme-chief, 07Beta-Cluster-reproducible: Warning about /etc/acmecerts/unified contents during puppet run on deployment-cache-text08 & deployment-cache-upload08 - https://phabricator.wikimedia.org/T399419#11690573 (10bd808) >>! In T399419#11183331, @BCornwall wrote: > Hm, it s...
[00:43:02] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11690585 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by vriley@cumin10...
[00:46:06] <wikibugs>	 10Phabricator: Phabricator database connection flapping - https://phabricator.wikimedia.org/T419494 (10bd808) 03NEW
[01:00:42] <wikibugs>	 10Phabricator: Phabricator database connection flapping - https://phabricator.wikimedia.org/T419494#11690628 (10Scott_French) This was most likely induced by an already known source of abusive traffic.
[01:03:52] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11690643 (10VRiley-WMF) @Dzahn It seems like it's getting stuck. Does this need a specific raid se...
[02:11:02] <wikibugs>	 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 13Patch-For-Review, 05Release, 05Train Deployments: 1.46.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T413810#11690699 (10Zabe)
[03:00:25] <wmf-insecte>	 Project mwcore-phpunit-coverage-master build #4932: 04FAILURE in 25 sec: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/4932/
[08:17:36] <codders>	 seeing npm cache corruption - https://integration.wikimedia.org/ci/job/mediawiki-node20/77834/console - will blow away the cache
[08:21:31] <codders>	 !log integration: integration-castor05: rm -fR /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node20
[08:21:32] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[09:11:52] <elukey>	 bd808: yw! Thanks for the task, we are testing the new PKI version so it is good that everything works in cloud :)
[09:31:11] <wikibugs>	 (03PS5) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073)
[09:32:40] <wikibugs>	 (03CR) 10CI reject: [V:04-1] dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[09:34:33] <wikibugs>	 (03CR) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[10:01:56] <wikibugs>	 (03PS6) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073)
[10:02:23] <wikibugs>	 (03PS7) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073)
[10:03:28] <wikibugs>	 (03CR) 10Hashar: "I forgot to adjust all the calls to use the DOM interface then forgot to `git add` the test script and example input." [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[10:03:45] <wikibugs>	 (03CR) 10CI reject: [V:04-1] dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[10:09:45] <wikibugs>	 (03PS8) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073)
[10:11:11] <wikibugs>	 (03CR) 10CI reject: [V:04-1] dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[10:17:24] <wikibugs>	 (03PS9) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073)
[10:21:04] <wikibugs>	 (03CR) 10Hashar: "And I fixed the remaining linting issues!    My previous still apply: I don't remember how to actually test that 😊" [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[10:22:39] <wikibugs>	 10Continuous-Integration-Config, 10phpunit-patch-coverage, 07ci-test-error (WMF-deployed Build Failure), 13Patch-For-Review: mwext-phpunit-coverage-patch no longer runs any tests for modified files - https://phabricator.wikimedia.org/T419073#11691164 (10hashar) I ported the script to use `xml.dom.minidom`...
[10:24:08] <A_smart_kitten>	 codders: T419480 seems like a similar report from yesterday (in case that's now been solved by clearing that cache)
[10:24:09] <stashbot>	 T419480: Wikibase node jobs are failing due to "no such file or directory" - https://phabricator.wikimedia.org/T419480
[10:29:25] <codders>	 thanks. I've resubmitted the change - let's see if that goes through
[10:47:58] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Castor, 10Wikidata, 07ci-test-error (WMF-deployed Build Failure): Wikibase node jobs are failing due to "no such file or directory" - https://phabricator.wikimedia.org/T419480#11691273 (10A_smart_kitten)
[11:22:53] <wikibugs>	 06Release-Engineering-Team, 10Citoid, 07Essential-Work, 07Technical-Debt: update nodejs22-slim image to 22.21.0 to support proxy env variables for outbound requests - https://phabricator.wikimedia.org/T416471#11691393 (10Mvolz) 05Open→03Declined
[11:23:12] <wikibugs>	 06Release-Engineering-Team, 10Citoid, 07Essential-Work, 07Technical-Debt: update nodejs22-slim image to 22.21.0 to support proxy env variables for outbound requests - https://phabricator.wikimedia.org/T416471#11691396 (10Mvolz) >>! In T416471#11683293, @Jdforrester-WMF wrote: > Note that the Node 24 im...
[12:08:11] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Castor, 10Wikidata, 07ci-test-error (WMF-deployed Build Failure): Wikibase node jobs are failing due to "no such file or directory" - https://phabricator.wikimedia.org/T419480#11691577 (10SomeRandomDeveloper) 05Open→03Resolved Seems to be resolved, thanks
[12:11:49] <wikibugs>	 (03merge) 10jnuche: queryhammer: Query load testing tool for WDQS index backend [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/149 (https://phabricator.wikimedia.org/T417414) (owner: 10trueg)
[12:31:11] <wikibugs>	 (03CR) 10Daimona Eaytoy: "Wonderful, thank you! I don't know about testing, but if the XML output is correct, I think that's already sufficient." [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[12:44:05] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Core-Tests, 07ci-test-error (WMF-deployed Build Failure), 05MW-1.46-notes (1.46.0-wmf.20; 2026-03-17), 13Patch-For-Review: The PHPUnit config override does not appear to be auto-generated - https://phabricator.wikimedia.org/T419107#11691698 (10Daimona) From https:/...
[13:34:48] <wmf-insecte>	 Project beta-code-update-eqiad build #591028: 04FAILURE in 18 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/591028/
[13:42:41] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11691944 (10Dzahn) @VRiley-WMF It is configured for standard `raid1-dev`. Just like `contint2003`...
[13:45:23] <wmf-insecte>	 Yippee, build fixed!
[13:45:23] <wmf-insecte>	 Project beta-code-update-eqiad build #591029: 09FIXED in 2 min 23 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/591029/
[13:49:23] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11691973 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by vriley@cumin1003 f...
[13:58:11] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11692024 (10VRiley-WMF) @Dzahn I just tried to look contint2003 however, when I'm in iDRAC, it's n...
[14:23:19] <wikibugs>	 10Phabricator: Phabricator database connection flapping - https://phabricator.wikimedia.org/T419494#11692163 (10Scott_French) @A_smart_kitten Agreed, thank you!
[14:39:53] <wikibugs>	 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 13Patch-For-Review, 05Release, 05Train Deployments: 1.46.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T413810#11692244 (10Nikerabbit)
[14:42:02] <wikibugs>	 (03approved) 10cdanis: app.py: Lowercase identity claim value [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/108 (owner: 10dduvall)
[14:53:45] <wikibugs>	 (03CR) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[15:01:50] <wikibugs>	 (03merge) 10dancy: build: Switch from abandoned releng/composer-package-… to releng/composer-… [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/238 (owner: 10jforrester)
[15:08:26] <wikibugs>	 (03approved) 10dancy: vector-search: Traffic pattern similarity search [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/150 (owner: 10fab)
[15:12:49] <wikibugs>	 (03update) 10fab: vector-search: Traffic pattern similarity search [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/150
[15:15:48] <wikibugs>	 (03merge) 10dancy: vector-search: Traffic pattern similarity search [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/150 (owner: 10fab)
[15:34:31] <wmf-insecte>	 Yippee, build fixed!
[15:34:32] <wmf-insecte>	 Project mwcore-phpunit-coverage-master build #4933: 09FIXED in 34 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/4933/
[15:46:57] <wikibugs>	 10Continuous-Integration-Config, 06Release-Engineering-Team (Priority Backlog 📥), 10Browser Test Platform, 10Wikibase (3rd party installations), and 3 others: Move some Wikibase selenium tests to a standalone job - https://phabricator.wikimedia.org/T287582#11692771 (10AMarkossyan-WMF)
[15:48:39] <wikibugs>	 10Continuous-Integration-Config, 10phpunit-patch-coverage, 07ci-test-error (WMF-deployed Build Failure), 07Essential-Work, 13Patch-For-Review: mwext-phpunit-coverage-patch no longer runs any tests for modified files - https://phabricator.wikimedia.org/T419073#11692806 (10hashar)
[15:48:46] <wikibugs>	 (03PS10) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073)
[15:55:25] <wikibugs>	 (03CR) 10Hashar: "I think this time I got it right! I have updated the diff in the commit message." [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[15:55:48] <hashar>	 Daimona: I am not sure why I jumped in that python xml parsing script of doom 
[15:56:04] <hashar>	 but I think I eventually get it right after more or less overhauling how the elements are processed
[15:56:54] <Daimona>	 Because you are awesome and you finally wanted me to offer you a few beers when we meet?
[15:57:08] <Daimona>	 Thanks for doing it!
[16:02:25] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11692959 (10Dzahn) As far as I can tell the size of disks has never mattered for the partman recip...
[16:02:43] <wikibugs>	 (03CR) 10Daimona Eaytoy: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[16:03:04] <Daimona>	 (I did find a bug, but otherwise I think that's it)
[16:03:42] <hashar>	 I am owed a few gallons of beer from all over the planet, I think I will be able to open a beer shop when I retire
[16:04:27] <hashar>	 and good point about dropping PHPUnit 9, I wnated to clear it later
[16:04:42] <hashar>	 but since the code is entirely overhauled,  I guess it is fine to have a single commit tackling all issues at once
[16:04:54] <hashar>	 though I wanted to send a long series of small commits, but that is hmm inconvenient
[16:06:27] <wikibugs>	 (03update) 10dduvall: app.py: Lowercase identity claim value [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/108
[16:06:30] <wikibugs>	 (03update) 10dduvall: app.py: Lowercase identity claim value [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/108
[16:07:37] <wikibugs>	 (03update) 10dancy: app.py: Lowercase identity claim value [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/108 (owner: 10dduvall)
[16:07:38] <wikibugs>	 (03approved) 10dancy: app.py: Lowercase identity claim value [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/108 (owner: 10dduvall)
[16:08:31] <wikibugs>	 (03merge) 10dduvall: app.py: Lowercase identity claim value [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/108
[16:17:09] <wikibugs>	 (03update) 10dduvall: Chart.yaml: appVersion: "v1.18.0" [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/109
[16:17:11] <wikibugs>	 (03open) 10dduvall: Chart.yaml: appVersion: "v1.18.0" [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/109
[16:17:13] <wikibugs>	 (03update) 10dduvall: Chart.yaml: appVersion: "v1.18.0" [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/109
[16:18:11] <wikibugs>	 (03PS11) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073)
[16:18:44] <wikibugs>	 (03PS12) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073)
[16:18:51] <wikibugs>	 (03approved) 10dancy: Chart.yaml: appVersion: "v1.18.0" [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/109 (owner: 10dduvall)
[16:19:09] <wikibugs>	 (03merge) 10dduvall: Chart.yaml: appVersion: "v1.18.0" [repos/releng/reggie] - 10https://gitlab.wikimedia.org/repos/releng/reggie/-/merge_requests/109
[16:19:21] <hashar>	 done with https://gerrit.wikimedia.org/r/c/integration/config/+/1249372/10..12/dockerfiles/quibble-coverage/phpunit-suite-edit.py
[16:19:27] <hashar>	 and I have updated the diff in the commit message
[16:20:35] <hashar>	 for the stuff before PHPUnit 9, I guess I can drop handling of `<filter>`  and `<whitelist>` being added `addUncoveredFilesFromWhitelist=true` attribute?
[16:41:35] <dduvall>	 !log deployed reggie v1.18.0 to gitlab-cloud-runner staging
[16:41:36] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[16:51:05] <Daimona>	 I can make a separate patch if you haven't already done it
[16:52:07] <hashar>	 Daimona: yes please do as a follow :]  I am not sure what I can mess up  and I'll +2/deploy both
[16:55:06] <wikibugs>	 (03PS1) 10Daimona Eaytoy: dockerfiles: [quibble-coverage] Drop support for PHPUnit < 9 [integration/config] - 10https://gerrit.wikimedia.org/r/1250008
[16:56:12] <Daimona>	 hashar: Voilà ;) https://gerrit.wikimedia.org/r/c/integration/config/+/1250008
[16:56:44] <wikibugs>	 (03CR) 10Daimona Eaytoy: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[16:56:54] <hashar>	 ack
[16:57:11] <wikibugs>	 (03CR) 10Hashar: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[16:57:52] <hashar>	 I have missed change #1250000 :(
[16:58:33] <hashar>	 taavi: congrats on having filed the 1 250 000 th change in Gerrit :-]
[17:00:00] <wikibugs>	 (03CR) 10Hashar: [C:03+2] "Thank you so much!" [integration/config] - 10https://gerrit.wikimedia.org/r/1250008 (owner: 10Daimona Eaytoy)
[17:00:09] <wikibugs>	 (03CR) 10Hashar: [C:03+2] "Thank you Daimona!" [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[17:01:35] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11693523 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by vriley@cumin10...
[17:02:12] <wikibugs>	 (03Merged) 10jenkins-bot: dockerfiles: [quibble-coverage] keep comments in phpunit suite edit [integration/config] - 10https://gerrit.wikimedia.org/r/1249372 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[17:02:21] <wikibugs>	 (03CR) 10CI reject: [V:04-1] dockerfiles: [quibble-coverage] Drop support for PHPUnit < 9 [integration/config] - 10https://gerrit.wikimedia.org/r/1250008 (owner: 10Daimona Eaytoy)
[17:03:22] <thcipriani>	 taavi: hashar and for a legit change, too. Unlike *ahem* some people: https://gerrit.wikimedia.org/r/555555 :D
[17:04:01] <wikibugs>	 (03open) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:04:10] <hashar>	 thcipriani: :-]]]
[17:04:24] <taavi>	 about time I get a fancy number for myself, gotten enough of those with a mass patch submission bot already
[17:04:26] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:04:37] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:04:48] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:04:55] <wikibugs>	 (03CR) 10Hashar: [C:03+2] "No clue why CI failed ... lets retry" [integration/config] - 10https://gerrit.wikimedia.org/r/1250008 (owner: 10Daimona Eaytoy)
[17:05:13] <wikibugs>	 (03PS1) 10Hashar: jjb: update MediaWiki coverage jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1250009 (https://phabricator.wikimedia.org/T419073)
[17:06:48] <wikibugs>	 (03Merged) 10jenkins-bot: dockerfiles: [quibble-coverage] Drop support for PHPUnit < 9 [integration/config] - 10https://gerrit.wikimedia.org/r/1250008 (owner: 10Daimona Eaytoy)
[17:11:38] <hashar>	 !log Updated MediaWiki coverage jobs so that they now keep "Generate a local configuration by running `composer phpunit:config`" message # T419073
[17:11:40] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[17:11:41] <stashbot>	 T419073: mwext-phpunit-coverage-patch no longer runs any tests for modified files - https://phabricator.wikimedia.org/T419073
[17:12:12] <wikibugs>	 (03CR) 10Hashar: [C:03+2] "I have updated the jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/1250009 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[17:12:21] <hashar>	 Daimona: jobs updated!
[17:14:06] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: update MediaWiki coverage jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1250009 (https://phabricator.wikimedia.org/T419073) (owner: 10Hashar)
[17:14:28] <hashar>	 success https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-patch/64190/console 
[17:19:32] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:20:24] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:21:29] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:21:39] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:22:36] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:23:01] <wikibugs>	 (03update) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:24:06] <wikibugs>	 10Continuous-Integration-Config, 10phpunit-patch-coverage, 07ci-test-error (WMF-deployed Build Failure), 07Essential-Work, 13Patch-For-Review: mwext-phpunit-coverage-patch no longer runs any tests for modified files - https://phabricator.wikimedia.org/T419073#11693655 (10hashar) I got [[ https://integrat...
[17:24:23] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11693656 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by vriley@cumin1003 f...
[17:28:55] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11693692 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by vriley@cumin10...
[17:29:49] <wikibugs>	 (03update) 10dancy: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559 (owner: 10dduvall)
[17:29:50] <wikibugs>	 (03approved) 10dancy: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559 (owner: 10dduvall)
[17:30:13] <wikibugs>	 (03merge) 10dduvall: ci: Reorder plan and deploy jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/559
[17:31:01] <wikibugs>	 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 13Patch-For-Review, 05Release, 05Train Deployments: 1.46.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T413810#11693718 (10cscott) You might want to backport [Upgrading web-auth/webauthn-lib (5.2.3 => 5.2.4) (1249922) ·...
[17:33:20] <wikibugs>	 10Continuous-Integration-Config, 10phpunit-patch-coverage, 07ci-test-error (WMF-deployed Build Failure), 07Essential-Work: mwext-phpunit-coverage-patch no longer runs any tests for modified files - https://phabricator.wikimedia.org/T419073#11693733 (10Jdforrester-WMF) 05Open→03Resolved Confirming,...
[17:39:20] <wikibugs>	 (03open) 10dduvall: ci: Add missing `needs` to deploy-production-cluster [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/560
[17:39:25] <wikibugs>	 (03update) 10dduvall: ci: Add missing `needs` to deploy-production-cluster [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/560
[17:39:46] <dduvall>	 !log deployed reggie v1.18.0 to gitlab-cloud-runner production
[17:39:47] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[17:39:51] <wikibugs>	 (03approved) 10dancy: ci: Add missing `needs` to deploy-production-cluster [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/560 (owner: 10dduvall)
[17:43:52] <wikibugs>	 10Continuous-Integration-Config, 10phpunit-patch-coverage, 07ci-test-error (WMF-deployed Build Failure), 07Essential-Work: mwext-phpunit-coverage-patch no longer runs any tests for modified files - https://phabricator.wikimedia.org/T419073#11693808 (10Dreamy_Jazz) Echoing thanks!
[17:46:31] <wikibugs>	 10Beta-Cluster-Infrastructure: Project deployment-prep instance deployment-mx04 is down - https://phabricator.wikimedia.org/T419506#11693827 (10bd808) 05Open→03Invalid Sunspots. `lang=shell-session bd808@deployment-mx04:~$ sudo -i puppet agent -tv Info: Using environment 'production' Info: Retrieving plu...
[17:52:46] <wikibugs>	 (03CR) 10Hashar: [C:03+2] build: Updating mediawiki/mediawiki-phan-config to 0.20.0 [integration/docroot] - 10https://gerrit.wikimedia.org/r/1249462 (owner: 10Libraryupgrader)
[18:16:19] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Acme-chief, 07Beta-Cluster-reproducible: Warning about /etc/acmecerts/unified contents during puppet run on deployment-cache-text08 & deployment-cache-upload08 - https://phabricator.wikimedia.org/T399419#11694107 (10BCornwall) @bd808 You would think so with such a key name! I...
[18:23:04] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Acme-chief, 07Beta-Cluster-reproducible: Warning about /etc/acmecerts/unified contents during puppet run on deployment-cache-text08 & deployment-cache-upload08 - https://phabricator.wikimedia.org/T399419#11694128 (10BCornwall) Ah, that service doesn't handle certs to consumer...
[18:24:19] <wikibugs>	 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 13Patch-For-Review, 05Release, 05Train Deployments: 1.46.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T413810#11694132 (10brennen) I believe T419497 should be resolved. With an assist from Reedy and James_F the branch...
[18:37:17] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Acme-chief, 07Beta-Cluster-reproducible: Warning about /etc/acmecerts/unified contents during puppet run on deployment-cache-text08 & deployment-cache-upload08 - https://phabricator.wikimedia.org/T399419#11694194 (10BCornwall) If I'm reading things correctly, the certs are no...
[18:38:47] <wikibugs>	 10Continuous-Integration-Config, 10phpunit-patch-coverage, 07ci-test-error (WMF-deployed Build Failure), 07Essential-Work: mwext-phpunit-coverage-patch no longer runs any tests for modified files - https://phabricator.wikimedia.org/T419073#11694198 (10Daimona) Thanks to you @hashar! The cause was reall...
[19:06:47] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11694295 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by vriley@cumin1003 f...
[19:08:12] <wikibugs>	 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.46.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T413810#11694299 (10brennen)
[19:24:30] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Core-Tests, 07ci-test-error (WMF-deployed Build Failure), 05MW-1.46-notes (1.46.0-wmf.20; 2026-03-17), 13Patch-For-Review: The PHPUnit config override does not appear to be auto-generated - https://phabricator.wikimedia.org/T419107#11694389 (10Daimona) So, this iss...
[20:06:14] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-REST-API, 06MW-Interfaces-Team, 07Essential-Work, 05MW-1.46-release: Remove Swagger UI from MW-1.46 (~May 2026) release - https://phabricator.wikimedia.org/T408697#11694500 (10HCoplin-WMF)
[20:11:12] <wikibugs>	 06Release-Engineering-Team, 10MediaWiki-Core-Tests, 07ci-test-error (WMF-deployed Build Failure), 05MW-1.46-notes (1.46.0-wmf.20; 2026-03-17), 13Patch-For-Review: The PHPUnit config override does not appear to be auto-generated - https://phabricator.wikimedia.org/T419107#11694518 (10Umherirrender) Not su...
[21:05:25] <wikibugs>	 (03open) 10dduvall: ci: Manually trigger deploy-production jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/561
[21:06:10] <wikibugs>	 (03merge) 10dduvall: ci: Add missing `needs` to deploy-production-cluster [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/560
[21:06:17] <wikibugs>	 (03update) 10dduvall: ci: Manually trigger deploy-production jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/561
[21:06:45] <wikibugs>	 (03update) 10dduvall: ci: Manually trigger deploy-production jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/561
[21:21:29] <wikibugs>	 (03approved) 10dancy: ci: Manually trigger deploy-production jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/561 (owner: 10dduvall)
[21:21:49] <wikibugs>	 (03merge) 10dduvall: ci: Manually trigger deploy-production jobs [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/561
[23:22:46] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 06DC-Ops, and 2 others: eqiad: request for a decom'ed R440 - Config C - https://phabricator.wikimedia.org/T418544#11695464 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by vriley@cumin10...