[00:12:25] 10Phabricator, 06cloud-services-team, 10Striker: Ensure that auto-created Phabricator projects for Toolforge tools are always editable by that tool's maintainers - https://phabricator.wikimedia.org/T412607#11501865 (10bd808) >>! In T412607#11498533, @Pppery wrote: > Ancient but https://wikitech.wikimedia.org... [01:10:41] (03CR) 10Reedy: [C:03+2] "https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/1224225 passed fine" [integration/config] - 10https://gerrit.wikimedia.org/r/1224142 (owner: 10Clare Ming) [02:36:12] 10Gerrit, 10Wikimedia-GitHub: Gerrit replication does not replicate tags deletion to GitHub - https://phabricator.wikimedia.org/T413966#11502022 (10hashar) `PushOne` instance creation is being injected two configs: - RemoteConfig assigned to `config` - ReplicationConfig assigned to `replConfig` `replConfig` t... [02:37:12] 10Gerrit, 10MediaWiki-Releasing, 10MediaWiki-General, 10Wikimedia-GitHub, 06MW-Interfaces-Team (MWI-Sprint-24 (2025-12-02 to 2025-12-24)): Consider deleting the `list` Git tag from the mediawiki/core repository - https://phabricator.wikimedia.org/T413213#11502033 (10hashar) 05Open→03Resolved a:0... [02:51:36] 10Gerrit, 10Wikimedia-GitHub: Gerrit replication does not replicate tags deletion to GitHub - https://phabricator.wikimedia.org/T413966#11502050 (10hashar) [07:35:01] Looks like there's an issue preventing HAProxy from reloading, so it keep running with the last known working configuration in which I remain blocked. https://phabricator.wikimedia.org/T413946 [07:37:45] (03PS1) 10Hslater: Zuul: [mediawiki/extensions/IssueTrackerLinks] Add VisualEditor as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1224536 [07:37:54] 06Release-Engineering-Team, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Add yubikey ssh key for dancy - https://phabricator.wikimedia.org/T414032#11502257 (10MoritzMuehlenhoff) [08:21:00] GitLab needs a short maintenance restart in at 9:30 UTC (in one hour) [08:50:51] 10Gerrit, 10Wikimedia-GitHub: Gerrit replication does not replicate tags deletion to GitHub - https://phabricator.wikimedia.org/T413966#11502420 (10hashar) > I don't know what is in in RemoteConfig config :/ And that is injected in `src/main/java/com/googlesource/gerrit/plugins/replication/Destination.java`.... [09:08:54] 10Phabricator (2025-11-04), 06Release-Engineering-Team (Doing 😎), 06collaboration-services, 07Essential-Work: Restrict project workboard access to logged in users only - https://phabricator.wikimedia.org/T403385#11502481 (10Dzahn) tbh, I don't see a significant difference between "please log in" and "p... [09:11:20] PROBLEM - jenkins_service_running on releases2003 is CRITICAL: PROCS CRITICAL: 2 processes with regex args .*/bin/java .*-jar /usr/share/java/jenkins.war https://wikitech.wikimedia.org/wiki/Jenkins [09:12:20] RECOVERY - jenkins_service_running on releases2003 is OK: PROCS OK: 1 process with regex args .*/bin/java .*-jar /usr/share/java/jenkins.war https://wikitech.wikimedia.org/wiki/Jenkins [09:25:21] (03CR) 10Hashar: "All the backports have been merged and Cite should no more depends on VisualEditor or WikiEditor to be loaded in order to pass tests. I'll" [integration/config] - 10https://gerrit.wikimedia.org/r/1214456 (https://phabricator.wikimedia.org/T406323) (owner: 10Hashar) [09:28:51] (03PS1) 10Hslater: Review access change [extensions/WikiRAG] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1224588 [09:30:29] (03CR) 10Hslater: [C:03+1] Review access change [extensions/WikiRAG] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1224588 (owner: 10Hslater) [09:41:30] GitLab maintenance done [09:41:33] (03CR) 10Hashar: [C:03+2] "I have had the Cite patches backported to release branches finally solving T406323." [integration/config] - 10https://gerrit.wikimedia.org/r/1214456 (https://phabricator.wikimedia.org/T406323) (owner: 10Hashar) [09:42:06] 10Phabricator (2025-11-04), 06Release-Engineering-Team (Doing 😎), 06collaboration-services, 07Essential-Work: Restrict project workboard access to logged in users only - https://phabricator.wikimedia.org/T403385#11502585 (10Sebastian_Berlin-WMSE) I meant that as a way for people that don't already have... [09:42:11] (03open) 10jelto: gitlab-runner: bump image version to alpine-v18.5.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/543 (https://phabricator.wikimedia.org/T414053) [09:43:03] (03Merged) 10jenkins-bot: Zuul: disable recursion after Cite got fixed [integration/config] - 10https://gerrit.wikimedia.org/r/1214456 (https://phabricator.wikimedia.org/T406323) (owner: 10Hashar) [10:06:49] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Request GitLab account approval - Aarohisharma3 - https://phabricator.wikimedia.org/T413627#11502609 (10Aklapper) 05Open→03Resolved a:03Aklapper Approved. [10:08:40] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [NkwadaNora] - https://phabricator.wikimedia.org/T412670#11502633 (10Aklapper) 05Open→03Invalid Wikimedia GitLab account got approved in the meantime [10:16:22] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Request GitLab account approval - Aarohisharma3 - https://phabricator.wikimedia.org/T413627#11502659 (10Aarohisharma3) Hi! Thank you for the approval. I plan to contribute to MediaWiki core, VisualEditor, frontend components, and related t... [10:17:53] (03merge) 10aklapper: Base64 encode the expand icon in the custom timeline CSS [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/109 (owner: 10pppery) [10:29:38] 10Phabricator, 06Release-Engineering-Team (Priority Backlog 📥): Change Maniphest AdvancedSearch default for "Group by" to "None" and for "Order by" to "Updated" - https://phabricator.wikimedia.org/T404843#11502668 (10Aklapper) 05Resolved→03Open This is buggy when passing URI parameters, e.g. https://phabri... [10:35:35] (03update) 10aklapper: Improve bot comment styles for phone and tablet size [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/110 (https://phabricator.wikimedia.org/T414003) (owner: 10matmarex) [10:37:35] (03update) 10aklapper: Improve bot comment styles for phone and tablet size [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/110 (https://phabricator.wikimedia.org/T414003) (owner: 10matmarex) [10:44:50] 10Phabricator (2026-01-06): Deploy user style to reduce bot comments on Phabricator - https://phabricator.wikimedia.org/T393289#11502713 (10Soda) Is there a way to get the more verbose state back, I can see the initial benefit of deprioritizing this data in the UI, but for example, having no way to see the f... [10:52:34] 10Phabricator (2025-11-04), 06Release-Engineering-Team (Doing 😎), 06collaboration-services, 07Essential-Work: Restrict project workboard access to logged in users only - https://phabricator.wikimedia.org/T403385#11502736 (10A_smart_kitten) >>! In T403385#11386185, @Dzahn wrote: > It seems shutting down... [11:03:59] (03PS1) 10Hashar: Zuul: [ConfirmEdit] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224608 (https://phabricator.wikimedia.org/T389998) [11:04:36] (03CR) 10Hashar: [C:03+2] Zuul: [ConfirmEdit] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224608 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:06:02] (03Merged) 10jenkins-bot: Zuul: [ConfirmEdit] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224608 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:08:57] (03PS1) 10Hashar: Zuul: [IPReputation] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224612 (https://phabricator.wikimedia.org/T389998) [11:14:42] 10Phabricator (2025-11-04), 06Release-Engineering-Team (Doing 😎), 06collaboration-services, 07Essential-Work: Restrict project workboard access to logged in users only - https://phabricator.wikimedia.org/T403385#11502820 (10Aklapper) I am considering reverting it, yes. It was one idea //(among other id... [11:14:50] (03open) 10aklapper: Revert "Restrict project workboard access to logged in users only" [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/111 (https://phabricator.wikimedia.org/T403385) [11:15:29] (03PS1) 10Hashar: Zuul: [OAuth] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224618 (https://phabricator.wikimedia.org/T389998) [11:15:56] (03CR) 10Hashar: [C:03+2] Zuul: [OAuth] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224618 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:15:59] (03CR) 10Hashar: [C:03+2] Zuul: [IPReputation] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224612 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:17:32] (03Merged) 10jenkins-bot: Zuul: [IPReputation] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224612 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:17:45] (03Merged) 10jenkins-bot: Zuul: [OAuth] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224618 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:25:03] maintenance-disconnect-full-disks build 770364 integration-agent-docker-1045 (/: 35%, /srv: 95%, /var/lib/docker: 33%): OFFLINE due to disk space [11:25:32] (03PS1) 10Hashar: Zuul: [MassMessage] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224623 [11:25:50] (03CR) 10Hashar: [C:03+2] Zuul: [MassMessage] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224623 (owner: 10Hashar) [11:26:56] 10Diffusion, 10Phabricator, 06Release-Engineering-Team, 07Performance Issue: Diffusion code view: Per-file change info is slow to load despite caching (diffusion.lastmodifiedquery) - https://phabricator.wikimedia.org/T403215#11502870 (10Aklapper) @brennen: I'd appreciate another triple of eyes/brain to hel... [11:27:19] (03Merged) 10jenkins-bot: Zuul: [MassMessage] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224623 (owner: 10Hashar) [11:28:12] (03PS1) 10Hashar: Zuul: [ORES] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224625 (https://phabricator.wikimedia.org/T389998) [11:30:02] maintenance-disconnect-full-disks build 770365 integration-agent-docker-1045 (/: 35%, /srv: 68%, /var/lib/docker: 33%): RECOVERY disk space OK [11:30:23] (03PS1) 10Hashar: Zuul: [StopForumSpam] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224627 (https://phabricator.wikimedia.org/T389998) [11:31:34] (03CR) 10Hashar: [C:03+2] Zuul: [ORES] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224625 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:31:43] (03CR) 10Hashar: [C:03+2] Zuul: [StopForumSpam] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224627 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:33:22] (03Merged) 10jenkins-bot: Zuul: [ORES] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224625 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:33:34] (03Merged) 10jenkins-bot: Zuul: [StopForumSpam] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224627 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [11:34:39] 10Phabricator (2025-11-04), 06Release-Engineering-Team (Doing 😎), 06collaboration-services, 07Essential-Work, 13Patch-For-Review: Restrict project workboard access to logged in users only - https://phabricator.wikimedia.org/T403385#11502911 (10Dzahn) Well, my comment was meant as "introducing a captc... [11:36:31] 10Phabricator (2025-11-04), 06Release-Engineering-Team (Doing 😎), 06collaboration-services, 07Essential-Work, 13Patch-For-Review: Restrict project workboard access to logged in users only - https://phabricator.wikimedia.org/T403385#11502918 (10Dzahn) >>! In T403385#11502585, @Sebastian_Berlin-WMSE wr... [11:44:11] 10GitLab (Infrastructure), 06collaboration-services: Make sure GitLab does not exceed apus object storage quotas - https://phabricator.wikimedia.org/T413871#11502957 (10Jelto) after some manual clean-up and reaching out to project owners we are down to: ` jelto@gitlab1004:/etc/gitlab$ s3cmd du -H s3://gitlab-... [11:47:28] (03PS1) 10Hslater: Zuul: [mediawiki/extensions/WikiRAG] Add BlueSpiceFoundation as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1224631 [12:03:46] 10Gerrit, 10bacula, 06collaboration-services: Backup freshness: Stale bacula backup for gerrit1003 - https://phabricator.wikimedia.org/T413853#11503033 (10jcrespo) ` RECOVERY - Backup freshness on backup1014 is OK: Fresh: 140 jobs https://wikitech.wikimedia.org/wiki/Bacula%23Monitoring ` Thi... [12:03:49] 10Gerrit, 10bacula, 06collaboration-services: Backup freshness: Stale bacula backup for gerrit1003 - https://phabricator.wikimedia.org/T413853#11503034 (10jcrespo) 05Open→03Resolved [12:10:49] (03PS1) 10Hashar: Zuul: [PersonalDashboard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224641 (https://phabricator.wikimedia.org/T389998) [12:10:51] (03PS1) 10Hashar: Zuul: [Thanks] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224642 (https://phabricator.wikimedia.org/T389998) [12:11:08] (03CR) 10Hashar: [C:03+2] Zuul: [Thanks] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224642 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [12:11:13] (03CR) 10Hashar: [C:03+2] Zuul: [PersonalDashboard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224641 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [12:12:46] (03Merged) 10jenkins-bot: Zuul: [PersonalDashboard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224641 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [12:13:00] (03Merged) 10jenkins-bot: Zuul: [Thanks] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224642 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [12:16:02] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.46.0-wmf.10 deployment blockers - https://phabricator.wikimedia.org/T408280#11503089 (10TTO) [12:18:04] diff -U0 <(git config -f <(git show HEAD^:modules/admin/files/home/hashar/.gitconfig) --list|sort) <(git config -f modules/admin/files/home/hashar/.gitconfig --list|sort)|egrep -v ^@@ [12:18:11] (wrong window) [12:24:37] 06Release-Engineering-Team, 10wikimedia.biterg.io: wikimedia.biterg.io lacks Maniphest indexing after 2025-11-04 - https://phabricator.wikimedia.org/T411362#11503143 (10Aklapper) 05Stalled→03Resolved elk.py was running into `Policy identifier is an object PHID (''), but no object handle was provided. A... [12:25:26] (03PS1) 10Hashar: Zuul: [TorBlock] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224653 (https://phabricator.wikimedia.org/T389998) [12:29:36] (03CR) 10Hashar: [C:03+2] "It works! ™" [integration/config] - 10https://gerrit.wikimedia.org/r/1224653 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [12:31:31] (03Merged) 10jenkins-bot: Zuul: [TorBlock] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224653 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [12:32:18] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083 (10A_smart_kitten) 03NEW [12:32:31] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11503189 (10A_smart_kitten) p:05Triage→03Low a:03A_smart_kitten Claiming this because, from the preliminary investigation I've done into the relevant code pr... [12:34:30] 10Phabricator (2026-01-06): Deploy user style to reduce bot comments on Phabricator - https://phabricator.wikimedia.org/T393289#11503199 (10A_smart_kitten) FWIW I concur with generally wanting to see the full version of @Stashbot comments - I believe I made the same change to the user-styles myself locally b... [12:45:34] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11503226 (10Aklapper) I admit I'm not that keen on introducing another preference unless there are good use cases which aren't "I don't like it" and/or debug (whic... [13:01:19] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11503274 (10A_smart_kitten) I mean, for a UX change, I feel like subjective 'I do/don't like it' opinions might hold a bit more weight than (say) for a change in l... [14:00:38] 10Continuous-Integration-Config, 10UploadWizard, 13Patch-For-Review: UploadWizard structure tests fail when EventLogging is not loaded - https://phabricator.wikimedia.org/T411660#11503710 (10hashar) @phuedx #uploadwizard does not have a maintainer anymore after the [[ https://www.mediawiki.org/wiki/Readers/S... [14:08:27] (03PS1) 10Hashar: Zuul: [UploadWizard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224684 (https://phabricator.wikimedia.org/T411660) [14:08:40] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11503759 (10Aklapper) > it interrupts their workflow If that is the case then I'd appreciate more elaboration //how// it interrupts their workflow. For example wrt... [14:10:03] maintenance-disconnect-full-disks build 770397 integration-agent-docker-1053 (/: 36%, /srv: 98%, /var/lib/docker: 28%): OFFLINE due to disk space [14:13:45] (03PS2) 10Hashar: Zuul: [UploadWizard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224684 (https://phabricator.wikimedia.org/T411660) [14:15:03] maintenance-disconnect-full-disks build 770398 integration-agent-docker-1053 (/: 36%, /srv: 53%, /var/lib/docker: 28%): RECOVERY disk space OK [14:16:19] (03CR) 10Hashar: [C:03+2] Zuul: [UploadWizard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224684 (https://phabricator.wikimedia.org/T411660) (owner: 10Hashar) [14:18:36] (03PS3) 10Hashar: Zuul: [UploadWizard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224684 (https://phabricator.wikimedia.org/T411660) [14:19:04] (03PS4) 10Hashar: Zuul: [UploadWizard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224684 (https://phabricator.wikimedia.org/T411660) [14:19:17] (03CR) 10Hashar: [C:03+2] Zuul: [UploadWizard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224684 (https://phabricator.wikimedia.org/T411660) (owner: 10Hashar) [14:21:02] (03Merged) 10jenkins-bot: Zuul: [UploadWizard] disable recursion [integration/config] - 10https://gerrit.wikimedia.org/r/1224684 (https://phabricator.wikimedia.org/T411660) (owner: 10Hashar) [14:22:10] 10Continuous-Integration-Config, 10UploadWizard, 13Patch-For-Review: UploadWizard structure tests fail when EventLogging is not loaded - https://phabricator.wikimedia.org/T411660#11503797 (10hashar) 05Open→03Resolved a:03hashar The `UploadWizard` tests failed for `EncryptedUploads` and `Pronunciati... [14:30:22] 10GitLab (Infrastructure), 06collaboration-services, 06Security-Team, 07SecTeam-Processed, and 2 others: GitLab Security Release: 18.7.1, 18.6.3, 18.5.5 - https://phabricator.wikimedia.org/T414053#11503837 (10sbassett) [14:30:23] 10GitLab (Infrastructure), 06collaboration-services, 06Security-Team, 07SecTeam-Processed, and 2 others: GitLab Security Release: 18.7.1, 18.6.3, 18.5.5 - https://phabricator.wikimedia.org/T414053#11503839 (10sbassett) [14:32:33] FIRING: PuppetAgentFailure: Puppet agent failure detected on instance deployment-mx03 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [15:22:39] 10Beta-Cluster-Infrastructure: Puppet agent failure detected on instance deployment-mx03 in project deployment-prep - https://phabricator.wikimedia.org/T414100 (10wmcs-alerts) 03NEW [15:26:52] (03merge) 10aklapper: Improve bot comment styles for phone and tablet size [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/110 (https://phabricator.wikimedia.org/T414003) (owner: 10matmarex) [15:42:03] 10Phabricator (2026-01-06): Deploy user style to reduce bot comments on Phabricator - https://phabricator.wikimedia.org/T393289#11504192 (10matmarex) >>! In T393289#11502713, @Soda wrote: > Is there a way to get the more verbose state back, I can see the initial benefit of deprioritizing this data in the UI,... [15:49:32] 06Release-Engineering-Team, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Add yubikey ssh key for dancy - https://phabricator.wikimedia.org/T414032#11504220 (10dancy) [15:53:02] (03merge) 10dancy: gitlab-runner: bump image version to alpine-v18.5.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/543 (https://phabricator.wikimedia.org/T414053) (owner: 10jelto) [15:54:35] 10Beta-Cluster-Infrastructure: Puppet agent failure detected on instance deployment-mx03 in project deployment-prep - https://phabricator.wikimedia.org/T414100#11504245 (10bd808) →14Duplicate dup:03T412975 [15:54:38] 10Beta-Cluster-Infrastructure, 06collaboration-services, 13Patch-For-Review: Replace deployment-mx03 with a bookworm-based instance (was Puppet failure: "Unable to locate package spamd") - https://phabricator.wikimedia.org/T412975#11504243 (10bd808) [15:55:09] !log Upgrading gitlab-runner to v18.5.0 on gitlab-cloud-runners. (T414053) [15:55:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:55:12] T414053: GitLab Security Release: 18.7.1, 18.6.3, 18.5.5 - https://phabricator.wikimedia.org/T414053 [16:14:44] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11504327 (10IKhitron) Great. I hope one day there will be five or six switches in preferences, for different parts of it. For now, I'll need to disable it, a pity,... [16:19:00] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11504343 (10Sophivorus) Perhaps the CSS can be reverted by a user-style or user-script for those that don't like it or need it for some specific workflow reason? [16:28:52] 10Continuous-Integration-Config, 07Epic, 07PHP 8.4 support: Make PHP 8.4 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T386108#11504391 (10Jdforrester-WMF) [16:29:16] 10Continuous-Integration-Config, 07Epic, 07PHP 8.4 support: Make PHP 8.4 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T386108#11504394 (10Jdforrester-WMF) [16:31:27] 10Continuous-Integration-Config, 07Epic, 07PHP 8.4 support: Make PHP 8.4 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T386108#11504415 (10Jdforrester-WMF) T409283 isn't fixed until the patch is in a release that i... [16:35:13] 10Beta-Cluster-Infrastructure: CDN edge HAProxy config broken by missing `/usr/share/GeoIP/proxy.mmdb` data file - https://phabricator.wikimedia.org/T414111 (10bd808) 03NEW [16:35:44] 10Beta-Cluster-Infrastructure: CDN edge HAProxy config broken by missing `/usr/share/GeoIP/proxy.mmdb` data file - https://phabricator.wikimedia.org/T414111#11504531 (10bd808) [16:35:45] 10Beta-Cluster-Infrastructure: Remove need for manually applied MaxMind data hacks on Beta Cluster cache servers - https://phabricator.wikimedia.org/T403105#11504532 (10bd808) [16:38:56] 10Beta-Cluster-Infrastructure, 06Traffic: CDN edge HAProxy config broken by missing `/usr/share/GeoIP/proxy.mmdb` data file - https://phabricator.wikimedia.org/T414111#11504535 (10bd808) [16:39:11] 10Beta-Cluster-Infrastructure, 06Traffic: Remove need for manually applied MaxMind data hacks on Beta Cluster cache servers - https://phabricator.wikimedia.org/T403105#11504538 (10bd808) [16:40:25] 10Continuous-Integration-Config, 07Epic, 07PHP 8.4 support: Make PHP 8.4 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T386108#11504541 (10A_smart_kitten) Ah, sorry - thank you for correcting me :) [16:41:12] 06Release-Engineering-Team, 10LDAP-Access-Requests, 06Security-Team, 06SRE, and 2 others: DannyS712 "offboarding" - https://phabricator.wikimedia.org/T413634#11504543 (10JMeybohm) #release-engineering-team: Could you help with removing +2 ? [16:44:56] 10Continuous-Integration-Config, 07Epic, 07PHP 8.4 support: Make PHP 8.4 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T386108#11504559 (10Jdforrester-WMF) >>! In T386108#11504541, @A_smart_kitten wrote: > Ah, sorr... [16:47:11] 10Beta-Cluster-Infrastructure, 06Traffic: CDN edge HAProxy config broken by missing `/usr/share/GeoIP/proxy.mmdb` data file - https://phabricator.wikimedia.org/T414111#11504567 (10bd808) `counterexample HACK incoming!!!!! ` `lang=shell-session bd808@deployment-cache-text08.deployment-prep.eqiad1:~$ sudo ln -s... [16:50:16] 10Beta-Cluster-Infrastructure, 06Traffic: CDN edge HAProxy config broken by missing `/usr/share/GeoIP/proxy.mmdb` data file - https://phabricator.wikimedia.org/T414111#11504579 (10ssingh) @SLyngshede-WMF can you look into this please? I think we can `ensure` on `$use_private_data.bool2str` for `/usr/share/GeoI... [16:51:26] 10Beta-Cluster-Infrastructure, 06Traffic: Remove need for manually applied MaxMind data hacks on Beta Cluster cache servers - https://phabricator.wikimedia.org/T403105#11504582 (10bd808) Another symlink hack has been applied for {T414111}. [16:52:03] 10Beta-Cluster-Infrastructure, 06Traffic: Remove need for manually applied MaxMind data hacks on Beta Cluster cache servers - https://phabricator.wikimedia.org/T403105#11504584 (10bd808) [16:56:06] (03open) 10jforrester: releases: Bump api-testing from 1.7.1 to 1.7.2 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/105 [16:56:30] (03merge) 10jforrester: releases: Bump api-testing from 1.7.1 to 1.7.2 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/105 [17:12:09] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11504655 (10A_smart_kitten) >>! In T414083#11504343, @Sophivorus wrote: > Perhaps the CSS can be reverted by a user-style or user-script for those that don't like... [17:23:10] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/WikiRAG] Add BlueSpiceFoundation as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1224631 (owner: 10Hslater) [17:23:21] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/IssueTrackerLinks] Add VisualEditor as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1224536 (owner: 10Hslater) [17:25:04] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/WikiRAG] Add BlueSpiceFoundation as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1224631 (owner: 10Hslater) [17:25:05] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/IssueTrackerLinks] Add VisualEditor as dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1224536 (owner: 10Hslater) [17:25:53] (03Abandoned) 10Hashar: Zuul: disable recursion with AbuseFilter/ConfirmEdit [integration/config] - 10https://gerrit.wikimedia.org/r/1212184 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [17:26:37] (03CR) 10Hashar: [C:03+2] "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/1224631 (owner: 10Hslater) [17:26:40] (03CR) 10Hashar: [C:03+2] "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/1224536 (owner: 10Hslater) [18:08:16] 10Beta-Cluster-Infrastructure, 06Traffic: CDN edge HAProxy config broken by missing `/usr/share/GeoIP/proxy.mmdb` data file - https://phabricator.wikimedia.org/T414111#11504849 (10bd808) p:05Triage→03Medium [18:13:46] 10Phabricator, 07dark-mode: Bot comment styles are not dark-mode compatible - https://phabricator.wikimedia.org/T414117 (10SomeRandomDeveloper) 03NEW [18:18:21] 10GitLab-Application-Security-Pipeline, 06Security-Team: Craft more mediawiki-specific and php semgrep rule sets - https://phabricator.wikimedia.org/T342468#11504903 (10mmartorana) 05Open→03Declined [18:24:15] !log Unblock 89.80.0.0/12 (T414113) [18:24:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:45:02] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11504990 (10Aklapper) >>! In T414083#11504327, @IKhitron wrote: > I hope one day there will be five or six switches in preferences [Definitely not.](https://omete... [18:45:15] 10Gerrit: Unable to log into Gerritt - https://phabricator.wikimedia.org/T414118 (10kimpham) 03NEW [18:46:28] 10Gerrit, 10Bitu, 06Infrastructure-Foundations: Unable to log into Gerritt - https://phabricator.wikimedia.org/T414118#11505005 (10Aklapper) [19:12:48] 10Gerrit, 10Bitu, 06Infrastructure-Foundations: Unable to log into Gerritt - https://phabricator.wikimedia.org/T414118#11505085 (10bd808) > I try to log in with my username kim.pham and password from https://idm.wikimedia.org/ but I get the error message authentication failed. Your https://ldap.toolforge.or... [19:20:13] (03PS1) 10Tbodt: zuul: [mediawiki/extensions/MultiTitle] Promote to Wikimedia prod section [integration/config] - 10https://gerrit.wikimedia.org/r/1224782 (https://phabricator.wikimedia.org/T404461) [19:22:16] 10Gerrit, 06Release-Engineering-Team (Doing 😎), 10Bitu, 06Infrastructure-Foundations, 07Essential-Work: Unable to log into Gerritt - https://phabricator.wikimedia.org/T414118#11505121 (10thcipriani) 05Open→03Resolved a:03thcipriani Here's what I see in the gerrit error logs: ` WARN com.google... [19:29:38] 10Gerrit, 06Release-Engineering-Team (Doing 😎), 10Bitu, 06Infrastructure-Foundations, 07Essential-Work: Unable to log into Gerritt - https://phabricator.wikimedia.org/T414118#11505149 (10kimpham) Thank you! [19:42:01] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11505177 (10matmarex) > ccing @matmarex for your info / thoughts I'm not against it, as long as the reduced comments are on by default. That said, I would like to... [19:42:53] (03open) 10dancy: Use watch bookmarks [repos/releng/k8s-pvc-cleaner] - 10https://gitlab.wikimedia.org/repos/releng/k8s-pvc-cleaner/-/merge_requests/33 [19:42:56] (03update) 10dancy: Use watch bookmarks [repos/releng/k8s-pvc-cleaner] - 10https://gitlab.wikimedia.org/repos/releng/k8s-pvc-cleaner/-/merge_requests/33 [19:44:10] (03merge) 10dancy: Use watch bookmarks [repos/releng/k8s-pvc-cleaner] - 10https://gitlab.wikimedia.org/repos/releng/k8s-pvc-cleaner/-/merge_requests/33 [19:44:37] 10Phabricator: Create a user-preference to enable/disable the Phabricator style that reduces bot-comments - https://phabricator.wikimedia.org/T414083#11505216 (10IKhitron) >>! In T414083#11504990, @Aklapper wrote: >>>! In T414083#11504327, @IKhitron wrote: >> I hope one day there will be five or six switches in... [19:49:25] 10Gerrit, 06Release-Engineering-Team (Doing 😎), 10Bitu, 06Infrastructure-Foundations, 07Essential-Work: Unable to log into Gerritt - https://phabricator.wikimedia.org/T414118#11505250 (10kimpham) 05Resolved→03Open Is it possible to be added to the wmde ldap? Should I ask my supervisor about what othe... [19:51:42] (03open) 10dancy: k8s-pvc-cleaner-values.yaml.tftpl: Use image.tag v1.0.5 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/544 [19:51:45] (03update) 10dancy: k8s-pvc-cleaner-values.yaml.tftpl: Use image.tag v1.0.5 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/544 [19:52:39] (03update) 10dancy: k8s-pvc-cleaner-values.yaml.tftpl: Use image.tag v1.0.5 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/544 [19:53:16] (03merge) 10dancy: k8s-pvc-cleaner-values.yaml.tftpl: Use image.tag v1.0.5 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/544 [19:59:40] (03open) 10tbodt: make-release: Start branching MultiTitle [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/231 (https://phabricator.wikimedia.org/T404461) [20:06:59] (03open) 10dancy: Fix bookmarks watch [repos/releng/k8s-pvc-cleaner] - 10https://gitlab.wikimedia.org/repos/releng/k8s-pvc-cleaner/-/merge_requests/34 [20:07:05] (03update) 10dancy: Fix bookmarks watch [repos/releng/k8s-pvc-cleaner] - 10https://gitlab.wikimedia.org/repos/releng/k8s-pvc-cleaner/-/merge_requests/34 [20:07:51] (03merge) 10dancy: Fix bookmarks watch [repos/releng/k8s-pvc-cleaner] - 10https://gitlab.wikimedia.org/repos/releng/k8s-pvc-cleaner/-/merge_requests/34 [20:10:43] (03open) 10dancy: k8s-pvc-cleaner-values.yaml.tftpl: Use image.tag v1.0.6 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/545 [20:10:45] (03update) 10dancy: k8s-pvc-cleaner-values.yaml.tftpl: Use image.tag v1.0.6 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/545 [20:11:56] (03merge) 10dancy: k8s-pvc-cleaner-values.yaml.tftpl: Use image.tag v1.0.6 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/545 [20:12:10] 10Gerrit, 06Release-Engineering-Team (Doing 😎), 10Bitu, 06Infrastructure-Foundations, 07Essential-Work: Unable to log into Gerritt - https://phabricator.wikimedia.org/T414118#11505369 (10Aklapper) 05Open→03Resolved Hi, please file a separate ticket for a separate request. See https://phabricator.... [20:18:12] 10Phabricator (2026-01-06): Deploy user style to reduce bot comments on Phabricator - https://phabricator.wikimedia.org/T393289#11505391 (10matmarex) {F71470893} [20:20:40] (03open) 10matmarex: Expand Stashbot comments on hover [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/112 (https://phabricator.wikimedia.org/T393289) [21:14:19] 10Continuous-Integration-Config, 06Test Kitchen, 05MW-1.43-release, 05MW-1.44-release, 05MW-1.45-release: InvalidArgumentException from line 827 of /workspace/src/includes/registration/ExtensionProcessor.php: It was attempted to load MetricsPlatform twice - https://phabricator.wikimedia.org/T414136 (10Ree... [21:14:21] 10Continuous-Integration-Config, 06Test Kitchen, 05MW-1.43-release, 05MW-1.44-release, 05MW-1.45-release: InvalidArgumentException from line 827 of /workspace/src/includes/registration/ExtensionProcessor.php: It was attempted to load MetricsPlatform twic... - https://phabricator.wikimedia.org/T414136#11505540 [21:14:36] hacks hacks hacks [21:21:08] (03PS1) 10Reedy: Zuul: Stop loading Extension:TestKitchen on REL1_XX branches [integration/config] - 10https://gerrit.wikimedia.org/r/1224815 (https://phabricator.wikimedia.org/T414136) [21:24:19] 10Continuous-Integration-Config, 06Test Kitchen, 05MW-1.43-release, 05MW-1.44-release, and 2 others: InvalidArgumentException from line 827 of /workspace/src/includes/registration/ExtensionProcessor.php: It was attempted to load MetricsPlatform twice - https://phabricator.wikimedia.org/T414136#11505552 (10R... [21:26:32] 10Continuous-Integration-Config, 06Test Kitchen, 05MW-1.43-release, 05MW-1.44-release, and 2 others: InvalidArgumentException from line 827 of /workspace/src/includes/registration/ExtensionProcessor.php: It was attempted to load MetricsPlatform twice - https://phabricator.wikimedia.org/T414136#11505558 (10R... [21:26:48] 10Continuous-Integration-Config, 06Test Kitchen, 05MW-1.43-release, 05MW-1.44-release, and 2 others: InvalidArgumentException from line 827 of /workspace/src/includes/registration/ExtensionProcessor.php: It was attempted to load MetricsPlatform twice - https://phabricator.wikimedia.org/T414136#11505562 (10R... [21:27:33] (03CR) 10Reedy: [C:03+2] Zuul: Stop loading Extension:TestKitchen on REL1_XX branches [integration/config] - 10https://gerrit.wikimedia.org/r/1224815 (https://phabricator.wikimedia.org/T414136) (owner: 10Reedy) [21:29:05] (03Merged) 10jenkins-bot: Zuul: Stop loading Extension:TestKitchen on REL1_XX branches [integration/config] - 10https://gerrit.wikimedia.org/r/1224815 (https://phabricator.wikimedia.org/T414136) (owner: 10Reedy) [21:29:51] 10Continuous-Integration-Config, 06Test Kitchen, 05MW-1.43-release, 05MW-1.44-release, and 2 others: InvalidArgumentException from line 827 of /workspace/src/includes/registration/ExtensionProcessor.php: It was attempted to load MetricsPlatform twice - https://phabricator.wikimedia.org/T414136#11505566 (10R... [21:30:15] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1224815 T414136 [21:30:17] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:30:17] T414136: InvalidArgumentException from line 827 of /workspace/src/includes/registration/ExtensionProcessor.php: It was attempted to load MetricsPlatform twice - https://phabricator.wikimedia.org/T414136 [21:31:26] something something and this is why we don't rename extensions something something [21:45:27] 10Continuous-Integration-Config, 06Test Kitchen, 05MW-1.43-release, 05MW-1.44-release, 05MW-1.45-release: InvalidArgumentException from line 827 of /workspace/src/includes/registration/ExtensionProcessor.php: It was attempted to load MetricsPlatform twic... - https://phabricator.wikimedia.org/T414136#11505595 [22:16:29] 06Release-Engineering-Team, 10LDAP-Access-Requests, 06Security-Team, 06SRE, and 2 others: DannyS712 "offboarding" - https://phabricator.wikimedia.org/T413634#11505648 (10bd808) >>! In T413634#11504543, @JMeybohm wrote: > #release-engineering-team: Could you help with removing +2 ? I [[https://gerrit.wikim... [22:26:47] 06Release-Engineering-Team, 10LDAP-Access-Requests, 06Security-Team, 06SRE, and 2 others: DannyS712 "offboarding" - https://phabricator.wikimedia.org/T413634#11505670 (10bd808) @DannyS712 In addition to your MediaWiki +2 which I just revoked, do you want to give up other rights in Gerrit such as your pywik...