[02:31:42] 10Phabricator (2026-01-06): Deploy user style to reduce bot comments on Phabricator - https://phabricator.wikimedia.org/T393289#11523756 (10Diskdance) Although I'm not against this idea, an option in preferences should be welcome. [08:24:03] 06Release-Engineering-Team, 06collaboration-services: Update sync-gitlab-group-with-ldap to handle syncing users who have no email address - https://phabricator.wikimedia.org/T414428#11524035 (10ABran-WMF) p:05Triageβ†’03Low [10:58:30] 06Release-Engineering-Team, 10ServiceOps-Mediawiki, 06SRE Observability, 10ServiceOps new: Proof of Concept: Train Health Dashboard - https://phabricator.wikimedia.org/T412801#11524374 (10jijiki) [14:01:25] 10Phabricator (Upstream), 06Release-Engineering-Team (Doing 😎), 07Upstream: "Call to phutil_nonempty_string() expected null or a string, got: bool" rendering alt text of image file - https://phabricator.wikimedia.org/T352170#11524901 (10Aklapper) a:03Aklapper [14:34:49] 10Phabricator (Upstream), 06Release-Engineering-Team (Doing 😎), 07Upstream: "Call to phutil_nonempty_string() expected null or a string, got: bool" rendering alt text of image file - https://phabricator.wikimedia.org/T352170#11525047 (10Aklapper) [14:50:07] !log jforrester@doc1004:~$ sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/ArticleSummaries/ # T413232 [14:50:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:50:12] T413232: Remove ArticleSummaries from doc.wikimedia.org/cover-extensions - https://phabricator.wikimedia.org/T413232 [14:50:27] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Projects-Cleanup, 06Reader Growth Team: Remove ArticleSummaries from doc.wikimedia.org/cover-extensions - https://phabricator.wikimedia.org/T413232#11525137 (10Jdforrester-WMF) 05Openβ†’03Resolved a:03Jdforrester-WMF Done. [15:01:31] 10Continuous-Integration-Config, 10Codex, 10doc.wikimedia.org: Codex PHP: publish the demo page on doc.wikimedia.org - https://phabricator.wikimedia.org/T382414#11525246 (10Jdforrester-WMF) a:05Jdforrester-WMFβ†’03None This is still stalled on the demo existing (sub-task), so un-cookie-licking for now. [15:14:06] 10Gerrit, 06collaboration-services, 13Patch-For-Review: gerrit behind CDN - https://phabricator.wikimedia.org/T411895#11525336 (10CDanis) πŸ’™cdanis@wmftop ~ πŸ•™β˜• DC=magru ; curl -I -X GET https://gerrit.wikimedia.org --connect-to ::gerrit-lb.${DC}.wikimedia.org ; nc -vW1 gerrit-lb.${DC}.wikimedia.org 29418 HTT... [15:36:49] (03open) 10dancy: Release 4.232.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1067 [15:39:20] (03merge) 10dancy: Release 4.232.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1067 [15:58:53] 10Phabricator (Upstream), 06Release-Engineering-Team (Doing 😎), 07Upstream: "Call to phutil_nonempty_string() expected null or a string, got: bool" rendering alt text of image file - https://phabricator.wikimedia.org/T352170#11525494 (10Aklapper) 05Openβ†’03Stalled [16:01:50] 06Release-Engineering-Team, 10Scap, 06serviceops, 06SRE, 07Datacenter-Switchover: Add scap lock/unlock steps to sre.switchdc.mediawiki cookbook - https://phabricator.wikimedia.org/T330996#11525496 (10dancy) [16:03:20] 06Release-Engineering-Team, 10Scap, 06serviceops, 06SRE, 07Datacenter-Switchover: Add scap lock/unlock steps to sre.switchdc.mediawiki cookbook - https://phabricator.wikimedia.org/T330996#11525507 (10dancy) @Blake I've installed a new release of scap on the deploy servers. You can now use `scap lock --a... [17:40:03] maintenance-disconnect-full-disks build 772455 integration-agent-docker-1046 (/: 36%, /srv: 97%, /var/lib/docker: 33%): OFFLINE due to disk space [17:45:03] maintenance-disconnect-full-disks build 772456 integration-agent-docker-1046 (/: 36%, /srv: 18%, /var/lib/docker: 32%): RECOVERY disk space OK [18:57:22] 10Gerrit, 06collaboration-services, 13Patch-For-Review: gerrit behind CDN - https://phabricator.wikimedia.org/T411895#11526048 (10CDanis) [19:14:57] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719 (10CDanis) 03NEW [19:17:32] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719#11526137 (10CDanis) [19:19:39] hi all, we're now beginning opt-in testing of using gerrit via the CDN, both https and ssh. instructions are at https://phabricator.wikimedia.org/T414719 [19:23:00] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719#11526157 (10CDanis) p:05Triageβ†’03High a:03CDanis [20:07:34] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719#11526361 (10CDanis) == FAQ == Q: How long should I leave this running? A: Up to one whole workday at a time. Don't set it and totally forget it -- it's directing you towards //one// of our edge si... [20:20:44] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719#11526396 (10thcipriani) Thanks so much for this work! Question: When I do `ssh gerrit.wikimedia.org -p 29418 gerrit show-connections --wide` I'm seeing 4 "connections" per PoP without any associat... [20:24:22] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 05Release, 05Train Deployments: 1.46.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T413804#11526404 (10brennen) [20:29:46] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719#11526427 (10CDanis) >>! In T414719#11526396, @thcipriani wrote: > When I do `ssh gerrit.wikimedia.org -p 29418 gerrit show-connections --wide` I'm seeing 4 "connections" per PoP without any associat... [20:36:17] (03open) 10dancy: scap update-patch/remove-patch: Lock staging directory during operation [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1068 (https://phabricator.wikimedia.org/T414628) [20:36:20] (03update) 10dancy: scap update-patch/remove-patch: Lock staging directory during operation [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1068 (https://phabricator.wikimedia.org/T414628) [20:39:34] (03update) 10dancy: scap update-patch/remove-patch: Lock staging directory during operation [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1068 (https://phabricator.wikimedia.org/T414628) [20:57:23] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719#11526630 (10bd808) I think this may just be a quirk of tunnelencabulator, but when I run it and use `ssh gerrit -- gerrit show-connections --wide` I see myself entering via IPv6 and not an edge prox... [21:02:30] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 06Abstract Wikipedia team, 06collaboration-services, and 4 others: Wikifunctions function orchestrator and evaluator test suites failing on GitLab CI with OOM errors - https://phabricator.wikimedia.org/T399348#11526651 (10vaughnwalters) >>! In T3... [21:06:47] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719#11526692 (10thcipriani) Thanks for the explanation @CDanis ! Digging through JVM metrics: gerrit seems to be handling the tcp connections ok. I dug a bit here since we have a lower number of `sshd.... [21:29:44] 10Gerrit, 06collaboration-services: Opt-in testing of Gerrit-via-CDN - https://phabricator.wikimedia.org/T414719#11526781 (10CDanis) >>! In T414719#11526630, @bd808 wrote: > I think this may just be a quirk of tunnelencabulator, but when I run it and use `ssh gerrit -- gerrit show-connections --wide` I see mys... [21:47:17] 06Release-Engineering-Team (Seen), 10Release Pipeline, 06serviceops, 06SRE: Kask functional testing with Cassandra via the Deployment Pipeline - https://phabricator.wikimedia.org/T224041#11526839 (10Eevans) [22:17:39] 10Phabricator, 06Release-Engineering-Team (Priority Backlog πŸ“₯): Support "other assignee" field for tasks with "Task" type - https://phabricator.wikimedia.org/T396905#11526997 (10A_smart_kitten) >>! In T396905#11396548, @A_smart_kitten wrote: > [...] the 'Change Other Assignee' option doesn't seem to curren...