[00:54:36] (03open) 10vriaa: fix: Lifecycle issues introduced during merge conflict resolution [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/26 [00:55:10] (03merge) 10vriaa: fix: Lifecycle issues introduced during merge conflict resolution [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/26 [01:05:25] 10Tool-community: Promote Community Organizers and Tools - https://phabricator.wikimedia.org/T415432 (10Adityakumar0545) 03NEW [02:24:56] FIRING: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [02:25:33] (03open) 10vriaa: feat: Landing page for banner management [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/27 [02:25:42] (03merge) 10vriaa: feat: Landing page for banner management [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/27 [02:37:41] (03open) 10vriaa: docs: update banner tool guide link [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/28 [02:37:47] (03merge) 10vriaa: docs: update banner tool guide link [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/28 [02:44:56] RESOLVED: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [02:49:53] (03open) 10vriaa: docs: Add link to developer docs [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/29 [02:49:58] (03merge) 10vriaa: docs: Add link to developer docs [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/29 [02:54:56] FIRING: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [03:14:56] RESOLVED: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [04:50:10] 10Tool-yearinreview, 06Indic-TechCom: Year in review tool is broken! - https://phabricator.wikimedia.org/T415434 (10Kuldeepburjbhalaike) 03NEW [04:54:56] FIRING: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [05:14:56] RESOLVED: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [07:49:56] FIRING: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [08:14:56] RESOLVED: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [08:47:38] (03open) 10keerthan16: Feat/logs download [toolforge-repos/tool-watch] - 10https://gitlab.wikimedia.org/toolforge-repos/tool-watch/-/merge_requests/1 [09:24:50] (03open) 10viserion-7: Fixed T415434 [toolforge-repos/yearinreview] - 10https://gitlab.wikimedia.org/toolforge-repos/yearinreview/-/merge_requests/12 [09:26:49] 10Tool-yearinreview, 06Indic-TechCom: Year in review tool is broken! - https://phabricator.wikimedia.org/T415434#11550893 (10Viserion7) a:03Viserion7 There's a missing comma on Line 7205 https://gitlab.wikimedia.org/toolforge-repos/yearinreview/-/blob/main/src/mocks/apiresponse.json?ref_type=heads#L7205 Hav... [09:28:10] (03merge) 10gopavasanth: Fixed T415434 [toolforge-repos/yearinreview] - 10https://gitlab.wikimedia.org/toolforge-repos/yearinreview/-/merge_requests/12 (owner: 10viserion-7) [09:31:54] 10Tool-yearinreview, 06Indic-TechCom: Year in review tool is broken! - https://phabricator.wikimedia.org/T415434#11550897 (10Viserion7) 05Open→03Resolved The PR has been merged @Kuldeepburjbhalaike [09:41:33] (03open) 10keerthan16: Feat/manual recheck [toolforge-repos/tool-watch] - 10https://gitlab.wikimedia.org/toolforge-repos/tool-watch/-/merge_requests/2 [09:48:56] FIRING: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [10:13:56] RESOLVED: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [10:16:40] 10Cloud-VPS (Debian Bullseye Deprecation), 10Tool-spacemedia: Cannot delete Cloud VPS bullseye instance - https://phabricator.wikimedia.org/T415437 (10Don-vip) 03NEW [10:48:10] 10VPS-project-Wikistats: Add kajwiki to wikistats - https://phabricator.wikimedia.org/T415043#11550927 (10Dzahn) [12:25:57] 10Tool-inteGraality: Wikidata:WikiProject_Govdirectory/Albania/Coverage_of_first_level_agencies. - https://phabricator.wikimedia.org/T415439 (10A1) 03NEW [12:29:23] 10Tool-inteGraality: Wikidata:WikiProject_Govdirectory/Albania/Coverage_of_first_level_agencies. - https://phabricator.wikimedia.org/T415439#11550982 (10Aklapper) @A1: What is this about? How is the task title related to the output in the description? What are steps to reproduce some problem? [12:49:56] FIRING: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [13:14:56] RESOLVED: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [15:04:45] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11551195 (10Hridyesh_Gupta) a:03Hridyesh_Gupta [15:06:05] 10Tool-campwiz-nxt, 10Google-Summer-of-Code (Google Summer of Code (2026)): GSoC 2026: CampWiz NxT Redesign - https://phabricator.wikimedia.org/T414269#11551196 (10Hridyesh_Gupta) Hello @Nokib_Sarkar , I am Hridyesh Gupta, a Full Stack Developer at Infosys Limited with strong expertise in Devops and maintainin... [15:17:22] (03open) 10keerthan16: Refactor tool details page UI for cleaner layout and better graph display [toolforge-repos/tool-watch] - 10https://gitlab.wikimedia.org/toolforge-repos/tool-watch/-/merge_requests/3 [15:30:42] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11551214 (10Hridyesh_Gupta) Hello @Nokib_Sarkar , there is no such repo named campwiz-nxt-frontend2 in Open-Knowledge-Impact-Foundation. Only campwiz-nxt and campwiz-nxt-frontend repo is present there. Am I expected t... [15:37:39] (03open) 10r4356th: Add a corresponding text color when background-color inline style rule exists [toolforge-repos/redminbot] - 10https://gitlab.wikimedia.org/toolforge-repos/redminbot/-/merge_requests/2 [15:38:21] 10Cloud-VPS (Quota-requests): Increase quota for wikiqlever - https://phabricator.wikimedia.org/T414983#11551230 (10Physikerwelt) Please also delete the current vm and disk as I can not do it myself (it seems I have insufficient permissions for that). [16:07:44] 10superset.wmcloud.org, 07Upstream: Misplaced HTML tags on Superset welcome page cause rendering an empty page - https://phabricator.wikimedia.org/T337563#11551243 (10TheDJ) Upstream said it was fixed in current, but it doesn't seem like it to me. [16:17:22] (03update) 10r4356th: Add a corresponding text color when background-color inline style rule exists [toolforge-repos/redminbot] - 10https://gitlab.wikimedia.org/toolforge-repos/redminbot/-/merge_requests/2 [16:20:59] (03update) 10r4356th: Add a corresponding text color when background-color inline style rule exists [toolforge-repos/redminbot] - 10https://gitlab.wikimedia.org/toolforge-repos/redminbot/-/merge_requests/2 [16:23:21] (03merge) 10r4356th: Add a corresponding text color when background-color inline style rule exists [toolforge-repos/redminbot] - 10https://gitlab.wikimedia.org/toolforge-repos/redminbot/-/merge_requests/2 [16:47:50] (03open) 10keerthan16: Profile page UI update [toolforge-repos/tool-watch] - 10https://gitlab.wikimedia.org/toolforge-repos/tool-watch/-/merge_requests/4 [16:48:46] 06cloud-services-team, 10Cloud-VPS, 07Upstream: Designate/pdns breaks at semicolons in DNS record TXT values - https://phabricator.wikimedia.org/T203036#11551300 (10TheDJ) A fix upstream was proposed, approved, but not yet merged: https://review.opendev.org/c/openstack/designate/+/965776 [16:54:27] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11551301 (10Tiven2240) @Hridyesh_Gupta kindly check now. [17:13:17] FIRING: JobUnavailable: Reduced availability for job rabbitmq in cloud@eqiad - https://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_job_unavailable - https://grafana.wikimedia.org/d/NEJu05xZz/prometheus-targets - https://alerts.wikimedia.org/?q=alertname%3DJobUnavailable [17:14:38] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for all services [17:17:22] FIRING: [7x] HAProxyBackendUnavailable: HAProxy service glance-api_backend backend cloudcontrol1006.private.eqiad.wikimedia.cloud is DOWN - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [17:18:17] RESOLVED: JobUnavailable: Reduced availability for job rabbitmq in cloud@eqiad - https://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_job_unavailable - https://grafana.wikimedia.org/d/NEJu05xZz/prometheus-targets - https://alerts.wikimedia.org/?q=alertname%3DJobUnavailable [17:18:56] FIRING: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [17:21:57] 06cloud-services-team, 10Horizon, 07Upstream: Designate DNS TXT records max length is 255 chars (Horizon reports vague "Error: Unable to create the record set.") - https://phabricator.wikimedia.org/T203035#11551311 (10TheDJ) Fixed in openstack/designate 12.1.0, openstack/designate 13.0.1, openstack/designate 14 [17:22:22] RESOLVED: [7x] HAProxyBackendUnavailable: HAProxy service glance-api_backend backend cloudcontrol1006.private.eqiad.wikimedia.cloud is DOWN - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [17:28:39] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment eqiad1 for all services [17:31:12] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11551314 (10Hridyesh_Gupta) Thank you @Tiven2240! Now it's present there. [17:43:56] RESOLVED: SystemdUnitDown: The service unit prometheus-node-textfile-wmcs-dnsleaks.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [19:18:11] 10Tool-bridgebot: Investigate switching to the matterbridge-org/matterbridge fork - https://phabricator.wikimedia.org/T415313#11551375 (10LucasWerkmeister) I guess the way to test this would be to deploy the new build, test it in the `matrix-telegram-test` gateway, and be ready to quickly restore the previous im... [20:04:27] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#11551384 (10Hridyesh_Gupta) Hello @Nokib_Sarkar and @Tiven2240, I'm setting up the frontend of the source repo but the NEXT_BASE_URL in .env.example (https://campwiz-backend-dev.toolforge.org) seems to be returning a... [22:44:11] (03open) 10vriaa: fix: Correct casing of SidebarGroup filename [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/30 [22:48:20] (03merge) 10vriaa: fix: Correct casing of SidebarGroup filename [toolforge-repos/centralnotice-banner-editor] - 10https://gitlab.wikimedia.org/toolforge-repos/centralnotice-banner-editor/-/merge_requests/30