[00:01:06] (03approved) 10raymond-ndibe: [toolforge,tool_handlers] replace destination_name comparisons with image_name [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/115 (https://phabricator.wikimedia.org/T395076) [00:02:14] (03merge) 10raymond-ndibe: [toolforge,tool_handlers] replace destination_name comparisons with image_name [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/115 (https://phabricator.wikimedia.org/T395076) [00:05:54] (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: components-api: bump to 0.0.170-20251021000227-485a8fbc [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1003 (https://phabricator.wikimedia.org/T395076) [00:06:18] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api [00:07:51] (03update) 10raymond-ndibe: [toolforge_deploy_mr.py] support deploy of MRs from external contributors [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/273 (https://phabricator.wikimedia.org/T394595) [00:11:18] !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [00:14:23] !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-api [00:19:35] !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [00:29:39] (03PS4) 10Pppery: Don't trigger on reopens [labs/tools/github-pr-closer] - 10https://gerrit.wikimedia.org/r/1079048 (https://phabricator.wikimedia.org/T374157) [00:30:05] (03update) 10raymond-ndibe: components-api: bump to 0.0.170-20251021000227-485a8fbc [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1003 (https://phabricator.wikimedia.org/T395076) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [00:30:06] (03approved) 10raymond-ndibe: components-api: bump to 0.0.170-20251021000227-485a8fbc [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1003 (https://phabricator.wikimedia.org/T395076) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [00:30:13] (03merge) 10raymond-ndibe: components-api: bump to 0.0.170-20251021000227-485a8fbc [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1003 (https://phabricator.wikimedia.org/T395076) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [00:44:27] (03update) 10raymond-ndibe: [toolforge_deploy_mr.py] support deploy of MRs from external contributors [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/273 (https://phabricator.wikimedia.org/T394595) [00:45:06] (03update) 10raymond-ndibe: [toolforge_deploy_mr.py] support deploy of MRs from external contributors [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/273 (https://phabricator.wikimedia.org/T394595) [00:48:58] (03update) 10raymond-ndibe: [DO NOT MERGE] testing gitlab ci changes [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/213 [00:54:28] (03open) 10samwilson: Remove non-existant Vector config vars [toolforge-repos/wikispore-config] - 10https://gitlab.wikimedia.org/toolforge-repos/wikispore-config/-/merge_requests/4 [00:55:24] (03update) 10raymond-ndibe: [toolforge_deploy_mr.py] support deploy of MRs from external contributors [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/273 (https://phabricator.wikimedia.org/T394595) [00:57:39] (03merge) 10samwilson: Remove non-existant Vector config vars [toolforge-repos/wikispore-config] - 10https://gitlab.wikimedia.org/toolforge-repos/wikispore-config/-/merge_requests/4 [00:57:59] (03update) 10raymond-ndibe: [helm image publish]: publish to reggie repo if PR owner not repo owner [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/61 (https://phabricator.wikimedia.org/T394595) [01:04:19] (03update) 10raymond-ndibe: [helm image publish]: publish to reggie repo if PR owner not repo owner [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/61 (https://phabricator.wikimedia.org/T394595) [01:06:02] (03approved) 10raymond-ndibe: [helm image publish]: publish to reggie repo if PR owner not repo owner [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/61 (https://phabricator.wikimedia.org/T394595) [01:06:03] (03update) 10raymond-ndibe: [helm image publish]: publish to reggie repo if PR owner not repo owner [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/61 (https://phabricator.wikimedia.org/T394595) [01:07:41] (03update) 10raymond-ndibe: [helm image publish]: publish to reggie repo if PR owner not repo owner [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/61 (https://phabricator.wikimedia.org/T394595) [01:07:54] (03merge) 10raymond-ndibe: [helm image publish]: publish to reggie repo if PR owner not repo owner [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/61 (https://phabricator.wikimedia.org/T394595) [01:09:18] (03approved) 10raymond-ndibe: [toolforge_deploy_mr.py] support deploy of MRs from external contributors [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/273 (https://phabricator.wikimedia.org/T394595) [01:09:33] (03merge) 10raymond-ndibe: [toolforge_deploy_mr.py] support deploy of MRs from external contributors [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/273 (https://phabricator.wikimedia.org/T394595) [01:10:35] 06cloud-services-team (FY2025/26-Q1), 10Toolforge (Toolforge iteration 24), 13Patch-For-Review: [cicd] create cicd flow for non repo owners - https://phabricator.wikimedia.org/T394595#11292147 (10Raymond_Ndibe) [01:10:46] 06cloud-services-team (FY2025/26-Q1), 10Toolforge (Toolforge iteration 24), 13Patch-For-Review: [cicd] create cicd flow for non repo owners - https://phabricator.wikimedia.org/T394595#11292149 (10Raymond_Ndibe) 05In progress→03Resolved [01:11:41] 10Toolforge (Toolforge iteration 24), 13Patch-For-Review: [components-api] exclude defaults when getting deployment - https://phabricator.wikimedia.org/T401648#11292153 (10Raymond_Ndibe) 05In progress→03Resolved [01:14:12] (03close) 10raymond-ndibe: [DO NOT MERGE] testing gitlab ci changes [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/213 [01:26:16] 10Toolforge (Toolforge iteration 24): alloy failing in macos lima-kilo - https://phabricator.wikimedia.org/T407822 (10Raymond_Ndibe) 03NEW [01:31:04] (03update) 10raymond-ndibe: helpers: add a script to easily deploy from the code [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/285 (owner: 10dcaro) [01:43:55] (03update) 10raymond-ndibe: helpers: add a script to easily deploy from the code [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/285 (owner: 10dcaro) [02:38:35] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [02:39:27] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30031 bytes in 1.772 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [02:51:50] (03open) 10raymond-ndibe: [jobs.py] breakup get_tags_in_use_by_toolforge_deploy gitlab querying into chunks [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/54 (https://phabricator.wikimedia.org/T407496) [02:57:08] (03update) 10raymond-ndibe: [jobs.py] breakup get_tags_in_use_by_toolforge_deploy gitlab querying into chunks [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/54 (https://phabricator.wikimedia.org/T407496) [02:57:59] 10Toolforge (Toolforge iteration 24), 13Patch-For-Review: [maintain-harbor] Failing to cleanup stale artifacts - https://phabricator.wikimedia.org/T407496#11292222 (10Raymond_Ndibe) 05Open→03In progress [06:04:35] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [06:09:33] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30031 bytes in 8.613 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [06:13:35] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [06:14:29] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30031 bytes in 3.520 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [06:45:20] 06cloud-services-team, 10Toolforge: Intermittent redis connection timeouts in Toolforge - https://phabricator.wikimedia.org/T318479#11292468 (10fgiunchedi) Is this still happening? I suspect the problem was related to k8s workers periodically renewing their DHCP lease and briefly losing the network. See also {... [06:53:30] (03update) 10taavi: Allocate floating IP to HAProxy service VIP [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/94 (https://phabricator.wikimedia.org/T283948) [06:53:36] (03update) 10taavi: Allow inbound HTTPS traffic to HAProxy service VIP [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/95 (https://phabricator.wikimedia.org/T283948) [07:52:50] FIRING: [3x] ProbeDown: Service tools-k8s-haproxy-7:443 has failed probes (http_admin_toolforge_org_ip4) - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [07:53:18] PROBLEM - toolschecker: NFS read/writeable on labs instances on checker.tools.wmflabs.org is CRITICAL: HTTP CRITICAL: HTTP/1.1 504 Gateway Time-out - string OK not found on http://checker.tools.wmflabs.org:80/nfs/home - 324 bytes in 60.021 second response time https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker [07:53:20] RECOVERY - toolschecker: NFS read/writeable on labs instances on checker.tools.wmflabs.org is OK: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.006 second response time https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker [07:57:50] RESOLVED: [3x] ProbeDown: Service tools-k8s-haproxy-7:443 has failed probes (http_admin_toolforge_org_ip4) - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:01:25] 10Cloud-VPS (Quota-requests), 10Catalyst: Quota increase request for project catalyst - https://phabricator.wikimedia.org/T407733#11292639 (10jnuche) Thank you! [08:18:23] (03update) 10dcaro: tofu-provisioning: introduce gitlab CI/CD based workflow [repos/cloud/metricsinfra/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/metricsinfra/tofu-provisioning/-/merge_requests/2 (owner: 10aborrero) [08:18:30] (03update) 10dcaro: maintain-kubeusers: add logic to drop access to deleted admins [repos/cloud/toolforge/maintain-kubeusers] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-kubeusers/-/merge_requests/71 (https://phabricator.wikimedia.org/T394786) (owner: 10aborrero) [08:22:29] 06cloud-services-team, 10Cloud-VPS: metricsinfra-thanos-fe-2 Puppet failure - https://phabricator.wikimedia.org/T407837 (10taavi) 03NEW [08:35:25] (03update) 10miiswom: Draft: Proof of concept: Add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/131 [08:44:53] (03update) 10miiswom: Draft: Proof of concept: Add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/131 [09:02:23] 06cloud-services-team, 10Toolforge: Intermittent redis connection timeouts in Toolforge - https://phabricator.wikimedia.org/T318479#11292839 (10fnegri) 05Open→03Resolved a:03fnegri Interesting theory. I checked the error logs for the same two tools I had checked back in March (https://phabricator.wik... [09:19:47] (03update) 10bahago: Feature/add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/127 [10:59:59] 10VPS-project-Phabricator, 10Bitu, 06collaboration-services, 06Infrastructure-Foundations, 13Patch-For-Review: Allow Bitu to link Phabricator account - https://phabricator.wikimedia.org/T406495#11293245 (10SLyngshede-WMF) 05Open→03In progress [11:07:45] 10Tool-wsindex, 10Wikisource Reader App: Add an option to sort list of books alphabetically - https://phabricator.wikimedia.org/T407311#11293269 (10System625) >>! In T407311#11290047, @Bodhisattwa wrote: > @System625 , thanks for the PR. Its a festive season in India and we are celebrating [[ https://en.wikip... [11:21:23] 10Tool-paulina, 10Outreachy (Round 31): Outreachy 31: Features to edit author and work data on Wikidata directly from Paulina - https://phabricator.wikimedia.org/T392429#11293297 (10Kimbrene-kakande) @Nat_WDU . could you please look into the MR request i made on footer responsiveness. I know your prolly busy t... [11:22:23] (03open) 10volans: deployment: exclude loki-tracing namespace [repos/cloud/toolforge/registry-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/registry-admission/-/merge_requests/31 [11:40:54] 10Toolforge (Toolforge iteration 24): alloy failing in macos lima-kilo - https://phabricator.wikimedia.org/T407822#11293350 (10dcaro) Yep, that's my fault, I deployed the loki stuff manually, not using the MR as it required tweaking, so I missed this, the comments should use `//` inestad of `#`, fixing [11:43:22] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component logging [11:44:25] (03open) 10dcaro: loki: use // for comments [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1004 [11:45:02] (03approved) 10dcaro: loki: use // for comments [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1004 [11:45:09] (03merge) 10dcaro: loki: use // for comments [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1004 [11:48:13] !log dcaro@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logging [11:48:24] 10Toolforge (Toolforge iteration 24): alloy failing in macos lima-kilo - https://phabricator.wikimedia.org/T407822#11293361 (10dcaro) 05Open→03Resolved a:03dcaro Fixed in https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1004 [12:30:46] (03close) 10volans: deployment: exclude loki-tracing namespace [repos/cloud/toolforge/registry-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/registry-admission/-/merge_requests/31 [12:59:41] 10Toolforge (Toolforge iteration 24): [infra,logging] prometheus failing to fetch the metrics endpoint - https://phabricator.wikimedia.org/T407852 (10dcaro) 03NEW [13:05:40] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Persistence, and 3 others: Set up x1 replication to Wiki Replicas - https://phabricator.wikimedia.org/T395881#11293564 (10Gehel) p:05Triage→03Medium [13:32:37] (03update) 10miiswom: Draft: Proof of concept: Add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/131 [14:01:08] (03approved) 10filippo: Allocate floating IP to HAProxy service VIP [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/94 (https://phabricator.wikimedia.org/T283948) (owner: 10taavi) [14:01:27] (03approved) 10filippo: Allow inbound HTTPS traffic to HAProxy service VIP [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/95 (https://phabricator.wikimedia.org/T283948) (owner: 10taavi) [14:06:30] (03update) 10miiswom: Draft: Proof of concept: Add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/131 [14:08:09] (03merge) 10taavi: Allocate floating IP to HAProxy service VIP [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/94 (https://phabricator.wikimedia.org/T283948) [14:08:10] (03update) 10taavi: Allow inbound HTTPS traffic to HAProxy service VIP [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/95 (https://phabricator.wikimedia.org/T283948) [14:17:07] (03update) 10taavi: Allow inbound HTTPS traffic to HAProxy service VIP [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/95 (https://phabricator.wikimedia.org/T283948) [14:17:08] (03update) 10taavi: toolsbeta: Point web traffic to HAProxy directly [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/96 (https://phabricator.wikimedia.org/T283948) [14:18:44] (03merge) 10taavi: Allow inbound HTTPS traffic to HAProxy service VIP [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/95 (https://phabricator.wikimedia.org/T283948) [14:18:46] (03update) 10taavi: toolsbeta: Point web traffic to HAProxy directly [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/96 (https://phabricator.wikimedia.org/T283948) [14:27:17] (03update) 10taavi: toolsbeta: Point web traffic to HAProxy directly [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/96 (https://phabricator.wikimedia.org/T283948) [15:05:42] (03update) 10damian: Draft: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 (https://phabricator.wikimedia.org/T403322) [15:09:22] (03update) 10damian: Draft: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 (https://phabricator.wikimedia.org/T403322) [15:10:18] (03update) 10miiswom: Draft: Proof of concept: Add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/131 [15:11:07] (03update) 10damian: Draft: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 (https://phabricator.wikimedia.org/T403322) [15:11:36] (03update) 10damian: Draft: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 (https://phabricator.wikimedia.org/T403322) [15:21:47] (03update) 10damian: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 (https://phabricator.wikimedia.org/T403322) [15:22:16] (03update) 10damian: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 (https://phabricator.wikimedia.org/T403322) [15:32:49] (03update) 10bahago: Feature/add author form [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/127 [15:37:26] (03update) 10bahago: Feature/add work [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/130 [15:37:35] (03update) 10dipanshu1223: T406989: Add dropdown to populate empty biography fields with input [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/50 [15:41:00] (03update) 10taavi: toolsbeta: Point web traffic to HAProxy directly [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/96 (https://phabricator.wikimedia.org/T283948) [15:41:01] (03update) 10taavi: tools: Point web traffic to HAProxy directly [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/97 (https://phabricator.wikimedia.org/T283948) [15:41:02] (03open) 10taavi: tools: Point web traffic to HAProxy directly [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/97 (https://phabricator.wikimedia.org/T283948) [15:41:06] (03update) 10taavi: tools: Point web traffic to HAProxy directly [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/97 (https://phabricator.wikimedia.org/T283948) [15:43:17] FIRING: JobUnavailable: Reduced availability for job maintain_dbusers_eqiad in cloud@eqiad - https://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_job_unavailable - https://grafana.wikimedia.org/d/NEJu05xZz/prometheus-targets - https://alerts.wikimedia.org/?q=alertname%3DJobUnavailable [15:43:23] 06cloud-services-team: JobUnavailable Reduced availability for job maintain_dbusers_eqiad in cloud@eqiad - https://phabricator.wikimedia.org/T407868 (10phaultfinder) 03NEW [15:47:44] !log filippo@cloudcumin1001 admin START - Cookbook wmcs.ceph.osd.undrain_node (T405478) [15:47:51] T405478: Experiment with cloudcephosd1050 and cloudcephosd1051 in single-nic configuration - https://phabricator.wikimedia.org/T405478 [15:48:56] FIRING: SystemdUnitDown: The service unit maintain-dbusers.service is in failed status on host cloudcontrol1007. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1007 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [15:51:24] (03update) 10aradhya: Proof of concept for adding new statements( T406989) [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/80