[01:56:36] (03update) 10aradhya: hide work data fields when they have no value (T406994) [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/73 [01:57:08] (03update) 10aradhya: Minor improvements to the country page (T405385) [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/46 [02:31:47] (03update) 10raymond-ndibe: loki.alloy: don't drop logs and increase rate limit [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/997 (owner: 10dcaro) [02:50:54] (03update) 10dipanshu1223: T397554: Add Wikidata Query Service link to works list [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/66 [02:53:02] (03update) 10raymond-ndibe: [jobs-api] refactor quota models [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/164 (https://phabricator.wikimedia.org/T389118) [02:59:07] (03update) 10dipanshu1223: T397554: Add Wikidata Query Service link to works list [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/66 [02:59:48] 10Tool-paulina: At an author's list of works, show a link to the SPARQL query at the Wikidata Query Service - https://phabricator.wikimedia.org/T397554#11270052 (10Dipanshu1223) hi @Nat_WDU i made some changes related this issue:-https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/66 changes ma... [03:02:54] (03update) 10dipanshu1223: T397554: Add Wikidata Query Service link to works list [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/66 [03:10:50] (03update) 10dipanshu1223: T397554: Add Wikidata Query Service link to works list [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/66 [03:55:57] (03update) 10dipanshu1223: T406994:Hide detail fields with "Unknown" values dynamically [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/59 [03:59:14] (03update) 10dipanshu1223: T406994:Hide detail fields with "Unknown" values dynamically [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/59 [04:06:40] 10Tool-paulina: Hide work data fields when they have no value - https://phabricator.wikimedia.org/T406994#11270083 (10Dipanshu1223) hi @Pepe_piton, I made some updates to improve handling of unknown values:https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/59- Changes: - Added data-unknown... [04:30:45] (03update) 10raymond-ndibe: [status] make job status an enum, with clearly defined states [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/208 (https://phabricator.wikimedia.org/T401172) [04:39:29] (03update) 10raymond-ndibe: [jobs-api] refactor quota models [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/164 (https://phabricator.wikimedia.org/T389118) [05:00:29] (03update) 10raymond-ndibe: [status] make job status an enum, with clearly defined states [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/208 (https://phabricator.wikimedia.org/T401172) [05:19:50] 06cloud-services-team, 10Quarry: Create simple admin management tool - https://phabricator.wikimedia.org/T224376#11270142 (10Aklapper) p:05Medium→03Low a:05Framawiki→03None [05:56:54] 06cloud-services-team, 10Quarry: Have an easy way to ban users from Quarry - https://phabricator.wikimedia.org/T104322#11270244 (10Agamyasamuel) [06:01:21] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [labs/tools/map-of-monuments] - 10https://gerrit.wikimedia.org/r/1195669 (owner: 10L10n-bot) [06:32:50] 06cloud-services-team, 10Cloud-VPS, 10Countervandalism-Network: Puppet failure on cvn-nfs-1 - https://phabricator.wikimedia.org/T407151#11270296 (10fgiunchedi) 05Open→03Resolved a:03fgiunchedi Indeed, that's my bad; I must have missed this host while working on {T347681}! Fixed now, for the record... [06:45:30] RESOLVED: PuppetAgentFailure: Puppet agent failure detected on instance cvn-nfs-1 in project cvn - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [08:10:11] (03update) 10oluwatumininu: Hide empty data fields on work page [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/48 [08:16:16] 10Tool-paulina: Hide work data fields when they have no value - https://phabricator.wikimedia.org/T406994#11270558 (10Oluwatumininu.m) > @Oluwatumininu.m I tried your contribution but I couldn't make it work as you provided here: https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/48/diffs > I... [08:42:23] (03update) 10damian: update deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/220 (https://phabricator.wikimedia.org/T403321) [08:42:36] (03update) 10damian: update deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/220 (https://phabricator.wikimedia.org/T403321) [08:44:26] (03update) 10damian: restart deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/218 [08:45:59] (03update) 10dcaro: loki.alloy: don't drop logs and increase rate limit [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/997 [08:52:06] (03update) 10miiswom: Add Wikidata and Wikimedia Commons links to work page [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/77 [08:59:57] (03update) 10damian: restart deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/218 [09:01:27] (03update) 10miiswom: Hide work data fields when they have no value [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/69 [09:06:01] (03update) 10miiswom: Hide work data fields when they have no value [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/69 [09:07:49] 10Tool-paulina: Hide work data fields when they have no value - https://phabricator.wikimedia.org/T406994#11270828 (10Miiswom) Good morning everyone, @Pepe_piton: I have just moved the `if` statements so that they wrap around the `div.detail-item` (instead of having them inside the `div`). Here my the updated... [09:10:43] (03update) 10damian: Expand `source` support in `ToolConfig` [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/132 (https://phabricator.wikimedia.org/T402764) [09:11:59] (03update) 10miiswom: Add Wikidata and Wikimedia Commons links to work page [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/77 [09:20:37] (03update) 10miiswom: Add Wikidata and Wikimedia Commons links to work page [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/77 [09:27:06] (03update) 10miiswom: Add Wikidata and Wikimedia Commons links to work page [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/77 [09:28:01] (03open) 10system625: feat: Display copyright term descriptions on term pages [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/79 [09:29:02] 10Tool-paulina: Improvements to the copyright term page: term description - https://phabricator.wikimedia.org/T405598#11270904 (10System625) Hello @Nat_WDU I have made a merge request concerning this issue: https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/79 Please kindly review [09:35:28] FIRING: WidespreadPuppetAgentFailure: Widespread puppet agent failures in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DWidespreadPuppetAgentFailure [09:40:52] (03update) 10damian: restart deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/218 [09:55:35] (03approved) 10dcaro: global: update generated toolforge models [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/140 [09:55:41] (03merge) 10dcaro: global: update generated toolforge models [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/140 [09:55:47] (03update) 10dcaro: [toolforge,tool_handlers] replace destination_name comparisons with image_name [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/115 (https://phabricator.wikimedia.org/T395076) (owner: 10raymond-ndibe) [09:55:52] (03update) 10dcaro: [tool-config] handle unset and default arguments consistently [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572) (owner: 10raymond-ndibe) [09:56:32] (03open) 10volans: shared: add loki-tracing S3 buckets [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/92 [09:58:36] (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: components-api: bump to 0.0.167-20251014095556-7d53b7f1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/998 [10:02:32] (03update) 10taavi: tofu-provisioning: use trixie base image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/71 (https://phabricator.wikimedia.org/T405742) (owner: 10fnegri) [10:02:35] (03approved) 10taavi: tofu-provisioning: use trixie base image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/71 (https://phabricator.wikimedia.org/T405742) (owner: 10fnegri) [10:02:39] (03update) 10dcaro: [tool-config] handle unset and default arguments consistently [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572) (owner: 10raymond-ndibe) [10:02:46] (03update) 10dcaro: [tool-config] handle unset and default arguments consistently [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572) (owner: 10raymond-ndibe) [10:03:11] (03merge) 10fnegri: tofu-provisioning: use trixie base image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/71 (https://phabricator.wikimedia.org/T405742) [10:03:28] FIRING: PuppetAgentFailure: Puppet agent failure detected on instance metricsinfra-prometheus-3 in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:07:28] FIRING: PuppetAgentFailure: Puppet agent failure detected on instance extdist-06 in project extdist - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:08:28] FIRING: [2x] PuppetAgentFailure: Puppet agent failure detected on instance metricsinfra-controller-2 in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:13:28] FIRING: [4x] PuppetAgentFailure: Puppet agent failure detected on instance metricsinfra-alertmanager-2 in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:18:28] FIRING: [4x] PuppetAgentFailure: Puppet agent failure detected on instance metricsinfra-alertmanager-2 in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:19:26] (03update) 10damian: allow restarting job during patch [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/221 (https://phabricator.wikimedia.org/T403321) [10:21:13] (03update) 10damian: allow restarting job during patch [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/221 (https://phabricator.wikimedia.org/T403321) [10:23:28] FIRING: [4x] PuppetAgentFailure: Puppet agent failure detected on instance metricsinfra-alertmanager-2 in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:30:10] (03update) 10damian: Expand `source` support in `ToolConfig` [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/132 (https://phabricator.wikimedia.org/T402764) [10:33:44] (03update) 10damian: Expand `source` support in `ToolConfig` [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/132 (https://phabricator.wikimedia.org/T402764) [10:33:48] FIRING: PuppetFailure: Puppet has failed on an-redacteddb1001:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [10:33:58] 06cloud-services-team: PuppetFailure Puppet has failed on an-redacteddb1001:9100 - https://phabricator.wikimedia.org/T407201 (10phaultfinder) 03NEW [10:34:16] (03update) 10dcaro: [jobs-api] save business models in a DB [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/114 (owner: 10raymond-ndibe) [10:38:12] (03update) 10damian: offload job restart logic to jobs-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/133 (https://phabricator.wikimedia.org/T403321) [10:38:47] (03close) 10damian: Use image name from builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/134 (https://phabricator.wikimedia.org/T403322) [10:39:02] (03update) 10damian: _do_run - retry runtime errors [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/139 (https://phabricator.wikimedia.org/T403175) [10:42:39] (03open) 10aradhya: Proof of concept for adding new statements( T406989) [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/80 [10:43:01] (03update) 10aradhya: Proof of concept for adding new statements( T406989) [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/80 [10:43:48] FIRING: PuppetFailure: Puppet has failed on cloudcumin1001:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [10:43:56] 06cloud-services-team: PuppetFailure Puppet has failed on cloudcumin1001:9100 - https://phabricator.wikimedia.org/T407204 (10phaultfinder) 03NEW [10:43:57] RESOLVED: PuppetFailure: Puppet has failed on an-redacteddb1001:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [10:46:16] (03PS1) 10Majavah: inventory: Refresh cloudgw hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196009 [10:48:27] 10Tool-paulina: Proof of concept for adding new statements - https://phabricator.wikimedia.org/T406989#11271275 (10Aradhya05) Hello @Pepe_piton @Nat_WDU, i have completed the task and submitted merge request : https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/80 Kindly review it. Thank you [10:48:28] FIRING: [3x] PuppetAgentFailure: Puppet agent failure detected on instance metricsinfra-alertmanager-2 in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:52:28] RESOLVED: PuppetAgentFailure: Puppet agent failure detected on instance extdist-06 in project extdist - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:53:48] RESOLVED: PuppetFailure: Puppet has failed on cloudcumin1001:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [10:58:28] FIRING: [3x] PuppetAgentFailure: Puppet agent failure detected on instance metricsinfra-alertmanager-2 in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [10:59:34] (03update) 10fnegri: Update OpenStack provider [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/91 [10:59:37] (03CR) 10Majavah: "recheck" [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196007 (owner: 10Majavah) [10:59:42] (03CR) 10Majavah: "recheck" [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196009 (owner: 10Majavah) [11:00:01] 10Toolforge, 06Infrastructure-Foundations, 10netops, 06tools-infrastructure-team: Plan networking for Toolforge-on-Metal experiment - https://phabricator.wikimedia.org/T407140#11271308 (10cmooney) >>! In T407140#11269245, @cmooney wrote: >> I assume (but have not yet checked that) the K8s CNI used (Calico?... [11:01:58] RESOLVED: WidespreadPuppetAgentFailure: Widespread puppet agent failures in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DWidespreadPuppetAgentFailure [11:02:10] 06cloud-services-team, 10Toolforge: replica.my.cnf missing for tool glamspore - https://phabricator.wikimedia.org/T407206 (10Samwilson) 03NEW [11:02:27] 06cloud-services-team, 10Toolforge: replica.my.cnf missing for tool glamspore - https://phabricator.wikimedia.org/T407206#11271326 (10Samwilson) [11:02:51] (03open) 10fnegri: tofu-provisioning: use new docker image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/72 (https://phabricator.wikimedia.org/T405742) [11:03:28] RESOLVED: [3x] PuppetAgentFailure: Puppet agent failure detected on instance metricsinfra-alertmanager-2 in project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [11:03:50] (03approved) 10taavi: tofu-provisioning: use new docker image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/72 (https://phabricator.wikimedia.org/T405742) (owner: 10fnegri) [11:04:23] (03merge) 10fnegri: tofu-provisioning: use new docker image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/72 (https://phabricator.wikimedia.org/T405742) [11:04:49] 06cloud-services-team, 10Toolforge: replica.my.cnf missing for tool glamspore - https://phabricator.wikimedia.org/T407206#11271335 (10taavi) ` Oct 14 11:03:58 cloudcontrol1007 maintain-dbusers[2931113]: ERROR [root.inner:173] Request to create replica.my.cnf file for account_type tool and account_id tools.glam... [11:10:14] (03update) 10fnegri: Update OpenStack provider [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/91 [11:17:20] (03PS1) 10Majavah: openstack: cloudweb: Add cookbook to batch reboot hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196017 [11:19:04] (03update) 10lebogang: T406950: add Wikimedia Commons link support to work pages [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/67 [11:19:18] (03PS2) 10Majavah: openstack: cloudweb: Add cookbook to batch reboot hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196017 [11:19:59] (03PS3) 10Majavah: openstack: cloudweb: Add cookbook to batch reboot hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196017 [11:20:28] !log taavi@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudweb.safe_reboot on hosts matched by 'P{O:wmcs::openstack::eqiad1::cloudweb}' [11:23:47] (03CR) 10CI reject: [V:04-1] openstack: cloudweb: Add cookbook to batch reboot hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196017 (owner: 10Majavah) [11:24:52] (03PS4) 10Majavah: openstack: cloudweb: Add cookbook to batch reboot hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196017 [11:26:42] (03open) 10system625: feat: Add SPARQL query link to author's works list page [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/81 [11:26:54] !log taavi@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.cloudweb.safe_reboot (exit_code=0) on hosts matched by 'P{O:wmcs::openstack::eqiad1::cloudweb}' [11:27:34] 10Tool-paulina: At an author's list of works, show a link to the SPARQL query at the Wikidata Query Service - https://phabricator.wikimedia.org/T397554#11271438 (10System625) Hello @Nat_WDU I made a merge request concerning this issue: https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/81 Ple... [11:28:34] (03CR) 10CI reject: [V:04-1] openstack: cloudweb: Add cookbook to batch reboot hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196017 (owner: 10Majavah) [11:30:20] (03PS5) 10Majavah: openstack: cloudweb: Add cookbook to batch reboot hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196017 [11:30:39] (03update) 10lebogang: T405598: Add copyright term description paragraph [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/37 [11:31:12] 06cloud-services-team: Do not page via Icinga for individual cloudweb hosts being down - https://phabricator.wikimedia.org/T407208 (10taavi) 03NEW [11:35:13] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api [11:40:47] 06cloud-services-team, 10Horizon, 10Striker, 13Patch-For-Review: Do not page via Icinga for individual cloudweb hosts being down - https://phabricator.wikimedia.org/T407208#11271499 (10taavi) p:05Triage→03High {T331197} disabled paging on the service level entirely since those were getting routed to th... [11:40:51] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [11:46:34] 06cloud-services-team, 10Toolforge: tools-static tries to use ipv6 when proxying to downstream hosts - https://phabricator.wikimedia.org/T212871#11271526 (10taavi) 05Open→03Resolved a:03taavi [11:47:25] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-api [11:52:39] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [11:54:16] 06cloud-services-team, 10Toolforge: replica.my.cnf missing for tool glamspore - https://phabricator.wikimedia.org/T407206#11271553 (10fgiunchedi) 05Open→03Resolved a:03fgiunchedi Apologies for the breakage, which is related to the work in {T404584}. I have restored the webproxies to point to tools-nf... [11:58:17] (03approved) 10dcaro: components-api: bump to 0.0.167-20251014095556-7d53b7f1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/998 (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [11:58:21] (03merge) 10dcaro: components-api: bump to 0.0.167-20251014095556-7d53b7f1 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/998 (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [11:59:29] (03approved) 10dcaro: [tool-config] handle unset and default arguments consistently [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572) (owner: 10raymond-ndibe) [12:02:44] (03update) 10dcaro: offload job restart logic to jobs-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/133 (https://phabricator.wikimedia.org/T403321) (owner: 10damian) [12:03:19] 06cloud-services-team, 10Toolforge: replica.my.cnf missing for tool glamspore - https://phabricator.wikimedia.org/T407206#11271580 (10Samwilson) Thank you both! All is well now. [12:04:55] (03open) 10fnegri: tofu-provisioning: add ca-certificates [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/73 (https://phabricator.wikimedia.org/T405742) [12:05:25] (03approved) 10taavi: tofu-provisioning: add ca-certificates [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/73 (https://phabricator.wikimedia.org/T405742) (owner: 10fnegri) [12:05:49] (03merge) 10fnegri: tofu-provisioning: add ca-certificates [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/73 (https://phabricator.wikimedia.org/T405742) [12:06:02] 10VPS-project-Phabricator, 06collaboration-services: phabricator.wmcloud.org account verification request: SomeRandomDeveloper - https://phabricator.wikimedia.org/T407211 (10SomeRandomDeveloper) 03NEW [12:10:52] (03update) 10dcaro: d/changelog: bump to 0.0.15 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/61 (https://phabricator.wikimedia.org/T400064) (owner: 10raymond-ndibe) [12:12:05] (03open) 10fnegri: tofu-provisioning: use latest docker image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/74 (https://phabricator.wikimedia.org/T405742) [12:12:39] 10Toolforge (Toolforge iteration 24): [tools,infra,k8s] scale up the cluster, specifically CPU - https://phabricator.wikimedia.org/T404726#11271668 (10dcaro) If there's no more comments, I'll start implementing the alerts and such to close this task. [12:14:05] (03approved) 10taavi: tofu-provisioning: use latest docker image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/74 (https://phabricator.wikimedia.org/T405742) (owner: 10fnegri) [12:16:16] (03merge) 10fnegri: tofu-provisioning: use latest docker image [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/74 (https://phabricator.wikimedia.org/T405742) [12:18:30] (03update) 10fnegri: Update OpenStack provider [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/91 [12:26:17] (03CR) 10Volans: [C:03+1] "LGTM" [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196007 (owner: 10Majavah) [12:30:48] (03update) 10dcaro: loki.alloy: don't drop logs and increase rate limit [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/997 [12:32:34] (03update) 10dcaro: offload job restart logic to jobs-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/133 (https://phabricator.wikimedia.org/T403321) (owner: 10damian) [12:33:17] 06cloud-services-team, 10PAWS: PAWS is unable to access CloudElastic - https://phabricator.wikimedia.org/T407216 (10taavi) 03NEW [12:34:28] (03CR) 10Majavah: [C:03+2] openstack: Fix command line flag references using underscores [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196007 (owner: 10Majavah) [12:37:09] (03update) 10dcaro: allow restarting job during patch [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/221 (https://phabricator.wikimedia.org/T403321) (owner: 10damian) [12:37:34] (03Merged) 10jenkins-bot: openstack: Fix command line flag references using underscores [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196007 (owner: 10Majavah) [12:37:54] (03update) 10dcaro: allow restarting job during patch [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/221 (https://phabricator.wikimedia.org/T403321) (owner: 10damian) [12:38:16] (03update) 10dcaro: update deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/220 (https://phabricator.wikimedia.org/T403321) (owner: 10damian) [12:38:48] (03update) 10dcaro: update deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/220 (https://phabricator.wikimedia.org/T403321) (owner: 10damian) [12:47:43] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [12:47:48] !log dcaro@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-cli [12:48:18] 06cloud-services-team, 10Data-Services: maintain-dbusers: Use cloud-private to talk to NFS servers instead of proxies - https://phabricator.wikimedia.org/T392794#11271864 (10fgiunchedi) AIUI we would need to: 1. allow port 80 access via security groups from cloudcontrol (ranges?) to nfs servers 1. swap dns na... [12:49:46] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [12:49:51] !log dcaro@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-cli [12:50:58] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [12:51:03] !log dcaro@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-cli [12:52:53] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [12:52:58] !log dcaro@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-cli [12:53:14] 06cloud-services-team, 10Data-Services: maintain-dbusers: Use cloud-private to talk to NFS servers instead of proxies - https://phabricator.wikimedia.org/T392794#11271899 (10taavi) yes. [12:54:50] (03update) 10dcaro: loki.alloy: don't drop logs and increase rate limit [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/997 [12:56:32] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [12:56:38] !log dcaro@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-cli [12:57:32] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [12:57:40] !log dcaro@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-cli [12:59:17] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [13:03:09] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli [13:04:42] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-cli [13:07:11] (03update) 10dcaro: [config] support port protocol [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/119 (https://phabricator.wikimedia.org/T401994) (owner: 10raymond-ndibe) [13:07:11] (03merge) 10dcaro: [tool-config] handle unset and default arguments consistently [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T401648 https://phabricator.wikimedia.org/T402572) (owner: 10raymond-ndibe) [13:08:35] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli [13:09:43] (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: components-api: bump to 0.0.168-20251014130725-6239a491 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/999 (https://phabricator.wikimedia.org/T402572) [13:14:05] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api [13:14:20] (03approved) 10dcaro: d/changelog: bump to 0.0.15 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/61 (https://phabricator.wikimedia.org/T400064) (owner: 10raymond-ndibe) [13:14:25] (03merge) 10dcaro: d/changelog: bump to 0.0.15 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/61 (https://phabricator.wikimedia.org/T400064) (owner: 10raymond-ndibe) [13:19:30] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [13:20:17] (03update) 10dcaro: [config] support port protocol [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/119 (https://phabricator.wikimedia.org/T401994) (owner: 10raymond-ndibe) [13:20:47] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-api [13:26:01] (03update) 10damian: update deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/220 (https://phabricator.wikimedia.org/T403321) [13:26:08] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [13:27:01] (03approved) 10dcaro: components-api: bump to 0.0.168-20251014130725-6239a491 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/999 (https://phabricator.wikimedia.org/T402572) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [13:27:08] (03merge) 10dcaro: components-api: bump to 0.0.168-20251014130725-6239a491 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/999 (https://phabricator.wikimedia.org/T402572) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [13:27:47] 10Toolforge (Toolforge iteration 24), 13Patch-For-Review: [components-api] handle non-passed arguments and defaults consistently - https://phabricator.wikimedia.org/T402572#11272192 (10dcaro) 05In progress→03Resolved [13:30:34] (03update) 10damian: _do_run - retry runtime errors [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/139 (https://phabricator.wikimedia.org/T403175) [13:30:47] (03update) 10damian: offload job restart logic to jobs-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/133 (https://phabricator.wikimedia.org/T403321) [13:42:00] (03update) 10fnegri: shared: add loki-tracing S3 buckets [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/92 (owner: 10volans) [13:49:16] (03update) 10damian: Expand `source` support in `ToolConfig` [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/132 (https://phabricator.wikimedia.org/T402764) [13:51:17] (03update) 10damian: Expand `source` support in `ToolConfig` [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/132 (https://phabricator.wikimedia.org/T402764) [13:52:59] (03update) 10damian: Expand `source` support in `ToolConfig` [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/132 (https://phabricator.wikimedia.org/T402764) [13:56:51] (03update) 10damian: Expand `source` support in `ToolConfig` [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/132 (https://phabricator.wikimedia.org/T402764) [13:59:10] (03update) 10dcaro: [config] support port protocol [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/119 (https://phabricator.wikimedia.org/T401994) (owner: 10raymond-ndibe) [14:00:23] 10Tool-paulina: Minor improvements to the country page - https://phabricator.wikimedia.org/T405385#11272384 (10Chumzine) Hello @Nat_WDU and @Pepe_piton, I trust you are both doing well. I know this task has been resolved but I would very much like to get your feedback on my work as it would mean a lot to me... [14:06:10] (03update) 10damian: allow restarting job during patch [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/221 (https://phabricator.wikimedia.org/T403321) [14:08:15] (03update) 10fnegri: shared: add loki-tracing S3 buckets [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/92 (owner: 10volans) [14:09:57] (03update) 10lebogang: T405598: Add copyright term description paragraph [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/37 [14:15:14] (03update) 10dcaro: [config] support port protocol [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/119 (https://phabricator.wikimedia.org/T401994) (owner: 10raymond-ndibe) [14:29:36] (03approved) 10dcaro: [config] support port protocol [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/119 (https://phabricator.wikimedia.org/T401994) (owner: 10raymond-ndibe) [14:29:42] (03merge) 10dcaro: [config] support port protocol [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/119 (https://phabricator.wikimedia.org/T401994) (owner: 10raymond-ndibe) [14:30:13] 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 06collaboration-services, 10GitLab (CI & Job Runners): tofu-provisioning: Failed to install provider - https://phabricator.wikimedia.org/T405742#11272529 (10fnegri) I pushed a new Trixie-based image: `docker-registry.svc.toolforge.org/tofu-provisioning:202... [14:32:05] 10Toolforge, 06Infrastructure-Foundations, 10netops, 06tools-infrastructure-team: Plan networking for Toolforge-on-Metal experiment - https://phabricator.wikimedia.org/T407140#11272555 (10Andrew) I'm pretty sure that the next step (or /a/ next step) is to convert the servers in T406630 into a ganeti cluste... [14:33:06] (03open) 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620: components-api: bump to 0.0.169-20251014142952-77be153f [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1000 (https://phabricator.wikimedia.org/T401994) [14:33:24] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api [14:38:49] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [14:42:32] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-api [14:47:54] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [14:50:11] (03update) 10raymond-ndibe: [toolforge,tool_handlers] replace destination_name comparisons with image_name [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/115 (https://phabricator.wikimedia.org/T395076) [14:51:06] 10Toolforge, 06Infrastructure-Foundations, 10netops, 06tools-infrastructure-team: Plan networking for Toolforge-on-Metal experiment - https://phabricator.wikimedia.org/T407140#11272643 (10cmooney) >>! In T407140#11272555, @Andrew wrote: > I'm pretty sure that the next step (or /a/ next step) is to convert... [15:02:01] (03approved) 10dcaro: components-api: bump to 0.0.169-20251014142952-77be153f [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1000 (https://phabricator.wikimedia.org/T401994) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [15:02:05] (03merge) 10dcaro: components-api: bump to 0.0.169-20251014142952-77be153f [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1000 (https://phabricator.wikimedia.org/T401994) (owner: 10group_203_bot_f4d95069bb2675e4ce1fff090c1c1620) [15:02:43] 10Toolforge (Toolforge iteration 24), 13Patch-For-Review: [components-api] support port protocol in config - https://phabricator.wikimedia.org/T401994#11272675 (10dcaro) 05In progress→03Resolved [15:27:21] (03update) 10dcaro: update deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/220 (https://phabricator.wikimedia.org/T403321) (owner: 10damian) [15:39:18] 10Tool-enderbot-dev, 10Phabricator: Workboard request for #tool-enderbot-dev - https://phabricator.wikimedia.org/T407251 (10Anderlaxe) 03NEW [15:43:46] 10Toolforge (Toolforge iteration 24): [components-api] support port protocol in config - https://phabricator.wikimedia.org/T401994#11272911 (10dcaro) >>! In T401994#11216684, @DamianZaremba wrote: > What is the timeline for this? > > I have 2 tools which have 1 job stuck in `jobs.yaml` rather than `componen... [15:43:57] (03update) 10damian: update deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/220 (https://phabricator.wikimedia.org/T403321) [15:44:52] (03update) 10dcaro: global: first commit [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/1 (https://phabricator.wikimedia.org/T127367) [15:45:28] (03approved) 10dcaro: [toolforge,tool_handlers] replace destination_name comparisons with image_name [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/115 (https://phabricator.wikimedia.org/T395076) (owner: 10raymond-ndibe) [15:45:38] (03update) 10dcaro: [toolforge,tool_handlers] replace destination_name comparisons with image_name [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/115 (https://phabricator.wikimedia.org/T395076) (owner: 10raymond-ndibe) [15:54:09] 10Tool-enderbot-dev, 06Project-Admins: Workboard request for #tool-enderbot-dev - https://phabricator.wikimedia.org/T407251#11272987 (10A_smart_kitten) 05Open→03Resolved a:03A_smart_kitten done :) [16:01:53] (03open) 10volans: README: add limactl command to connect to the VM [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/279 [16:03:17] 10Tool-enderbot-dev: Implement bot features for ApprovedRevs tasks - https://phabricator.wikimedia.org/T407260 (10Anderlaxe) 03NEW [16:03:39] (03approved) 10dcaro: README: add limactl command to connect to the VM [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/279 (owner: 10volans) [16:04:25] (03update) 10piracalamina: Add copyright term description to term pages above country list [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/74 (owner: 10rolalove) [16:05:18] 10Tool-enderbot-dev: Implement bot features for ApprovedRevs tasks - https://phabricator.wikimedia.org/T407260#11273078 (10Anderlaxe) p:05Triage→03Low [16:08:21] (03approved) 10piracalamina: Improvements to the copyright term page: Term Description [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/70 (owner: 10shr0x-ya) [16:08:59] (03open) 10fnegri: tofu-provisioning: fmt all files [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/75 [16:09:09] 10Tool-paulina: Improvements to the copyright term page: term description - https://phabricator.wikimedia.org/T405598#11273106 (10Lebogang) >>! In T405598#11269402, @Nat_WDU wrote: > Here's some feedback on the latest fixes and MR's: > > > @Oluwatumininu.m you got it right, thanks! > > @Lebogang and @Oluwatum... [16:15:57] (03approved) 10taavi: tofu-provisioning: fmt all files [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/75 (owner: 10fnegri) [16:18:14] (03CR) 10FNegri: [C:03+1] inventory: Refresh cloudgw hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196009 (owner: 10Majavah) [16:18:23] (03update) 10piracalamina: feat: Display copyright term descriptions on term pages [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/79 (owner: 10system625) [16:19:15] (03CR) 10Majavah: [C:03+2] inventory: Refresh cloudgw hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196009 (owner: 10Majavah) [16:19:33] 10Toolforge (Toolforge iteration 24): [components-api] support port protocol in config - https://phabricator.wikimedia.org/T401994#11273166 (10DamianZaremba) >>! In T401994#11272911, @dcaro wrote: > Should be deployed already :), let me know if you find issues. Great! I'll give it a go either later this eve... [16:25:22] 10VPS-project-Phabricator, 06collaboration-services: phabricator.wmcloud.org account verification request: SomeRandomDeveloper - https://phabricator.wikimedia.org/T407211#11273203 (10Dzahn) 05Open→03Resolved a:03Dzahn Done! Your email address has been verified. [16:27:55] 10Tool-enderbot-dev: Implement bot features for ApprovedRevs tasks - https://phabricator.wikimedia.org/T407260#11273213 (10Anderlaxe) An API action exists to individually (un)approve a single revision. A mass approval action can be done with `ApprovedRevs/maintenance/approveAllPages.php `. Will attempt to cross-... [16:28:33] (03Merged) 10jenkins-bot: inventory: Refresh cloudgw hosts [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1196009 (owner: 10Majavah) [16:28:48] 10VPS-project-Codesearch: Remove DarkVector from codesearch - https://phabricator.wikimedia.org/T407115#11273216 (10Dzahn) Is "not found at all" an advantage over "found last active version and told that it's unmaintained"? [16:33:11] 10Tool-enderbot-dev: API scenario: Scrape revIDs of unapproved pages to then use approve action repeatedly - https://phabricator.wikimedia.org/T407262 (10Anderlaxe) 03NEW [16:35:18] (03merge) 10volans: README: add limactl command to connect to the VM [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/279 [16:39:37] 06cloud-services-team (FY2025/26-Q1), 10Toolforge, 06collaboration-services, 10GitLab (CI & Job Runners): tofu-provisioning: Failed to install provider - https://phabricator.wikimedia.org/T405742#11273294 (10fnegri) I found something interesting: adding `--net=host` fixes the issue, regardless of which doc... [16:51:24] (03open) 10damian: Draft: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 [16:51:43] (03update) 10damian: Draft: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 (https://phabricator.wikimedia.org/T403322) [16:55:34] (03update) 10damian: Draft: Use the image name as provided by builds-api [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/143 (https://phabricator.wikimedia.org/T403322) [17:09:35] 10VPS-project-Phabricator, 06collaboration-services: phabricator.wmcloud.org account verification request: - https://phabricator.wikimedia.org/T407269 (10T388022) 03NEW [17:10:05] 10VPS-project-Phabricator, 06collaboration-services: phabricator.wmcloud.org account verification request: - https://phabricator.wikimedia.org/T407269#11273530 (10T388022) a:03T388022 [17:20:54] 10VPS-project-Phabricator, 06collaboration-services: phabricator.wmcloud.org account verification request: - https://phabricator.wikimedia.org/T407269#11273600 (10Pppery) a:05T388022→03None [17:21:40] 10VPS-project-Phabricator, 06collaboration-services: phabricator.wmcloud.org account verification request: - https://phabricator.wikimedia.org/T407269#11273620 (10Pppery) [17:32:57] (03open) 10dipanshu1223: T405412 "Edit field feature" [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/82 [17:35:58] 10Tool-paulina: Proof of concept for editing statements in Paulina - https://phabricator.wikimedia.org/T405412#11273745 (10Dipanshu1223) hey @Pepe_piton i made a merge request related this issue:-https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/82 changes made:- - Added pencil icon next t... [17:37:32] (03update) 10raymond-ndibe: logs: use logs-api for logs [repos/cloud/toolforge/jobs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/121 (owner: 10dcaro) [17:37:45] (03update) 10raymond-ndibe: logs-api: add new component [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/911 (owner: 10dcaro) [17:37:46] (03update) 10raymond-ndibe: logs-api: add new component [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/911 (owner: 10dcaro) [17:38:03] (03approved) 10raymond-ndibe: logs-api: add new component [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/911 (owner: 10dcaro) [17:38:44] (03update) 10raymond-ndibe: global: first commit [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/1 (https://phabricator.wikimedia.org/T127367) (owner: 10dcaro) [17:38:45] (03update) 10raymond-ndibe: global: first commit [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/1 (https://phabricator.wikimedia.org/T127367) (owner: 10dcaro) [17:38:47] (03approved) 10raymond-ndibe: global: first commit [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/1 (https://phabricator.wikimedia.org/T127367) (owner: 10dcaro) [17:39:10] (03update) 10raymond-ndibe: logs_api: add the option to enable logs-api [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/75 (owner: 10dcaro) [17:39:13] (03update) 10raymond-ndibe: logs_api: add the option to enable logs-api [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/75 (owner: 10dcaro) [17:39:18] (03approved) 10raymond-ndibe: logs_api: add the option to enable logs-api [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/75 (owner: 10dcaro) [17:39:46] (03approved) 10raymond-ndibe: logs: use logs-api for logs [repos/cloud/toolforge/jobs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/121 (owner: 10dcaro) [17:46:57] 10VPS-project-Phabricator, 06collaboration-services: phabricator.wmcloud.org account verification request:  - https://phabricator.wikimedia.org/T407269#11273799 (10Dzahn) 05Open→03Invalid [17:58:30] 10Tool-paulina: Improvements to the copyright term page: term description - https://phabricator.wikimedia.org/T405598#11273843 (10Nat_WDU) @Rolalove & @Lebogang The implementation itself is ok but your MRs include a couple of changes that roll back T405603. @shreya-bhagat Thanks a lot! conflicts are solved now... [18:01:16] (03update) 10raymond-ndibe: Change `show` command to output raw value [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/92 (https://phabricator.wikimedia.org/T405024) (owner: 10damian) [18:05:03] (03merge) 10piracalamina: Improvements to the copyright term page: Term Description [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/70 (owner: 10shr0x-ya) [18:05:39] 10Tool-paulina: Improvements to the copyright term page: term description - https://phabricator.wikimedia.org/T405598#11273864 (10Nat_WDU) 05Open→03Resolved [18:05:44] (03close) 10piracalamina: feat: add wikidata copyright description to term pages [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/15 (owner: 10rona) [18:05:52] (03close) 10piracalamina: T405598: Add copyright term description paragraph [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/37 (owner: 10lebogang) [18:06:02] (03close) 10piracalamina: Improvements to the copyright term page: term description [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/64 (owner: 10oluwatumininu) [18:06:31] (03close) 10piracalamina: Add copyright term description to term pages above country list [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/74 (owner: 10rolalove) [18:06:44] (03close) 10piracalamina: T405598:Add copyright term description paragraph on country lists pages [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/75 (owner: 10dipanshu1223) [18:06:58] (03close) 10piracalamina: feat: Display copyright term descriptions on term pages [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/79 (owner: 10system625) [18:14:27] (03close) 10piracalamina: Add updated template for country page [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/76 (owner: 10chumzine) [18:15:37] 10Tool-paulina: Minor improvements to the country page - https://phabricator.wikimedia.org/T405385#11273888 (10Nat_WDU) Hello, @Chumzine ! I've reviewed and closed your MR. The implementation was correct, you may record this as a contribution. Thanks! [18:26:00] (03update) 10oluwatumininu: Improve country dropdown for the "country of origin" filter in the advanced search for works. [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/14 [19:04:46] (03update) 10lebogang: T406950: add Wikimedia Commons link support to work pages [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/67 [19:06:02] 10Tool-paulina: Add Wikidata and Wikimedia Commons links to work page - https://phabricator.wikimedia.org/T406950#11274052 (10Lebogang) >>! In T406950#11269488, @Pepe_piton wrote: > @Lebogang Good job. You've managed to grasp the logic of the task, finding a way to add the link to Wikimedia Commons. It works wel... [19:08:18] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [19:08:20] !log andrew@cloudcumin1001 admin END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment codfw1dev for all services [19:13:41] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [19:13:43] !log andrew@cloudcumin1001 admin END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment codfw1dev for all services [19:16:17] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [19:16:19] !log andrew@cloudcumin1001 admin END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment codfw1dev for all services [19:17:12] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [19:18:22] !log andrew@cloudcumin1001 admin END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment codfw1dev for all services [19:23:15] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [19:27:29] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for all services [19:43:19] (03update) 10raymond-ndibe: [toolforge_deploy_mr.py] support deploy of MRs from external contributors [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/273 (https://phabricator.wikimedia.org/T394595) [19:46:35] 10Toolforge (Toolforge iteration 24), 13Patch-For-Review: [jobs-api] refactor models - https://phabricator.wikimedia.org/T389118#11274240 (10Raymond_Ndibe) 05In progress→03Resolved [19:59:34] (03open) 10shr0x-ya: T406989: Proof of concept for adding new statements [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/83 [20:04:29] (03update) 10shr0x-ya: T406989: Proof of concept for adding new statements [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/83 [20:07:50] (03update) 10lebogang: T406950: add Wikimedia Commons link support to work pages [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/67 [20:08:43] (03update) 10shr0x-ya: T406989: Proof of concept for adding new statements [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/83 [20:11:56] 10Tool-paulina: Proof of concept for adding new statements - https://phabricator.wikimedia.org/T406989#11274330 (10shreya-bhagat) Hello! @Pepe_piton @Nat_WDU Completed the task: https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/83 Kindly review! Changes: 1. Added an “Add Information” butt... [20:17:44] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [20:20:38] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30033 bytes in 4.727 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [21:00:24] (03open) 10afanyulionel: Improve: Hide work data fields when they have no value [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/84 [21:03:54] 10Tool-paulina: Hide work data fields when they have no value - https://phabricator.wikimedia.org/T406994#11274471 (10Afanyulionel) >>! In T406994#11270828, @Miiswom wrote: > Good morning everyone, > > @Pepe_piton: I have just moved the `if` statements so that they wrap around the `div.detail-item` (instead of... [21:42:08] (03approved) 10raymond-ndibe: update deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/220 (https://phabricator.wikimedia.org/T403321) (owner: 10damian) [21:43:12] 10VPS-project-Codesearch: Remove DarkVector from codesearch - https://phabricator.wikimedia.org/T407115#11274597 (10Ladsgroup) >>! In T407115#11273216, @Dzahn wrote: > Is "not found at all" an advantage over "found last active version and told that it's unmaintained"? I think so. When we don't find it, we don't... [21:44:37] (03approved) 10raymond-ndibe: restart deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/218 (owner: 10damian) [21:52:06] 06cloud-services-team: Toolforge on Metal pilot - https://phabricator.wikimedia.org/T407296 (10Andrew) 03NEW [21:56:36] (03update) 10damian: restart deployment via template hash change [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/218 [21:56:48] FIRING: PuppetConstantChange: Puppet performing a change on every puppet run on cloudcontrol2005-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=changed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetConstantChange [22:05:11] 06cloud-services-team: What are the parts of toolforge? - https://phabricator.wikimedia.org/T407299 (10Andrew) 03NEW [22:12:20] 06cloud-services-team: Toolforge on Metal pilot - https://phabricator.wikimedia.org/T407296#11274680 (10Andrew) I have some questions about this project, which I'm hoping some Tiger Team folks will have answers to. Typically an experiment seeks to answer a question. What question are we answering here? I starte... [22:19:00] 06cloud-services-team: What are the parts of toolforge? - https://phabricator.wikimedia.org/T407299#11274694 (10bd808) https://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge says that multi-maintainer tool accounts with access to shared storage, $TOOLNAME.toolforge.org hosting, cronjobs, daemons, p... [22:19:34] FIRING: DiskSpace: Disk space cloudcontrol2006-dev:9100:/ 6.988% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=cloudcontrol2006-dev - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [22:25:48] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [22:26:40] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30032 bytes in 1.293 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [22:27:04] 06cloud-services-team: What are the parts of toolforge? - https://phabricator.wikimedia.org/T407299#11274712 (10bd808) https://wikitech.wikimedia.org/wiki/Help:Toolforge/Redis and https://wikitech.wikimedia.org/wiki/Help:Toolforge/Elasticsearch are more shared services. [22:29:34] RESOLVED: DiskSpace: Disk space cloudcontrol2006-dev:9100:/ 6.957% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=cloudcontrol2006-dev - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [23:20:57] (03update) 10chumzine: Resolve T405598 [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/78 [23:36:26] 10VPS-project-Codesearch: Remove DarkVector from codesearch - https://phabricator.wikimedia.org/T407115#11274810 (10Dzahn) Gotcha! thanks for that example