[00:02:48] 10Tool-quickcategories: Add support for mediawikiCategories to QuickCategories - https://phabricator.wikimedia.org/T388618 (10LucasWerkmeister) 03NEW [00:10:08] 10Tool-quickcategories: Add support for mediawikiCategories to QuickCategories - https://phabricator.wikimedia.org/T388618#10626903 (10LucasWerkmeister) Though testing this is probably going to be a pain – I don’t know if any test wiki has a comparable Data namespace. (This would be much easier if T213295 hadn’t... [03:08:12] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [03:08:15] !log raymond-ndibe@cloudcumin1001 toolsbeta END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component jobs-api [03:09:20] !log raymond-ndibe@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [03:16:26] (03open) 10raymond-ndibe: [builds-builder] drop certain permissions for local-image-builder [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/68 (https://phabricator.wikimedia.org/T361708) [03:17:12] !log raymond-ndibe@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [03:19:56] !log raymond-ndibe@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [03:28:34] (03approved) 10raymond-ndibe: show: add some indentation for the long status [repos/cloud/toolforge/components-cli] (add_build_status) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/23 (owner: 10dcaro) [03:28:42] (03update) 10raymond-ndibe: show: add some indentation for the long status [repos/cloud/toolforge/components-cli] (add_build_status) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/23 (owner: 10dcaro) [03:29:38] !log raymond-ndibe@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [04:31:07] (03update) 10raymond-ndibe: deploy: support deploying source build components (buildpack) [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/53 (https://phabricator.wikimedia.org/T384634) (owner: 10dcaro) [04:32:14] (03update) 10raymond-ndibe: deployment: update the deployment state during deploy [repos/cloud/toolforge/components-api] (deploy_source_build_too) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/54 (owner: 10dcaro) [04:34:56] (03update) 10raymond-ndibe: deploy_task: build the source based components [repos/cloud/toolforge/components-api] (add_deployment_status_updates) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/57 (owner: 10dcaro) [04:46:25] 06cloud-services-team: Chuck Onwumelu internship: experiments with Toolsbeta and lima-kilo - https://phabricator.wikimedia.org/T386806#10627137 (10Chuckonwumelu) [04:56:46] (03approved) 10raymond-ndibe: add build status [repos/cloud/toolforge/components-cli] (add_tabulate) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/22 (owner: 10dcaro) [04:56:47] (03update) 10raymond-ndibe: add build status [repos/cloud/toolforge/components-cli] (add_tabulate) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/22 (owner: 10dcaro) [04:57:08] (03update) 10raymond-ndibe: deployment.list: tabulate and add some colors [repos/cloud/toolforge/components-cli] (add_status) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/21 (owner: 10dcaro) [04:57:10] (03approved) 10raymond-ndibe: deployment.list: tabulate and add some colors [repos/cloud/toolforge/components-cli] (add_status) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/21 (owner: 10dcaro) [04:57:33] (03approved) 10raymond-ndibe: deployment: add the status and long_status fields [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/20 (owner: 10dcaro) [04:57:36] (03update) 10raymond-ndibe: deployment: add the status and long_status fields [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/20 (owner: 10dcaro) [07:49:19] 10Striker, 10Bitu, 10CAS-SSO, 06Infrastructure-Foundations, 10Phabricator: Inconsistent mapping of Developer accounts and SUL accounts across Phabricator, Bitu, and Striker - https://phabricator.wikimedia.org/T388498#10627203 (10Arendpieter) >>! In T388498#10626310, @bd808 wrote: > That would be @Bugrepo... [09:23:27] 10Tool-schedule-deployment: IndexError: list index out of range on some windows - https://phabricator.wikimedia.org/T388633 (10Lucas_Werkmeister_WMDE) 03NEW [09:54:39] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [09:56:39] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:00:49] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:02:01] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:08:46] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:12:54] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:13:42] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:23:49] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:26:15] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:27:10] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [10:55:16] 10Toolforge (Toolforge iteration 18): [components-api] restrict running deplpoyments to 1 - https://phabricator.wikimedia.org/T388643 (10dcaro) 03NEW [10:56:23] 10Toolforge (Toolforge iteration 18): [components-api] allow stopping a deployment that's running - https://phabricator.wikimedia.org/T388644 (10dcaro) 03NEW [11:09:11] (03PS1) 10Stevemunene: hdfs: create dummy keytabs for new hosts [labs/private] - 10https://gerrit.wikimedia.org/r/1126955 (https://phabricator.wikimedia.org/T388512) [12:16:29] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [12:35:23] 10Tool-schedule-deployment: IndexError: list index out of range on some windows - https://phabricator.wikimedia.org/T388633#10628238 (10jnuche) The 1742320800 epoch mentioned in the example corresponds to "2025-03-18 11:00 SF" . That's a regular train deployment window: https://wikitech.wikimedia.org/wiki/Deploy... [13:05:11] 10Cloud Services Proposals, 06cloud-services-team, 10Cloud-VPS: Decision Request - How openstack projects relate to tofu-infra - https://phabricator.wikimedia.org/T385604#10628351 (10aborrero) [13:05:41] 10Cloud Services Proposals, 06cloud-services-team, 10Cloud-VPS: Decision Request - How openstack projects relate to tofu-infra - https://phabricator.wikimedia.org/T385604#10628352 (10aborrero) I propose we move forward with option 2. [13:07:16] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:09:27] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:11:39] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:15:42] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:17:10] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:17:52] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:26:10] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:27:49] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:28:46] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:52:30] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:53:52] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:54:09] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:57:37] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [13:59:42] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [14:01:16] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [14:03:48] FIRING: PuppetFailure: Puppet has failed on cloudcontrol2004-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [14:03:57] 06cloud-services-team: PuppetFailure Puppet has failed on cloudcontrol2004-dev:9100 - https://phabricator.wikimedia.org/T388676 (10phaultfinder) 03NEW [14:07:12] (03CR) 10Btullis: [C:03+1] hdfs: create dummy keytabs for new hosts [labs/private] - 10https://gerrit.wikimedia.org/r/1126955 (https://phabricator.wikimedia.org/T388512) (owner: 10Stevemunene) [14:07:24] 06cloud-services-team, 10Cloud-VPS, 10Observability-Metrics, 10SRE Observability (FY2024/2025-Q3): Remove librenms -> graphite integration, replace with gnmi - https://phabricator.wikimedia.org/T372457#10628642 (10ayounsi) @dcaro you might find this useful https://gerrit.wikimedia.org/r/c/operations/alerts... [14:07:52] (03CR) 10Stevemunene: [C:03+2] hdfs: create dummy keytabs for new hosts [labs/private] - 10https://gerrit.wikimedia.org/r/1126955 (https://phabricator.wikimedia.org/T388512) (owner: 10Stevemunene) [14:07:57] 10Tool-schedule-deployment: IndexError: list index out of range on some windows - https://phabricator.wikimedia.org/T388633#10628643 (10Joe) I just selected this morning's backport window, which was the first offered from the interface. At the time, it conicided with the train window because of the daylight savi... [14:08:02] (03CR) 10Stevemunene: [V:03+2 C:03+2] hdfs: create dummy keytabs for new hosts [labs/private] - 10https://gerrit.wikimedia.org/r/1126955 (https://phabricator.wikimedia.org/T388512) (owner: 10Stevemunene) [14:09:10] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [14:13:38] 06cloud-services-team, 10Cloud-VPS, 10Observability-Metrics, 10SRE Observability (FY2024/2025-Q3): Remove librenms -> graphite integration, replace with gnmi - https://phabricator.wikimedia.org/T372457#10628668 (10dcaro) >>! In T372457#10628642, @ayounsi wrote: > @dcaro you might find this useful https://g... [14:13:48] RESOLVED: PuppetFailure: Puppet has failed on cloudcontrol2004-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [14:30:15] 10VPS-project-Wikistats: Add tgwikisource to Wikistats - https://phabricator.wikimedia.org/T388678 (10Pppery) 03NEW [14:30:18] 10VPS-project-Wikistats: Add tgwikisource to Wikistats - https://phabricator.wikimedia.org/T388678#10628784 (10Pppery) 05Open→03Stalled [14:31:25] 10VPS-project-Wikistats: Add tlwikisource to Wikistats - https://phabricator.wikimedia.org/T388678#10628802 (10Pppery) [14:54:27] (03open) 10dcaro: Makefile: don't require minikube/kind to generate the api code [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/122 [15:02:31] 06cloud-services-team, 10Toolforge: [toolforge, toolforge-cli] Experiment with PyInstaller to package CLI tools for buildpack images - https://phabricator.wikimedia.org/T369693#10628947 (10dcaro) 05Open→03Declined We are moving on with golang generated code instead [15:08:15] (03open) 10dcaro: build: add runner parameter [repos/cloud/toolforge/builds-api] (dont_require_minikube) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T380127) [15:13:13] 10Cloud-Services, 06cloud-services-team, 10Elasticsearch, 10Data-Platform-SRE (2025.03.01 - 2025.03.21), and 2 others: Cloudelastic alerts should route to data platform alerts, not wmcs - https://phabricator.wikimedia.org/T388270#10629021 (10lmata) [15:13:32] 10cloud-services-team (FY2024/2025-Q3-Q4), 10Toolforge: [tools.meta] can't delete file inside cache/wikimedia-wikis.dat - https://phabricator.wikimedia.org/T357098#10629023 (10dcaro) 05In progress→03Resolved Retried and it worked this time, whatever was getting it stuck was not there anymore. [15:14:08] 06cloud-services-team, 10Toolforge (Toolforge iteration 18), 13Patch-For-Review: [builds-builder] Add support for Heroku's "24" builder stack based on Ubuntu 2024.04 noble - https://phabricator.wikimedia.org/T380127#10629035 (10dcaro) a:03dcaro [15:14:14] 06cloud-services-team, 10Toolforge (Toolforge iteration 18), 13Patch-For-Review: [builds-builder] Add support for Heroku's "24" builder stack based on Ubuntu 2024.04 noble - https://phabricator.wikimedia.org/T380127#10629037 (10dcaro) 05Open→03In progress [15:14:26] 10Tool-schedule-deployment: IndexError: list index out of range on some windows - https://phabricator.wikimedia.org/T388633#10629040 (10bd808) I think this is the same issue reported at {T388556} yesterday. Date math, timezones, and daylight confusion time across 2-3 programming languages seem the likely trigger. [15:18:36] (03update) 10dcaro: Makefile: don't require minikube/kind to generate the api code [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/122 [15:20:47] (03update) 10dcaro: build: add runner parameter [repos/cloud/toolforge/builds-api] (dont_require_minikube) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T380127) [15:25:59] (03update) 10dcaro: build: add runner parameter [repos/cloud/toolforge/builds-api] (dont_require_minikube) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T380127) [15:33:02] 10Striker, 10Bitu, 10CAS-SSO, 06Infrastructure-Foundations, 10Phabricator: Inconsistent mapping of Developer accounts and SUL accounts across Phabricator, Bitu, and Striker - https://phabricator.wikimedia.org/T388498#10629171 (10bd808) >>! In T388498#10627203, @Arendpieter wrote: >>>! In T388498#10626310... [15:55:49] !log fnegri@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component builds-builder [15:56:15] !log fnegri@cloudcumin1001 toolsbeta END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component builds-builder [16:00:57] (03update) 10dcaro: build: add runner parameter [repos/cloud/toolforge/builds-api] (dont_require_minikube) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T380127) [16:01:16] (03update) 10dcaro: build: add runner parameter [repos/cloud/toolforge/builds-api] (dont_require_minikube) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/123 (https://phabricator.wikimedia.org/T380127) [16:17:15] (03open) 10dcaro: start: Add useLatestBuilder parameter and configs [repos/cloud/toolforge/builds-api] (add_runner_parameter) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/124 (https://phabricator.wikimedia.org/T380127) [16:18:36] (03update) 10dcaro: start: Add useLatestBuilder parameter and configs [repos/cloud/toolforge/builds-api] (add_runner_parameter) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/124 (https://phabricator.wikimedia.org/T380127) [16:28:35] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [16:29:17] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [16:31:57] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [16:33:41] (03update) 10aborrero: Draft: test new project module [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/93 (https://phabricator.wikimedia.org/T375283) (owner: 10fnegri) [17:31:15] (03open) 10fnegri: Update to bookworm and new helmfile repo [repos/cloud/toolforge/packaging-helmfile] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/packaging-helmfile/-/merge_requests/2 [17:40:29] 10Tools: In Glamorous the square brackets [ ] in the link cause these links to break in wikitext - https://phabricator.wikimedia.org/T379721#10629843 (10Prototyperspective) Finally at least a workaround has been found: replacing the `[` with `[` and `]` with `]`. Since most people don't know of this w... [17:43:25] (03open) 10fnegri: deploy.sh: use helmfile sync instead of apply [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/712 [17:44:06] (03update) 10fnegri: deploy.sh: use helmfile sync instead of apply [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/712 [18:01:08] 14cloud-services-team (FY2024/2025-Q1-Q2), 10Toolforge, 05Cloud-Services-Origin-Team, 07Cloud-Services-Worktype-Maintenance: [helmfile] Toolforge needs helmfile >=/0.145.3, but we have 0.135.0 - https://phabricator.wikimedia.org/T339328#10629938 (10fnegri) The prod version in apt.wikimedia.org (0.171.0... [18:21:36] (03PS2) 10Eevans: cassandra: obsolete secrets [labs/private] - 10https://gerrit.wikimedia.org/r/1123703 (https://phabricator.wikimedia.org/T387586) [18:22:22] (03CR) 10Eevans: [V:03+2 C:03+2] cassandra: obsolete secrets [labs/private] - 10https://gerrit.wikimedia.org/r/1123703 (https://phabricator.wikimedia.org/T387586) (owner: 10Eevans) [18:24:36] 10Toolforge (Toolforge iteration 18): [builds-api] Limit the amount of running builds - https://phabricator.wikimedia.org/T388706 (10dcaro) 03NEW [18:27:21] (03update) 10dcaro: start: Add useLatestBuilder parameter and configs [repos/cloud/toolforge/builds-api] (add_runner_parameter) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/124 (https://phabricator.wikimedia.org/T380127) [18:29:03] (03update) 10dcaro: start: Add useLatestBuilder parameter and configs [repos/cloud/toolforge/builds-api] (add_runner_parameter) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/124 (https://phabricator.wikimedia.org/T380127) [18:54:57] (03update) 10fnegri: deploy.sh: use helmfile sync instead of apply [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/712 [18:55:07] (03update) 10fnegri: deploy.sh: use helmfile sync instead of apply [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/712 [19:00:01] (03update) 10fnegri: wmcs-k8s-metrics: upgrade charts for K8s v1.29 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/681 (https://phabricator.wikimedia.org/T362868) [19:00:55] !log fnegri@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component wmcs-k8s-metrics (T362868) [19:01:00] T362868: [infra,k8s] Upgrade Toolforge Kubernetes to version 1.29 - https://phabricator.wikimedia.org/T362868 [19:09:48] !log fnegri@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component wmcs-k8s-metrics (T362868) [19:46:11] 06cloud-services-team, 10Toolforge: Restore Toolforge subfolder from backup - https://phabricator.wikimedia.org/T388713 (10MBH) 03NEW [20:50:55] 06cloud-services-team, 10Toolforge: Restore Toolforge subfolder from backup - https://phabricator.wikimedia.org/T388713#10630459 (10bd808) Some WMCS team SRE may be able to perform some heroics, but per https://wikitech.wikimedia.org/wiki/Help:Toolforge/Tool_accounts#Backup_Toolforge_data there is no official... [21:13:41] (03update) 10raymond-ndibe: deploy: support deploying source build components (buildpack) [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/53 (https://phabricator.wikimedia.org/T384634) (owner: 10dcaro) [21:13:46] (03approved) 10raymond-ndibe: deploy: support deploying source build components (buildpack) [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/53 (https://phabricator.wikimedia.org/T384634) (owner: 10dcaro) [23:11:53] (03update) 10raymond-ndibe: deploy_task: build the source based components [repos/cloud/toolforge/components-api] (add_deployment_status_updates) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/57 (owner: 10dcaro) [23:11:56] (03approved) 10raymond-ndibe: deploy_task: build the source based components [repos/cloud/toolforge/components-api] (add_deployment_status_updates) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/57 (owner: 10dcaro) [23:12:44] (03update) 10raymond-ndibe: deployment: update the deployment state during deploy [repos/cloud/toolforge/components-api] (deploy_source_build_too) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/54 (owner: 10dcaro) [23:12:46] (03approved) 10raymond-ndibe: deployment: update the deployment state during deploy [repos/cloud/toolforge/components-api] (deploy_source_build_too) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/54 (owner: 10dcaro) [23:26:53] 10Toolforge (Toolforge iteration 18), 07Documentation: [harbor,docs] Improve Harbor quota handling and docs - https://phabricator.wikimedia.org/T351092#10631188 (10Raymond_Ndibe) documentation updated on how to manage/request build quotas on wikitech https://wikitech.wikimedia.org/w/index.php?title=Portal%3ATo... [23:27:14] 10Toolforge (Toolforge iteration 18), 07Documentation, 13Patch-For-Review: [harbor,docs] Improve Harbor quota handling and docs - https://phabricator.wikimedia.org/T351092#10631189 (10Raymond_Ndibe) [23:45:38] 10Tool-schedule-deployment: Some links from [[wikitech:Deployments]] lead to 404 pages - https://phabricator.wikimedia.org/T388556#10631228 (10bd808) The problem here turns out to be "hacks". `lang=python def epoch_to_window_when(epoch): # XXX: this is fragile, but maybe the best we have right now? dt_u... [23:47:22] 10Tool-schedule-deployment: Logic to find a deployment window given a unix timestamp assumes that wikitext uses the "SF" timezone marker - https://phabricator.wikimedia.org/T388556#10631230 (10bd808) [23:47:43] 10Tool-schedule-deployment: Logic to find a deployment window given a unix timestamp assumes that wikitext uses the "SF" timezone marker - https://phabricator.wikimedia.org/T388556#10631231 (10bd808) 05Open→03In progress a:03bd808