[00:05:49] 10Continuous-Integration-Infrastructure (Zuul upgrade): OpenTofu erroring out when trying to fetch data to build kubeconfig - https://phabricator.wikimedia.org/T397106#10920951 (10bd808) Manual bisect: * 🚫 terraform-provider-openstack v3.2.0, `Openstack-Api-Version: container-infrastructure-management 1.9` * 🚫 t... [00:22:37] (03open) 10bd808: Changes implemented while working on getting `tofu apply` to work [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/6 (https://phabricator.wikimedia.org/T396936 https://phabricator.wikimedia.org/T397098 https://phabricator.wikimedia.org/T397106) [00:31:25] (03update) 10bd808: Changes implemented while working on getting `tofu apply` to work [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/6 (https://phabricator.wikimedia.org/T396936 https://phabricator.wikimedia.org/T397098 https://phabricator.wikimedia.org/T397106) [00:33:41] (03merge) 10bd808: Changes implemented while working on getting `tofu apply` to work [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/6 (https://phabricator.wikimedia.org/T396936 https://phabricator.wikimedia.org/T397098 https://phabricator.wikimedia.org/T397106) [01:01:23] (03PS1) 10Corvus: Override log URL endpoint [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1159620 [01:26:58] 10Continuous-Integration-Infrastructure (Zuul upgrade), 13Patch-For-Review: OpenTofu erroring out when trying to fetch data to build kubeconfig - https://phabricator.wikimedia.org/T397106#10921034 (10bd808) @Andrew Do you have any good intuition on how I could figure out if the `Openstack-Api-Version: containe... [01:27:06] 10Continuous-Integration-Infrastructure (Zuul upgrade), 13Patch-For-Review: OpenTofu erroring out when trying to fetch data to build kubeconfig - https://phabricator.wikimedia.org/T397106#10921035 (10bd808) p:05High→03Medium [01:45:26] 10Continuous-Integration-Infrastructure (Zuul upgrade): OpenTofu erroring out when trying to fetch data to build kubeconfig - https://phabricator.wikimedia.org/T397106#10921071 (10Andrew) The string 'container-infrastructure-management' does not seem to appear anywhere in the magnum source. The string also doesn... [02:20:39] 10Continuous-Integration-Infrastructure (Zuul upgrade): OpenTofu erroring out when trying to fetch data to build kubeconfig - https://phabricator.wikimedia.org/T397106#10921109 (10Andrew) It looks like this /ought/ to alias that weird string to the proper string. But your tests show otherwise https://github.com... [02:21:01] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for eggroll97 - https://phabricator.wikimedia.org/T397110#10921114 (10Pppery) 05Open→03Resolved a:03Pppery Welcome! [07:04:56] Project beta-code-update-eqiad build #552725: 04FAILURE in 1 min 56 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/552725/ [07:12:48] (03CR) 10Hashar: [C:03+2] "se" [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1159620 (owner: 10Corvus) [07:14:03] (03CR) 10CI reject: [V:04-1] Override log URL endpoint [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1159620 (owner: 10Corvus) [07:15:05] Yippee, build fixed! [07:15:05] Project beta-code-update-eqiad build #552726: 09FIXED in 2 min 4 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/552726/ [07:15:16] (03PS1) 10Hashar: Zuul: add James E. Blair to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1159933 [07:18:11] (03PS1) 10Hashar: Merge branch 'master' into zuul3 [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1159936 [07:23:37] (03PS2) 10Hashar: Override log URL endpoint [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1159620 (owner: 10Corvus) [07:55:12] 10Scap: scap backport should warn if it knows it will take a long time - https://phabricator.wikimedia.org/T397089#10921539 (10phuedx) >>! In T397089#10920330, @dancy wrote: > Do you mean writing a (likely to be overlooked) line of log output while `scap sync-world` is running, or do you mean an interactive warn... [08:01:03] (03CR) 10Hashar: [C:03+2] Merge branch 'master' into zuul3 [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1159936 (owner: 10Hashar) [08:02:17] (03Merged) 10jenkins-bot: Merge branch 'master' into zuul3 [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1159936 (owner: 10Hashar) [08:02:22] (03Merged) 10jenkins-bot: Override log URL endpoint [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1159620 (owner: 10Corvus) [08:08:00] https://www.mediawiki.org/w/index.php?oldid=558609 [08:08:02] err [08:19:12] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921628 (10Bugreporter2) [08:19:24] (03CR) 10Ilias Sarantopoulos: [C:03+1] "LGTM! Thanks for tidying things up!" [integration/config] - 10https://gerrit.wikimedia.org/r/1159377 (https://phabricator.wikimedia.org/T393865) (owner: 10Bartosz Wójtowicz) [08:19:32] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921632 (10Bugreporter2) [08:25:57] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921652 (10Bugreporter2) [08:26:46] 10GitLab (Infrastructure), 06cloud-services-team, 10Cloud-VPS, 06collaboration-services: Volume is stuck to deleted instance in devtools project - https://phabricator.wikimedia.org/T396739#10921655 (10Jelto) Unfortunately the volume is still stuck to the deleted instance and this is blocking {T396622}. [08:27:12] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921659 (10Bugreporter2) [08:39:22] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921726 (10Bugreporter2) [08:40:30] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921729 (10Bugreporter2) [08:44:00] 10Deployments, 10Release-Engineering-Team (Yak Shaving 🐃🪒), 10logspam-watch: Make logspam-watch available on deployment.eqiad.wmnet - https://phabricator.wikimedia.org/T372563#10921740 (10Lucas_Werkmeister_WMDE) See also: {T391005} [08:45:24] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921753 (10Bugreporter2) [08:46:12] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921756 (10Bugreporter2) [08:51:06] (03CR) 10Klausman: [C:03+1] "LGTM!" [integration/config] - 10https://gerrit.wikimedia.org/r/1159377 (https://phabricator.wikimedia.org/T393865) (owner: 10Bartosz Wójtowicz) [08:56:55] any phab admins about? [08:56:57] hashar: ^ [08:57:34] RhinosF1: yeah I am around :) [09:23:24] (03CR) 10Bartosz Wójtowicz: "We can deploy now! <3" [integration/config] - 10https://gerrit.wikimedia.org/r/1159377 (https://phabricator.wikimedia.org/T393865) (owner: 10Bartosz Wójtowicz) [09:24:00] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10921944 (10Samwilson) How are you deciding which extensions to create subtasks for? I'd not have tho... [09:52:19] binary":"/tmp/chrome/linux-137.0.7151.70/chrome-linux64/chrome" [09:52:29] now I have to figure out why webdriver.io downloads Chrome .. [10:19:20] 10GitLab (Infrastructure), 06cloud-services-team, 10Cloud-VPS, 06collaboration-services: Volume is stuck to deleted instance in devtools project - https://phabricator.wikimedia.org/T396739#10922203 (10fnegri) cc @Andrew who has fixed similar issues in the past. [10:47:25] 10Continuous-Integration-Infrastructure, 10MediaWiki-libs-Rdbms: Raise Quibble jobs' tested version of MariaDB to 10.6 - https://phabricator.wikimedia.org/T366646#10922328 (10Ladsgroup) Thank you! [11:11:11] 10Scap (SpiderPig 🕸️): SpiderPig live job log view is broken - https://phabricator.wikimedia.org/T397097#10922461 (10TheresNoTime) Same here (in Chrome fwiw) {F62362820} [11:33:18] had to set `CI` environment variable to have wdio-mediawiki to setup the browser in a way that prevents wdio from download it [11:40:10] (03PS1) 10Fomafix: Zuul: [mediawiki/extensions/ReadingLists] Add BetaFeatures phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1160098 [12:04:48] (03PS1) 10Hashar: Fetch output directory from nodes [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160114 [12:05:43] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/ReadingLists] Add BetaFeatures phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1160098 (owner: 10Fomafix) [12:06:53] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ReadingLists] Add BetaFeatures phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1160098 (owner: 10Fomafix) [12:18:21] (03PS1) 10Hashar: Make fetch-output-openshift verbose [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160121 [12:42:15] 10MediaWiki-Releasing: Bundle Extension:Disambiguator with MediaWiki - https://phabricator.wikimedia.org/T397129#10922927 (10Reedy) [12:42:20] 10MediaWiki-Releasing: Bundle Extension:TemplateSandbox with MediaWiki - https://phabricator.wikimedia.org/T397130#10922928 (10Reedy) p:05Triage→03Low [12:42:29] 10MediaWiki-Releasing: Bundle Extension:Disambiguator with MediaWiki - https://phabricator.wikimedia.org/T397129#10922931 (10Reedy) p:05Triage→03Low [12:52:00] 10GitLab: configure-projects bot impersonation token expires June 17, 2025 - https://phabricator.wikimedia.org/T397071#10923018 (10ABran-WMF) [13:10:53] 10Phabricator: Consider uninstalling Pholio (Phabricator application) - https://phabricator.wikimedia.org/T397188 (10Aklapper) 03NEW p:05Triage→03Low [13:14:37] 10MediaWiki-Releasing: Bundle Extension:DynamicSideBar with MediaWiki - https://phabricator.wikimedia.org/T397134#10923169 (10Aklapper) [13:14:38] 10MediaWiki-Releasing: Bundle Extension:DynamicPageList3 with MediaWiki - https://phabricator.wikimedia.org/T397133#10923170 (10Aklapper) [13:36:05] 10Phabricator: Make username autocomplete proposals order more context aware - https://phabricator.wikimedia.org/T397194 (10Aklapper) 03NEW [13:36:20] 10Phabricator (Upstream), 07Upstream: Make username autocomplete proposals order more context aware - https://phabricator.wikimedia.org/T397194#10923342 (10Aklapper) p:05Triage→03Low [13:37:04] 10Phabricator (Upstream), 07Upstream: Make username autocomplete proposals order more context aware - https://phabricator.wikimedia.org/T397194#10923358 (10Aklapper) [13:41:19] (03PS1) 10Hashar: fetch-output-openshift is to be run on nodes [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160146 [13:42:57] 10Phabricator (Upstream), 07Upstream: Make username autocomplete proposals order more context aware - https://phabricator.wikimedia.org/T397194#10923368 (10Aklapper) [13:54:14] 10Scap, 10Observability-Metrics: Migrate scap metrics to Prometheus - https://phabricator.wikimedia.org/T377273#10923463 (10lmata) [14:17:30] 10Continuous-Integration-Infrastructure (Zuul upgrade): Zuul can not post configuration errors to Gerrit - https://phabricator.wikimedia.org/T397202 (10hashar) 03NEW [14:24:59] (03open) 10dancy: spiderpig/model.py: Fix Interaction.choices_parsed [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/839 [14:25:01] (03update) 10dancy: spiderpig/model.py: Fix Interaction.choices_parsed [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/839 [14:25:23] (03update) 10dancy: spiderpig/model.py: Fix Interaction.choices_parsed [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/839 [14:28:00] (03merge) 10dancy: spiderpig/model.py: Fix Interaction.choices_parsed [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/839 [14:31:39] 10GitLab (CI & Job Runners), 07Essential-Work: Buildkit v0.23.0 released - https://phabricator.wikimedia.org/T397204 (10dancy) 03NEW [14:33:03] (03open) 10dancy: Revert "spiderpig/api.py: Include Content-Type header in job log response" [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/840 [14:33:05] (03update) 10dancy: Revert "spiderpig/api.py: Include Content-Type header in job log response" [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/840 [14:33:22] (03update) 10dancy: Revert "spiderpig/api.py: Include Content-Type header in job log response" [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/840 (https://phabricator.wikimedia.org/T397097) [14:33:32] (03update) 10dancy: Revert "spiderpig/api.py: Include Content-Type header in job log response" [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/840 (https://phabricator.wikimedia.org/T397097) [14:34:45] (03merge) 10dancy: Allow repos/releng/zuul/zuul to build from a Dockerfile [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/118 (https://phabricator.wikimedia.org/T396245) (owner: 10dduvall) [14:35:49] (03merge) 10dancy: Revert "spiderpig/api.py: Include Content-Type header in job log response" [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/840 (https://phabricator.wikimedia.org/T397097) [14:36:29] (03open) 10dancy: Release 4.176.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/841 [14:37:42] (03PS1) 10Hashar: Add index.html to the log url [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160168 [14:38:45] (03merge) 10dancy: Release 4.176.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/841 [14:46:17] (03PS1) 10Hashar: Revert "Add index.html to the log url" [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160170 [14:48:25] 10Scap (SpiderPig 🕸️): SpiderPig live job log view is broken - https://phabricator.wikimedia.org/T397097#10923911 (10dancy) p:05Triage→03Low I deployed scap 4.176.0 which reverts to the original behavior. I'll need to do more testing to figure out what went wrong. [14:54:51] 10GitLab: configure-projects bot impersonation token expires June 17, 2025 - https://phabricator.wikimedia.org/T397071#10923943 (10dancy) 05Open→03Resolved a:03dancy Token stored in Release Engineering shared 1Password. [14:58:16] 10Continuous-Integration-Infrastructure (Zuul upgrade): terraform-provider-openstack >v3.0.0 uses a gophercloud client that does not work with WMCS Magnum APIs - https://phabricator.wikimedia.org/T397106#10923977 (10bd808) [15:03:51] 10Continuous-Integration-Infrastructure (Zuul upgrade): terraform-provider-openstack >v3.0.0 uses a gophercloud client that does not work with WMCS Magnum APIs - https://phabricator.wikimedia.org/T397106#10924004 (10bd808) 05In progress→03Open a:05bd808→03None https://opendev.org/openstack/magnum/search?... [15:06:09] 10Continuous-Integration-Infrastructure (Zuul upgrade), 07Browser-Tests, 07ci-test-error: Webdriver.io can't start Chrome (zuul upgrade) - https://phabricator.wikimedia.org/T397215 (10hashar) 03NEW [15:07:21] (03update) 10dancy: Drop several php_fpm* config parameters [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/829 (https://phabricator.wikimedia.org/T396166) [15:07:30] (03update) 10dancy: Drop several php_fpm* config parameters [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/829 (https://phabricator.wikimedia.org/T396166) [15:08:47] (03merge) 10dancy: Drop several php_fpm* config parameters [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/829 (https://phabricator.wikimedia.org/T396166) [15:09:31] (03open) 10dancy: Release 4.177.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/842 [15:11:38] 10Phabricator, 06Release-Engineering-Team, 06collaboration-services, 06DBA: Prepare a database test for m3 - https://phabricator.wikimedia.org/T390034#10924065 (10brennen) > Any news on this? We are now trying to schedule some GTID testing and we'd need to know when these hosts will be released. Gah,... [15:12:38] (03merge) 10dancy: Release 4.177.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/842 [15:31:40] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: puppetize setup of new zuul VMs - https://phabricator.wikimedia.org/T395938#10924268 (10thcipriani) Still need the zuul base images! @dduvall is working on images in T396245 and will update when we have an image there. [15:45:17] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog 📥): Experiment with Quibble job migration - https://phabricator.wikimedia.org/T392117#10924381 (10thcipriani) 05Open→03In progress p:05Triage→03Medium a:03hashar [15:50:21] 10Continuous-Integration-Config, 07Epic, 07PHP 8.4 support: Make PHP 8.4 voting on development (master) branch of MW ecosystem (core, vendor, extensions, skins, libraries) in CI - https://phabricator.wikimedia.org/T386108#10924417 (10Krinkle) [15:55:14] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: allow new zuul executor VMs in prod to talk to cloud VPS - https://phabricator.wikimedia.org/T394838#10924451 (10thcipriani) For the record, the executor will need access to :443 for the k8s api server that @bd808 is working on c... [16:04:42] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 10Cloud-VPS (Quota-requests): Increase volume storage quota for zuul project - https://phabricator.wikimedia.org/T397098#10924470 (10Dzahn) [16:23:40] Krinkle: Oddly, I can't get pcov to load in the image, even a simple `php -dpcov.enabled=1 -m` doesn't list it. [16:36:41] Ah, yeah, missed -dextension. Fixing example: https://gerrit.wikimedia.org/r/c/mediawiki/libs/Minify/+/1160197 [16:38:27] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: allow new zuul executor VMs in prod to talk to cloud VPS - https://phabricator.wikimedia.org/T394838#10924680 (10bd808) [[https://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#Case_3:_generic_network_access_prod_--%3... [16:58:21] 10Continuous-Integration-Infrastructure (Zuul upgrade): terraform-provider-openstack >v3.0.0 uses a gophercloud client that does not work with WMCS Magnum APIs - https://phabricator.wikimedia.org/T397106#10924766 (10Andrew) Opened gophercloud issue here: https://github.com/gophercloud/gophercloud/issues/3429 [17:07:34] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10924824 (10Dzahn) >>! In T377889#10866191, @brennen wrote: > Well, SSH times out. It's firewalling. `scap::target` includes `scap::ferm` which opens the firew... [17:14:41] James_F: right.. So what do you want to do there? Apply in JJB? I'm unsure how widely used the base image is. Might be easier to start with enabling it at jjb level but open to either. [17:15:24] (03PS1) 10Corvus: Tell Zuul to use index.html at the end of dirs [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160209 [17:16:51] 10Continuous-Integration-Infrastructure (Zuul upgrade), 07Upstream: terraform-provider-openstack >v3.0.0 uses a gophercloud client that does not work with WMCS Magnum APIs - https://phabricator.wikimedia.org/T397106#10924887 (10bd808) [17:23:08] (03PS2) 10Hashar: Tell Zuul to use index.html at the end of dirs [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160209 (owner: 10Corvus) [17:23:26] (03CR) 10Hashar: [C:03+2] "Awesome thank you so much :]" [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160209 (owner: 10Corvus) [17:24:42] (03Merged) 10jenkins-bot: Tell Zuul to use index.html at the end of dirs [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160209 (owner: 10Corvus) [17:24:45] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10924920 (10Dzahn) Info: Applying configuration version '(53672bf49c) Dzahn - Revert "phabricator: comment out scap::target in migration class"' Error: Execution... [17:27:49] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10924945 (10Dzahn) On second puppet run, after that scap::target was created and the phab-deploy SSH key was written.. and the firewall hole was opened. Still h... [17:29:35] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10924962 (10Dzahn) This is like T378769 and T257317 once again, or similar at least. [17:30:44] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 10Cloud-VPS (Quota-requests): Increase volume storage quota for zuul project - https://phabricator.wikimedia.org/T397098#10924966 (10dcaro) @bd808 I'm guessing that there's nothing else left to do? (let me know) [17:32:03] (03PS1) 10Hashar: Review access change [integration/config] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1160215 [17:32:11] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06Release-Engineering-Team: Grant +2 to Corvus on integration/config zuul3 branch - https://phabricator.wikimedia.org/T397242 (10hashar) 03NEW [17:32:23] (03PS2) 10Hashar: Grant +2 and push to Corvus on integration/config zuul3 branch [integration/config] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1160215 (https://phabricator.wikimedia.org/T397242) [17:32:43] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 10Cloud-VPS (Quota-requests): Increase volume storage quota for zuul project - https://phabricator.wikimedia.org/T397098#10924996 (10bd808) >>! In T397098#10924966, @dcaro wrote: > @bd808 I'm guessing that there's nothing else lef... [17:33:17] (03CR) 10Hashar: [V:03+2 C:03+2] "That should give you +2 and push rights to integration/config zuul3 branch (previous changes: https://gerrit.wikimedia.org/r/q/branch:zuul" [integration/config] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1160215 (https://phabricator.wikimedia.org/T397242) (owner: 10Hashar) [17:33:29] (03CR) 10BryanDavis: [C:03+1] Grant +2 and push to Corvus on integration/config zuul3 branch [integration/config] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1160215 (https://phabricator.wikimedia.org/T397242) (owner: 10Hashar) [17:33:36] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06Release-Engineering-Team, 13Patch-For-Review: Grant +2 to Corvus on integration/config zuul3 branch - https://phabricator.wikimedia.org/T397242#10925000 (10hashar) 05Open→03Resolved a:03hashar [17:38:53] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 10Cloud-VPS (Quota-requests): Increase volume storage quota for zuul project - https://phabricator.wikimedia.org/T397098#10925041 (10Andrew) 05Open→03Resolved a:03Andrew [17:41:20] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [17:41:22] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [17:41:24] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [17:42:27] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [17:47:55] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [17:47:58] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [17:47:59] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [17:53:00] (03PS1) 10Corvus: Remove pipeline reporter tags [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160224 [17:54:03] (03CR) 10Corvus: [C:03+2] Remove pipeline reporter tags [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160224 (owner: 10Corvus) [18:03:27] (03PS1) 10Corvus: Noop change to force reconfig [integration/config] (zuul3) - 10https://gerrit.wikimedia.org/r/1160228 [18:16:06] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10925215 (10Dzahn) After my latest merge, puppet created that missing /etc/phabricator/script-vars file now. Now we are at: ` fatal: destination path '/srv/de... [18:17:21] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10925219 (10Dzahn) Did a manual `rm -rf /srv/deployment/phabricator/deployment-cache/cache` and trying again. [18:24:53] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10925229 (10Dzahn) Deleted that .cache dir one more time. Ran the command manually as phab-deploy user, before puppet ran again..and: ` [phab1005:~] $ sudo -u... [18:38:35] 10Phabricator, 10Release-Engineering-Team (Doing 😎): Change "Can Use Application" policy for {Flags, Tokens, Multimeter} from "Public" to "All Users" - https://phabricator.wikimedia.org/T397248 (10Aklapper) 03NEW p:05Triage→03Low [18:38:43] 10Phabricator, 10Release-Engineering-Team (Doing 😎): Change "Can Use Application" policy for {Flags, Tokens} from "Public" to "All Users" - https://phabricator.wikimedia.org/T397248#10925261 (10Aklapper) [18:39:33] 10Phabricator, 10Release-Engineering-Team (Doing 😎): Change "Can Use Application" policy for {Flags, Tokens} from "Public" to "All Users" - https://phabricator.wikimedia.org/T397248#10925270 (10Aklapper) 05Open→03Resolved [18:46:36] (03open) 10swfrench: Draft: make-container-image: introduce webserver-bookworm flavour [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/184 (https://phabricator.wikimedia.org/T378128) [18:54:40] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 07Essential-Work: Buildkit v0.23.0 released - https://phabricator.wikimedia.org/T397204#10925315 (10dancy) [18:58:09] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10925319 (10Dzahn) The mssing scap_sudo_defaults file has been created: ` Notice: /Stage[main]/Profile::Phabricator::Migration/File[/etc/sudoers.d/scap_sudo_def... [19:15:20] 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: install a service on phab1005 - https://phabricator.wikimedia.org/T377889#10925365 (10brennen) Much closer: {P78239} [19:46:58] (03update) 10dduvall: release: Use a multi stage release process [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/130 [19:47:00] (03update) 10dduvall: release: Use a multi stage release process [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/130 [19:47:02] (03update) 10dduvall: release: Use a multi stage release process [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/130 [19:48:05] (03update) 10dduvall: release: Use a multi stage release process [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/130 [20:30:11] (03approved) 10dancy: release: Use a multi stage release process [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/130 (owner: 10dduvall) [20:30:31] (03merge) 10dduvall: release: Use a multi stage release process [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/130 [21:04:21] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen): Rename all our quibble jobs to make some sense - https://phabricator.wikimedia.org/T254814#10925713 (10Krinkle) Refresh based on https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1159603. We now have... [21:11:52] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [21:12:02] (03update) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [21:12:03] (03update) 10dduvall: builder: Fix lack of validation on custom builders [repos/releng/blubber] (review/builder-script-8bc6) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/131 [21:12:05] (03update) 10dduvall: builder: Fix lack of validation on custom builders [repos/releng/blubber] (review/builder-script-8bc6) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/131 [21:12:08] (03open) 10dduvall: builder: Fix lack of validation on custom builders [repos/releng/blubber] (review/builder-script-8bc6) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/131 [21:18:03] 10Continuous-Integration-Infrastructure (Zuul upgrade): Zuul can not post configuration errors to Gerrit - https://phabricator.wikimedia.org/T397202#10925773 (10hashar) 05Open→03Resolved a:03Corvus @corvus fixed it: https://gerrit.wikimedia.org/r/c/integration/config/+/1160224: Remove pipeline reporte... [21:18:07] (03approved) 10jhuneidi: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 (owner: 10dduvall) [21:18:34] (03merge) 10dduvall: builder: Support multiline builder `script` and string `command` [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/130 [21:18:39] (03update) 10dduvall: builder: Fix lack of validation on custom builders [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/131 [21:29:53] 10Release-Engineering-Team (Seen), 10Data³, 10Quality-and-Test-Engineering-Team (Quality Engineering): Release Engineering Data Collection and Retention (aka Data³) - https://phabricator.wikimedia.org/T216085#10925805 (10thcipriani) 05Open→03Declined Considering all the subtasks are declined, and we'... [21:42:00] 06Project-Admins, 06Release-Engineering-Team, 10Data³: Consider archiving #Data³ - https://phabricator.wikimedia.org/T396891#10925833 (10thcipriani) There's no active work on DDD specifically happening, I can archive the project. Looking at the tasks, there are a couple that are still valid. Most are featur... [21:44:12] 10Phabricator, 10Release-Engineering-Team (Seen): Phab feature request: Cycle time for a task entering a column to resolution, with support for wildcards - https://phabricator.wikimedia.org/T148805#10925858 (10thcipriani) [21:47:02] (03approved) 10jhuneidi: builder: Fix lack of validation on custom builders [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/131 (owner: 10dduvall) [21:47:15] (03merge) 10dduvall: builder: Fix lack of validation on custom builders [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/131 [21:48:06] 06Project-Admins, 06Release-Engineering-Team: Consider archiving #Data³ - https://phabricator.wikimedia.org/T396891#10925867 (10thcipriani) 05Open→03Resolved a:03thcipriani > Open questions: > # should the #data3 Phabricator project be archived? Yes. Done. > - if so: > ## …what should happen to... [21:48:09] (03open) 10dduvall: version: 1.3.0 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/132 [21:51:02] 10Release-Engineering-Team (Priority Backlog 📥): Organize a deployment training for k8s - https://phabricator.wikimedia.org/T290915#10925871 (10thcipriani) 05Open→03Declined [21:51:40] 10GitLab (Infrastructure), 06cloud-services-team, 10Cloud-VPS, 06collaboration-services: Volume is stuck to deleted instance in devtools project - https://phabricator.wikimedia.org/T396739#10925872 (10Andrew) I am going to explore the possibility that this is https://www.reddit.com/r/openstack/comments/1e9... [21:51:40] 10Release-Engineering-Team (Doing 😎), 07Essential-Work, 05Release, 05Train Deployments: 1.45.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T392176#10925874 (10thcipriani) [21:53:26] (03merge) 10dduvall: version: 1.3.0 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/132 [21:53:57] 10Scap (SpiderPig 🕸️): SpiderPig UI: improve the scrolling behavior - https://phabricator.wikimedia.org/T384053#10925876 (10thcipriani) 05Open→03Invalid Scrolling working ok :) [21:54:52] 10Scap (SpiderPig 🕸️): SpiderPig UI: show some job details in an accordion - https://phabricator.wikimedia.org/T383852#10925880 (10thcipriani) 05Open→03Invalid Job details exist, no further work needed. [21:55:47] 10Scap (SpiderPig 🕸️): SpiderPig UI: address user interface feedback - https://phabricator.wikimedia.org/T383835#10925884 (10thcipriani) 05Open→03Invalid Nothing further to do here aside from addressing new tickets as they come in. [21:59:17] 10Scap (SpiderPig 🕸️): Add a favicon for spiderpig.wikimedia.org - https://phabricator.wikimedia.org/T394104#10925903 (10thcipriani) p:05Triage→03Low [22:00:03] 10Scap (SpiderPig 🕸️): Spiderpig UI should link to mwdebug dashboard in logstash - https://phabricator.wikimedia.org/T393895#10925905 (10thcipriani) [22:02:53] 10Scap (SpiderPig 🕸️), 10Codex, 06Design-System-Team: SpiderPigUI: add a start icon to Backport - https://phabricator.wikimedia.org/T383856#10925930 (10thcipriani) 05Open→03Declined The "Start Backport" button looks good and works well! [22:05:44] 10Scap (SpiderPig 🕸️): SpiderPig UI: add links to user accounts - https://phabricator.wikimedia.org/T383823#10925934 (10thcipriani) 05Open→03Declined Declining this for now as I'm unclear what we'd link to. We could link to the ldap toolforge tool: https://ldap.toolforge.org/user/thcipriani but I've neve... [22:13:26] (03open) 10jgleeson: Update wmf-cv wrapper to point to new standalone install [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/80 (https://phabricator.wikimedia.org/T372005) [22:21:43] (03update) 10jgleeson: Update wmf-cv wrapper to point to new standalone install [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/80 (https://phabricator.wikimedia.org/T372005) [22:54:30] 10Phabricator, 06Release-Engineering-Team, 06collaboration-services, 06DBA: Prepare a database test for m3 - https://phabricator.wikimedia.org/T390034#10926034 (10brennen) Update: scap deploy is working; currently waiting on a run of Phab's storage utility to get through a bunch of `ANALYZE TABLE` stuf... [23:00:10] (03approved) 10ejegg: Update wmf-cv wrapper to point to new standalone install [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/80 (https://phabricator.wikimedia.org/T372005) (owner: 10jgleeson) [23:00:27] (03merge) 10ejegg: Update wmf-cv wrapper to point to new standalone install [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/80 (https://phabricator.wikimedia.org/T372005) (owner: 10jgleeson) [23:26:28] FIRING: PuppetAgentFailure: Puppet agent failure detected on instance deployment-cache-upload08 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [23:26:35] 10Beta-Cluster-Infrastructure: Puppet agent failure detected on instance deployment-cache-upload08 in project deployment-prep - https://phabricator.wikimedia.org/T397263 (10wmcs-alerts) 03NEW [23:26:37] (03open) 10dduvall: wmf: Optimize .pipeline/blubber.yaml [repos/releng/zuul/zuul] (wmf/12.0.0) - 10https://gitlab.wikimedia.org/repos/releng/zuul/zuul/-/merge_requests/12 (https://phabricator.wikimedia.org/T396245) [23:31:53] (03update) 10dduvall: wmf: Optimize .pipeline/blubber.yaml [repos/releng/zuul/zuul] (wmf/12.0.0) - 10https://gitlab.wikimedia.org/repos/releng/zuul/zuul/-/merge_requests/12 (https://phabricator.wikimedia.org/T396245) [23:32:07] (03update) 10dduvall: wmf: Optimize .pipeline/blubber.yaml [repos/releng/zuul/zuul] (wmf/12.0.0) - 10https://gitlab.wikimedia.org/repos/releng/zuul/zuul/-/merge_requests/12 (https://phabricator.wikimedia.org/T396245) [23:41:11] 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Move *.beta.wmflabs.org to *.beta.wmcloud.org - https://phabricator.wikimedia.org/T289318#10926168 (10Krinkle) >>! In T289318#10888891, @bd808 wrote: > […] https://wikidata.beta.wmcloud.org/wiki/Wikidata:Main_Page gives an `Invalid host name (wikidata.beta.wmc... [23:41:28] RESOLVED: PuppetAgentFailure: Puppet agent failure detected on instance deployment-cache-upload08 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [23:41:33] 10Beta-Cluster-Infrastructure: Puppet agent failure detected on instance deployment-cache-upload08 in project deployment-prep - https://phabricator.wikimedia.org/T397263#10926170 (10wmcs-alerts)