[00:06:45] (03open) 10bd808: CI: fix `tags` syntax [toolforge-repos/containers-rproxy] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-rproxy/-/merge_requests/1 [00:12:59] (03update) 10bd808: CI: fix `tags` syntax [toolforge-repos/containers-rproxy] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-rproxy/-/merge_requests/1 [00:13:25] (03update) 10bd808: CI: fix `tags` syntax [toolforge-repos/containers-rproxy] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-rproxy/-/merge_requests/1 [00:15:33] (03merge) 10bd808: CI: fix `tags` syntax [toolforge-repos/containers-rproxy] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-rproxy/-/merge_requests/1 [00:24:12] (03update) 10raymond-ndibe: jobs-api: add jobs version migration script and docs [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/746 (https://phabricator.wikimedia.org/T359649) (owner: 10dcaro) [00:33:23] (03PS1) 10Wandji collins: chore: update package lock json [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229220 [00:33:49] (03CR) 10Wandji collins: [V:03+2] chore: update package lock json [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229220 (owner: 10Wandji collins) [00:35:45] (03CR) 10Wandji collins: [V:03+2 C:03+2] chore: update package lock json [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229220 (owner: 10Wandji collins) [00:45:29] (03update) 10raymond-ndibe: jobs-api: add jobs version migration script and docs [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/746 (https://phabricator.wikimedia.org/T359649) (owner: 10dcaro) [00:52:08] (03update) 10raymond-ndibe: jobs-api: add jobs version migration script and docs [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/746 (https://phabricator.wikimedia.org/T359649) (owner: 10dcaro) [01:04:03] (03update) 10raymond-ndibe: jobs-api: add jobs version migration script and docs [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/746 (https://phabricator.wikimedia.org/T359649) (owner: 10dcaro) [01:06:08] (03PS1) 10Wandji collins: chore: update lockfile to include @swc/helpers@0.5.18 [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229233 [01:07:53] (03CR) 10Wandji collins: [V:03+1 C:03+1] chore: update lockfile to include @swc/helpers@0.5.18 [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229233 (owner: 10Wandji collins) [01:08:01] (03CR) 10Wandji collins: [V:03+1 C:03+2] chore: update lockfile to include @swc/helpers@0.5.18 [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229233 (owner: 10Wandji collins) [01:08:40] (03Merged) 10jenkins-bot: chore: update lockfile to include @swc/helpers@0.5.18 [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229233 (owner: 10Wandji collins) [01:11:42] (03CR) 10Wandji collins: [V:03+2 C:03+2] chore: update lockfile to include @swc/helpers@0.5.18 [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229233 (owner: 10Wandji collins) [01:13:26] (03update) 10raymond-ndibe: jobs-api: add jobs version migration script and docs [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/746 (https://phabricator.wikimedia.org/T359649) (owner: 10dcaro) [01:40:46] (03open) 10bd808: README: update deployment instructions [toolforge-repos/containers-rproxy] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-rproxy/-/merge_requests/2 [01:52:01] (03update) 10bd808: README: update deployment instructions [toolforge-repos/containers-rproxy] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-rproxy/-/merge_requests/2 [01:53:06] (03merge) 10bd808: README: update deployment instructions [toolforge-repos/containers-rproxy] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-rproxy/-/merge_requests/2 [01:59:18] 10Tool-campwiz-nxt, 10Google-Summer-of-Code (Google Summer of Code (2026)): GSoC 2026: CampWiz NxT Redesign - https://phabricator.wikimedia.org/T414269#11540062 (10Hridyesh_Gupta) Hello @Sanjaydevs, the period where potential contributors interact with mentors has not started yet, so maybe you should wait for... [02:01:20] 10wikitech.wikimedia.org, 10Pywikibot: Request access to Wikitech for Pywikibot and Database Reports - https://phabricator.wikimedia.org/T415157 (10kairat_zamirbekov) 03NEW [02:04:12] 10wikitech.wikimedia.org: Request access to Wikitech for Pywikibot and Database Reports - https://phabricator.wikimedia.org/T415157#11540075 (10JJMC89) 05Open→03Invalid Use your existing Wikimedia account to login to Wikitech. [02:30:56] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Persistence: Add datetime versions of timestamp fields to Wikireplica databases - https://phabricator.wikimedia.org/T414199#11540129 (10Huji) >>! In T414199#11511823, @Marostegui wrote: > Maybe you can explore virtual columns? https://maria... [02:31:44] (03PS1) 10Wandji collins: Homepage redirect to route with locale [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229250 (https://phabricator.wikimedia.org/T415159) [02:34:02] (03CR) 10Wandji collins: [C:03+2] Homepage redirect to route with locale [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229250 (https://phabricator.wikimedia.org/T415159) (owner: 10Wandji collins) [02:34:45] (03Merged) 10jenkins-bot: Homepage redirect to route with locale [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229250 (https://phabricator.wikimedia.org/T415159) (owner: 10Wandji collins) [03:37:31] (03update) 10raymond-ndibe: jobs-api: add jobs version migration script and docs [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/746 (https://phabricator.wikimedia.org/T359649) (owner: 10dcaro) [03:51:46] (03update) 10raymond-ndibe: change permission of home dir to 0701 [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/305 [03:53:42] (03update) 10raymond-ndibe: change permission of home dir to 0701 [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/305 [06:30:21] 06cloud-services-team (Hardware), 06DC-Ops, 10ops-eqiad, 06SRE: Q2:rack/setup/install clouddb1026-1033 - https://phabricator.wikimedia.org/T409162#11540335 (10Marostegui) [06:31:23] 06cloud-services-team, 10Data-Services, 06Data-Persistence: Install a clouddb hosts with Debian Trixie - https://phabricator.wikimedia.org/T415165#11540338 (10Marostegui) [08:29:39] 10Tool-inteGraality: Error (first time using inteGraality) - https://phabricator.wikimedia.org/T415138#11540417 (10JeanFred) hi @RobinIsadorable , thanks for using integraality and for reporting this. Can you provide more details here? Which dashboard were you trying to work on − can you provide a link? [08:34:31] 10Tool-inteGraality: Clear indication in column header that one is looking at label, description or alias - https://phabricator.wikimedia.org/T395203#11540424 (10JeanFred) Sounds like a good idea. Any suggestions on how to make the distinction? :) [09:33:42] 10Cloud-VPS (Quota-requests): Increase quota for wikiqlever - https://phabricator.wikimedia.org/T414983#11540515 (10fgiunchedi) Understood, thank you @Physikerwelt for the explanation [09:46:28] 10Cloud-VPS (Quota-requests): Increase quota for wikiqlever - https://phabricator.wikimedia.org/T414983#11540525 (10Daniel_Mietchen) [10:08:31] (03open) 10marostegui: task_template_es_primary, task_template_primary: Small consistency fix [toolforge-repos/switchmaster] - 10https://gitlab.wikimedia.org/toolforge-repos/switchmaster/-/merge_requests/17 [10:09:12] (03merge) 10marostegui: task_template_es_primary, task_template_primary: Small consistency fix [toolforge-repos/switchmaster] - 10https://gitlab.wikimedia.org/toolforge-repos/switchmaster/-/merge_requests/17 [10:11:03] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Persistence: Add datetime versions of timestamp fields to Wikireplica databases - https://phabricator.wikimedia.org/T414199#11540600 (10fnegri) > The //real// solution here is to have OLAP databases provided on #data-services which are not... [11:13:25] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Persistence: Add datetime versions of timestamp fields to Wikireplica databases - https://phabricator.wikimedia.org/T414199#11540745 (10Ladsgroup) Yeah, to me this feels a bit of x/y problem. A proper solution would be having an OLAP infra... [11:17:04] 10Tool-containers: Create a reusable container to replace nginx ingress anonymizing reverse proxy setups - https://phabricator.wikimedia.org/T414836#11540749 (10taavi) [11:17:06] 06cloud-services-team, 10Toolforge: Remove remaining uses of ingress-nginx specific annotations - https://phabricator.wikimedia.org/T414674#11540750 (10taavi) [11:17:10] 06cloud-services-team, 10Toolforge: Replace ingress-nginx before upstream EOL date - https://phabricator.wikimedia.org/T392356#11540751 (10taavi) [11:23:33] (03update) 10ladsgroup: task_template_es_primary, task_template_primary: Small consistency fix [toolforge-repos/switchmaster] - 10https://gitlab.wikimedia.org/toolforge-repos/switchmaster/-/merge_requests/17 (owner: 10marostegui) [12:55:00] 06cloud-services-team, 10Toolforge: Replace ingress-nginx before upstream EOL date - https://phabricator.wikimedia.org/T392356#11541061 (10taavi) [12:55:26] (03open) 10taavi: Cleanup [repos/cloud/toolforge/ingress-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/34 [13:06:23] 06cloud-services-team, 10Toolforge: Move ingress annotations to an allowlist model - https://phabricator.wikimedia.org/T415192 (10taavi) 03NEW [13:06:32] 06cloud-services-team, 10Toolforge: Move ingress annotations to an allowlist model - https://phabricator.wikimedia.org/T415192#11541099 (10taavi) [13:06:34] 06cloud-services-team, 10Toolforge: Remove remaining uses of ingress-nginx specific annotations - https://phabricator.wikimedia.org/T414674#11541100 (10taavi) [13:27:48] (03open) 10taavi: server: Allowlist permitted annotations [repos/cloud/toolforge/ingress-admission] (push-pqmrmzqtznvs) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/35 (https://phabricator.wikimedia.org/T415192) [13:29:43] (03update) 10taavi: server: Allowlist permitted annotations [repos/cloud/toolforge/ingress-admission] (push-pqmrmzqtznvs) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/35 (https://phabricator.wikimedia.org/T415192) [13:30:21] 06cloud-services-team, 10Toolforge, 13Patch-For-Review: Move ingress annotations to an allowlist model - https://phabricator.wikimedia.org/T415192#11541143 (10taavi) a:03taavi [13:46:58] 06cloud-services-team, 10Data-Services, 10Datasets-General-or-Unknown: Move dumps.wikimedia.org HTTP service behind CDN edge - https://phabricator.wikimedia.org/T306550#11541202 (10taavi) [14:35:53] 06cloud-services-team, 10Toolforge, 13Patch-For-Review: Move ingress annotations to an allowlist model - https://phabricator.wikimedia.org/T415192#11541565 (10fnegri) p:05Triage→03High [14:50:46] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Persistence: Add datetime versions of timestamp fields to Wikireplica databases - https://phabricator.wikimedia.org/T414199#11542026 (10Ottomata) +1 to #Data-Services OLAP infra. BTW, We started a project in 2018 to do this, but canned i... [14:53:07] 06cloud-services-team, 10Toolforge: Toolforge NFS tracing misses some dumps events - https://phabricator.wikimedia.org/T415199 (10taavi) 03NEW [14:53:30] 06cloud-services-team, 10Data-Services, 06Data-Persistence: Install a clouddb hosts with Debian Trixie - https://phabricator.wikimedia.org/T415165#11542051 (10fnegri) +1 from me, any host in `clouddb10[26-33]` should be fine [14:53:48] 06cloud-services-team, 10Data-Services: [wikireplicas] Create views for new wiki pplwiki - https://phabricator.wikimedia.org/T415050#11542055 (10fnegri) p:05Triage→03Medium [14:54:10] 06cloud-services-team, 10Data-Services: [wikireplicas] Create views for new wiki kajwiki - https://phabricator.wikimedia.org/T415041#11542057 (10fnegri) p:05Triage→03Medium [14:54:19] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Persistence: Add datetime versions of timestamp fields to Wikireplica databases - https://phabricator.wikimedia.org/T414199#11542059 (10taavi) 05Open→03Declined OLAP infrastructure is tracked elsewhere as indicated above. It seems l... [14:55:45] 06cloud-services-team, 10Data-Services, 06Data-Persistence: Install a clouddb hosts with Debian Trixie - https://phabricator.wikimedia.org/T415165#11542069 (10taavi) If this goes well, any reason not to install all of those on Trixie from the start to avoid having to re-image them later? [15:03:00] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Persistence: Add datetime versions of timestamp fields to Wikireplica databases - https://phabricator.wikimedia.org/T414199#11542118 (10Ottomata) Suggestion: If OLAP infra in Cloud Services is something a significant portion of the deve... [15:04:20] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Engineering-Icebox, 07Epic: Plan a replacement for wiki replicas that is better suited to typical OLAP use cases than the MediaWiki OLTP schema - https://phabricator.wikimedia.org/T215858#11542120 (10Ottomata) Suggestion: If OLAP infra in... [15:52:11] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Data-Services, 06Data-Persistence: Install a clouddb hosts with Debian Trixie - https://phabricator.wikimedia.org/T415165#11542367 (10fnegri) p:05Triage→03Medium I would suggest: 1. reimage one host 2. install mariadb and set up replication on that host 3. if... [16:10:44] FIRING: MaintainDBUsersManyErrors: Maintain-dbusers is having sustained errors - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainDBUsersManyErrors - https://grafana.wikimedia.org/d/ae240a06-c13e-49f3-b12c-58432c551e85/wmcs-maintain-dbusers - https://alerts.wikimedia.org/?q=alertname%3DMaintainDBUsersManyErrors [16:11:11] 06cloud-services-team, 10Toolforge: Toolforge NFS tracing misses some dumps events - https://phabricator.wikimedia.org/T415199#11542429 (10fnegri) p:05Triage→03Medium [16:15:44] RESOLVED: MaintainDBUsersManyErrors: Maintain-dbusers is having sustained errors - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainDBUsersManyErrors - https://grafana.wikimedia.org/d/ae240a06-c13e-49f3-b12c-58432c551e85/wmcs-maintain-dbusers - https://alerts.wikimedia.org/?q=alertname%3DMaintainDBUsersManyErrors [16:20:32] 06cloud-services-team, 10Data-Services, 10VPS-Projects, 13Patch-For-Review: Requesting access to NFS mount /public/dumps for wikiqlever Cloud VPS project - https://phabricator.wikimedia.org/T414986#11542474 (10fnegri) 05In progress→03Resolved Verified that mounts are working on `qlever1.wikiqlever.... [16:23:20] 06cloud-services-team, 10Data-Services, 10VPS-Projects, 13Patch-For-Review: Requesting access to NFS mount /public/dumps for wikiqlever Cloud VPS project - https://phabricator.wikimedia.org/T414986#11542493 (10Physikerwelt) Thank you very much. This works now as expected. Here the logs from the puppet... [16:43:41] 06cloud-services-team (FY2025/2026-Q3-Q4), 10Data-Services, 06Data-Persistence: Install a clouddb hosts with Debian Trixie - https://phabricator.wikimedia.org/T415165#11542554 (10Marostegui) >>! In T415165#11542069, @taavi wrote: > If this goes well, any reason not to install all of those on Trixie from the... [16:56:48] 10Tool-containers: Create a reusable container to replace nginx ingress anonymizing reverse proxy setups - https://phabricator.wikimedia.org/T414836#11542598 (10bd808) I have an initial working solution at https://gitlab.wikimedia.org/toolforge-repos/containers-rproxy. I have deployed it to replace the tool-bd80... [17:25:56] 10Tool-wikicontest, 06Indic MediaWiki Developers UG, 06Indic-TechCom: Add “Trusted Members” section (managed by Superadmin) to allow contest creation - https://phabricator.wikimedia.org/T414402#11542712 (10Adityakumar0545) 05Resolved→03Open [17:26:09] 10Tool-wikicontest, 06Indic MediaWiki Developers UG, 06Indic-TechCom: Add “Trusted Members” section (managed by Superadmin) to allow contest creation - https://phabricator.wikimedia.org/T414402#11542714 (10Adityakumar0545) 05Open→03Resolved [17:27:20] 10Tool-wikicontest, 06Indic-TechCom: Add Reference Count Validation in Wikicontest Tool - https://phabricator.wikimedia.org/T414477#11542718 (10Adityakumar0545) 05Open→03Resolved [18:06:07] 10Cloud-VPS (Quota-requests): Increase quota for wikiqlever - https://phabricator.wikimedia.org/T414983#11542790 (10Andrew) +1 this is just fine if the project winds up succeeding and having users. Please try to fail fast and let us know if you wind up not using things. [18:14:18] 06cloud-services-team, 10PAWS: [bug] File list is not shown in the Terminal - https://phabricator.wikimedia.org/T414860#11542806 (10bd808) 05Resolved→03Invalid [19:17:59] 06cloud-services-team, 10Data-Services, 06Data-Engineering, 06Data-Persistence, and 3 others: Set up x1 replication to Wiki Replicas - https://phabricator.wikimedia.org/T395881#11543080 (10Ladsgroup) 05Open→03Stalled Blocked on {T415219} [20:12:47] 10Tool-inteGraality: Error (first time using inteGraality) - https://phabricator.wikimedia.org/T415138#11543223 (10RobinIsadorable) https://www.wikidata.org/wiki/User:RobinIsadorable/sandbox [20:13:18] 10Tool-inteGraality: Error (first time using inteGraality) - https://phabricator.wikimedia.org/T415138#11543224 (10RobinIsadorable) I don't know if it's a formatting issue on my part or a tool issue. [21:40:06] (03PS1) 10Wandji collins: Fix: api endpoint to production and not to local endpoint. [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229711 [21:40:53] 10Tool-containers: Create a reusable container to replace nginx ingress anonymizing reverse proxy setups - https://phabricator.wikimedia.org/T414836#11543464 (10bd808) Looking at P87548 I just realized that the current rproxy solution I have built really only works to provide a single reverse proxy per Toolforge... [21:43:09] (03CR) 10Wandji collins: [V:03+1 C:03+1] Fix: api endpoint to production and not to local endpoint. [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229711 (owner: 10Wandji collins) [21:43:49] (03CR) 10Wandji collins: [V:03+1 C:03+2] Fix: api endpoint to production and not to local endpoint. [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229711 (owner: 10Wandji collins) [21:44:33] (03Merged) 10jenkins-bot: Fix: api endpoint to production and not to local endpoint. [labs/tools/WdTmCollab] - 10https://gerrit.wikimedia.org/r/1229711 (owner: 10Wandji collins) [22:17:38] 10Tool-spacemedia, 06Commons, 10MediaWiki-File-management: Make image hashes available through API or database query on Commons - https://phabricator.wikimedia.org/T167947#11543519 (10Mike_Peel) MediaWiki already checks hashes of new uploads against existing files and prevents uploads of duplicates from what... [22:20:20] (03PS1) 10Jforrester: build: Upgrade mediawiki/mediawiki-phan-config from 0.17.0 to 0.18.0 [labs/tools/coverme] - 10https://gerrit.wikimedia.org/r/1229734 [22:21:42] (03CR) 10Reedy: [C:03+2] build: Upgrade mediawiki/mediawiki-phan-config from 0.17.0 to 0.18.0 [labs/tools/coverme] - 10https://gerrit.wikimedia.org/r/1229734 (owner: 10Jforrester) [22:22:21] (03Merged) 10jenkins-bot: build: Upgrade mediawiki/mediawiki-phan-config from 0.17.0 to 0.18.0 [labs/tools/coverme] - 10https://gerrit.wikimedia.org/r/1229734 (owner: 10Jforrester) [22:34:21] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2005-dev.codfw.wmnet' (Txxxxxx) [22:50:01] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2005-dev.codfw.wmnet' (Txxxxxx) [22:50:17] FIRING: JobUnavailable: Reduced availability for job openstack in cloud@codfw - https://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_job_unavailable - https://grafana.wikimedia.org/d/NEJu05xZz/prometheus-targets - https://alerts.wikimedia.org/?q=alertname%3DJobUnavailable [22:55:17] RESOLVED: JobUnavailable: Reduced availability for job openstack in cloud@codfw - https://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_job_unavailable - https://grafana.wikimedia.org/d/NEJu05xZz/prometheus-targets - https://alerts.wikimedia.org/?q=alertname%3DJobUnavailable [22:56:34] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2006-dev.codfw.wmnet' (Txxxxxx) [23:03:21] !log andrew@cloudcumin1001 admin END (FAIL) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=99) on host 'cloudcontrol2006-dev.codfw.wmnet' (Txxxxxx) [23:18:41] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2006-dev.codfw.wmnet' (Txxxxxx) [23:18:42] !log andrew@cloudcumin1001 admin END (ERROR) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=97) on host 'cloudcontrol2006-dev.codfw.wmnet' (Txxxxxx) [23:18:46] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2006-dev.codfw.wmnet' [23:22:55] !log andrew@cloudcumin1001 admin END (FAIL) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=99) on host 'cloudcontrol2006-dev.codfw.wmnet' [23:24:48] 10Tool-spacemedia, 06Commons, 10MediaWiki-File-management: Make image hashes available through API or database query on Commons - https://phabricator.wikimedia.org/T167947#11543623 (10Bawolff) >>! In T167947#11543519, @Mike_Peel wrote: > MediaWiki already checks hashes of new uploads against existing files a... [23:31:33] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2006-dev.codfw.wmnet' [23:47:39] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2006-dev.codfw.wmnet' [23:54:18] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2010-dev.codfw.wmnet'