[01:00:44] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11292131 (10Krinkle) [08:09:31] 06Data-Engineering, 06Data-Engineering-Radar, 06Discovery-Search, 06Infrastructure-Foundations, and 3 others: Elasticsearch dependency upgrade in spicerack - https://phabricator.wikimedia.org/T390860#11292656 (10elukey) @bking super thanks a lot, I accept the offer! I'll ping you in this task when the rele... [08:14:48] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [08:17:10] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1195348 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [09:08:44] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Data-Platform, 06Movement-Insights (FY25-26 H1): NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11292856 (10GGoncalves-WMF) @calbon mentioned today that we want to make sure to capture th... [09:31:25] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07OKR-Work: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406766#11292959 (10BTullis) a:03BTullis I'll make a start on this. [09:51:52] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 10MediaWiki-extensions-EventLogging, and 2 others: Deprecate and remove MetricsClient#dispatch() - https://phabricator.wikimedia.org/T352969#11293039 (10phuedx) p:05Medium→03High [11:50:59] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Create a new gitlab repository for use with dbt - https://phabricator.wikimedia.org/T406765#11293368 (10BTullis) >>! In T406765#11276663, @Ottomata wrote: > Suggestion: instead of naming the repo 'dbt' which looks a bit more like a fork of 'dbt', name... [12:14:42] (03PS1) 10CDanis: Add ja4h X-Analytics sub-field [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1197625 (https://phabricator.wikimedia.org/T400270) [12:18:18] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07OKR-Work, 13Patch-For-Review: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406766#11293422 (10BTullis) I have [[https://gitlab.wikimedia.org/repos/data-engineeri... [13:05:40] 06Data-Engineering, 06cloud-services-team, 06Data-Persistence, 10Data-Services, and 3 others: Set up x1 replication to Wiki Replicas - https://phabricator.wikimedia.org/T395881#11293564 (10Gehel) p:05Triage→03Medium [13:14:03] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Adapt MW Content pipelines to the removal of upstream revision.rev_sha1 - https://phabricator.wikimedia.org/T405641#11293573 (10xcollazo) All DAGs were successful overnight, although I did need to make a... [13:30:02] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work, 13Patch-For-Review: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11293637 (10xcollazo) [13:48:07] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Prepare data engineering infrastructure for drop of rev_sha1 - https://phabricator.wikimedia.org/T405503#11293754 (10xcollazo) We are done from our side. [13:50:00] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Create a new gitlab repository for use with dbt - https://phabricator.wikimedia.org/T406765#11293759 (10JMonton-WMF) I renamed it to `dbt-jobs`. The repo is renamed but the URL still uses `dbt` https://gitlab.wikimedia.org/repos/data-engineering/dbt I... [13:50:07] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE, 06Movement-Insights, 07Epic: Explore the use of dbt-core and appropriate adapters in the data-platform environment - https://phabricator.wikimedia.org/T406764#11293760 (10GGoncalves-WMF) [14:44:09] (03CR) 10Aleksandar Mastilovic: [V:03+2 C:03+2] Add user_central_id to the mediawiki_history dataset(s) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [14:47:55] (03PS4) 10Aleksandar Mastilovic: Add user central ID columns to mediawiki_history tables [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1195348 (https://phabricator.wikimedia.org/T406263) [14:58:46] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10RESTBase-API, 06serviceops, 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863 (10Ottomata) 03NEW [14:59:16] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Prepare data engineering infrastructure for drop of rev_sha1 - https://phabricator.wikimedia.org/T405503#11294117 (10Ladsgroup) Thanks! [14:59:41] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10RESTBase-API, 06serviceops, 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11294119 (10Ottomata) I much prefer option C, but I'm not sure difficult that might be, or if is setting to strong of a... [15:01:13] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10RESTBase-API, 06serviceops, 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11294146 (10Ottomata) p:05Triage→03High [15:01:35] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06MW-Interfaces-Team, 10RESTBase-API, 06serviceops, 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11294148 (10Ottomata) [15:02:25] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1195348 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [15:04:01] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06MW-Interfaces-Team, 10RESTBase-API, 06serviceops, 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11294152 (10Ottomata) [15:06:53] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06MW-Interfaces-Team, 10RESTBase-API, 06serviceops, 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11294176 (10Ottomata) a:03Ottomata [15:07:50] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Global Editor Metrics - Druid mediawiki_history_reduced changes - https://phabricator.wikimedia.org/T406069#11294178 (10Ottomata) a:03amastilovic [15:14:58] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06MW-Interfaces-Team, 10RESTBase-API, 06serviceops, 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11294203 (10Ottomata) In order to expedite this work, I am considering implementing versioning... [15:21:08] (03CR) 10Ottomata: [C:03+1] Add user central ID columns to mediawiki_history tables [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1195348 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [15:29:49] (03CR) 10Aleksandar Mastilovic: [V:03+2 C:03+2] Add user central ID columns to mediawiki_history tables [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1195348 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [15:43:12] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07OKR-Work, 13Patch-For-Review: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406766#11294359 (10BTullis) I have built a version 0.0.39 of conda-analytics and added... [15:46:39] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07OKR-Work: SDS 1.3.2 Conduct Analysis on Alerting for changes in automated traffic distribution - https://phabricator.wikimedia.org/T406882#11294380 (10Snwachukwu) @Hghani I think for thresholds, the question is should we use a fixed threshold or ro...