[01:29:05] 06Data-Engineering, 06Data-Engineering-Icebox: Use hive metastore when registering views - https://phabricator.wikimedia.org/T350617#11408060 (10Milimetric) a:05Milimetric→03None [02:05:48] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11408086 (10xcollazo) Funnily enough, now there are now 4.3M rows more on the target table than the source: `... [06:13:50] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11408208 (10Marostegui) [09:14:23] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11408495 (10APizzata-WMF) All the action items from my side have been published on the document [10:24:14] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11408750 (10JAllemandou) > Funnily enough, now there are now 4.3M rows more on the target table than the sourc... [10:26:19] (03PS2) 10Aqu: Add Spur datasets HQLs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1210696 (https://phabricator.wikimedia.org/T410285) [10:46:50] (03CR) 10Joal: [C:03+1] "One question about location, code looks good :)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1210696 (https://phabricator.wikimedia.org/T410285) (owner: 10Aqu) [11:40:59] 06Data-Engineering, 06Data-Engineering-Radar, 10Observability-Logging, 06serviceops, and 2 others: Fix Kafka replicas skew - https://phabricator.wikimedia.org/T407185#11409008 (10Clement_Goubert) 05Open→03In progress [14:32:30] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11409619 (10xcollazo) (Opened {T411100} to follow up on the driver memory limitation) [14:53:27] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11409702 (10xcollazo) >>! In T410688#11408750, @JAllemandou wrote: >> Funnily enough, now there are now 4.3M r... [14:54:35] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11409704 (10xcollazo) Documentation from table doesn't help much: https://www.mediawiki.org/wiki/Extension:Cen... [16:39:46] 06Data-Engineering, 06Data-Engineering-Radar, 10Observability-Logging, 06serviceops, and 2 others: Fix Kafka replicas skew - https://phabricator.wikimedia.org/T407185#11410134 (10Clement_Goubert) Rebalance done on kafka-main-eqiad {F70672099} Partition count stays imbalanced due to partition size variance,... [16:47:17] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11410171 (10Marostegui) [17:09:31] 06Data-Engineering: Productize Data for Monthly Active Moderator Actions - https://phabricator.wikimedia.org/T410940#11410273 (10SonjaPerry) Hi @GGoncalves-WMF! Thanks for taking this on! To your comment about currently seeing this as essential work - if possible, I would suggest making this a hypothesis under W... [17:11:42] 06Data-Engineering, 10superset.wikimedia.org, 06Data-Platform-SRE (2025.11.07 - 2025.11.28), 07Essential-Work: Thanos / Prometheus metrics names with uppercase characters not accessible from Superset SQL Lab or Presto CLI - https://phabricator.wikimedia.org/T409874#11410292 (10Ahoelzl) p:05Medium→03Low... [17:12:32] 06Data-Engineering, 06Data-Engineering-Radar, 10superset.wikimedia.org, 06Data-Platform-SRE (2025.11.07 - 2025.11.28), 07Essential-Work: Thanos / Prometheus metrics names with uppercase characters not accessible from Superset SQL Lab or Presto CLI - https://phabricator.wikimedia.org/T409874#11410296 (10Ah... [17:13:44] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11410300 (10Ahoelzl) @JAllemandou is this relevant for Data Engineering? [17:17:20] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 06Test Kitchen, 07Essential-Work, 07Technical-Debt: Stop adding user-agent details to http.request_header.user-agent directly via EventLogging - https://phabricator.wikimedia.org/T408719#11410311 (10Ahoelzl) @JVanderhoop-WMF can you help us underst... [17:19:44] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Data-Engineering-Wikistats, 06Movement-Insights: NEW FEATURE REQUEST: Temp Accounts on Wikistats - https://phabricator.wikimedia.org/T410796#11410327 (10Ahoelzl) [17:22:22] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-extensions-EventLogging, 06Test Kitchen, and 2 others: [EPIC] Deprecate and remove mw.eventLog.id - https://phabricator.wikimedia.org/T408177#11410333 (10Ahoelzl) [17:25:40] 06Data-Engineering, 10Data-Engineering-Wikistats: Get visibility which pages are being heavily edited, plundered, which need patrolling - https://phabricator.wikimedia.org/T315196#11410353 (10Ahoelzl) 05Open→03Declined 3 years old ticket. Please re-open if still needed. [17:28:01] 06Data-Engineering, 10DPE-Mediawiki-Content: When wikis cannot be exported due to SiteInfo, don't fail them - https://phabricator.wikimedia.org/T408819#11410377 (10Ahoelzl) How often do we run into this case? Could this be handled by documentation / run book for the person on OpsWeek? [17:48:13] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Data-Engineering-Wikistats, 06Movement-Insights: NEW FEATURE REQUEST: Temp Accounts on Wikistats - https://phabricator.wikimedia.org/T410796#11410454 (10Mayakp.wiki) Ok, I added an entry to the [[ https://meta.wikimedia.org/w/index.php?title=Con... [18:19:19] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11410585 (10xcollazo) Now running a backfilling SQL that deduplicates `wmf_raw.centralauth_localuser` with a h... [18:57:31] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 13Patch-For-Review: Provision Global Editor Metrics tables & endpoints - https://phabricator.wikimedia.org/T410962#11410733 (10Eevans) Ok, schema has been created, grants made, and DG v1.0.14 has been deployed to //staging//. L... [19:02:53] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11410751 (10JAllemandou) We quickly chat with @xcollazo and decided that, since time is pressing, we are going... [19:50:09] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Review and productionize the WME differential privacy data set - https://phabricator.wikimedia.org/T409601#11410941 (10Snwachukwu) a:03Snwachukwu [20:39:49] 06Data-Engineering, 10DPE-Mediawiki-Content: When wikis cannot be exported due to SiteInfo, don't fail them - https://phabricator.wikimedia.org/T408819#11411030 (10xcollazo) >>! In T408819#11410377, @Ahoelzl wrote: > How often do we run into this case? Could this be handled by documentation / run book for the... [20:45:15] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11411034 (10JAllemandou) >>! In T410531#11410299, @Ahoelzl wrote: > @JAllemandou is this relevant for Data Engineering? This is not relevant for DE, we don'... [21:50:32] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11411288 (10xcollazo) Backfilling rerun from T410688#11410585 finished successfully, but it struggled with a c... [22:16:35] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11411385 (10xcollazo) @JAllemandou table `wmf_content.mediawiki_revision_history` has been backfilled, and the...