[00:11:39] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11288227 (10toni.stoev) Now that mobile and desktop are served from the same URL, I am kind of satisfied... [06:50:48] 06Data-Engineering: Stop sqooping revision.rev_sha1 - https://phabricator.wikimedia.org/T406644#11288461 (10JAllemandou) I did this as part of T406000. See https://gerrit.wikimedia.org/r/c/operations/puppet/+/1196631 [06:51:19] 06Data-Engineering: Stop sqooping revision.rev_sha1 - https://phabricator.wikimedia.org/T406644#11288464 (10JAllemandou) →14Duplicate dup:03T406000 [06:51:20] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Adapt mediawiki_history to the removal of mediawiki revision.rev_sha1 - https://phabricator.wikimedia.org/T406000#11288466 (10JAllemandou) [09:54:46] (03CR) 10Guilherme Gonçalves: WIP: traffic_signals schema draft (035 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1196959 (owner: 10CDanis) [10:00:59] 06Data-Engineering, 10Dumps-Generation, 06Wikibase Reuse Team, 10Wikidata, and 3 others: No Wikidata dumps for Week 40 of 2025 (recurring issue) - https://phabricator.wikimedia.org/T406429#11288936 (10BTullis) Good news! The patch to switch database servers seems to have worked. The latest runs of `mediawi... [10:37:48] 06Data-Engineering, 10Dumps-Generation, 06Wikibase Reuse Team, 10Wikidata, and 3 others: No Wikidata dumps for Week 40 of 2025 (recurring issue) - https://phabricator.wikimedia.org/T406429#11288992 (10BTullis) I have created {T407735}, which describes the housekeeping issue in detail. [10:45:35] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 10Data-Persistence-Design-Review: Global Editor Metrics - Data Persistence Design Review - https://phabricator.wikimedia.org/T401260#11289019 (10Ottomata) [10:53:19] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work, 13Patch-For-Review: Global Editor Metrics - Data Pipeline - user_edited_pages - https://phabricator.wikimedia.org/T407559#11289027 (10Ottomata) TIL about [[ https://datahub.wikimedia.org/dataset/urn:li:d... [11:02:33] 06Data-Engineering, 10Dumps-Generation, 06Wikibase Reuse Team, 10Wikidata, and 3 others: No Wikidata dumps for Week 40 of 2025 (recurring issue) - https://phabricator.wikimedia.org/T406429#11289046 (10BTullis) I have manually removed 5.1 TB of old dumps from the cephfs volume in T407735#11289038 and I have... [11:49:01] 06Data-Engineering, 06Infrastructure-Foundations, 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07Essential-Work, 13Patch-For-Review: Also intake Network Error Logging events into the Analytics Data Lake - https://phabricator.wikimedia.org/T304373#11289152 (10brouberol) {F66766592} Nice! I can see i... [14:40:02] 06Data-Engineering, 06Discovery-Search, 06Java-Scala-Standardization, 07Essential-Work: Ignore MacOS .DS_Store in parent pom - https://phabricator.wikimedia.org/T407514#11290013 (10Gehel) [14:43:18] 06Data-Engineering, 06Java-Scala-Standardization, 06Discovery-Search (2025.09.26 - 2025.10.17), 07Essential-Work: Ignore MacOS .DS_Store in parent pom - https://phabricator.wikimedia.org/T407514#11290030 (10pfischer) [15:27:25] 06Data-Engineering, 06Java-Scala-Standardization, 06Discovery-Search (2025.09.26 - 2025.10.17), 07Essential-Work: Ignore MacOS .DS_Store in parent pom - https://phabricator.wikimedia.org/T407514#11290244 (10EBernhardson) MR: https://gitlab.wikimedia.org/repos/maven/wmf-jvm-parent-pom/-/merge_requests/27 [15:27:36] 06Data-Engineering, 06Java-Scala-Standardization, 06Discovery-Search (2025.09.26 - 2025.10.17), 07Essential-Work: Ignore MacOS .DS_Store in parent pom - https://phabricator.wikimedia.org/T407514#11290247 (10EBernhardson) a:03EBernhardson [16:08:52] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Global Editor Metrics - Data Pipeline - https://phabricator.wikimedia.org/T405039#11290461 (10Ottomata) === Daily source dataset decision > Add user_central_id to mediawiki_content_history_v1 and use it a... [16:10:18] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Global Editor Metrics - Data Pipeline - https://phabricator.wikimedia.org/T405039#11290466 (10Ottomata) > user_edited_pages_daily0 looks unnecessary to me, but I could be convinced otherwise. WIP Typo! I... [16:12:59] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work, 13Patch-For-Review: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11290471 (10Ottomata) @xcollazo Marcel and I just di... [16:15:45] (03CR) 10Aleksandar Mastilovic: Add user_central_id to the mediawiki_history dataset(s) (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [16:54:46] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Growth-Team, 10MediaWiki-Page-derived-data, 06Wikipedia-Android-App-Backlog, and 3 others: Global Editor Metrics - HTTP API endpoints - https://phabricator.wikimedia.org/T405041#11290629 (10Ottomata) @mforns @Sfaci and @APizzata-WMF [[ https://... [17:00:23] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox: Sort inconsistency in AQS timestamp behavior - https://phabricator.wikimedia.org/T160311#11290648 (10Ottomata) [17:35:31] 06Data-Engineering, 10Event-Platform: mediawiki_event_enrichment - update default params and tests to use mediawiki/page_change 1.3.0 (latest) schema - https://phabricator.wikimedia.org/T407779 (10Ottomata) 03NEW [17:41:49] (03CR) 10Ottomata: "In the nice to have in https://phabricator.wikimedia.org/T406263:" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1195348 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [17:44:59] 06Data-Engineering, 10Event-Platform: mediawiki_event_enrichment - update default params and tests to use mediawiki/page_change 1.3.0 (latest) schema - https://phabricator.wikimedia.org/T407779#11290772 (10Ottomata) [17:45:59] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work, 13Patch-For-Review: Global Editor Metrics - Data Pipeline - user_edited_pages - https://phabricator.wikimedia.org/T407559#11290778 (10Ottomata) [17:46:22] (03CR) 10Aleksandar Mastilovic: "Sounds good to me, what do you think @joal@wikimedia.org?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1195348 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [17:49:58] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Modify code to dump all slots - https://phabricator.wikimedia.org/T384945#11290784 (10xcollazo) Confirming that `commonswiki` MCR output looks syntactically correct. Further semantic checks will be done... [17:58:30] 06Data-Engineering, 06Experimentation Lab, 10MediaWiki-extensions-WikimediaEvents, 05MW-1.45-notes (1.45.0-wmf.23; 2025-10-14), 13Patch-For-Review: Prepare mediawiki-client-error Logstash dashboards for mobile subdomain sunsetting - https://phabricator.wikimedia.org/T400852#11290839 (10Jdlrobson-WMF) [18:05:00] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 06Data-Persistence (work done), and 3 others: Update DB schema to store whether contribution tracking is enabled for a given event - https://phabricator.wikimedia.org/T402816#11290872 (10ifried) 05Open→03Resolved [18:10:01] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Adapt MW Content pipelines to the removal of upstream revision.rev_sha1 - https://phabricator.wikimedia.org/T405641#11290900 (10xcollazo) From [[ https://gitlab.wikimedia.org/repos/data-engineering/dumps... [18:12:47] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work, 13Patch-For-Review: mediawiki_history_reduced - add page_id and user_central_id fields - https://phabricator.wikimedia.org/T406263#11290905 (10Ottomata) [19:11:35] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Adapt MW Content pipelines to the removal of upstream revision.rev_sha1 - https://phabricator.wikimedia.org/T405641#11291107 (10xcollazo) Paused all related DAGs. [19:17:42] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Adapt MW Content pipelines to the removal of upstream revision.rev_sha1 - https://phabricator.wikimedia.org/T405641#11291135 (10xcollazo) Ran the followin in production: ` $ hostname -f an-launcher1002.e... [19:18:15] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work, 13Patch-For-Review: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11291142 (10xcollazo) >>! In T405641#11291135, @xcol... [19:19:13] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Adapt MW Content pipelines to the removal of upstream revision.rev_sha1 - https://phabricator.wikimedia.org/T405641#11291145 (10xcollazo) Resumed all related DAGs [19:29:47] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Adapt MW Content pipelines to the removal of upstream revision.rev_sha1 - https://phabricator.wikimedia.org/T405641#11291232 (10xcollazo) Updated wikitech: https://wikitech.wikimedia.org/w/index.php?tit...