[03:18:28] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [05:04:45] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add afl_ip_hex column and afl_var_dump_timestamp index to abuse_filter_log - https://phabricator.wikimedia.org/T396130#10921236 (10Marostegui) [05:05:25] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add afl_ip_hex column and afl_var_dump_timestamp index to abuse_filter_log - https://phabricator.wikimedia.org/T396130#10921241 (10Marostegui) [06:35:14] 06Data-Engineering, 10MediaWiki-DomainEvents, 10ci-test-error (WMF-deployed Build Failure), 10Event-Platform, 13Patch-For-Review: phpunit\integration\PageChangeEmissionTest::testPageMove with data set "Valid move with redirect" ('SourcePageA', 'Destinati... - https://phabricator.wikimedia.org/T397087#10921401 [07:18:28] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [08:26:07] 06Data-Engineering: Consultation Request ­- Pipeline from a Hive query to a Gerrit repository - https://phabricator.wikimedia.org/T387367#10921653 (10phuedx) [08:27:08] 06Data-Engineering: Consultation Request ­- Pipeline from a Hive query to a Gerrit repository - https://phabricator.wikimedia.org/T387367#10921658 (10phuedx) @CDobbins: I've been bold and removed the #experimentation_lab tag and added the #data-engineering tag to match the parent task. LMK if I've misunderstood... [10:43:24] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 10ci-test-error (WMF-deployed Build Failure), 10Event-Platform, 13Patch-For-Review: phpunit\integration\PageChangeEmissionTest::testPageMove with data set "Valid move with red... - https://phabricator.wikimedia.org/T397087#10922323 [10:43:44] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10MediaWiki-DomainEvents, 10ci-test-error (WMF-deployed Build Failure), 10Event-Platform, 13Patch-For-Review: phpunit\integration\PageChangeEmissionTest::testPageMove with data set "Valid move with red... - https://phabricator.wikimedia.org/T397087#10922326 [11:18:28] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [11:22:53] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10922496 (10BTullis) [11:39:26] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10922566 (10FCeratto-WMF) [11:42:02] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10922598 (10FCeratto-WMF) [11:42:06] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10922608 (10BTullis) [12:17:52] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10922690 (10Ladsgroup) [12:18:16] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#10922693 (10Ladsgroup) I took the liberty of updating the task description to make it less confusing of what's done and w... [12:24:50] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10922779 (10BTullis) [12:36:00] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10922845 (10BTullis) [12:39:37] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10922898 (10BTullis) [12:42:53] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10922939 (10BTullis) [12:46:11] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10922978 (10BTullis) [12:52:52] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10923053 (10BTullis) [13:06:48] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10923119 (10BTullis) [13:21:33] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10923223 (10BTullis) [13:32:12] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10923299 (10BTullis) [13:36:47] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10923353 (10BTullis) [14:03:57] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10923505 (10BTullis) [14:16:19] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#10923586 (10BTullis) >>! In T379385#10879542, @xcollazo wrote: >>Spark is 3.5.3 (although we don't currently build spark from Bigtop) > > Interesting. Should... [15:18:28] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [15:24:37] 10Data-Engineering (Q4 2025 April 1st - June 30th), 13Patch-For-Review: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment - https://phabricator.wikimedia.org/T369845#10924164 (10Antoine_Quhen) Where we currently are in the Refine migration : 1/ Data quality Following previous MR (ref... [16:15:54] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: DPE Deep Dive on MW Content Tables - https://phabricator.wikimedia.org/T396882#10924541 (10xcollazo) [16:16:33] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: DPE Deep Dive on MW Content Tables - https://phabricator.wikimedia.org/T396882#10924542 (10xcollazo) Slides: https://docs.google.com/presentation/d/1YaFTRIuy_r7i8eiJPJu81zxCMP5X2GAq4kUxrakeyts/edit?slide=id.p#slide=id.p [16:21:34] 06Data-Engineering: [Iceberg Migration] Extend Iceberg table maintenance mechanism to support multiple Airflow instances - https://phabricator.wikimedia.org/T373693#10924583 (10xcollazo) >>! In T373693#10906965, @amastilovic wrote: > So, now that T383931 has been completed, what else is there that should be done... [17:35:14] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user (and LDAP nda, wmde) for Anton Kokh (WMDE) - https://phabricator.wikimedia.org/T395917#10925011 (10KFrancis) Hi all, I'm confirming the NDA is complete. Thanks! [17:40:42] 06Data-Engineering, 06Data-Engineering-Radar, 10LDAP-Access-Requests, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-user (and LDAP nda, wmde) for Anton Kokh (WMDE) - https://phabricator.wikimedia.org/T395917#10925046 (10herron) [18:33:01] 06Data-Engineering, 10Data-Platform-SRE (2025.06.13 - 2025.07.04): Request for dedicated Airflow instance for WME - https://phabricator.wikimedia.org/T396672#10925243 (10HShaikh) Hey ben, So for the need for new instance was looking at it from a future isolation perspective. (WME doesn't want their jobs to pot... [19:18:28] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [21:33:01] 10Quarry: quarry: Drop manual frontend build process - https://phabricator.wikimedia.org/T396991#10925819 (10Krinkle) I assume the reason it uses Nunjucks is to share the template files between Python and JS. Is that right? That is - are there cases where the same exact template file is used on both sides? Or is... [22:17:58] milimetric: fyi, could use CR on this :) https://gerrit.wikimedia.org/r/c/1156649 [23:18:28] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem