[00:44:49] (03PS1) 10Gerrit maintenance bot: Add zgh.wiktionary to pageview allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1170221 (https://phabricator.wikimedia.org/T399785) [03:19:25] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [03:29:43] 06Data-Engineering, 06Data-Engineering-Radar, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#11011720 (10Krinkle) [03:35:17] 06Data-Engineering, 06Data-Engineering-Radar, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#11011722 (10Novem_Linguae) Looks like we've ticked most the boxes and resolved most the subtasks. Might be... [04:56:13] 06Data-Engineering, 06Data-Engineering-Radar, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#11011816 (10Krinkle) [06:05:45] 06Data-Engineering, 06Data-Engineering-Radar, 10CheckUser, 06DBA, and 2 others: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11011845 (10Marostegui) p:05Triage→03Medium a:03FCeratto-WMF Could you wor... [07:19:25] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [07:34:40] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11012015 (10Marostegui) [07:51:03] 14Analytics-Radar, 06Data-Engineering-Radar, 10TimedMediaHandler, 07Video: Record and report metrics for audio and video playback - https://phabricator.wikimedia.org/T108522#11012046 (10TheDJ) [07:53:05] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11012051 (10TheDJ) @AndrewTavis_WMDE just a note, that browsers can preload video. So request data does not necessarily correlate to an actual view. [07:59:54] 06Data-Engineering, 06Data-Engineering-Radar, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#11012061 (10jijiki) [08:00:50] 06Data-Engineering, 06Data-Engineering-Radar, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#11012072 (10jijiki) [09:15:42] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11012411 (10AndrewTavis_WMDE) Thanks for checking in here, @TheDJ 👋 Can we check the conditions with you, as as I understood it the approach we'd taken was getting around th... [10:07:08] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Upgrade Hadoop to version 3.3.6 and Hive to version 4.0.1 - https://phabricator.wikimedia.org/T379385#11012540 (10BTullis) [11:19:25] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [12:16:39] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11012993 (10TheDJ) Can you give examples of these requests that we are filtering? If they are directly on the video, are you only checking requests that have the Range heade... [12:35:48] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11013053 (10TheDJ) Additional note. If you also count the thumbnail poster downloads of videos, then by combining these numbers, You can give a rough estimate of the click t... [13:07:41] (03CR) 10Hasan Akgün (WMDE): [C:03+2] Use WikimediaDbList more consistently [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1163315 (owner: 10Lucas Werkmeister (WMDE)) [13:08:14] (03Merged) 10jenkins-bot: Use WikimediaDbList more consistently [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1163315 (owner: 10Lucas Werkmeister (WMDE)) [13:08:40] (03CR) 10Hasan Akgün (WMDE): [C:03+2] Remove Facebook, IRC and Twitter social metrics [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/734898 (https://phabricator.wikimedia.org/T294014) (owner: 10Lucas Werkmeister (WMDE)) [13:08:41] (03PS3) 10Lucas Werkmeister (WMDE): Remove Facebook, IRC and Twitter social metrics [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/734898 (https://phabricator.wikimedia.org/T294014) [13:09:08] (03PS1) 10Lucas Werkmeister (WMDE): Use WikimediaDbList more consistently [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1170338 [13:09:12] (03CR) 10Lucas Werkmeister (WMDE): [C:03+2] Use WikimediaDbList more consistently [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1170338 (owner: 10Lucas Werkmeister (WMDE)) [13:09:42] (03Merged) 10jenkins-bot: Use WikimediaDbList more consistently [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1170338 (owner: 10Lucas Werkmeister (WMDE)) [13:10:06] (03CR) 10Lucas Werkmeister (WMDE): [C:03+2] "poke Zuul after rebase" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/734898 (https://phabricator.wikimedia.org/T294014) (owner: 10Lucas Werkmeister (WMDE)) [13:10:38] (03Merged) 10jenkins-bot: Remove Facebook, IRC and Twitter social metrics [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/734898 (https://phabricator.wikimedia.org/T294014) (owner: 10Lucas Werkmeister (WMDE)) [13:54:56] (03PS1) 10Lucas Werkmeister (WMDE): Remove Facebook, IRC and Twitter social metrics [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1170349 (https://phabricator.wikimedia.org/T294014) [13:55:01] (03CR) 10Lucas Werkmeister (WMDE): [C:03+2] Remove Facebook, IRC and Twitter social metrics [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1170349 (https://phabricator.wikimedia.org/T294014) (owner: 10Lucas Werkmeister (WMDE)) [13:55:28] (03Merged) 10jenkins-bot: Remove Facebook, IRC and Twitter social metrics [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1170349 (https://phabricator.wikimedia.org/T294014) (owner: 10Lucas Werkmeister (WMDE)) [14:08:57] 06Data-Engineering, 06Data-Engineering-Radar, 10Citoid, 06MediaWiki-Engineering, and 8 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#11013379 (10MSantos) [14:09:17] 06Data-Engineering, 06Data-Engineering-Radar, 10Citoid, 06MediaWiki-Engineering, and 8 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#11013386 (10Jgiannelos) [14:19:42] 06Data-Engineering, 06Data-Platform-SRE, 06Java-Scala-Standardization, 10Discovery-Search (2025.07.04 - 2025.07.25), 13Patch-For-Review: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all depen... - https://phabricator.wikimedia.org/T367405#11013447 [14:21:00] 10Data-Engineering-Roadmap, 10DPE-Mediawiki-Content, 10Discovery-Search (2025.07.04 - 2025.07.25), 13Patch-For-Review: SUP: Use flink 1.20.1 - https://phabricator.wikimedia.org/T398159#11013472 (10pfischer) [14:21:08] 06Data-Engineering, 06Java-Scala-Standardization, 10Discovery-Search (2025.07.04 - 2025.07.25): Create Gitlab CI templates for JVM packages - https://phabricator.wikimedia.org/T386406#11013480 (10pfischer) [14:21:12] 06Data-Engineering, 06Data-Engineering-Radar, 10CirrusSearch, 10Structured Data Engineering, and 4 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#11013474 (10pfischer) [14:21:28] 10Data-Engineering-Roadmap, 10DPE-Mediawiki-Content, 10Data-Platform-SRE (2025.07.05 - 2025.07.25), 10Discovery-Search (2025.07.04 - 2025.07.25): Flink: Update k8s operator to 1.12.0 - https://phabricator.wikimedia.org/T398162#11013488 (10pfischer) [14:35:49] 10Data-Engineering (Q4 2025 April 1st - June 30th), 06Experimentation Lab, 10Event-Platform: EventGate: Add Prometheus metric for hoisting errors - https://phabricator.wikimedia.org/T398922#11013621 (10dr0ptp4kt) I was hoping to load stuff into Pyrra by around the end of July. Is it viable to add this funct... [15:19:25] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [16:01:24] (03PS2) 10Mforns: Improve the automated traffic detection pipeline [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1163417 [16:06:02] 10Data-Engineering (Q4 2025 April 1st - June 30th), 13Patch-For-Review: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment - https://phabricator.wikimedia.org/T369845#11014168 (10Ottomata) [16:33:32] 10Data-Engineering (Q4 2025 April 1st - June 30th), 07Essential-Work, 13Patch-For-Review: Spike: Figure out a strategy to use Airflow's ExternalTaskMarker for our webrequest pipeline - https://phabricator.wikimedia.org/T399203#11014267 (10Ahoelzl) [16:34:04] 10Data-Engineering (Q4 2025 April 1st - June 30th), 07Essential-Work, 13Patch-For-Review: Spike: Figure out a strategy to use Airflow's ExternalTaskMarker for our webrequest pipeline - https://phabricator.wikimedia.org/T399203#11014271 (10Ahoelzl) a:03xcollazo [16:48:06] 10Data-Engineering (Q4 2025 April 1st - June 30th), 07Essential-Work, 10Event-Platform: Gobblin-wmf Gitlab migration and maintenance - https://phabricator.wikimedia.org/T370368#11014353 (10amastilovic) [16:48:45] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Observability-Tracing, 10Event-Platform: EventGate: Enable OpenTelemetry Propagation - https://phabricator.wikimedia.org/T391353#11014357 (10Ottomata) [16:48:53] 06Data-Engineering, 10ChangeProp, 06MW-Interfaces-Team, 10Observability-Tracing, and 2 others: Implement tracing across changeprop-jobqueue - https://phabricator.wikimedia.org/T395038#11014358 (10Ottomata) [16:52:28] 10Data-Engineering (Q4 2025 April 1st - June 30th): test_produced_by_config SLA miss configured to be too small for upstream dataset run time - https://phabricator.wikimedia.org/T388861#11014383 (10Ahoelzl) a:03amastilovic [16:53:30] 06Data-Engineering, 10ChangeProp, 06MW-Interfaces-Team, 10Observability-Tracing, and 2 others: Implement tracing across changeprop-jobqueue - https://phabricator.wikimedia.org/T395038#11014387 (10Ottomata) Re stream config, if this is a setting for eventgate, it would be better to put it in the [[ https://... [19:19:25] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem [20:34:06] 10Data-Engineering (Q4 2025 April 1st - June 30th): Manage druid `webrequest_sampled_live` data size - https://phabricator.wikimedia.org/T398236#11015219 (10CDanis) @JAllemandou should we write a patch to drop `client_port`? I've only ever added fields to druid before, not removed them; are there any special st... [23:02:21] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11015445 (10Dzahn) We got paged about db1229 and then extended the downtime. [23:03:32] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11015457 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=a275f0f6-56fd-4987-adda-13d277b05393) set by swfrench@cumin2002 for 12:00:00 on 1... [23:19:25] FIRING: [2x] AlertLintProblem: Linting problems found for HaproxyKafkaDeliveryErrors - https://wikitech.wikimedia.org/wiki/Alertmanager#Alert_linting_found_problems - TODO - https://alerts.wikimedia.org/?q=alertname%3DAlertLintProblem