[03:26:02] PROBLEM - MariaDB Slave Lag: s1 on dbstore1002 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 892.28 seconds [03:59:11] RECOVERY - MariaDB Slave Lag: s1 on dbstore1002 is OK: OK slave_sql_lag Replication lag: 212.08 seconds [05:14:14] 10Operations, 10Puppet, 10puppet-compiler, 10Release-Engineering-Team (Watching / External): Integrate the puppet compiler in the puppet CI pipeline - https://phabricator.wikimedia.org/T166066#4114630 (10Joe) [11:33:59] (03CR) 10Eranroz: [C: 031] "In hewiki WP:VP there is a consensus for enabling Related Articles, with ability of users to disable it in preferences. Guycn2 suggested t" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/424757 (https://phabricator.wikimedia.org/T191573) (owner: 10Urbanecm) [12:31:31] (03PS1) 10Urbanecm: Fix broken line that includes a group into a group by mistake [mediawiki-config] - 10https://gerrit.wikimedia.org/r/424851 (https://phabricator.wikimedia.org/T191719) [12:34:18] (03CR) 10Urbanecm: "This is configuration, no preferences should be hidden by default and therefore, unhiding isn't simple possible. Config cannot introduce n" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/424757 (https://phabricator.wikimedia.org/T191573) (owner: 10Urbanecm) [12:36:13] ACKNOWLEDGEMENT - HP RAID on db2069 is CRITICAL: CRITICAL: Slot 0: Predictive Failure: 1I:1:1 - Failed: 1I:1:4 - OK: 1I:1:2, 1I:1:3, 1I:1:5, 1I:1:6, 1I:1:7, 1I:1:8, 1I:1:9, 1I:1:10, 1I:1:11, 1I:1:12 - Controller: OK - Battery/Capacitor: OK nagiosadmin RAID handler auto-ack: https://phabricator.wikimedia.org/T191720 [12:36:21] 10Operations, 10ops-codfw: Degraded RAID on db2069 - https://phabricator.wikimedia.org/T191720#4114784 (10ops-monitoring-bot) [13:08:07] (03CR) 10Eranroz: [C: 031] "We plan to do it with simple gadget so user can hide it in the client side with CSS. (I just wanted to verify there is no already such fea" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/424757 (https://phabricator.wikimedia.org/T191573) (owner: 10Urbanecm) [13:31:20] 10Operations, 10ops-codfw, 10DBA: Degraded RAID on db2069 - https://phabricator.wikimedia.org/T191720#4114841 (10Marostegui) a:03Papaul [13:31:45] 10Operations, 10ops-codfw, 10DBA: Degraded RAID on db2069 - https://phabricator.wikimedia.org/T191720#4114784 (10Marostegui) Hi! Please get the disk changed when you can. Thanks! [13:34:41] (03PS2) 10Subramanya Sastry: Enable RemexHtml on wikis with <50 issues in high priority linter cats [mediawiki-config] - 10https://gerrit.wikimedia.org/r/423496 (https://phabricator.wikimedia.org/T190731) [13:49:11] 10Operations, 10ops-codfw, 10DBA: db2069 RAID with predictive failure - https://phabricator.wikimedia.org/T191593#4114862 (10Marostegui) 05Open>03Invalid Finally failed T191720 [14:50:38] (03PS1) 10Giuseppe Lavagetto: Make envoy build work when operating behind a proxy [docker-images/production-images] - 10https://gerrit.wikimedia.org/r/424857 [18:04:14] (03CR) 10Rxy: [C: 031] "LGTM" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/424851 (https://phabricator.wikimedia.org/T191719) (owner: 10Urbanecm)