[05:29:53] 10serviceops, 10Operations, 10wikitech.wikimedia.org: Install php-ldap on all MW appservers - https://phabricator.wikimedia.org/T237889 (10MoritzMuehlenhoff) >>! In T237889#6052809, @Andrew wrote: > Pinging @MoritzMuehlenhoff, any objections to this? Fine with me. php-ldap is built from the core PHP package... [06:00:40] 10serviceops, 10Growth-Team, 10MediaWiki-Configuration, 10Parsoid, and 5 others: Intermittent internal API errors with Flow - https://phabricator.wikimedia.org/T249705 (10Joe) >>! In T249705#6051589, @kostajh wrote: > @joe I see your patch was merged on Friday but it seems like there is still an instance o... [06:31:36] 10serviceops, 10Operations, 10wikitech.wikimedia.org: Install php-ldap on all MW appservers - https://phabricator.wikimedia.org/T237889 (10Joe) >>! In T237889#6053314, @bd808 wrote: >>>! In T237889#6053313, @Joe wrote: >> Also: how temporary? Do you have a tentative timeline for transitioning wikitech to SUL... [07:22:11] 10serviceops, 10Growth-Team, 10MediaWiki-Configuration, 10Parsoid, and 5 others: Intermittent internal API errors with Flow - https://phabricator.wikimedia.org/T249705 (10Joe) [07:23:04] 10serviceops, 10Growth-Team, 10MediaWiki-Configuration, 10Parsoid, and 5 others: Intermittent internal API errors with Flow - https://phabricator.wikimedia.org/T249705 (10Joe) p:05Low→03High Changing priority as this seems to be highly user visible. [13:35:13] 10serviceops, 10Growth-Team, 10MediaWiki-Configuration, 10Parsoid, and 5 others: Intermittent internal API errors with Flow - https://phabricator.wikimedia.org/T249705 (10Joe) a:03Joe I've added some further retry logic for requests to parsoid, this *might* help. [13:45:55] could we please get some team updates in the weekly SRE meeting doc soon? [13:46:41] thanks :) [13:52:46] <_joe_> I expected it to happen at the team meeting yesterday... [14:01:11] I added some. You might want to add more about envoy for appservers [14:44:32] 10serviceops, 10Growth-Team, 10MediaWiki-Configuration, 10Parsoid, and 5 others: Intermittent internal API errors with Flow - https://phabricator.wikimedia.org/T249705 (10Joe) 05Open→03Resolved This is now resolved, I see no further errors since my latest change was merged. [14:51:07] <_joe_> mutante: I might, yes [14:55:29] _joe_: cool. yea, we did not get to that in the meeting [15:01:28] I facilitated and didn't think about reporting out because there wasn't a in-real-time full team meeting, my bad [16:10:46] 10serviceops, 10Operations, 10observability, 10Patch-For-Review, and 2 others: Create an alert for high memcached bw usage - https://phabricator.wikimedia.org/T224454 (10CDanis) The patch now posted here is a reasonably-clean Python implementation of the same idea described in my now-long-ago comment at T2... [17:27:02] 10serviceops, 10Core Platform Team, 10Operations, 10Performance-Team, 10Traffic: Reduce rate of purges emitted by Mediawiki - https://phabricator.wikimedia.org/T250205 (10Joe) [19:59:31] 10serviceops, 10Core Platform Team, 10Operations, 10Performance-Team, 10Traffic: Reduce rate of purges emitted by MediaWiki - https://phabricator.wikimedia.org/T250205 (10Krinkle) [20:00:26] 10serviceops, 10Core Platform Team, 10Operations, 10Performance-Team, 10Traffic: Reduce rate of purges emitted by MediaWiki - https://phabricator.wikimedia.org/T250205 (10Krinkle) [20:01:14] 10serviceops, 10Core Platform Team, 10Operations, 10Traffic, 10Performance-Team (Radar): Reduce rate of purges emitted by MediaWiki - https://phabricator.wikimedia.org/T250205 (10Gilles) [20:07:15] 10serviceops, 10Operations, 10Parsing-Team, 10TechCom, and 4 others: Strategy for storing parser output for "old revision" (Popular diffs and permalinks) - https://phabricator.wikimedia.org/T244058 (10Gilles) [20:12:36] 10serviceops, 10Core Platform Team, 10Operations, 10Traffic, 10Performance-Team (Radar): Reduce rate of purges emitted by MediaWiki - https://phabricator.wikimedia.org/T250205 (10daniel) p:05Triage→03Medium @Joe You are assigned to this ticket, is this something you are going to work on in the code?... [22:06:11] 10serviceops, 10MediaWiki-Cache, 10Operations, 10Core Platform Team Workboards (Clinic Duty Team), 10Patch-For-Review: WANObjectCache::getWithSetCallback seems not to set objects when fetching data is slow - https://phabricator.wikimedia.org/T244877 (10Krinkle) [22:15:16] 10serviceops, 10MediaWiki-Maintenance-system, 10Operations: purgeParserCache.php: Cannot purge this kind of parser cache - https://phabricator.wikimedia.org/T250231 (10RLazarus) [22:34:23] 10serviceops, 10MediaWiki-Cache, 10Operations, 10Core Platform Team Workboards (Clinic Duty Team), and 2 others: WANObjectCache::getWithSetCallback seems not to set objects when fetching data is slow - https://phabricator.wikimedia.org/T244877 (10Krinkle) [22:38:58] 10serviceops, 10MediaWiki-Maintenance-system, 10Operations: purgeParserCache.php: Cannot purge this kind of parser cache - https://phabricator.wikimedia.org/T250231 (10Krinkle) [22:39:07] 10serviceops, 10MediaWiki-Cache, 10Operations: purgeParserCache.php: Cannot purge this kind of parser cache - https://phabricator.wikimedia.org/T250231 (10Krinkle) [22:45:07] 10serviceops, 10MediaWiki-Cache, 10Operations: purgeParserCache.php: Cannot purge this kind of parser cache - https://phabricator.wikimedia.org/T250231 (10Krinkle) The error message incorrect/deceptive. It was written to account for BagOStuff implementations that lack an `deleteObjectsExpiringBefore` impleme... [23:11:03] 10serviceops, 10MediaWiki-Parser, 10Operations: purgeParserCache.php: Cannot purge this kind of parser cache - https://phabricator.wikimedia.org/T250231 (10Krinkle)