[00:00:42] 10serviceops, 10SRE, 10Performance-Team (Radar), 10Release-Engineering-Team (Deployment services), and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10Dzahn) > Something I haven't looked at yet, but which... [00:31:55] 10serviceops, 10SRE, 10Performance-Team (Radar), 10Release-Engineering-Team (Deployment services), and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10Legoktm) I started by profiling `api.php?action=parse... [09:10:41] 10serviceops, 10SRE, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10Legoktm) [09:11:22] 10serviceops: Migrate WMF Production from PHP 7.2 to a newer version - https://phabricator.wikimedia.org/T271736 (10Legoktm) [09:11:26] 10serviceops, 10SRE, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10Legoktm) 05Open→03Stalled Currently stalled pending resolution of {T273312}. [15:10:33] 10serviceops, 10Prod-Kubernetes, 10Patch-For-Review, 10User-fsero: Set up PodSecurityPolicies in clusters - https://phabricator.wikimedia.org/T228967 (10JMeybohm) With kube-controller-manager running with service accounts, pods could no longer be created because validation against apparmor profiles failed... [15:51:52] 10serviceops, 10Prod-Kubernetes, 10SRE, 10Kubernetes, 10User-fsero: Upgrade Calico - https://phabricator.wikimedia.org/T207804 (10JMeybohm) [15:51:55] 10serviceops, 10Prod-Kubernetes, 10SRE, 10Kubernetes, 10Patch-For-Review: Refactor calico deploy strategy - https://phabricator.wikimedia.org/T267653 (10JMeybohm) 05Resolved→03Open 2021-01-30 15:45:27.743 [ERROR][8] lookup.go 63: Failed to get Typha endpoint from Kubernetes error=endpoints "calico-ty... [18:51:06] 10serviceops, 10SRE, 10Performance-Team (Radar), 10Release-Engineering-Team (Deployment services), and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10Dzahn) >>! In T273312#6788233, @CDanis wrote: > Somet... [18:52:23] 10serviceops, 10SRE, 10Performance-Team (Radar), 10Release-Engineering-Team (Deployment services), and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10Dzahn) [21:09:04] 10serviceops, 10SRE, 10Performance-Team (Radar), 10Release-Engineering-Team (Deployment services), and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10Joe) A couple thoughts: - There is a patch up for sp...