[09:39:20] 10serviceops, 10Operations, 10ops-codfw, 10Patch-For-Review, 10Sustainability (Incident Followup): (Need by: TBD) rack/setup/install kubernetes20[07-14].codfw.wmnet and kubestage200[1-2].codfw.wmnet. - https://phabricator.wikimedia.org/T252185 (10ops-monitoring-bot) Script wmf-auto-reimage was launched b... [10:01:57] 10serviceops, 10Operations, 10ops-codfw, 10Patch-For-Review, 10Sustainability (Incident Followup): (Need by: TBD) rack/setup/install kubernetes20[07-14].codfw.wmnet and kubestage200[1-2].codfw.wmnet. - https://phabricator.wikimedia.org/T252185 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['k... [14:25:10] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Upgrade kubernetes clusters to a security supported (LTS) version - https://phabricator.wikimedia.org/T244335 (10JMeybohm) Discussion as of today: "We messed up looking at changelogs and figure out dependencies" We reimaged and rolled out... [17:06:21] o/ anyone have a few minutes to discuss a puppet patch that i was advised to discuss with somebody from serviceops? :) [17:10:54] chaomodus: 👋 [17:12:17] rzl: ! okay it's this patch: https://gerrit.wikimedia.org/r/c/operations/puppet/+/643354 [17:12:39] oops I'm on that and I've been neglecting it, sorry [17:13:00] let me take a quick read to catch up -- while I'm looking, anything particular you want to talk about? [17:13:11] rzl: i'm feeling a bit of remedial puppetry in it, somethinga bout the arrangement of things i think is incorrect. I feel like the arrangement of things is incorrect. [17:13:29] i feel like i repeated myself. [17:13:44] :) [17:13:52] interrupted a thought and typed the same thing again aha [17:15:10] haha I got you [17:15:12] can you say more? [17:15:40] it was pointed out to me taht it's a bit silly to have a define for our special use of redis, and it should just be in the module|profile [17:16:00] (it's really just a config arrangement preference, nothing else special) [17:16:20] nod [17:16:54] sounds right to me so far -- it'd be worth abstracting out if there were going to be two netboxen, or something, but otherwise probably not [17:18:16] yes [17:36:24] i guess the only other thing is that i'm given to believe the config we define will accomplish what we want (memory only with some other minor tweaks for latency) and override the shipped config defaults that the redis module pushes [17:37:16] sure [17:37:45] (looking at the pcc it seems to, but i dunno how redis treatssome of the keys we override) [17:37:47] (I haven't dug into it to confirm that or whatever, but sounds plausible) [17:37:59] oh is that the question? got it [17:38:18] I don't actually know redis config at all, you might want effie for that [17:38:26] oic [17:38:31] (and tbh you probably want to get her review again anyhow, I'd feel bad going around her -1 like that) [17:38:46] kay. [17:38:58] happy to dig into it if you like but I'm not coming in with a whole bunch of prior knowledge, sorry :) [17:39:07] I will update it and independently validate the assumptions :) [17:39:20] No worries, thanks for having a glance! [21:36:15] 10serviceops, 10DynamicPageList (Wikimedia), 10PoolCounter, 10MW-1.36-notes (1.36.0-wmf.18; 2020-11-17), and 3 others: Limit concurrency of DPL queries - https://phabricator.wikimedia.org/T263220 (10Urbanecm) >>! In T263220#6685713, @daniel wrote: >>>! In T263220#6684731, @Urbanecm wrote: >> https://www.ph... [21:36:29] 10serviceops, 10DynamicPageList (Wikimedia), 10Operations, 10PoolCounter, and 4 others: Limit concurrency of DPL queries - https://phabricator.wikimedia.org/T263220 (10Urbanecm) [21:36:40] 10serviceops, 10DynamicPageList (Wikimedia), 10Operations, 10PoolCounter, and 4 others: Limit concurrency of DPL queries - https://phabricator.wikimedia.org/T263220 (10Urbanecm) Wrong tag, but keeping it, as it's related too. [23:08:32] 10serviceops, 10Operations, 10Release-Engineering-Team: replace doc1001.eqiad.wmnet with a buster VM - https://phabricator.wikimedia.org/T247653 (10Dzahn) [23:10:49] 10serviceops, 10Operations, 10vm-requests, 10Release-Engineering-Team (Kanban): eqiad: 1 VM request for doc.wikimedia.org - https://phabricator.wikimedia.org/T211974 (10Dzahn) Now doc1002 should be created (T269977) to buster (T247653). And we should also make doc2001 in codfw. [23:22:08] 10serviceops, 10Operations, 10Release-Engineering-Team: replace doc1001.eqiad.wmnet with a buster VM - https://phabricator.wikimedia.org/T247653 (10Dzahn) [23:33:55] 10serviceops, 10Operations, 10Release-Engineering-Team-TODO, 10Patch-For-Review, and 2 others: Upgrade MediaWiki appservers to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10Dzahn) I ran all httpbb appserver tests on mwdebug1003: ` [deploy1001:~] $ for testfile in /srv/deploymen...