[00:21:40] 10serviceops: mcrouter memcached flapping in gutter pool - https://phabricator.wikimedia.org/T255511 (10wkandek) [00:25:20] 10serviceops: Incident communication to AWS Abuse team - https://phabricator.wikimedia.org/T255513 (10wkandek) [06:34:40] 10serviceops, 10Operations, 10Patch-For-Review, 10User-Elukey: Reimage one memcached shard to Buster - https://phabricator.wikimedia.org/T252391 (10elukey) The next steps for this task should be: 1) Remove the nutcracker shards in https://gerrit.wikimedia.org/r/595810 (the change should re-hash their (mc1... [06:49:00] 10serviceops: mcrouter memcached flapping in gutter pool - https://phabricator.wikimedia.org/T255511 (10elukey) Adding some info about how mcrouter behaves at the moment :) Every mcrouter takes independent choices about what shard is "healthy" and what it is not (TKO), using the following criteria: * If 10x1s t... [10:30:20] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team-TODO, and 4 others: Kask functional testing with Cassandra via the Deployment Pipeline - https://phabricator.wikimedia.org/T224041 (10akosiaris) >>! In T224041#6225405, @jeena wrote: > I created a helm test and got the integration a... [13:56:15] 10serviceops, 10Operations: Remaining nginx packages on some mw servers - https://phabricator.wikimedia.org/T255565 (10MoritzMuehlenhoff) [14:57:14] 10serviceops, 10observability, 10User-fgiunchedi: Envoy should listen on ipv6 and ipv4 - https://phabricator.wikimedia.org/T255568 (10fgiunchedi) [18:37:29] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team-TODO, and 4 others: Kask functional testing with Cassandra via the Deployment Pipeline - https://phabricator.wikimedia.org/T224041 (10thcipriani) [19:07:01] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team-TODO, and 4 others: Kask functional testing with Cassandra via the Deployment Pipeline - https://phabricator.wikimedia.org/T224041 (10jeena) >>! In T224041#6227592, @akosiaris wrote: > However, up to now we did not have a need to pu... [20:32:31] 10serviceops, 10Continuous-Integration-Infrastructure, 10Operations: replace backends for releases.wikimedia.org with buster VMs - https://phabricator.wikimedia.org/T247652 (10Dzahn) [20:32:59] 10serviceops, 10Continuous-Integration-Infrastructure, 10Operations: replace backends for releases.wikimedia.org with buster VMs - https://phabricator.wikimedia.org/T247652 (10Dzahn) VMs with buster, releases1002/releases2002 have been created in the subtask. [22:29:48] 10serviceops, 10observability, 10Developer Productivity, 10Performance-Team (Radar): The "Server: mw•" response header is missing on mwmaint/noc.wm.o - https://phabricator.wikimedia.org/T255629 (10Krinkle) [22:31:35] 10serviceops, 10observability, 10Developer Productivity, 10Performance-Team (Radar): The "Server: mw•" response header is missing on mwmaint/noc.wm.o - https://phabricator.wikimedia.org/T255629 (10Krinkle) [23:14:24] 10serviceops, 10Operations, 10ops-codfw, 10Patch-For-Review: (Need by: TBD) rack/setup/install kubernetes20[07-14].codfw.wmnet and kubestage200[1-2].codfw.wmnet. - https://phabricator.wikimedia.org/T252185 (10Papaul) ` [edit interfaces interface-range vlan-private1-a-codfw] member ge-5/0/8 { ... } +... [23:14:44] 10serviceops, 10Operations, 10ops-codfw, 10Patch-For-Review: (Need by: TBD) rack/setup/install kubernetes20[07-14].codfw.wmnet and kubestage200[1-2].codfw.wmnet. - https://phabricator.wikimedia.org/T252185 (10Papaul) [23:15:35] 10serviceops, 10Operations, 10ops-codfw, 10Patch-For-Review: (Need by: TBD) rack/setup/install kubernetes20[07-14].codfw.wmnet and kubestage200[1-2].codfw.wmnet. - https://phabricator.wikimedia.org/T252185 (10Papaul) @akosiaris switch configuration done for all servers.