[08:11:42] hi! I've merged https://gerrit.wikimedia.org/r/c/operations/puppet/+/1228514 yesterday that adds a redirect to `redirect.dat`, but the redirection does not seem to be in place yet. I assumed puppet needed to run worldwide, but it's been >12h now. Does the change require a mediawiki deploy for it to be active? Thanks! [08:27:54] brouberol: yep, it's an apache change https://wikitech.wikimedia.org/wiki/Application_servers/Runbook#Apache [08:28:44] aah, I see. IIRC last time I asked, I was told that I just needed to wait for puppet to run, Either that or I'm just misremembering [08:30:23] Probably misremembring :) It's been like this ever since we moved to mw-on-k8s [08:31:42] yep, probably [08:36:39] I see that there's a backport running atm, so I should expect the change to be bundled in, right? [08:37:05] yeah [08:37:13] perfect, thanks [08:37:24] brouberol: Did that change have an httpbb test associated? [08:37:31] (Haven't looked at the CR) [08:37:52] It didn't no [08:38:07] I wasn't aware we needed to write tests for redirects, sorry :/ [08:38:39] It's all right, redirects are probably the least impactful, but it's better to have it and not need it etc. [08:38:56] understood [08:49:08] hmm, actually, there seems to have been a successful backport yesterday, as well as just right now, and the redirect isn't live yet [15:18:30] is there an ongoing rolling restart on kafka-main-eqiad? I'm seeing some under-replication alerts [15:18:55] brouberol: 10:17:25 <+logmsgbot> !log blake@cumin1003 END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling reboot on A:kafka-main-eqiad [15:18:56] brouberol: https://sal.toolforge.org/log/ToP725sBvg159pQraboU [15:19:04] jinx [15:19:08] the graph looks like a RR (under-replication going up and down, pause, etc), but I just wanted to be sure [15:19:10] ok good [15:19:18] sorry, I tend to jump on these when I see them [15:19:22] np! [15:19:41] brouberol: when in doubt, seek SAL [15:19:47] wise words [15:20:08] SAL too noisy nowadays 🧓 [15:27:27] huh, sal.toolforge.org has the logs, but search doesn't find them [15:28:05] the search is Not Great [15:28:13] lol [17:18:56] I'm updating the API key that statograph uses, metric mirroring to wikimediastatus.net might be interrupted briefly [17:21:28] thanks hugh! [18:28:53] reminder to please try out Gerrit-via-CDN! https://phabricator.wikimedia.org/T414719 I've been working with it enabled since turning it on [18:48:59] ^^^ [22:11:43] cdanis I installed/started tunnelencabulator but it thinks the closest DC for me is eqiad (I'm much closer geographically to codfw). Any ideas why, or should I just ignore it and use eqiad? [22:12:18] inflatador: working as intended -- by default it tunnels via your second-closest site, under the assumption that if you are running the script, it's because the site closest to you is broken 😅 [22:12:39] you can just pass it `-d codfw` [22:13:24] cdanis thanks, I guess I should RTFM one of these days ;( [22:13:39] np, the --help output is minimally meme-y :) [22:14:08] well, that's not true, but I tried to make everything clear in the example usages or names [22:14:43] Unlike most things on the Internet, reading the comments actually makes me happy ;)