[07:13:51] greetings [08:35:22] i might be missing something but the istio docs say that either of the methods in https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1235 should work but they clearly don't :( [09:50:57] topranks: I blame you for asking about any problems seen with the VXLAN networks, since a new one has just appeared [09:51:17] hahaha my apologies :) [09:51:30] anything I can help with? [09:52:11] it's some fun with kubernetes and calico ipip between the old vlan and new vxlan networks :D [09:52:22] let me do some digging first, and if I don't find what's up with it I'll ask [09:53:01] ok well let me know, I'm working on qos stuff right now so actually IPIP/vxlan/k8s sounds a lot more appealing :P [09:53:42] T425172 if you're curious [09:53:42] T425172: Toolforge web egress with Istio/Envoy seems slow - https://phabricator.wikimedia.org/T425172 [09:58:09] yeah idk... mtu would have been my first suspect, but I'm only remembering we increased that for the vxlan networks by using jumbos? so 1500 is supported? do pings from the vxlan networks show high rtt to that endpoint? or is the sluggishness only apparent with a web transfer? [10:02:18] no, 1500 byte packets go through fine with pings, no increased latency with those or anything. I took a tcpdump for one of the affected paths and it shows a bunch of retransmissions with the http response [10:02:48] actually what I didn't do yet was to check whether this is specific to this one tool or a more widespread issue, I should do that next [13:42:36] godog: the cloudvps-quota dropdown should probably be filtered to include projects in the default domain as well [13:42:58] also it just seems to be completely broken with floating ips [13:43:34] also also the repo is missing a license [13:44:28] taavi: ack, thank you, I'll start with the low hanging fruits [15:06:54] taavi: ok all three items addressed, please keep the feedback coming