[02:48:46] <bd808>	 Hmmm. My magnum cluster build timed out. I’m not sure where to go digging to debug this. https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/jobs/536600
[07:46:17] <taavi>	 quarry's being bit by scrapers :/
[07:46:40] <taavi>	 I'm applying some probably-not-very-efficient blocks with the hopes that they're good enough for monday
[13:47:37] <bd808>	 The OpenStack dashboard at https://logstash.wikimedia.org/app/dashboards#/view/3ef008b0-c871-11eb-ad54-8bb5fcb640c0?_g=h@e78830b&_a=h@2a13bc7 is showing a lot of noisy errors about something trying to authenticate as rook.
[13:48:53] <bd808>	 Also `Truncating password to algorithm specific maximum length 72 characters.` 56,172 times a day. o_0
[19:44:02] <bd808>	 I got the Magnum build to progress a bit further by changing the networking config it was trying to apply, but things got stuck while provisioning the first VM in the cluster. The instance's log is full of "Service Unavailable" for attempts to fetch `http://169.254.169.254/openstack/latest/user_data`. I'm wondering if the network stuff is still not configured right.
[20:43:35] <bd808>	 T396935
[20:43:36] <stashbot>	 T396935: Magnum created instances failing to talk to OpenStack user_data service - https://phabricator.wikimedia.org/T396935