[04:46:23] <marostegui>	 zabe: probably because of the s3 switchover I did yesterday
[04:46:26] <marostegui>	 Now switching s2 codfw
[08:04:04] <jinxer-wm>	 FIRING: SystemdUnitFailed: wmf_auto_restart_prometheus-mysqld-exporter.service on db2144:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[08:04:51] <Emperor>	 ^-- is this expected?
[08:18:57] <marostegui>	 sort of, I will decommission that host now
[08:22:42] <Emperor>	 👍
[08:24:04] <jinxer-wm>	 FIRING: [2x] SystemdUnitFailed: wmf_auto_restart_prometheus-mysqld-exporter.service on db2144:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[09:19:29] <jynus>	 not urgent: is there an aprox timeline for misc-dbs-in-trixie?
[09:21:45] <marostegui>	 jynus: It will take a few weeks
[09:21:57] <marostegui>	 But remember that mariadb version isn't changing, just OS
[10:59:07] <jynus>	 instead of rebooting, I will reimage some hosts, such as the backup1 replicas into trixie, at the same time I change its vlan
[11:41:55] <jynus>	 tracking progress on T425637
[11:41:55] <stashbot>	 T425637: Migrate backup1-* sections to Debian Trixie - https://phabricator.wikimedia.org/T425637
[12:24:21] <jinxer-wm>	 FIRING: SystemdUnitFailed: apache2.service on dborch1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[12:26:40] <marostegui>	 federico3: ^
[12:27:15] <federico3>	 is puppet restarting it by itself or something? I wonder why it was not happening before the reboot
[16:14:04] <jinxer-wm>	 FIRING: [2x] SystemdUnitFailed: apache2.service on dborch1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[16:15:55] <federico3>	 ok it has to be puppet, I both shut down the service and disabled it
[16:24:04] <jinxer-wm>	 RESOLVED: [2x] SystemdUnitFailed: apache2.service on dborch1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed