[00:23:28] FIRING: OOM: OOM killer active on civi1002.frack.eqiad.wmnet:9100 - TODO - TODO - https://alerts.wikimedia.org/?q=alertname%3DOOM [00:28:28] RESOLVED: OOM: OOM killer active on civi1002.frack.eqiad.wmnet:9100 - TODO - TODO - https://alerts.wikimedia.org/?q=alertname%3DOOM [05:36:30] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_46) - 10https://gerrit.wikimedia.org/r/1285056 (owner: 10L10n-bot) [06:18:57] FIRING: HostMemoryUtilizationWarn: Host high memory utilization (instance fransw2002.frack.codfw.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DHostMemoryUtilizationWarn [06:19:57] FIRING: HostMemoryUtilizationCritical: Host high memory utilization (instance fransw2002.frack.codfw.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DHostMemoryUtilizationCritical [06:38:57] RESOLVED: HostMemoryUtilizationWarn: Host high memory utilization (instance fransw2002.frack.codfw.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DHostMemoryUtilizationWarn [06:39:57] RESOLVED: HostMemoryUtilizationCritical: Host high memory utilization (instance fransw2002.frack.codfw.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DHostMemoryUtilizationCritical [07:23:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [07:48:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.7] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [09:57:03] 10fundraising-tech-ops: (re)establish offsite backups for fundraising - https://phabricator.wikimedia.org/T170327#11901833 (10jcrespo) We are working on this for production network backups, feel free to talk to me if this gets prioritized in the future. [11:23:16] FIRING: ContextSwitchingSpike: Host context switching high (instance frdb1007.frack.eqiad.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DContextSwitchingSpike [11:58:16] RESOLVED: ContextSwitchingSpike: Host context switching high (instance frdb1007.frack.eqiad.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DContextSwitchingSpike [14:31:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [14:36:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages