[00:20:29] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:36:23] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.583 seconds [00:46:26] PROBLEM - Puppet freshness on analytics1001 is CRITICAL: Puppet has not run in the last 10 hours [00:46:26] PROBLEM - Puppet freshness on ocg3 is CRITICAL: Puppet has not run in the last 10 hours [00:46:26] PROBLEM - Puppet freshness on virt1004 is CRITICAL: Puppet has not run in the last 10 hours [01:02:29] PROBLEM - Puppet freshness on magnesium is CRITICAL: Puppet has not run in the last 10 hours [01:02:29] PROBLEM - Puppet freshness on zinc is CRITICAL: Puppet has not run in the last 10 hours [01:11:29] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:23:56] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 6.694 seconds [01:39:32] PROBLEM - MySQL Slave Delay on db78 is CRITICAL: CRIT replication delay 234 seconds [01:40:26] PROBLEM - MySQL Slave Delay on db1025 is CRITICAL: CRIT replication delay 288 seconds [01:44:11] RECOVERY - MySQL Slave Delay on db78 is OK: OK replication delay 0 seconds [01:45:05] RECOVERY - MySQL Slave Delay on db1025 is OK: OK replication delay 2 seconds [01:58:53] PROBLEM - Puppetmaster HTTPS on stafford is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:59:56] PROBLEM - MySQL Slave Delay on db78 is CRITICAL: CRIT replication delay 248 seconds [02:00:50] PROBLEM - MySQL Slave Delay on db1025 is CRITICAL: CRIT replication delay 303 seconds [02:03:23] PROBLEM - Puppet freshness on zhen is CRITICAL: Puppet has not run in the last 10 hours [02:17:47] RECOVERY - Puppetmaster HTTPS on stafford is OK: HTTP OK HTTP/1.1 400 Bad Request - 336 bytes in 0.017 seconds [02:23:41] !log LocalisationUpdate completed (1.21wmf4) at Sun Nov 25 02:23:41 UTC 2012 [02:23:49] Logged the message, Master [03:48:14] RECOVERY - MySQL Slave Delay on db78 is OK: OK replication delay 0 seconds [03:51:32] RECOVERY - MySQL Slave Delay on db1025 is OK: OK replication delay 17 seconds [05:01:33] PROBLEM - Puppet freshness on ms1002 is CRITICAL: Puppet has not run in the last 10 hours [05:24:29] PROBLEM - Puppet freshness on ssl3001 is CRITICAL: Puppet has not run in the last 10 hours