[00:02:16] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 35.99, 24.59, 18.04 [00:08:09] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.78, 22.05, 19.30 [00:10:28] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:11:30] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:14:07] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cyberneticeye.xyz could not be found [00:16:09] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.70, 19.69, 19.48 [00:16:23] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [00:17:26] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:07] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - cyberneticeye.xyz All nameservers failed to answer the query. [01:38:08] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cyberneticeye.xyz could not be found [01:56:33] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.95, 17.71, 15.54 [01:58:29] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.11, 17.28, 15.71 [03:15:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JURZp [03:15:14] [02miraheze/services] 07MirahezeSSLBot 03e0c4455 - BOT: Updating services config for wikis [07:28:06] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - cyberneticeye.xyz reverse DNS resolves to ec2-50-18-145-230.us-west-1.compute.amazonaws.com [08:12:46] PROBLEM - cyberneticeye.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:13:06] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cyberneticeye.xyz could not be found [09:27:06] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - cyberneticeye.xyz reverse DNS resolves to 135.241.94.34.bc.googleusercontent.com [09:34:06] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cyberneticeye.xyz could not be found [10:10:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUR2Q [10:10:19] [02miraheze/services] 07MirahezeSSLBot 03a4a080b - BOT: Updating services config for wikis [10:30:08] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - cyberneticeye.xyz reverse DNS resolves to ec2-50-18-145-230.us-west-1.compute.amazonaws.com [11:08:09] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.87, 20.03, 15.97 [11:10:09] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.59, 17.62, 15.53 [12:17:08] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JURK5 [12:17:09] [02miraheze/mediawiki] 07paladox 03eae208e - Update Cosmos [13:25:56] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.68, 20.02, 16.99 [13:27:54] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.81, 18.00, 16.59 [13:37:36] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.10, 20.96, 18.02 [13:39:32] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.08, 19.01, 17.64 [13:45:31] PROBLEM - www.bluepageswiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.bluepageswiki.org' expires in 15 day(s) (Sat 03 Oct 2020 13:41:06 GMT +0000). [13:50:18] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUR1R [13:50:19] [02miraheze/ssl] 07MirahezeSSLBot 0318ef7c0 - Bot: Update SSL cert for www.bluepageswiki.org [13:51:14] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.88, 20.46, 19.05 [13:52:59] PROBLEM - wiki.mobilityengineer.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mobilityengineer.com' expires in 15 day(s) (Sat 03 Oct 2020 13:50:15 GMT +0000). [13:53:15] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUR1V [13:53:16] [02miraheze/ssl] 07MirahezeSSLBot 03e413b7b - Bot: Update SSL cert for wiki.mobilityengineer.com [13:55:07] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.86, 20.40, 19.45 [13:55:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUR1i [13:55:13] [02miraheze/services] 07MirahezeSSLBot 03d4bedaf - BOT: Updating services config for wikis [14:06:25] RECOVERY - wiki.mobilityengineer.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mobilityengineer.com' will expire on Wed 16 Dec 2020 12:53:08 GMT +0000. [14:06:27] RECOVERY - www.bluepageswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.bluepageswiki.org' will expire on Wed 16 Dec 2020 12:50:11 GMT +0000. [14:25:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JURDC [14:25:13] [02miraheze/services] 07MirahezeSSLBot 034430739 - BOT: Updating services config for wikis [14:29:58] PROBLEM - augovwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'augovwiki.com' expires in 15 day(s) (Sat 03 Oct 2020 14:23:05 GMT +0000). [14:31:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JURDK [14:31:49] [02miraheze/ssl] 07MirahezeSSLBot 0344b4486 - Bot: Update SSL cert for augovwiki.com [14:36:11] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.15, 21.77, 19.28 [14:38:09] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.00, 19.79, 18.85 [14:43:50] RECOVERY - augovwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'augovwiki.com' will expire on Wed 16 Dec 2020 13:31:41 GMT +0000. [14:45:28] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JURyJ [14:45:30] [02miraheze/ManageWiki] 07translatewiki 0367e389d - Localisation updates from https://translatewiki.net. [14:45:31] [ Main page - translatewiki.net ] - translatewiki.net [14:45:32] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±7] 13https://git.io/JURyU [14:45:33] [02miraheze/MirahezeMagic] 07translatewiki 03d65206d - Localisation updates from https://translatewiki.net. [14:45:34] [ Main page - translatewiki.net ] - translatewiki.net [15:08:50] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [15:09:40] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [15:09:46] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [15:10:26] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [15:15:47] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [15:17:31] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:18:21] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:26:42] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:37:22] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.08, 22.13, 18.86 [15:41:03] PROBLEM - bacula2 Bacula Static 1 on bacula2 is CRITICAL: connect to address 168.235.111.29 port 5666: Connection timed outconnect to host 168.235.111.29 port 5666: Connection timed out [15:41:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.11, 22.08, 19.58 [15:43:00] PROBLEM - bacula2 Bacula Static 1 on bacula2 is WARNING: WARNING: Full, 11404431 files, 584.4GB, 2020-08-21 15:26:00 (3.9 weeks ago) [15:45:22] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.95, 18.06, 18.56 [16:04:09] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.19, 22.57, 20.13 [16:06:09] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.19, 22.51, 20.40 [16:08:09] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.68, 19.39, 19.51 [16:26:10] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.37, 21.88, 19.79 [16:28:12] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.57, 19.81, 19.22 [16:31:41] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JUR5O [16:31:42] [02miraheze/ssl] 07Reception123 03d109c2d - add wiki.arru.xyz cert [16:36:10] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.29, 19.59, 19.60 [16:42:11] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.86, 21.46, 20.53 [16:46:07] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.95, 19.82, 20.04 [17:07:45] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.43, 21.79, 20.28 [17:15:37] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 31.95, 24.38, 21.81 [17:17:35] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.71, 21.83, 21.20 [17:19:32] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.69, 19.30, 20.32 [17:23:24] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 34.64, 25.40, 22.44 [17:35:23] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.56, 21.66, 22.92 [17:45:23] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.69, 22.27, 22.27 [17:47:23] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.72, 22.02, 22.21 [17:57:23] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.06, 23.39, 22.60 [17:59:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.76, 22.17, 22.17 [18:05:23] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.72, 23.30, 22.61 [18:07:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.59, 21.82, 22.18 [18:10:22] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JURN2 [18:10:23] [02miraheze/services] 07MirahezeSSLBot 034474a6b - BOT: Updating services config for wikis [18:19:22] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.25, 16.20, 19.40 [18:35:23] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.18, 23.76, 21.49 [18:37:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.51, 23.86, 21.84 [18:45:22] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.69, 23.27, 21.81 [18:49:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.83, 23.94, 22.59 [18:51:32] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 46.24, 30.77, 25.16 [18:55:04] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JURA7 [18:55:06] [02miraheze/mediawiki] 07paladox 0319677dc - Update Cosmos [19:01:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.15, 21.45, 23.73 [19:03:21] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 23.25, 23.44, 24.25 [19:05:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.59, 20.38, 23.03 [19:15:22] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.25, 16.23, 19.61 [19:23:23] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.45, 21.02, 20.30 [19:25:23] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.38, 21.40, 20.54 [19:27:23] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.73, 19.78, 20.09 [19:27:31] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 146s [19:29:31] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [19:31:21] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.91, 21.80, 20.75 [19:33:23] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.17, 19.82, 20.20 [19:37:29] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JURpR [19:37:31] [02miraheze/mediawiki] 07paladox 035f8c807 - Update Cosmos [19:55:21] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.62, 22.26, 20.69 [19:57:22] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.59, 20.23, 20.17 [20:05:02] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 2.00, 4.02, 2.12 [20:07:02] PROBLEM - ns1 Current Load on ns1 is WARNING: WARNING - load average: 0.04, 1.80, 1.64 [20:09:01] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.00, 0.81, 1.26 [20:14:39] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cyberneticeye.xyz could not be found [20:15:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JURjg [20:15:14] [02miraheze/services] 07MirahezeSSLBot 034a30d93 - BOT: Updating services config for wikis [20:19:13] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JURj6 [20:19:14] [02miraheze/mediawiki] 07paladox 03821aed4 - Update Cosmos [20:42:16] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - cyberneticeye.xyz reverse DNS resolves to static.60.217.216.95.clients.your-server.de [20:49:09] PROBLEM - cyberneticeye.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cyberneticeye.xyz could not be found [22:35:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0U5 [22:35:13] [02miraheze/services] 07MirahezeSSLBot 03f68dc39 - BOT: Updating services config for wikis [23:07:22] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.87, 19.70, 16.28 [23:09:23] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.30, 18.87, 16.31 [23:10:19] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0kJ [23:10:21] [02miraheze/services] 07MirahezeSSLBot 031c0e507 - BOT: Updating services config for wikis [23:11:24] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.96, 17.51, 16.14 [23:20:08] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [23:26:03] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [23:27:23] RECOVERY - cyberneticeye.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'cyberneticeye.xyz' will expire on Wed 07 Oct 2020 18:21:51 GMT +0000.