[00:02:52] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 7 datacenters are down: 128.199.139.216/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [00:03:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 41.68, 34.52, 24.38 [00:04:19] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 30.71, 29.77, 21.98 [00:04:20] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 11.50, 8.04, 6.19 [00:04:46] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:05:09] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 9.72, 8.79, 6.65 [00:07:56] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 10.22, 5.46, 3.55 [00:08:13] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 6.36, 7.84, 6.58 [00:08:59] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.11, 7.73, 6.71 [00:09:18] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 13.96, 24.00, 23.03 [00:09:56] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.17, 3.98, 3.24 [00:12:09] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 9.71, 8.15, 6.93 [00:12:50] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 11.73, 9.21, 7.44 [00:15:06] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.98, 16.44, 19.93 [00:16:03] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 6.09, 7.33, 6.91 [00:16:51] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.40, 7.55, 7.17 [00:17:59] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.73, 6.57, 6.67 [00:18:50] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.57, 6.35, 6.77 [00:20:20] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.45, 22.03, 22.55 [00:22:20] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 30.45, 25.05, 23.55 [00:22:42] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [00:22:52] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.93, 7.04, 6.98 [00:23:26] PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 3.78, 3.70, 3.07 [00:23:53] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.87, 7.66, 7.10 [00:24:19] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 17.53, 22.25, 22.74 [00:24:42] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:24:51] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.28, 6.01, 6.61 [00:25:04] PROBLEM - wiki.counterculturelabs.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.counterculturelabs.org could not be found [00:25:25] RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 2.81, 3.38, 3.03 [00:27:46] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.15, 6.04, 6.58 [00:31:46] RECOVERY - wiki.counterculturelabs.org - reverse DNS on sslhost is OK: rDNS OK - wiki.counterculturelabs.org reverse DNS resolves to cp6.miraheze.org [00:32:16] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.15, 20.24, 21.07 [00:33:37] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.41, 6.91, 6.74 [00:34:14] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.50, 18.60, 20.38 [00:35:34] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.18, 5.96, 6.41 [00:42:31] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.65, 21.75, 20.01 [00:42:58] PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 3.43, 3.39, 3.18 [00:43:26] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 8.06, 7.50, 6.80 [00:44:10] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.68, 20.93, 20.43 [00:44:27] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.47, 19.73, 19.48 [00:44:54] RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 3.04, 3.29, 3.17 [00:45:22] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.39, 6.50, 6.53 [00:46:11] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.58, 18.29, 19.58 [00:48:03] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JkQ42 [00:48:04] [02miraheze/mediawiki] 07Universal-Omega 039e8f1cc - Updating MirahezeMagic [00:48:06] [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [00:48:52] [02mediawiki] 07Universal-Omega opened pull request 03#606: Updating MirahezeMagic - 13https://git.io/JkQ4r [00:50:35] [02mediawiki] 07Universal-Omega closed pull request 03#606: Updating MirahezeMagic - 13https://git.io/JkQ4r [00:50:37] [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JkQ41 [00:50:38] [02miraheze/mediawiki] 07Universal-Omega 03e6a0910 - Merge pull request #606 from miraheze/Universal-Omega-patch-1 Updating MirahezeMagic [00:50:40] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [00:50:41] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [00:51:16] [02mediawiki] 07Universal-Omega deleted branch 03REL1_34 - 13https://git.io/vbL5b [00:51:18] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03REL1_34 [00:52:26] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.93, 21.65, 20.19 [00:53:11] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.55, 6.97, 6.57 [00:54:26] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.65, 22.69, 20.77 [00:55:09] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.57, 6.37, 6.39 [00:58:26] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.82, 19.96, 20.17 [01:00:43] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:01:39] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:01:43] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:02:42] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [01:02:49] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 9.64, 7.44, 6.11 [01:02:58] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 9.03, 7.36, 6.66 [01:03:39] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [01:03:40] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [01:04:50] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 3.78, 6.19, 5.83 [01:04:54] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.83, 6.47, 6.42 [01:12:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.89, 23.04, 20.97 [01:13:18] RECOVERY - test2 MediaWiki Rendering on test2 is OK: HTTP OK: HTTP/1.1 200 OK - 19610 bytes in 1.452 second response time [01:15:28] PROBLEM - test2 Current Load on test2 is CRITICAL: CRITICAL - load average: 11.86, 5.48, 2.45 [01:16:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.07, 21.40, 20.94 [01:17:27] PROBLEM - test2 Current Load on test2 is WARNING: WARNING - load average: 2.27, 3.98, 2.27 [01:19:26] RECOVERY - test2 Current Load on test2 is OK: OK - load average: 1.96, 3.26, 2.21 [01:24:26] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.32, 18.56, 19.96 [01:32:26] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.24, 21.73, 20.33 [01:34:26] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.40, 21.36, 20.36 [01:36:26] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.43, 21.73, 20.57 [01:38:26] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.25, 20.73, 20.37 [01:40:26] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.80, 18.21, 19.46 [01:50:44] [02mediawiki] 07Universal-Omega commented on pull request 03#551: Bump skins/Tweeki from `63d8cc6` to `08127f4` - 13https://git.io/JkQgv [01:50:46] [02mediawiki] 07Universal-Omega closed pull request 03#551: Bump skins/Tweeki from `63d8cc6` to `08127f4` - 13https://git.io/JkoAT [01:50:47] [02mediawiki] 07dependabot[bot] commented on pull request 03#551: Bump skins/Tweeki from `63d8cc6` to `08127f4` - 13https://git.io/JkQgf [01:50:49] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_35/skins/Tweeki-08127f4 - 13https://git.io/vbL5b [01:50:50] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_35/skins/Tweeki-08127f4 [01:53:21] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.30, 18.13, 16.43 [01:53:28] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.94, 6.15, 5.28 [01:53:48] PROBLEM - test2 APT on test2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [01:54:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.94, 21.51, 19.80 [01:55:19] PROBLEM - test2 Current Load on test2 is WARNING: WARNING - load average: 3.61, 3.05, 1.75 [01:55:20] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.99, 16.57, 16.08 [01:55:23] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.20, 5.30, 5.07 [01:55:45] RECOVERY - test2 APT on test2 is OK: APT OK: 14 packages available for upgrade (0 critical updates). [01:56:26] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.38, 20.27, 19.56 [01:57:17] RECOVERY - test2 Current Load on test2 is OK: OK - load average: 1.28, 2.26, 1.61 [02:06:33] PROBLEM - test2 APT on test2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [02:07:20] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 51.04, 32.48, 24.01 [02:07:58] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 10.68, 11.98, 6.12 [02:08:30] RECOVERY - test2 APT on test2 is OK: APT OK: 14 packages available for upgrade (0 critical updates). [02:11:56] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.57, 6.27, 5.10 [02:13:13] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.54, 17.71, 16.14 [02:15:05] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.51, 22.95, 22.76 [02:15:12] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.28, 16.21, 15.80 [02:20:52] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 10.58, 15.27, 19.40 [02:30:54] [02mediawiki] 07Universal-Omega closed pull request 03#593: Bump extensions/Translate from `52fb1a7` to `5c828b8` - 13https://git.io/JkHPH [02:30:56] [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JkQwR [02:30:57] [02miraheze/mediawiki] 07Universal-Omega 03ed4bbb1 - Merge pull request #593 from miraheze/dependabot/submodules/REL1_35/extensions/Translate-5c828b8 Bump extensions/Translate from `52fb1a7` to `5c828b8` [02:31:00] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_35/extensions/Translate-5c828b8 - 13https://git.io/vbL5b [02:31:02] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_35/extensions/Translate-5c828b8 [02:40:44] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [02:41:42] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [02:41:47] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [02:42:42] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [02:43:38] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [02:43:46] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:03:38] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.73, 19.31, 17.85 [03:05:35] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.34, 19.01, 17.88 [03:09:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.77, 20.90, 19.06 [03:11:24] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.37, 18.74, 18.48 [03:12:36] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 12.01, 8.17, 6.43 [03:12:50] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 11.72, 8.07, 6.19 [03:14:49] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.30, 7.54, 6.24 [03:16:34] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 6.23, 7.66, 6.69 [03:16:49] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.92, 6.71, 6.10 [03:18:02] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JkQPn [03:18:04] [02miraheze/WikiDiscover] 07Universal-Omega 039be01e5 - MagicWords: Don't count deleted wikis [03:18:05] [02WikiDiscover] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vhUAp [03:18:07] [02WikiDiscover] 07Universal-Omega opened pull request 03#24: MagicWords: Don't count deleted wikis - 13https://git.io/JkQPc [03:18:31] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.65, 6.59, 6.42 [03:24:23] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 6.06, 7.09, 6.72 [03:26:20] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 3.68, 5.91, 6.33 [04:03:18] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.33, 6.02, 5.42 [04:05:16] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.77, 5.51, 5.31 [04:32:49] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.98, 5.96, 5.12 [04:32:51] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.89, 5.71, 5.02 [04:34:50] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 3.84, 5.07, 4.89 [04:34:50] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 3.42, 4.82, 4.79 [04:42:50] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.25, 6.32, 5.40 [04:44:50] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.80, 5.81, 5.32 [05:22:50] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 8.12, 6.53, 5.63 [05:24:50] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 5.40, 6.10, 5.59 [05:32:49] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.93, 6.56, 5.78 [05:34:49] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.58, 5.86, 5.63 [05:40:27] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkQpc [05:40:29] [02miraheze/services] 07MirahezeSSLBot 03bb587e9 - BOT: Updating services config for wikis [06:03:11] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.99, 6.28, 5.49 [06:05:06] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.83, 5.63, 5.34 [06:12:50] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.85, 6.81, 5.81 [06:14:50] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.13, 5.93, 5.62 [06:40:45] !log depool mw7 [06:40:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:41:17] !log reboot mw7 [06:41:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:43:42] RECOVERY - cp3 Stunnel Http for mw7 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 1.066 second response time [06:43:46] RECOVERY - cp6 Stunnel Http for mw7 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.520 second response time [06:44:24] RECOVERY - mw7 MediaWiki Rendering on mw7 is OK: HTTP OK: HTTP/1.1 200 OK - 19599 bytes in 0.175 second response time [06:44:43] PROBLEM - mw7 Check Gluster Clients on mw7 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [06:44:48] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 2 minutes ago with 9 failures. Failed resources (up to 3 shown): Service[prometheus-node-exporter],Service[nagios-nrpe-server],Service[ssh],Service[postfix] [06:44:51] RECOVERY - cp7 Stunnel Http for mw7 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.004 second response time [06:44:59] RECOVERY - cp6 Varnish Backends on cp6 is OK: All 7 backends are healthy [06:45:01] RECOVERY - cp9 Stunnel Http for mw7 on cp9 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.334 second response time [06:45:10] RECOVERY - cp9 Varnish Backends on cp9 is OK: All 7 backends are healthy [06:45:12] !log repool mw7 [06:45:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:38] RECOVERY - cp7 Varnish Backends on cp7 is OK: All 7 backends are healthy [06:46:22] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 7 backends are healthy [06:46:40] RECOVERY - mw7 Check Gluster Clients on mw7 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [06:46:42] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [06:50:18] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [06:53:43] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.49, 20.31, 17.60 [06:55:42] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.87, 19.05, 17.48 [06:58:15] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [07:03:21] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.81, 20.63, 18.39 [07:03:28] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jk7LU [07:03:29] [02miraheze/MirahezeMagic] 07Universal-Omega 03ed19d64 - fix assignImportedEdits [07:03:31] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [07:03:32] [02MirahezeMagic] 07Universal-Omega opened pull request 03#154: fix assignImportedEdits - 13https://git.io/Jk7LT [07:04:14] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:05:19] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.99, 21.66, 19.02 [07:06:49] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/Jk7LE [07:06:51] [02miraheze/ssl] 07Reception123 035fa3acc - add wiki.mineland.eu cert [07:07:16] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 32.23, 23.28, 19.81 [07:08:49] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jk7LX [07:08:51] [02miraheze/MirahezeMagic] 07Universal-Omega 03b1d3b47 - fix [07:08:52] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#154: fix assignImportedEdits - 13https://git.io/Jk7LT [07:09:12] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.63, 21.69, 19.66 [07:11:21] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jk7te [07:11:22] [02miraheze/MirahezeMagic] 07Universal-Omega 03e5b7018 - change wording [07:11:24] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#154: fix assignImportedEdits - 13https://git.io/Jk7LT [07:13:07] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.66, 19.17, 19.04 [07:14:06] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/Jk7tO [07:14:08] [02miraheze/ssl] 07Reception123 03746b500 - add lg.gyaanipedia.co.in cert [07:17:04] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.72, 21.37, 20.00 [07:17:16] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [07:20:35] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jk7qk [07:20:37] [02miraheze/MirahezeMagic] 07Universal-Omega 039e696a2 - fix [07:20:38] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#154: fix assignImportedEdits - 13https://git.io/Jk7LT [07:21:01] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.04, 19.79, 19.70 [07:21:49] [02MirahezeMagic] 07Universal-Omega closed pull request 03#154: fix assignImportedEdits - 13https://git.io/Jk7LT [07:21:51] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 035 commits to 03master [+0/-0/±5] 13https://git.io/Jk7qq [07:21:52] [02miraheze/MirahezeMagic] 07Universal-Omega 03bd9a489 - Merge pull request #154 from miraheze/Universal-Omega-patch-1 fix assignImportedEdits [07:21:54] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [07:21:55] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [07:25:16] !log sudo -u www-data php /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/assignImportedEdits.php --wiki dcmultiversewiki on Jobrunner1 [07:25:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:28:55] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.23, 23.18, 21.41 [07:31:13] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [07:33:11] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [07:36:44] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.38, 19.27, 20.35 [07:38:46] miraheze/MirahezeMagic/Universal-Omega-patch-1/9e696a2 - Universal Omega The build has errored. https://travis-ci.org/miraheze/MirahezeMagic/builds/746215286 [07:40:45] !log sudo -u www-data php /srv/mediawiki/w/maintenance/initEditCount.php --wiki dcmultiversewiki on Jobrunner1 [07:40:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:47:31] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.99, 22.94, 21.24 [07:48:37] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [07:53:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.66, 21.89, 21.62 [07:57:20] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.62, 23.71, 22.34 [07:58:39] PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [07:59:17] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 13.76, 20.09, 21.18 [08:02:55] PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 3.72, 3.13, 2.40 [08:03:14] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.58, 17.03, 19.76 [08:03:45] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 38.16, 25.64, 18.67 [08:04:37] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:04:53] RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 1.59, 2.51, 2.26 [08:05:41] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.41, 20.35, 17.59 [08:22:43] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.36, 20.22, 18.75 [08:23:51] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/Jk7cY [08:23:52] [02miraheze/mediawiki] 07Reception123 0321aa3c2 - Update MirahezeMagic [08:24:41] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.69, 19.72, 18.75 [08:32:04] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 23.12, 19.18, 17.41 [08:34:00] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.52, 18.94, 17.56 [08:40:09] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:40:28] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:40:42] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:41:08] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:41:39] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:43:04] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [08:43:37] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [08:44:07] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:44:25] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:44:42] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:02:37] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.01, 20.47, 19.65 [09:04:34] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.06, 19.12, 19.25 [09:14:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.92, 20.27, 19.35 [09:16:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.67, 21.70, 19.91 [09:18:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.55, 23.37, 20.87 [09:26:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.23, 21.26, 20.86 [09:28:28] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.27, 19.33, 20.20 [09:32:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.57, 20.89, 20.64 [09:34:28] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.03, 19.36, 20.11 [09:43:51] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.82, 18.06, 15.97 [09:45:49] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.13, 17.14, 15.90 [09:48:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.20, 20.43, 19.95 [09:50:27] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 20.32, 19.92, 19.77 [09:54:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.19, 22.47, 20.61 [09:56:27] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.75, 20.21, 20.02 [10:02:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.52, 22.31, 20.81 [10:04:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.46, 20.52, 20.40 [10:08:27] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.65, 19.89, 20.20 [10:13:09] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 36.60, 25.68, 19.02 [10:15:09] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 14.12, 20.74, 18.02 [10:15:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk7ot [10:15:14] [02miraheze/services] 07MirahezeSSLBot 038555372 - BOT: Updating services config for wikis [10:17:09] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 11.43, 17.48, 17.14 [10:22:10] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.46, 20.25, 20.08 [10:24:07] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.01, 19.52, 19.85 [10:41:33] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 11.87, 10.01, 5.32 [10:41:35] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 42.65, 30.21, 22.90 [10:42:04] PROBLEM - gluster1 Current Load on gluster1 is WARNING: WARNING - load average: 7.59, 5.71, 4.25 [10:43:28] PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 4.41, 7.86, 5.09 [10:44:04] RECOVERY - gluster1 Current Load on gluster1 is OK: OK - load average: 5.26, 5.34, 4.29 [10:45:22] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.10, 5.95, 4.72 [10:49:21] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.20, 21.50, 21.88 [10:59:06] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.26, 17.32, 19.73 [11:03:10] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.26, 18.86, 15.65 [11:04:52] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.12, 22.43, 21.17 [11:05:10] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.46, 17.46, 15.59 [11:06:50] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.38, 20.60, 20.68 [11:08:46] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.13, 18.60, 19.93 [11:19:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.98, 22.56, 21.21 [11:21:24] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.97, 24.71, 22.18 [11:23:21] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.43, 23.47, 22.09 [11:29:11] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 45.98, 28.68, 24.05 [11:30:43] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 12.68, 13.35, 7.36 [11:34:43] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.28, 6.79, 5.99 [11:35:03] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.12, 22.72, 22.99 [11:48:41] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.43, 20.69, 21.26 [11:50:37] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.18, 20.82, 21.23 [11:54:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.35, 18.81, 20.34 [12:13:17] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.70, 18.57, 15.69 [12:15:13] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.41, 16.78, 15.37 [12:22:48] PROBLEM - ns1 APT on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [12:22:51] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.65, 21.23, 19.90 [12:24:46] RECOVERY - ns1 APT on ns1 is OK: APT OK: 5 packages available for upgrade (0 critical updates). [12:24:48] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.79, 19.11, 19.31 [12:35:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.21, 25.74, 22.02 [12:37:23] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.56, 22.49, 21.26 [12:49:06] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.82, 19.26, 20.40 [12:54:58] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.43, 22.21, 21.44 [13:00:49] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.00, 18.40, 20.05 [13:12:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.57, 21.51, 20.62 [13:16:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.71, 23.87, 21.92 [13:26:32] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.76, 22.35, 21.50 [13:28:29] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.01, 21.73, 21.35 [13:32:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.14, 23.44, 22.01 [13:38:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.84, 23.76, 22.86 [13:42:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.64, 22.81, 22.60 [13:46:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.31, 22.79, 22.68 [13:52:29] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.53, 21.89, 22.09 [13:54:29] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.06, 21.23, 21.83 [13:58:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.42, 22.62, 22.19 [14:08:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.44, 22.79, 23.27 [14:12:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 34.81, 25.97, 24.18 [14:19:04] PROBLEM - www.reviwiki.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.reviwiki.info could not be found [14:19:06] PROBLEM - electowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for electowiki.org could not be found [14:19:11] PROBLEM - wiki.dom64.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.dom64.xyz could not be found [14:19:11] PROBLEM - storytime.jdstroy.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for storytime.jdstroy.cf could not be found [14:19:12] PROBLEM - wiki.valkyrienskies.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.valkyrienskies.org could not be found [14:24:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.20, 23.22, 24.00 [14:25:48] RECOVERY - electowiki.org - reverse DNS on sslhost is OK: rDNS OK - electowiki.org reverse DNS resolves to cp6.miraheze.org [14:25:57] RECOVERY - wiki.dom64.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.dom64.xyz reverse DNS resolves to cp7.miraheze.org [14:25:58] RECOVERY - storytime.jdstroy.cf - reverse DNS on sslhost is OK: rDNS OK - storytime.jdstroy.cf reverse DNS resolves to cp7.miraheze.org [14:25:59] RECOVERY - wiki.valkyrienskies.org - reverse DNS on sslhost is OK: rDNS OK - wiki.valkyrienskies.org reverse DNS resolves to cp6.miraheze.org [14:26:01] RECOVERY - www.reviwiki.info - reverse DNS on sslhost is OK: rDNS OK - www.reviwiki.info reverse DNS resolves to cp7.miraheze.org [14:32:29] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.29, 21.51, 22.44 [14:42:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.80, 23.29, 23.46 [14:52:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.31, 23.98, 22.83 [14:54:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.70, 22.64, 22.45 [14:56:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.48, 24.75, 23.21 [15:00:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.52, 23.16, 23.00 [15:05:09] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.23, 20.87, 16.18 [15:06:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.16, 22.83, 22.86 [15:07:09] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.58, 17.58, 15.52 [15:08:27] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.05, 22.86, 22.92 [15:12:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.34, 21.36, 22.11 [15:14:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.73, 21.88, 22.18 [15:22:29] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.19, 22.75, 22.27 [15:24:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.26, 22.54, 22.28 [15:30:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 31.01, 24.41, 22.85 [15:33:33] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 7.97, 9.98, 6.15 [15:35:28] PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 3.31, 7.70, 5.77 [15:37:22] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 4.03, 6.69, 5.63 [15:55:02] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.12, 22.63, 18.78 [15:57:00] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.58, 19.52, 18.09 [15:58:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 13.67, 19.67, 22.95 [16:08:27] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.83, 16.64, 20.09 [16:09:36] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk56c [16:09:37] [02miraheze/CreateWiki] 07JohnFLewis 035edb59b - Reintroduce old behaviour as this is preferred to new logic [16:14:44] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 10.90, 8.63, 5.42 [16:15:17] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.78, 23.15, 21.94 [16:15:35] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.85, 21.95, 18.50 [16:16:43] PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 6.38, 7.54, 5.39 [16:16:47] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 4.70, 6.89, 4.59 [16:17:31] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.09, 19.55, 18.03 [16:18:42] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 2.57, 5.34, 4.29 [16:19:11] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.39, 22.33, 21.71 [16:20:43] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.96, 5.40, 5.00 [16:21:18] [02WikiDiscover] 07JohnFLewis closed pull request 03#24: MagicWords: Don't count deleted wikis - 13https://git.io/JkQPc [16:21:20] [02miraheze/WikiDiscover] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk5PR [16:21:21] [02miraheze/WikiDiscover] 07Universal-Omega 0391f933b - MagicWords: Don't count deleted wikis (#24) [16:23:05] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.73, 22.34, 21.87 [16:25:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk5Xf [16:25:13] [02miraheze/services] 07MirahezeSSLBot 03d05bd39 - BOT: Updating services config for wikis [16:28:57] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.45, 22.70, 21.99 [16:35:11] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/Jk5MR [16:35:13] [02miraheze/mw-config] 07Universal-Omega 039b1d864 - Change linkPage for liberty [16:35:14] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [16:35:16] [02mw-config] 07Universal-Omega opened pull request 03#3479: Change linkPage for liberty - 13https://git.io/Jk5ME [16:36:47] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.44, 23.99, 23.10 [16:38:45] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 23.99, 24.09, 23.24 [16:48:29] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.22, 23.03, 23.88 [16:52:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 50.54, 30.05, 25.93 [16:58:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.57, 21.80, 23.73 [17:01:51] [02CreateWiki] 07R4356th opened pull request 03#174: Replace "Reason" with "Description" - 13https://git.io/Jk5Qk [17:04:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.79, 23.26, 23.51 [17:05:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk5QR [17:05:13] [02miraheze/services] 07MirahezeSSLBot 038f620d5 - BOT: Updating services config for wikis [17:06:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.51, 21.81, 22.93 [17:08:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.39, 23.71, 23.57 [17:10:29] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.87, 21.82, 22.85 [17:12:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 32.75, 25.42, 23.99 [17:22:37] PROBLEM - encyclopediaofastrobiology.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for encyclopediaofastrobiology.org could not be found [17:22:39] PROBLEM - tep.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tep.wiki could not be found [17:22:41] PROBLEM - www.bluevies.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.bluevies.org could not be found [17:22:42] PROBLEM - wiki.arru.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.arru.xyz could not be found [17:27:48] [02ManageWiki] 07Universal-Omega closed pull request 03#207: Add localization support for "Administration" in the sidebar - 13https://git.io/JklAF [17:27:49] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/Jk5d5 [17:27:51] [02miraheze/ManageWiki] 07Universal-Omega 036366816 - Add localization support for "Administration" in the sidebar (#207) * Add localization support for "Administration" in the sidebar * Add localization support for "Administration" in the sidebar * Add qqq.json for "managewiki-sidebar-header" * Fix spacing [17:27:52] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [17:27:54] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vpSns [17:29:09] [02mw-config] 07Universal-Omega closed pull request 03#3479: Change linkPage for liberty - 13https://git.io/Jk5ME [17:29:10] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk5Ff [17:29:12] [02miraheze/mw-config] 07Universal-Omega 03a9094a8 - Change linkPage for liberty (#3479) [17:29:13] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [17:29:15] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [17:29:27] RECOVERY - encyclopediaofastrobiology.org - reverse DNS on sslhost is OK: rDNS OK - encyclopediaofastrobiology.org reverse DNS resolves to cp6.miraheze.org [17:29:30] RECOVERY - tep.wiki - reverse DNS on sslhost is OK: rDNS OK - tep.wiki reverse DNS resolves to cp7.miraheze.org [17:29:34] RECOVERY - www.bluevies.org - reverse DNS on sslhost is OK: rDNS OK - www.bluevies.org reverse DNS resolves to cp6.miraheze.org [17:29:36] RECOVERY - wiki.arru.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.arru.xyz reverse DNS resolves to cp6.miraheze.org [17:36:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.22, 21.28, 23.26 [17:38:00]