[00:03:27] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 32.26, 26.76, 21.02 [00:04:04] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.44, 20.56, 17.60 [00:06:04] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 10.38, 16.95, 16.64 [00:07:21] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 17.35, 22.50, 20.66 [00:13:13] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 18.33, 20.32, 20.31 [00:24:51] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 16.97, 21.11, 20.13 [00:26:48] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.12, 18.55, 19.35 [00:36:51] https://phabricator.miraheze.org/T6431 - cp9 extremely latent for a number of users, authored by SCVSlalom, assigned to None, Priority: High, Status: Open [02:43:23] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 8.91, 7.29, 5.91 [02:43:56] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 11.09, 7.98, 6.15 [02:45:23] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 6.23, 6.92, 5.95 [02:45:56] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 5.83, 7.15, 6.08 [02:51:58] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:800:105a::10/cpweb [02:54:04] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.87, 18.14, 16.84 [02:54:16] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.81, 21.22, 18.78 [02:55:56] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [02:56:03] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.71, 15.99, 16.21 [02:58:08] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.76, 18.41, 18.24 [03:23:36] PROBLEM - wiki.nowchess.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nowchess.org could not be found [03:24:04] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.54, 19.46, 16.69 [03:26:03] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.58, 17.65, 16.37 [03:30:31] RECOVERY - wiki.nowchess.org - reverse DNS on sslhost is OK: rDNS OK - wiki.nowchess.org reverse DNS resolves to cp6.miraheze.org [04:26:07] [02MirahezeMagic] 07Universal-Omega closed pull request 03#164: Add new MWS tab messages - 13https://git.io/JIsVt [04:26:08] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 034 commits to 03master [+0/-0/±4] 13https://git.io/JIcOW [04:26:10] [02miraheze/MirahezeMagic] 07Universal-Omega 0399fddda - Merge pull request #164 from miraheze/Universal-Omega-patch-1 Add new MWS tab messages [04:26:11] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [04:26:13] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [04:33:34] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.60, 18.84, 17.26 [04:35:30] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.79, 18.39, 17.28 [04:39:45] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [04:39:47] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [04:40:20] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±3] 13https://git.io/JIcsn [04:40:21] [02miraheze/mediawiki] 07Universal-Omega 036b556b2 - Updating MirahezeMagic [04:40:23] [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [04:42:41] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [04:42:43] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [05:03:41] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 25.63, 20.49, 18.51 [05:05:37] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.85, 20.47, 18.71 [05:07:33] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.65, 18.19, 18.11 [05:15:20] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.81, 21.54, 19.53 [05:17:16] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 25.06, 21.52, 19.68 [05:19:13] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.80, 20.96, 19.66 [05:23:46] PROBLEM - wiki.erisly.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.erisly.com could not be found [05:25:04] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.36, 20.12, 19.79 [05:30:29] RECOVERY - wiki.erisly.com - reverse DNS on sslhost is OK: rDNS OK - wiki.erisly.com reverse DNS resolves to cp7.miraheze.org [05:52:56] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JIcBh [05:52:57] [02miraheze/mediawiki] 07Universal-Omega 03c08807b - Updating MirahezeMagic [05:52:59] [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [05:53:31] [02mediawiki] 07Universal-Omega opened pull request 03#626: Updating MirahezeMagic - 13https://git.io/JIcRf [05:54:13] [02mediawiki] 07Universal-Omega closed pull request 03#626: Updating MirahezeMagic - 13https://git.io/JIcRf [05:54:14] [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JIcRO [05:54:16] [02miraheze/mediawiki] 07Universal-Omega 03384d6b9 - Merge pull request #626 from miraheze/Universal-Omega-patch-1 Updating MirahezeMagic [05:54:17] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [05:54:19] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [06:06:23] RECOVERY - test2 APT on test2 is OK: APT OK: 29 packages available for upgrade (0 critical updates). [06:10:39] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.73, 20.16, 18.80 [06:11:07] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:11:08] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:11:23] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:11:47] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:11:47] PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:12:11] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:12:39] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.22, 21.28, 19.36 [06:13:47] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [06:14:39] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.08, 21.27, 19.61 [06:15:50] RECOVERY - services2 APT on services2 is OK: APT OK: 29 packages available for upgrade (0 critical updates). [06:17:46] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [06:18:10] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:19:02] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:19:10] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:19:20] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:22:38] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.90, 23.03, 20.85 [06:24:07] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* and Jbr* [06:24:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:24:23] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 12.55, 8.83, 7.06 [06:24:39] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.86, 23.20, 21.20 [06:24:40] [02mw-config] 07Universal-Omega closed pull request 03#3523: Complete re-organization of ManageWikiSettings - 13https://git.io/JIszC [06:24:42] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIczz [06:24:43] [02miraheze/mw-config] 07Universal-Omega 033338d38 - Complete re-organization of ManageWikiSettings (#3523) * Complete re-organization of ManageWikiSettings * edit tab rename to editing * Update ManageWikiSettings.php * fix tabs * revert rename edit tab to editing * Update ManageWikiSettings.php [06:24:45] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [06:24:46] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [06:25:22] PROBLEM - towarzystwo.prawa.kredytowego.pl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for towarzystwo.prawa.kredytowego.pl could not be found [06:25:30] PROBLEM - beaconspace.unrestrictedlorefare.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for beaconspace.unrestrictedlorefare.com could not be found [06:25:32] PROBLEM - wiki.nowchess.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nowchess.org could not be found [06:25:35] PROBLEM - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.gesamtschule-nordkirchen.de could not be found [06:25:36] PROBLEM - ao90.pinho.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ao90.pinho.org could not be found [06:26:23] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 6.64, 7.79, 6.89 [06:30:38] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.53, 21.67, 20.96 [06:32:05] RECOVERY - towarzystwo.prawa.kredytowego.pl - reverse DNS on sslhost is OK: rDNS OK - towarzystwo.prawa.kredytowego.pl reverse DNS resolves to cp7.miraheze.org [06:32:22] RECOVERY - beaconspace.unrestrictedlorefare.com - reverse DNS on sslhost is OK: rDNS OK - beaconspace.unrestrictedlorefare.com reverse DNS resolves to cp7.miraheze.org [06:32:24] RECOVERY - wiki.nowchess.org - reverse DNS on sslhost is OK: rDNS OK - wiki.nowchess.org reverse DNS resolves to cp6.miraheze.org [06:32:30] RECOVERY - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is OK: rDNS OK - wiki.gesamtschule-nordkirchen.de reverse DNS resolves to cp7.miraheze.org [06:32:33] RECOVERY - ao90.pinho.org - reverse DNS on sslhost is OK: rDNS OK - ao90.pinho.org reverse DNS resolves to cp7.miraheze.org [06:32:38] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.82, 21.31, 20.92 [06:32:57] RECOVERY - jobrunner1 APT on jobrunner1 is OK: APT OK: 37 packages available for upgrade (0 critical updates). [06:36:38] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.89, 18.79, 20.04 [06:42:38] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 32.95, 22.61, 20.81 [06:44:38] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.20, 22.60, 21.09 [06:46:30] RECOVERY - mw4 APT on mw4 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [06:46:38] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.19, 19.18, 20.02 [06:47:04] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu] [06:52:45] RECOVERY - mw5 APT on mw5 is OK: APT OK: 26 packages available for upgrade (0 critical updates). [06:55:02] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:03:21] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.25, 21.56, 20.60 [07:05:17] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.07, 20.09, 20.21 [08:53:13] PROBLEM - test2 Current Load on test2 is CRITICAL: CRITICAL - load average: 4.18, 2.42, 1.07 [08:54:25] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 9.10, 8.19, 6.52 [08:55:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIc5w [08:55:12] [02miraheze/services] 07MirahezeSSLBot 03228a124 - BOT: Updating services config for wikis [08:55:13] RECOVERY - test2 Current Load on test2 is OK: OK - load average: 1.07, 1.96, 1.07 [08:56:22] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 3.82, 6.44, 6.08 [11:56:21] !log added discord webhook for mcpirevivalwiki [11:56:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:05:52] R4356th/mw-config/patch-3/c48954d - R4356th The build passed. https://travis-ci.com/R4356th/mw-config/builds/206869590 [13:18:36] Why is the message here? It was on my fork. (I have not enabled Travis CI on my repo.) [13:23:56] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 10.90, 8.68, 6.84 [13:24:24] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 9.21, 7.75, 6.39 [13:25:56] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 8.14, 8.41, 6.97 [13:26:24] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 7.13, 7.68, 6.55 [13:34:07] There probably activated on its own because of forking the repo 🤷‍♂️ [13:44:24] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 11.10, 8.97, 7.51 [13:46:24] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.52, 7.56, 7.16 [14:02:56] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 9.88, 7.69, 7.02 [14:03:24] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 10.86, 8.06, 7.09 [14:05:23] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 7.14, 7.76, 7.11 [14:06:47] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.77, 7.07, 7.00 [15:13:56] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 11.41, 8.61, 6.70 [15:15:56] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 6.39, 7.44, 6.49 [15:22:25] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JIWfW [15:22:27] [02miraheze/MirahezeMagic] 07Universal-Omega 0389c6260 - move SkinAddFooterLinks from LocalSettings.php to here. [15:22:28] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [15:22:30] [02MirahezeMagic] 07Universal-Omega opened pull request 03#166: move SkinAddFooterLinks from LocalSettings.php to here. - 13https://git.io/JIWf8 [15:25:29] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JIWJO [15:25:30] [02miraheze/MirahezeMagic] 07Universal-Omega 0351cf265 - add SkinAddFooterLinks hook [15:25:32] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#166: move SkinAddFooterLinks from LocalSettings.php to here. - 13https://git.io/JIWf8 [15:29:09] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JIWJp [15:29:11] [02miraheze/mw-config] 07Universal-Omega 037011f62 - remove SkinAddFooterLinks hook [15:29:12] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [15:29:34] [02mw-config] 07Universal-Omega opened pull request 03#3525: remove SkinAddFooterLinks hook - 13https://git.io/JIWUe [15:30:24] [02MirahezeMagic] 07Universal-Omega edited pull request 03#166: Move SkinAddFooterLinks hook from LocalSettings.php to here - 13https://git.io/JIWf8 [15:32:55] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 9.78, 8.65, 7.45 [15:33:10] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 128.199.139.216/cpweb, 51.77.107.210/cpweb, 2001:41d0:800:1056::2/cpweb, 2607:5300:205:200::2ac4/cpweb [15:33:58] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 3 datacenters are down: 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2607:5300:205:200::2ac4/cpweb [15:35:09] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [15:35:10] PROBLEM - pwiki.arkcls.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pwiki.arkcls.com could not be found [15:35:13] PROBLEM - wiki.mcpirevival.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mcpirevival.tk could not be found [15:35:16] PROBLEM - wiki.abyogsms.org.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.abyogsms.org.in could not be found [15:35:20] PROBLEM - www.dariawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.dariawiki.org could not be found [15:35:26] PROBLEM - wiki.counterculturelabs.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.counterculturelabs.org could not be found [15:35:31] PROBLEM - wiki.minecraftathome.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.minecraftathome.com could not be found [15:35:35] PROBLEM - www.lab612.at - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.lab612.at could not be found [15:35:35] PROBLEM - wiki.teamrelectric.ca - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.teamrelectric.ca could not be found [15:35:36] PROBLEM - miraheze.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.ga could not be found [15:35:37] PROBLEM - baharna.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for baharna.org could not be found [15:35:40] PROBLEM - sdiy.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sdiy.info could not be found [15:35:42] PROBLEM - wiki.mxlinuxusers.de - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mxlinuxusers.de could not be found [15:35:46] PROBLEM - wiki.mineland.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mineland.eu could not be found [15:35:47] PROBLEM - wiki.warframestat.us - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.warframestat.us could not be found [15:35:54] PROBLEM - poserdazfreebies.orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for poserdazfreebies.orain.org could not be found [15:35:55] PROBLEM - fr.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for fr.gyaanipedia.co.in could not be found [15:35:56] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:35:58] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.zymonic.com could not be found [15:35:58] PROBLEM - wiki.danvs.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.danvs.net could not be found [15:35:59] PROBLEM - vedopedia.witches-empire.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vedopedia.witches-empire.com could not be found [15:36:53] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 6.22, 7.91, 7.48 [15:41:51] RECOVERY - pwiki.arkcls.com - reverse DNS on sslhost is OK: rDNS OK - pwiki.arkcls.com reverse DNS resolves to cp7.miraheze.org [15:41:56] RECOVERY - wiki.mcpirevival.tk - reverse DNS on sslhost is OK: rDNS OK - wiki.mcpirevival.tk reverse DNS resolves to cp7.miraheze.org [15:42:04] RECOVERY - wiki.abyogsms.org.in - reverse DNS on sslhost is OK: rDNS OK - wiki.abyogsms.org.in reverse DNS resolves to cp6.miraheze.org [15:42:09] RECOVERY - www.dariawiki.org - reverse DNS on sslhost is OK: rDNS OK - www.dariawiki.org reverse DNS resolves to cp6.miraheze.org [15:42:11] RECOVERY - wiki.minecraftathome.com - reverse DNS on sslhost is OK: rDNS OK - wiki.minecraftathome.com reverse DNS resolves to cp7.miraheze.org [15:42:17] RECOVERY - wiki.teamrelectric.ca - reverse DNS on sslhost is OK: rDNS OK - wiki.teamrelectric.ca reverse DNS resolves to cp6.miraheze.org [15:42:23] RECOVERY - miraheze.ga - reverse DNS on sslhost is OK: rDNS OK - miraheze.ga reverse DNS resolves to cp7.miraheze.org [15:42:23] RECOVERY - baharna.org - reverse DNS on sslhost is OK: rDNS OK - baharna.org reverse DNS resolves to cp6.miraheze.org [15:42:24] RECOVERY - wiki.counterculturelabs.org - reverse DNS on sslhost is OK: rDNS OK - wiki.counterculturelabs.org reverse DNS resolves to cp6.miraheze.org [15:42:28] RECOVERY - sdiy.info - reverse DNS on sslhost is OK: rDNS OK - sdiy.info reverse DNS resolves to cp6.miraheze.org [15:42:33] RECOVERY - wiki.mxlinuxusers.de - reverse DNS on sslhost is OK: rDNS OK - wiki.mxlinuxusers.de reverse DNS resolves to cp7.miraheze.org [15:42:37] RECOVERY - www.lab612.at - reverse DNS on sslhost is OK: rDNS OK - www.lab612.at reverse DNS resolves to cp7.miraheze.org [15:42:39] RECOVERY - fr.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - fr.gyaanipedia.co.in reverse DNS resolves to cp7.miraheze.org [15:42:41] RECOVERY - wiki.warframestat.us - reverse DNS on sslhost is OK: rDNS OK - wiki.warframestat.us reverse DNS resolves to cp6.miraheze.org [15:42:41] RECOVERY - wiki.mineland.eu - reverse DNS on sslhost is OK: rDNS OK - wiki.mineland.eu reverse DNS resolves to cp6.miraheze.org [15:42:42] RECOVERY - wiki.zymonic.com - reverse DNS on sslhost is OK: rDNS OK - wiki.zymonic.com reverse DNS resolves to cp7.miraheze.org [15:42:43] RECOVERY - wiki.danvs.net - reverse DNS on sslhost is OK: rDNS OK - wiki.danvs.net reverse DNS resolves to cp7.miraheze.org [15:42:46] RECOVERY - vedopedia.witches-empire.com - reverse DNS on sslhost is OK: rDNS OK - vedopedia.witches-empire.com reverse DNS resolves to cp6.miraheze.org [15:42:52] RECOVERY - poserdazfreebies.orain.org - reverse DNS on sslhost is OK: rDNS OK - poserdazfreebies.orain.org reverse DNS resolves to cp6.miraheze.org [15:43:23] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 9.92, 8.47, 7.65 [15:44:50] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 9.21, 9.05, 8.02 [15:46:49] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 7.43, 8.33, 7.87 [15:47:14] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 6.97, 8.10, 7.73 [15:52:46] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 11.39, 8.90, 8.07 [15:53:04] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 10.94, 8.88, 8.01 [15:53:56] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [15:54:45] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 9.52, 8.93, 8.17 [15:54:56] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 128.199.139.216/cpweb [15:54:59] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 9.66, 9.13, 8.20 [15:55:56] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:56:55] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [15:58:50] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 6.22, 8.20, 8.08 [16:02:42] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 11.90, 9.83, 8.78 [16:02:50] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 5 datacenters are down: 2400:6180:0:d0::403:f001/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [16:03:56] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 5 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 2001:41d0:800:1056::2/cpweb, 51.222.27.129/cpweb [16:04:40] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 11.59, 9.83, 8.72 [16:04:49] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [16:05:56] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:06:37] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.24, 8.81, 8.48 [16:06:40] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.47, 9.07, 8.76 [16:10:34] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 8.19, 8.25, 8.31 [16:10:42] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 10.79, 9.29, 8.89 [16:14:28] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 14.45, 10.74, 9.27 [16:16:26] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 8.11, 9.75, 9.09 [16:18:41] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 8.76, 9.74, 9.45 [16:22:40] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 10.09, 9.49, 9.37 [16:23:25] PROBLEM - wiki.anglish.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.anglish.info could not be found [16:23:34] PROBLEM - wiki.xysspon.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.xysspon.com could not be found [16:23:35] PROBLEM - wiki.fraterniterebellion.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.fraterniterebellion.com could not be found [16:24:11] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 10.80, 9.11, 8.86 [16:24:49] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.15, 21.36, 18.77 [16:26:07] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 9.99, 9.42, 9.01 [16:26:38] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 8.96, 9.33, 9.37 [16:26:45] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.07, 20.89, 18.90 [16:28:41] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.60, 19.45, 18.64 [16:30:22] RECOVERY - wiki.xysspon.com - reverse DNS on sslhost is OK: rDNS OK - wiki.xysspon.com reverse DNS resolves to cp6.miraheze.org [16:30:22] RECOVERY - wiki.fraterniterebellion.com - reverse DNS on sslhost is OK: rDNS OK - wiki.fraterniterebellion.com reverse DNS resolves to cp7.miraheze.org [16:30:24] RECOVERY - wiki.anglish.info - reverse DNS on sslhost is OK: rDNS OK - wiki.anglish.info reverse DNS resolves to cp6.miraheze.org [16:31:56] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 12.51, 9.67, 9.10 [16:32:38] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 10.72, 9.19, 9.19 [16:35:15] @R4356th If you identify your nickname to NickServ, not sure if you've already that, you can DM JohnLewis or PuppyKun (@NDKilla's IRC username) to request a Miraheze hostmask, if you wish [16:35:43] They're Miraheze's Group Contacts with Freenode. [16:36:30] I contacted NDkilla yesterday about that. [16:36:32] PROBLEM - indiancannabis.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for indiancannabis.wiki could not be found [16:36:34] PROBLEM - wiki.velaan.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.velaan.org could not be found [16:36:38] PROBLEM - www.pornwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.pornwiki.org could not be found [16:36:38] PROBLEM - pubwiki.lab.co.pl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pubwiki.lab.co.pl could not be found [16:36:38] PROBLEM - wiki.graalmilitary.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.graalmilitary.com could not be found [16:36:39] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 6.18, 8.48, 8.99 [16:36:40] PROBLEM - wiki.mikrodev.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mikrodev.com could not be found [16:36:41] PROBLEM - wiki.mastodon.kr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mastodon.kr could not be found [16:36:44] PROBLEM - civclassic.civwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for civclassic.civwiki.org could not be found [16:36:45] PROBLEM - en.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.gyaanipedia.co.in could not be found [16:36:46] PROBLEM - hw.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hw.gyaanipedia.co.in could not be found [16:36:46] PROBLEM - wiki.sketch.town - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.sketch.town could not be found [16:36:51] PROBLEM - lg.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lg.gyaanipedia.co.in could not be found [16:36:55] PROBLEM - kunwok.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for kunwok.org could not be found [16:36:55] PROBLEM - runzeppelin.ru - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for runzeppelin.ru could not be found [16:37:05] Dennis [16:37:56] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.52, 8.55, 8.96 [16:38:08] Reception123: delete the SQL backup of attwiki [16:38:53] .tell R4356th Oh, okay, great. :) [16:38:53] dmehus: I'll pass that on when R4356th is around. [16:40:37] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 7.66, 7.10, 8.27 [16:43:18] RECOVERY - indiancannabis.wiki - reverse DNS on sslhost is OK: rDNS OK - indiancannabis.wiki reverse DNS resolves to cp6.miraheze.org [16:43:22] RECOVERY - wiki.velaan.org - reverse DNS on sslhost is OK: rDNS OK - wiki.velaan.org reverse DNS resolves to cp6.miraheze.org [16:43:26] RECOVERY - hw.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - hw.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org [16:43:27] RECOVERY - wiki.sketch.town - reverse DNS on sslhost is OK: rDNS OK - wiki.sketch.town reverse DNS resolves to cp6.miraheze.org [16:43:31] RECOVERY - wiki.graalmilitary.com - reverse DNS on sslhost is OK: rDNS OK - wiki.graalmilitary.com reverse DNS resolves to cp7.miraheze.org [16:43:34] RECOVERY - lg.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - lg.gyaanipedia.co.in reverse DNS resolves to cp7.miraheze.org [16:43:35] RECOVERY - wiki.mikrodev.com - reverse DNS on sslhost is OK: rDNS OK - wiki.mikrodev.com reverse DNS resolves to cp7.miraheze.org [16:43:35] RECOVERY - wiki.mastodon.kr - reverse DNS on sslhost is OK: rDNS OK - wiki.mastodon.kr reverse DNS resolves to cp7.miraheze.org [16:43:36] RECOVERY - www.pornwiki.org - reverse DNS on sslhost is OK: rDNS OK - www.pornwiki.org reverse DNS resolves to cp7.miraheze.org [16:43:38] RECOVERY - pubwiki.lab.co.pl - reverse DNS on sslhost is OK: rDNS OK - pubwiki.lab.co.pl reverse DNS resolves to cp7.miraheze.org [16:43:38] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JIWO1 [16:43:39] [02miraheze/MirahezeMagic] 07Universal-Omega 03fdf79bc - Use UserOptionsLookup [16:43:41] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/fQRGX [16:43:41] RECOVERY - civclassic.civwiki.org - reverse DNS on sslhost is OK: rDNS OK - civclassic.civwiki.org reverse DNS resolves to cp7.miraheze.org [16:43:43] RECOVERY - en.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - en.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org [16:43:43] RECOVERY - kunwok.org - reverse DNS on sslhost is OK: rDNS OK - kunwok.org reverse DNS resolves to cp7.miraheze.org [16:43:44] [02MirahezeMagic] 07Universal-Omega opened pull request 03#167: Use UserOptionsLookup - 13https://git.io/JIWOD [16:43:44] RECOVERY - runzeppelin.ru - reverse DNS on sslhost is OK: rDNS OK - runzeppelin.ru reverse DNS resolves to cp6.miraheze.org [16:43:56] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 12.17, 9.54, 9.08 [16:44:35] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 10.16, 8.93, 8.74 [16:45:56] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.30, 8.41, 8.74 [16:46:34] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.33, 7.60, 8.28 [16:47:56] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.65, 7.23, 8.27 [16:52:34] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 11.23, 8.50, 8.27 [16:56:32] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.44, 7.81, 8.13 [16:59:04] phab task needs doing [16:59:39] miraheze/MirahezeMagic/Universal-Omega-patch-2/fdf79bc - Universal Omega The build passed. https://travis-ci.org/miraheze/MirahezeMagic/builds/747963047 [17:00:48] ".tell R4356th Oh, okay, great. :)" (y) [17:00:49] R4356th: 2020-12-06 - 16:38:53UTC tell R4356th Oh, okay, great. :) [17:14:18] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 10.55, 8.87, 7.87 [17:14:26] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 8.58, 8.20, 7.71 [17:16:14] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.52, 7.33, 7.44 [17:16:27] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 6.16, 7.39, 7.47 [17:23:08] PROBLEM - wiki.grottocenter.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.grottocenter.org could not be found [17:24:27] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 9.02, 8.65, 7.87 [17:26:30] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 6.32, 8.17, 7.82 [17:29:58] RECOVERY - wiki.grottocenter.org - reverse DNS on sslhost is OK: rDNS OK - wiki.grottocenter.org reverse DNS resolves to cp7.miraheze.org [17:33:57] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 11.69, 8.93, 7.87 [17:34:28] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 12.27, 10.14, 8.61 [17:35:56] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 6.18, 7.75, 7.56 [17:36:29] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.18, 8.93, 8.35 [17:38:28] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 6.51, 7.93, 8.04 [17:40:30] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 7 backends are healthy [17:40:40] RECOVERY - cp6 Varnish Backends on cp6 is OK: All 7 backends are healthy [17:40:41] !log repooled mw7 [17:40:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:41:20] RECOVERY - cp7 Varnish Backends on cp7 is OK: All 7 backends are healthy [17:41:46] RECOVERY - cp9 Varnish Backends on cp9 is OK: All 7 backends are healthy [17:41:49] RECOVERY - mw7 Check Gluster Clients on mw7 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [17:52:09] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIWlw [17:52:11] [02miraheze/mw-config] 07paladox 03692b2a1 - Increase wfDebug sampling [17:54:22] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [17:54:29] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.22, 20.48, 15.95 [17:56:28] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.03, 17.79, 15.52 [18:05:13] PROBLEM - graylog1 Current Load on graylog1 is CRITICAL: CRITICAL - load average: 4.17, 3.31, 2.51 [18:07:13] RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 3.33, 3.22, 2.58 [18:13:13] PROBLEM - graylog1 Current Load on graylog1 is CRITICAL: CRITICAL - load average: 10.64, 7.85, 4.71 [18:14:31] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 10.15, 8.37, 6.77 [18:14:40] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 23.86, 20.05, 17.37 [18:15:06] PROBLEM - wiki.graalmilitary.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.graalmilitary.com could not be found [18:15:06] PROBLEM - wiki.valkyrienskies.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.valkyrienskies.org could not be found [18:15:06] PROBLEM - wiki.jacksonheights.nyc - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.jacksonheights.nyc could not be found [18:15:09] PROBLEM - www.bluepageswiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.bluepageswiki.org could not be found [18:15:10] PROBLEM - de.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for de.gyaanipedia.co.in could not be found [18:16:31] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.82, 7.45, 6.64 [18:16:39] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 18.76, 19.45, 17.48 [18:21:46] RECOVERY - wiki.valkyrienskies.org - reverse DNS on sslhost is OK: rDNS OK - wiki.valkyrienskies.org reverse DNS resolves to cp6.miraheze.org [18:21:48] RECOVERY - wiki.jacksonheights.nyc - reverse DNS on sslhost is OK: rDNS OK - wiki.jacksonheights.nyc reverse DNS resolves to cp7.miraheze.org [18:21:52] RECOVERY - www.bluepageswiki.org - reverse DNS on sslhost is OK: rDNS OK - www.bluepageswiki.org reverse DNS resolves to cp7.miraheze.org [18:21:52] RECOVERY - de.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - de.gyaanipedia.co.in reverse DNS resolves to cp7.miraheze.org [18:21:59] RECOVERY - wiki.graalmilitary.com - reverse DNS on sslhost is OK: rDNS OK - wiki.graalmilitary.com reverse DNS resolves to cp6.miraheze.org [18:24:39] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.70, 21.27, 18.93 [18:26:38] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.30, 19.95, 18.73 [18:33:12] PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 1.01, 2.39, 3.80 [18:37:13] RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 1.13, 1.73, 3.21 [18:50:28] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.24, 20.78, 18.76 [18:52:28] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.12, 19.40, 18.48 [19:09:12] PROBLEM - graylog1 Current Load on graylog1 is CRITICAL: CRITICAL - load average: 5.92, 4.90, 3.60 [19:15:13] PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 2.37, 3.83, 3.60 [19:19:12] RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 3.08, 3.20, 3.38 [19:23:24] !log removed posixaccount class from my ldap account [19:23:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:48] [02MirahezeMagic] 07paladox closed pull request 03#166: Move SkinAddFooterLinks hook from LocalSettings.php to here - 13https://git.io/JIWf8 [19:36:50] [02miraheze/MirahezeMagic] 07paladox pushed 033 commits to 03master [+0/-0/±4] 13https://git.io/JIWwE [19:36:51] [02miraheze/MirahezeMagic] 07paladox 03ddb77d1 - Merge pull request #166 from miraheze/Universal-Omega-patch-1 Move SkinAddFooterLinks hook from LocalSettings.php to here [19:36:53] [02MirahezeMagic] 07paladox deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX [19:36:55] [02miraheze/MirahezeMagic] 07paladox deleted branch 03Universal-Omega-patch-1 [19:38:58] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JIWwS [19:38:59] [02miraheze/mediawiki] 07paladox 031d9591d - Update MirahezeMagic [19:39:22] [02mw-config] 07paladox closed pull request 03#3525: remove SkinAddFooterLinks hook - 13https://git.io/JIWUe [19:39:24] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIWw5 [19:39:25] [02miraheze/mw-config] 07Universal-Omega 039c1b5ee - remove SkinAddFooterLinks hook (#3525) [19:39:27] [02miraheze/mw-config] 07paladox deleted branch 03Universal-Omega-patch-2 [19:39:28] [02mw-config] 07paladox deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [19:42:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JIWrq [19:42:23] [02miraheze/puppet] 07paladox 037a546ba - matomo: Upgrade to 4.0.4 [19:51:23] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [19:51:28] !log added mrjaroslavik back to cvt@ mail list [19:51:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:49] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [19:52:12] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [19:52:22] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [19:53:05] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [19:53:06] !log added dmehus to stewards@ mail list [19:53:08] @southparkfan hi [19:53:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:53:53] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.41, 23.33, 19.74 [19:54:10] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [19:54:22] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [19:55:02] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:55:22] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:55:46] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:56:26] @southparkfan I sent you a discord DM [19:57:10] nlmpù^=$ [19:57:11] nlmpù^=*$ [19:57:27] oups [19:57:51] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.41, 22.39, 20.26 [19:58:15] (Never forget to stop your computer before cleaning your keybord 👀) [19:59:49] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.76, 19.34, 19.36 [20:02:14] lol @HeartsDo...yeah, or flick your keyboard off if it's a wireless keyboard [20:02:25] for me it's usually the touch screen on the monitor [20:03:18] @HeartsDo: we've all done it [20:43:37] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.67, 20.11, 17.77 [20:45:37] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.15, 19.76, 17.93 [20:59:12] PROBLEM - graylog1 Current Load on graylog1 is CRITICAL: CRITICAL - load average: 5.30, 3.51, 2.24 [21:01:47] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.48, 18.81, 16.65 [21:03:13] RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 2.90, 3.40, 2.51 [21:03:28] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.91, 21.27, 19.35 [21:03:46] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 28.53, 22.53, 18.28 [21:05:27] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.13, 19.76, 19.04 [21:07:38] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.81, 23.39, 19.73 [21:09:12] PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 4.00, 3.78, 2.96 [21:09:34] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.19, 20.18, 18.98 [21:11:12] PROBLEM - graylog1 Current Load on graylog1 is CRITICAL: CRITICAL - load average: 4.18, 3.92, 3.11 [21:13:34] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.03, 21.63, 19.79 [21:15:30] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.98, 20.59, 19.65 [21:17:26] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.65, 19.19, 19.22 [21:19:12] PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 1.91, 3.45, 3.36 [21:21:12] RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 1.41, 2.83, 3.15 [21:25:16] !log refresh backups on bacula2 [21:25:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:26:15] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.09, 22.59, 20.84 [21:26:45] RECOVERY - bacula2 Disk Space on bacula2 is OK: DISK OK - free space: / 945354 MB (99% inode=99%); [21:28:14] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.14, 20.21, 20.18 [21:36:16] !log upgrade bacula2 to debian 10.7 [21:36:18]