[00:04:26] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.85, 8.23, 6.31 [00:05:42] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.78, 7.66, 6.01 [00:06:27] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.68, 8.00, 6.47 [00:07:41] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.89, 7.33, 6.09 [00:09:39] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.77, 6.67, 5.99 [00:10:26] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.09, 6.60, 6.21 [00:18:36] db11 backup at 4,2% now? [00:19:00] it's been running for almost two hours [00:21:23] paladox: I'm going to sleep [00:21:29] ok [00:21:37] how many hours have you left till you're going to do the same? [00:21:43] (if you sleep at all) [00:22:10] wait, damnit, I stopped the backup [00:22:17] it'll be a few hours [00:22:23] i'll be going to watch some tv [00:22:25] oh heh [00:22:38] that was a stupid thing to do [00:23:10] !log stopped db11 dump, removed backup [00:23:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:23:19] in that case there's no point staying around for even more hours [00:23:32] night [00:27:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+3/-1/±5] 13https://git.io/JOfGS [00:27:32] [02miraheze/puppet] 07paladox 03cb7c14a - Add CSP header [00:27:33] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [00:28:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JOfG7 [00:28:13] [02miraheze/puppet] 07paladox 03f12432a - Fix syntax [00:28:15] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [00:30:33] PROBLEM - test4 Puppet on test4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:31:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+1/-1/±0] 13https://git.io/JOfZt [00:31:24] [02miraheze/puppet] 07paladox 037f6c05d - Fix file [00:31:25] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [00:32:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JOfZG [00:32:26] [02miraheze/puppet] 07paladox 036dd6cce - Make source optional [00:32:27] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [00:34:31] RECOVERY - test4 Puppet on test4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:26:26] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [02:53:13] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.59, 1.81, 1.28 [02:57:13] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.20, 1.46, 1.26 [04:27:39] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp10.miraheze.org [04:56:41] [02ManageWiki] 07Universal-Omega edited pull request 03#266: [BUG FIX] fix preferences type - 13https://git.io/JOfvf [05:02:04] [02ManageWiki] 07Universal-Omega edited pull request 03#266: [BUG FIX] fix preferences type - 13https://git.io/JOfvf [05:39:03] [02ManageWiki] 07Universal-Omega synchronize pull request 03#266: [BUG FIX] fix preferences type - 13https://git.io/JOfvf [05:39:05] [02ManageWiki] 07Universal-Omega synchronize pull request 03#266: [BUG FIX] fix preferences type - 13https://git.io/JOfvf [05:40:03] miraheze/ManageWiki - Universal-Omega the build passed. [05:40:08] miraheze/ManageWiki - Universal-Omega the build passed. [05:41:50] RECOVERY - wiki.yapsavun.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yapsavun.com' will expire on Mon 07 Jun 2021 10:09:44 GMT +0000. [05:51:09] PROBLEM - wiki.yapsavun.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:26:46] [02ManageWiki] 07Reception123 closed pull request 03#266: [BUG FIX] fix preferences type - 13https://git.io/JOfvf [06:26:47] [02miraheze/ManageWiki] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOfAe [06:26:49] [02miraheze/ManageWiki] 07Universal-Omega 0339f403f - [BUG FIX] fix preferences type (#266) [06:27:54] miraheze/ManageWiki - Reception123 the build passed. [06:31:55] !log renamed crappypastawiki to lolpastawiki [06:42:47] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JOfpW [06:42:48] [02miraheze/mediawiki] 07Reception123 0364fee7a - Update ManageWiki [06:43:53] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JOfpw [06:43:54] [02miraheze/ssl] 07Reception123 03599a770 - add wiki.thefactoryhka.com.pa cert [07:06:14] RECOVERY - pt.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.graalmilitary.com' will expire on Wed 07 Jul 2021 14:26:12 GMT +0000. [07:09:14] RECOVERY - egoish.org - LetsEncrypt on sslhost is OK: OK - Certificate 'egoish.org' will expire on Wed 07 Jul 2021 14:29:21 GMT +0000. [07:10:32] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [07:10:59] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [07:13:55] dmehus: your email is noted [07:30:33] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [07:34:03] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [07:34:53] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:52:36] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-3 [+0/-0/±1] 13https://git.io/JOJLk [07:52:38] [02miraheze/mw-config] 07Reception123 03c22f0ee - wmincTestWikiNamespaces settings for idiotpediaincubatorwiki T7045 [07:52:39] [02mw-config] 07Reception123 created branch 03Reception123-patch-3 - 13https://git.io/vbvb3 [07:52:41] [02mw-config] 07Reception123 opened pull request 03#3826: wmincTestWikiNamespaces settings for idiotpediaincubatorwiki T7045 - 13https://git.io/JOJLL [07:53:39] miraheze/mw-config - Reception123 the build passed. [07:53:52] [02mw-config] 07Reception123 closed pull request 03#3826: wmincTestWikiNamespaces settings for idiotpediaincubatorwiki T7045 - 13https://git.io/JOJLL [07:53:54] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOJLZ [07:53:56] [02miraheze/mw-config] 07Reception123 037c9587e - wmincTestWikiNamespaces settings for idiotpediaincubatorwiki T7045 (#3826) [07:53:57] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-3 - 13https://git.io/vbvb3 [07:53:58] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-3 [07:54:44] miraheze/mw-config - Reception123 the build passed. [10:30:59] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp11.miraheze.org [11:28:54] !log upgraded phabricator [11:29:49] !log sudo service logbot start on monw2 [11:29:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:29:56] !log upgraded phabricator [11:29:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:33:00] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki rumoredmovieswiki --username-prefix="wikia:rumored-movies" /home/reception/rumoredmovies_pages_full.xml [11:33:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:33:18] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [13:34:02] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=lolpastawiki --r "[[phab:T7106|Requested]]" /home/reception/cpdel.txt [13:34:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:29] RhinosF1, ack [14:01:38] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 544.07 ms [14:02:22] dmehus: Reception123 locked, I assume you checked their edits and everything was fine although I asked reception to look at uploads just in case [14:05:53] we should probably not continue the discussion here but yes there were none [14:08:35] ^ [14:41:29] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 255.60 ms [14:45:34] PROBLEM - ping6 on cp3 is WARNING: PING WARNING - Packet loss = 0%, RTA = 341.07 ms [14:47:33] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 479.23 ms [14:57:30] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 271.51 ms [15:04:37] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 603.16 ms [15:08:36] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 281.79 ms [15:12:40] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 443.54 ms [15:16:37] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 261.32 ms [15:20:41] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 362.22 ms [15:22:40] PROBLEM - ping6 on cp3 is WARNING: PING WARNING - Packet loss = 0%, RTA = 346.02 ms [15:24:40] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 522.41 ms [15:41:58] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±2] 13https://git.io/JOUle [15:42:00] [02miraheze/mediawiki] 07paladox 03b764330 - Update LinkTitles [15:46:34] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 255.73 ms [16:02:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±3] 13https://git.io/JOUB6 [16:02:36] [02miraheze/puppet] 07paladox 039e30ec4 - ats: Minor tweeks [16:02:37] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [16:05:50] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.56, 6.48, 5.34 [16:06:56] PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 5.34, 6.76, 3.21 [16:07:27] PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 6.95, 5.43, 2.58 [16:07:50] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.52, 6.22, 5.39 [16:09:26] PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.23, 3.72, 2.30 [16:10:54] RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 0.50, 3.23, 2.54 [16:11:27] RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.66, 2.68, 2.08 [16:15:28] PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.97, 3.50, 2.64 [16:17:30] RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.72, 2.53, 2.39 [16:33:48] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp10.miraheze.org [16:43:38] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 402.51 ms [16:43:56] JohnLewis: that keeps going off ^ [16:54:56] 402ms ping for a requests half way around the world isn’t too bad, just not optimal [16:54:56] JohnLewis: 2021-04-09 - 16:14:35UTC ask JohnLewis could we in theory allow other wikis to use IR? (Botswiki specifically) [16:56:00] JohnLewis: true, didn't we raise the crit at one point due to that [16:56:13] I don’t believe we did [16:57:18] We did change something for cps [16:57:27] Because it kept going off and wasn't useful [16:57:33] Due to distance [16:58:38] I consider 402ms quite good. I have noticed some off and on slowness today, but that was not likely related to our cache proxies, as I think that was more of a function of the delete page script job that was running earlier [17:01:54] You won’t interact with cp3 [17:03:51] yeah, true [17:05:52] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.28, 7.02, 5.42 [17:07:53] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.18, 6.27, 5.34 [17:09:04] PROBLEM - wiki.slimeapedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.slimeapedia.org' expires in 15 day(s) (Mon 26 Apr 2021 17:01:56 GMT +0000). [17:10:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.29, 7.16, 5.96 [17:11:53] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.99, 6.82, 5.75 [17:12:43] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.89, 6.33, 5.81 [17:13:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.21, 6.35, 5.72 [17:15:37] PROBLEM - ping6 on cp3 is WARNING: PING WARNING - Packet loss = 0%, RTA = 347.69 ms [17:15:53] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOUrh [17:15:55] [02miraheze/ssl] 07MirahezeSSLBot 036a2543b - Bot: Update SSL cert for wiki.slimeapedia.org [17:17:37] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 443.80 ms [17:21:34] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 265.40 ms [17:25:39] PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 417.81 ms [17:43:32] RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 265.34 ms [18:38:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±3] 13https://git.io/JOUSN [18:38:56] [02miraheze/puppet] 07paladox 0318d6b05 - ats: Fix redirecting domains [18:38:57] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [18:54:31] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JOUHa [18:54:33] [02miraheze/ssl] 07paladox 0309c74fb - Add new regex configs to orain [18:54:34] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [18:54:36] [02ssl] 07paladox opened pull request 03#403: Add new regex configs to orain - 13https://git.io/JOUHV [18:56:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOUHH [18:56:22] [02miraheze/puppet] 07paladox 03cbdc580 - Add support for additional_domain and regex_domain_ats [18:56:23] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [18:56:25] [02puppet] 07paladox opened pull request 03#1738: Add support for additional_domain and regex_domain_ats - 13https://git.io/JOUH7 [18:58:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOUQT [18:58:23] [02miraheze/puppet] 07paladox 03c77563e - Update mediawiki.conf [18:58:24] [02puppet] 07paladox synchronize pull request 03#1738: Add support for additional_domain and regex_domain_ats - 13https://git.io/JOUH7 [19:00:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOUQW [19:00:11] [02miraheze/puppet] 07paladox 03590c77c - Update mediawiki.conf.erb [19:00:13] [02puppet] 07paladox synchronize pull request 03#1738: Add support for additional_domain and regex_domain_ats - 13https://git.io/JOUH7 [19:02:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOUQE [19:02:03] [02miraheze/puppet] 07paladox 031cc843d - Update certs.pp [19:02:04] [02puppet] 07paladox synchronize pull request 03#1738: Add support for additional_domain and regex_domain_ats - 13https://git.io/JOUH7 [19:05:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/JOUQh [19:05:53] [02miraheze/puppet] 07paladox 03003592b - Update mediawiki.conf [19:05:55] [02puppet] 07paladox synchronize pull request 03#1738: Add support for additional_domain and regex_domain_ats - 13https://git.io/JOUH7 [19:06:59] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.35, 7.08, 5.71 [19:07:31] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JOU7L [19:07:33] [02miraheze/ssl] 07paladox 03bcc808b - Update redirects.yaml [19:07:34] [02ssl] 07paladox synchronize pull request 03#403: Add new regex configs to orain - 13https://git.io/JOUHV [19:08:10] [02ssl] 07paladox closed pull request 03#403: Add new regex configs to orain - 13https://git.io/JOUHV [19:08:11] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOU7q [19:08:13] [02miraheze/ssl] 07paladox 03db3a4f9 - Add new regex configs to orain (#403) [19:08:14] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [19:08:16] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [19:08:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JOU7m [19:08:19] [02miraheze/puppet] 07paladox 03d596368 - Add support for additional_domain and regex_domain_ats (#1738) [19:08:21] [02puppet] 07paladox closed pull request 03#1738: Add support for additional_domain and regex_domain_ats - 13https://git.io/JOUH7 [19:08:22] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3 [19:08:24] [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS [19:08:26] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±2] 13https://git.io/JOU7Y [19:08:27] [02miraheze/puppet] 07paladox 031e476cc - Fix support for regex redirects including maps [19:08:28] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [19:08:43] [02miraheze/puppet] 07paladox pushed 032 commits to 03patch-1 [+0/-0/±6] 13https://git.io/JOU7s [19:08:44] [02miraheze/puppet] 07paladox 03e8f0d18 - Merge remote-tracking branch 'origin/master' into patch-1 [19:08:46] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [19:08:58] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.49, 6.13, 5.54 [19:10:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JOU7i [19:10:49] [02miraheze/puppet] 07paladox 033e5efe4 - Fix wrong regex [19:10:50] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [19:19:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JOU5P [19:19:20] [02miraheze/puppet] 07paladox 0303cab0a - Remove additional_domain from ats [19:19:21] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [19:22:11] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOU5j [19:22:13] [02miraheze/ssl] 07paladox 03598a287 - Move orain wildcard redirect to bottom of the list [19:34:55] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.02, 6.52, 5.57 [19:35:18] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.14, 6.57, 5.69 [19:36:04] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [19:36:55] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.82, 5.90, 5.46 [19:37:18] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.03, 5.94, 5.56 [19:41:04] RECOVERY - wiki.slimeapedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimeapedia.org' will expire on Fri 09 Jul 2021 16:15:48 GMT +0000. [19:52:03] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.94, 7.13, 6.04 [19:53:58] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.82, 6.36, 5.90 [20:00:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JOUAc [20:00:56] [02miraheze/puppet] 07paladox 036f37353 - Add *.miraheze.org to ats [20:00:57] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:03:17] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JOUAa [20:03:19] [02miraheze/puppet] 07paladox 03006ba78 - Add m.miraheze.org cert [20:03:20] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:05:27] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.22, 6.76, 6.02 [20:05:30] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.57, 6.97, 6.22 [20:07:23] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.05, 6.57, 6.05 [20:07:25] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.98, 6.18, 6.01 [20:39:40] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.88, 7.39, 6.41 [20:41:34] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.34, 6.53, 6.20 [21:35:24] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.81, 6.54, 5.43 [21:37:24] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.07, 5.82, 5.30 [22:20:32] [02miraheze/mw-config] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JOTmY [22:20:34] [02miraheze/mw-config] 07JohnFLewis 03681f15f - Log JobQueueRedis errors [22:21:34] miraheze/mw-config - JohnFLewis the build passed. [22:36:06] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp11.miraheze.org [22:42:53] PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: CRITICAL: Full, 238729 files, 84.61GB, 2021-03-10 22:42:00 (4.4 weeks ago) [23:05:25] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.54, 6.93, 5.27 [23:05:26] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.47, 5.64, 4.76 [23:06:08] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.87, 7.11, 5.80 [23:07:24] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.72, 6.46, 5.31 [23:07:26] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.95, 5.43, 4.80 [23:08:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.77, 6.84, 5.86 [23:12:08] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.85, 7.68, 6.41 [23:13:25] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.89, 7.38, 6.00 [23:14:08] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.51, 7.45, 6.47 [23:15:26] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.72, 7.16, 6.09 [23:20:10] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.97, 6.42, 6.39 [23:25:24] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.96, 6.52, 6.44