[00:02:50] RECOVERY - mw6 Disk Space on mw6 is OK: DISK OK - free space: / 2486 MB (13% inode=73%); [00:03:32] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 23.41, 25.87, 19.25 [00:05:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 11.94, 20.72, 18.16 [00:07:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.84, 17.95, 17.47 [01:50:22] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jkztf [01:50:24] [02miraheze/services] 07MirahezeSSLBot 03387a1b0 - BOT: Updating services config for wikis [03:32:01] PROBLEM - wiki.counterculturelabs.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.counterculturelabs.org' expires in 15 day(s) (Sun 06 Dec 2020 03:29:55 GMT +0000). [03:40:04] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkzCm [03:40:06] [02miraheze/ssl] 07MirahezeSSLBot 03ba69478 - Bot: Update SSL cert for wiki.counterculturelabs.org [03:52:59] RECOVERY - wiki.counterculturelabs.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.counterculturelabs.org' will expire on Thu 18 Feb 2021 02:39:57 GMT +0000. [04:31:56] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jkz4p [04:31:57] [02miraheze/WikiDiscover] 07Universal-Omega 03c966b93 - Add more MagicWords [04:31:59] [02WikiDiscover] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vhUAp [04:33:51] miraheze/WikiDiscover/Universal-Omega-patch-1/c966b93 - Universal Omega The build passed. https://travis-ci.com/miraheze/WikiDiscover/builds/202965432 [04:34:16] [02WikiDiscover] 07Universal-Omega opened pull request 03#19: Add more MagicWords for private, closed and active wikis (T6224) - 13https://git.io/JkzBq [04:37:22] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JkzBV [04:37:23] [02miraheze/WikiDiscover] 07Universal-Omega 037b12e19 - add NUMBEROFACTIVEWIKIS magic word [04:37:25] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#19: Add more MagicWords for private, closed and active wikis (T6224) - 13https://git.io/JkzBq [04:39:35] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JkzBQ [04:39:37] [02miraheze/WikiDiscover] 07Universal-Omega 038557740 - Add MagicWords [04:39:38] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#19: Add more MagicWords for private, closed and active wikis (T6224) - 13https://git.io/JkzBq [05:42:11] PROBLEM - bacula2 Bacula Phabricator Static on bacula2 is CRITICAL: CRITICAL: Diff, 18801 files, 8.284MB, 2020-10-21 05:42:00 (4.3 weeks ago) [06:37:33] RECOVERY - mw6 APT on mw6 is OK: APT OK: 12 packages available for upgrade (0 critical updates). [06:42:27] RECOVERY - jobrunner2 APT on jobrunner2 is OK: APT OK: 12 packages available for upgrade (0 critical updates). [07:01:40] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkzPU [07:01:42] [02miraheze/WikiDiscover] 07Universal-Omega 03f395304 - Add "Established" date [07:01:43] [02WikiDiscover] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vhUAp [07:02:23] [02WikiDiscover] 07Universal-Omega opened pull request 03#20: Add "Established" date (T5351) - 13https://git.io/JkzPq [07:03:37] miraheze/WikiDiscover/Universal-Omega-patch-2/f395304 - Universal Omega The build passed. https://travis-ci.com/miraheze/WikiDiscover/builds/202981574 [07:04:56] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkzPR [07:04:57] [02miraheze/WikiDiscover] 07Universal-Omega 03f7e4978 - Add wikidiscover-table-established [07:04:59] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#20: Add "Established" date (T5351) - 13https://git.io/JkzPq [07:06:17] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkzPK [07:06:18] [02miraheze/WikiDiscover] 07Universal-Omega 03869869c - Add wikidiscover-table-established [07:06:20] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#20: Add "Established" date (T5351) - 13https://git.io/JkzPq [07:38:31] .in 9h do T6466 [07:38:31] Reception123: Okay, will remind at 2020-11-20 - 17:38:31CET [08:01:23] [02landing] 07Universal-Omega commented on pull request 03#44: Update translations.php - 13https://git.io/JkzSk [08:01:24] [02landing] 07Universal-Omega closed pull request 03#44: Update translations.php - 13https://git.io/JU9lz [08:08:13] [02mediawiki] 07Universal-Omega closed pull request 03#528: Bump extensions/DonationInterface from `84ac29c` to `bde7f11` - 13https://git.io/Jkurd [08:08:14] [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JkzSy [08:08:16] [02miraheze/mediawiki] 07Universal-Omega 03d4790ea - Merge pull request #528 from miraheze/dependabot/submodules/REL1_35/extensions/DonationInterface-bde7f11 Bump extensions/DonationInterface from `84ac29c` to `bde7f11` [08:08:18] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_35/extensions/DonationInterface-bde7f11 [08:08:19] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_35/extensions/DonationInterface-bde7f11 - 13https://git.io/vbL5b [08:09:55] [02mediawiki] 07Universal-Omega closed pull request 03#534: Bump extensions/ArticleFeedbackv5 from `c6f5a64` to `722e655` - 13https://git.io/JkuoJ [08:09:57] [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JkzSp [08:09:58] [02miraheze/mediawiki] 07Universal-Omega 0379dc6bf - Merge pull request #534 from miraheze/dependabot/submodules/REL1_35/extensions/ArticleFeedbackv5-722e655 Bump extensions/ArticleFeedbackv5 from `c6f5a64` to `722e655` [08:10:03] [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/ArticleFeedbackv5-722e655 [08:10:04] [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/ArticleFeedbackv5-722e655 - 13https://git.io/vbL5b [08:13:03] [02mediawiki] 07Universal-Omega closed pull request 03#542: Bump extensions/SimpleBlogPage from `d696443` to `4ebc830` - 13https://git.io/JkuoC [08:13:05] [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/Jkz9G [08:13:06] [02miraheze/mediawiki] 07Universal-Omega 0336a333d - Merge pull request #542 from miraheze/dependabot/submodules/REL1_35/extensions/SimpleBlogPage-4ebc830 Bump extensions/SimpleBlogPage from `d696443` to `4ebc830` [08:13:08] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_35/extensions/SimpleBlogPage-4ebc830 - 13https://git.io/vbL5b [08:13:09] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_35/extensions/SimpleBlogPage-4ebc830 [08:19:43] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:19:58] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:20:37] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:20:40] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [08:26:38] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [08:26:41] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [08:27:42] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:27:57] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:10:22] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkgOH [12:10:23] [02miraheze/services] 07MirahezeSSLBot 0382cb2b3 - BOT: Updating services config for wikis [12:15:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jkg3z [12:15:13] [02miraheze/services] 07MirahezeSSLBot 0340a1dfd - BOT: Updating services config for wikis [12:17:04] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --report=1 --wiki gyaanipediawiki /home/reception/gyaanipedia_pages_full.xml [12:17:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:17:15] !log on jobrunner2 [12:17:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:21:22] PROBLEM - fc.songcontests.eu - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'fc.songcontests.eu' expires in 15 day(s) (Sun 06 Dec 2020 14:19:16 GMT +0000). [14:22:54] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.02, 23.45, 20.42 [14:24:53] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.55, 22.11, 20.33 [14:27:04] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.74, 5.47, 4.71 [14:27:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkgV5 [14:27:27] [02miraheze/ssl] 07MirahezeSSLBot 03c2ef6ee - Bot: Update SSL cert for fc.songcontests.eu [14:29:01] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.01, 4.72, 4.52 [14:30:50] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.67, 21.58, 20.70 [14:34:48] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.20, 23.02, 21.66 [14:35:09] RECOVERY - fc.songcontests.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'fc.songcontests.eu' will expire on Thu 18 Feb 2021 13:27:17 GMT +0000. [14:36:48] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.66, 23.32, 21.88 [14:38:47] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.80, 22.74, 21.88 [14:44:55] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 40.40, 27.35, 23.59 [14:46:54] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.58, 23.39, 22.63 [14:50:59] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.63, 23.85, 22.83 [14:52:40] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.35, 5.29, 4.72 [14:54:37] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.52, 4.98, 4.68 [14:58:55] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.88, 23.54, 23.53 [15:04:53] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.48, 22.85, 23.15 [15:06:52] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.48, 20.87, 22.42 [15:12:49] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.90, 23.20, 22.67 [15:14:48] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.76, 21.18, 22.04 [15:15:26] !log MariaDB [phabricator_dashboard]> UPDATE dashboard SET status = "archived" WHERE id = '27'; [15:15:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:23:18] [02WikiDiscover] 07JohnFLewis commented on pull request 03#20: Add "Established" date (T5351) - 13https://git.io/JkgM7 [15:24:47] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.72, 23.88, 22.41 [15:25:57] [02WikiDiscover] 07JohnFLewis reviewed pull request 03#19 commit - 13https://git.io/JkgDB [15:25:59] [02WikiDiscover] 07JohnFLewis reviewed pull request 03#19 commit - 13https://git.io/JkgDR [15:28:27] [02WikiDiscover] 07Universal-Omega reviewed pull request 03#19 commit - 13https://git.io/Jkgye [15:30:58] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [15:32:01] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.80, 5.37, 4.76 [15:32:03] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [15:32:15] PROBLEM - cp9 Current Load on cp9 is CRITICAL: CRITICAL - load average: 5.39, 2.57, 1.30 [15:32:21] PROBLEM - cp9 HTTPS on cp9 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:33:05] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/Jkgyx [15:33:07] [02miraheze/WikiDiscover] 07Universal-Omega 031de5d5c - remove if [15:33:08] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#20: Add "Established" date (T5351) - 13https://git.io/JkzPq [15:33:26] [02WikiDiscover] 07Universal-Omega commented on pull request 03#20: Add "Established" date (T5351) - 13https://git.io/Jkgyj [15:33:43] [02WikiDiscover] 07Universal-Omega edited a comment on pull request 03#20: Add "Established" date (T5351) - 13https://git.io/Jkgyj [15:33:57] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.73, 5.07, 4.75 [15:34:01] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [15:34:18] RECOVERY - cp9 HTTPS on cp9 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 2107 bytes in 3.157 second response time [15:36:08] RECOVERY - cp9 Current Load on cp9 is OK: OK - load average: 0.39, 1.57, 1.20 [15:38:11] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.98, 5.36, 4.97 [15:38:16] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 2607:5300:205:200::2ac4/cpweb [15:39:02] PROBLEM - www.mh142.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.mh142.com could not be found [15:39:02] PROBLEM - www.permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.permanentfuturelab.wiki could not be found [15:39:09] PROBLEM - wiki.openhatch.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.openhatch.org could not be found [15:39:09] PROBLEM - wiki.whentheycry.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.whentheycry.org could not be found [15:39:13] PROBLEM - wiki.rebirthofthenight.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.rebirthofthenight.com could not be found [15:39:15] PROBLEM - wikipariksha.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikipariksha.com could not be found [15:39:19] PROBLEM - www.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.petrawiki.org could not be found [15:39:23] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:39:28] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 6.88, 6.47, 4.86 [15:39:37] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JkgSp [15:39:39] [02miraheze/WikiDiscover] 07Universal-Omega 03faeac20 - fix to $magicWordId [15:39:40] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#19: Add more MagicWords for private, closed and active wikis (T6224) - 13https://git.io/JkzBq [15:40:09] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 5.01, 5.00, 4.87 [15:41:23] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 6.74, 6.41, 5.01 [15:43:21] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 5 datacenters are down: 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [15:43:43] PROBLEM - wikiescola.com.br - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikiescola.com.br could not be found [15:43:43] PROBLEM - www.bluepageswiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.bluepageswiki.org could not be found [15:43:48] PROBLEM - n64brew.dev - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for n64brew.dev could not be found [15:43:49] PROBLEM - towarzystwo.prawa.kredytowego.pl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for towarzystwo.prawa.kredytowego.pl could not be found [15:43:50] PROBLEM - www.tradwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.tradwiki.org could not be found [15:43:50] PROBLEM - dariawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dariawiki.org could not be found [15:43:51] PROBLEM - wiki.arnab.at - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.arnab.at could not be found [15:43:52] PROBLEM - wiki.thehall.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.thehall.xyz could not be found [15:44:01] PROBLEM - wiki.usagihime.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.usagihime.ml could not be found [15:44:23] PROBLEM - wiki.azimuth.navy - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.azimuth.navy could not be found [15:45:18] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:46:00] RECOVERY - www.permanentfuturelab.wiki - reverse DNS on sslhost is OK: rDNS OK - www.permanentfuturelab.wiki reverse DNS resolves to cp7.miraheze.org [15:46:00] RECOVERY - www.mh142.com - reverse DNS on sslhost is OK: rDNS OK - www.mh142.com reverse DNS resolves to cp7.miraheze.org [15:46:01] RECOVERY - wiki.rebirthofthenight.com - reverse DNS on sslhost is OK: rDNS OK - wiki.rebirthofthenight.com reverse DNS resolves to cp7.miraheze.org [15:46:02] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [15:46:04] RECOVERY - wikipariksha.com - reverse DNS on sslhost is OK: rDNS OK - wikipariksha.com reverse DNS resolves to cp7.miraheze.org [15:46:08] RECOVERY - wiki.openhatch.org - reverse DNS on sslhost is OK: rDNS OK - wiki.openhatch.org reverse DNS resolves to cp6.miraheze.org [15:46:08] RECOVERY - wiki.whentheycry.org - reverse DNS on sslhost is OK: rDNS OK - wiki.whentheycry.org reverse DNS resolves to cp7.miraheze.org [15:46:10] RECOVERY - www.petrawiki.org - reverse DNS on sslhost is OK: rDNS OK - www.petrawiki.org reverse DNS resolves to cp7.miraheze.org [15:50:30] RECOVERY - towarzystwo.prawa.kredytowego.pl - reverse DNS on sslhost is OK: rDNS OK - towarzystwo.prawa.kredytowego.pl reverse DNS resolves to cp6.miraheze.org [15:50:30] RECOVERY - n64brew.dev - reverse DNS on sslhost is OK: rDNS OK - n64brew.dev reverse DNS resolves to cp6.miraheze.org [15:50:32] RECOVERY - www.tradwiki.org - reverse DNS on sslhost is OK: rDNS OK - www.tradwiki.org reverse DNS resolves to cp6.miraheze.org [15:50:34] RECOVERY - www.bluepageswiki.org - reverse DNS on sslhost is OK: rDNS OK - www.bluepageswiki.org reverse DNS resolves to cp7.miraheze.org [15:50:34] RECOVERY - wikiescola.com.br - reverse DNS on sslhost is OK: rDNS OK - wikiescola.com.br reverse DNS resolves to cp7.miraheze.org [15:50:47] RECOVERY - dariawiki.org - reverse DNS on sslhost is OK: rDNS OK - dariawiki.org reverse DNS resolves to cp6.miraheze.org [15:50:49] RECOVERY - wiki.arnab.at - reverse DNS on sslhost is OK: rDNS OK - wiki.arnab.at reverse DNS resolves to cp6.miraheze.org [15:50:50] RECOVERY - wiki.thehall.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.thehall.xyz reverse DNS resolves to cp6.miraheze.org [15:50:50] RECOVERY - wiki.usagihime.ml - reverse DNS on sslhost is OK: rDNS OK - wiki.usagihime.ml reverse DNS resolves to cp7.miraheze.org [15:51:19] RECOVERY - wiki.azimuth.navy - reverse DNS on sslhost is OK: rDNS OK - wiki.azimuth.navy reverse DNS resolves to cp6.miraheze.org [16:01:02] [02miraheze/puppet] 07Reception123 pushed 032 commits to 03Reception123-patch-2 [+0/-0/±3] 13https://git.io/Jkg7B [16:01:04] [02miraheze/puppet] 07Reception123 03c9971a6 - add MediaModeration API key Per T5824 [16:01:05] [02miraheze/puppet] 07Reception123 0344263fd - indent fix [16:01:07] [02puppet] 07Reception123 created branch 03Reception123-patch-2 - 13https://git.io/vbiAS [16:01:29] [02puppet] 07Reception123 opened pull request 03#1519: add MediaModeration API key - 13https://git.io/Jkg7E [16:03:46] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.14, 5.66, 4.91 [16:07:44] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.92, 5.09, 4.83 [16:23:21] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+1/-0/±1] 13https://git.io/JkgFX [16:23:22] [02miraheze/mediawiki] 07Reception123 03e2777d0 - Install MediaModeration ext. [16:23:39] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±3] 13https://git.io/JkgFD [16:23:41] [02miraheze/mw-config] 07Reception123 03d63e29d - Add MediaModeration extension T5824 [16:23:42] [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://git.io/vbvb3 [16:23:47] [02mw-config] 07Reception123 opened pull request 03#3463: Add MediaModeration extension T5824 - 13https://git.io/JkgF9 [16:24:41] [02mw-config] 07Reception123 edited pull request 03#3463: Add MediaModeration extension T5824 - 13https://git.io/JkgF9 [16:25:05] [02puppet] 07Reception123 edited pull request 03#1519: add MediaModeration API key - 13https://git.io/Jkg7E [16:25:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jkgbv [16:25:15] [02miraheze/services] 07MirahezeSSLBot 03f2958b1 - BOT: Updating services config for wikis [16:25:26] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.59, 5.59, 5.25 [16:27:39] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://git.io/JkgbB [16:27:40] [02miraheze/mw-config] 07Reception123 03371411c - must be an array apparently [16:27:42] [02mw-config] 07Reception123 synchronize pull request 03#3463: Add MediaModeration extension T5824 - 13https://git.io/JkgF9 [16:29:19] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 2.66, 4.68, 5.00 [16:33:15] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 8.77, 6.59, 5.54 [16:33:26] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 9.26, 7.36, 6.12 [16:35:23] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.57, 6.82, 5.76 [16:35:31] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.46, 6.09, 5.51 [16:35:35] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.33, 7.13, 6.18 [16:37:18] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 6.42, 6.72, 5.85 [16:37:30] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 3.41, 5.29, 5.31 [16:38:31] Reception123: do T6466 [16:39:29] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.18, 5.68, 5.44 [16:39:38] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 5.69, 6.79, 6.29 [16:40:01] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [16:40:52] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [16:40:58] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [16:41:27] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.52, 5.46, 5.40 [16:41:51] PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [16:41:52] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [16:42:58] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures [16:43:09] [02WikiDiscover] 07JohnFLewis closed pull request 03#20: Add "Established" date (T5351) - 13https://git.io/JkzPq [16:43:10] [02miraheze/WikiDiscover] 07JohnFLewis pushed 035 commits to 03master [+0/-0/±7] 13https://git.io/JkgAf [16:43:12] [02miraheze/WikiDiscover] 07JohnFLewis 0359da65d - Merge pull request #20 from miraheze/Universal-Omega-patch-2 Add "Established" date (T5351) [16:43:39] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 8.18, 7.49, 6.69 [16:43:52] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:43:59] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:45:08] PROBLEM - programming.red - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for programming.red could not be found [16:45:09] PROBLEM - lama.madooa.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lama.madooa.org could not be found [16:45:11] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 9.61, 7.79, 6.55 [16:45:40] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 5.81, 6.77, 6.51 [16:46:51] [02WikiDiscover] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vhUAp [16:46:53] [02miraheze/WikiDiscover] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [16:47:08] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 4.90, 7.01, 6.44 [16:49:03] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 3.45, 5.79, 6.05 [16:51:56] RECOVERY - programming.red - reverse DNS on sslhost is OK: rDNS OK - programming.red reverse DNS resolves to cp7.miraheze.org [16:51:57] RECOVERY - lama.madooa.org - reverse DNS on sslhost is OK: rDNS OK - lama.madooa.org reverse DNS resolves to cp6.miraheze.org [16:52:37] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [16:53:10] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.94, 5.63, 5.35 [16:53:42] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:56:09] PROBLEM - dariawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dariawiki.org could not be found [16:56:12] PROBLEM - wiki.thehall.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.thehall.xyz could not be found [16:56:14] PROBLEM - history.estill.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for history.estill.org could not be found [16:56:16] PROBLEM - wiki.rebirthofthenight.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.rebirthofthenight.com could not be found [16:56:23] PROBLEM - wikipariksha.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikipariksha.com could not be found [16:56:24] PROBLEM - beaconspace.unrestrictedlorefare.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for beaconspace.unrestrictedlorefare.com could not be found [16:56:24] PROBLEM - www.lab612.at - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.lab612.at could not be found [16:57:23] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.48, 5.17, 5.21 [16:59:21] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.25, 4.87, 5.10 [17:03:01] RECOVERY - history.estill.org - reverse DNS on sslhost is OK: rDNS OK - history.estill.org reverse DNS resolves to cp7.miraheze.org [17:03:04] RECOVERY - wiki.rebirthofthenight.com - reverse DNS on sslhost is OK: rDNS OK - wiki.rebirthofthenight.com reverse DNS resolves to cp6.miraheze.org [17:03:05] RECOVERY - beaconspace.unrestrictedlorefare.com - reverse DNS on sslhost is OK: rDNS OK - beaconspace.unrestrictedlorefare.com reverse DNS resolves to cp7.miraheze.org [17:03:05] RECOVERY - www.lab612.at - reverse DNS on sslhost is OK: rDNS OK - www.lab612.at reverse DNS resolves to cp6.miraheze.org [17:03:06] RECOVERY - dariawiki.org - reverse DNS on sslhost is OK: rDNS OK - dariawiki.org reverse DNS resolves to cp7.miraheze.org [17:03:09] RECOVERY - wiki.thehall.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.thehall.xyz reverse DNS resolves to cp7.miraheze.org [17:03:11] RECOVERY - wikipariksha.com - reverse DNS on sslhost is OK: rDNS OK - wikipariksha.com reverse DNS resolves to cp6.miraheze.org [17:03:57] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±2] 13https://git.io/JkgpJ [17:03:58] [02miraheze/mediawiki] 07Universal-Omega 03f4c027a - Updating WikiDiscover [17:04:00] [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [17:08:07] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [17:08:08] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [17:08:22] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±2] 13https://git.io/Jkgp4 [17:08:24] [02miraheze/mediawiki] 07Universal-Omega 0376538ad - Updating WikiDiscover [17:08:25] [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [17:12:25] [02WikiDiscover] 07JohnFLewis reviewed pull request 03#19 commit - 13https://git.io/JkgDB [17:16:55] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JkghC [17:16:57] [02miraheze/ssl] 07Reception123 033a631a3 - add idleon.info cert [17:19:43] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [17:19:44] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [17:22:20] PROBLEM - wiki.hrznstudio.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.hrznstudio.com could not be found [17:22:42] PROBLEM - pwiki.arkcls.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pwiki.arkcls.com could not be found [17:25:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jkgj0 [17:25:14] [02miraheze/services] 07MirahezeSSLBot 03fbeecfc - BOT: Updating services config for wikis [17:29:03] RECOVERY - wiki.hrznstudio.com - reverse DNS on sslhost is OK: rDNS OK - wiki.hrznstudio.com reverse DNS resolves to cp7.miraheze.org [17:29:40] RECOVERY - pwiki.arkcls.com - reverse DNS on sslhost is OK: rDNS OK - pwiki.arkcls.com reverse DNS resolves to cp6.miraheze.org [17:47:47] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.62, 4.85, 4.28 [17:49:47] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.05, 4.45, 4.20 [17:53:32] PROBLEM - adadevelopersacademy.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for adadevelopersacademy.wiki could not be found [17:53:35] PROBLEM - vmcodex.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vmcodex.net could not be found [17:53:37] PROBLEM - permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for permanentfuturelab.wiki could not be found [17:53:40] PROBLEM - history.estill.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for history.estill.org could not be found [17:53:43] PROBLEM - commonswiki.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commonswiki.miraheze.org could not be found [18:00:19] RECOVERY - vmcodex.net - reverse DNS on sslhost is OK: rDNS OK - vmcodex.net reverse DNS resolves to cp7.miraheze.org [18:00:22] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk2JE [18:00:23] [02miraheze/services] 07MirahezeSSLBot 03d0a6a88 - BOT: Updating services config for wikis [18:00:30] RECOVERY - adadevelopersacademy.wiki - reverse DNS on sslhost is OK: rDNS OK - adadevelopersacademy.wiki reverse DNS resolves to cp7.miraheze.org [18:00:33] RECOVERY - permanentfuturelab.wiki - reverse DNS on sslhost is OK: rDNS OK - permanentfuturelab.wiki reverse DNS resolves to cp7.miraheze.org [18:00:41] RECOVERY - history.estill.org - reverse DNS on sslhost is OK: rDNS OK - history.estill.org reverse DNS resolves to cp7.miraheze.org [18:00:42] RECOVERY - commonswiki.miraheze.org - reverse DNS on sslhost is OK: rDNS OK - commonswiki.miraheze.org reverse DNS resolves to cp7.miraheze.org [18:03:59] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.20, 5.36, 4.93 [18:05:59] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.81, 4.87, 4.78 [18:10:41] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jk2Uc [18:10:43] [02miraheze/WikiDiscover] 07Universal-Omega 0337d7619 - Standardize format; add numberofwikisincategory parser [18:10:44] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#19: Add more MagicWords for private, closed and active wikis (T6224) - 13https://git.io/JkzBq [18:11:23] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jk2U8 [18:11:24] [02miraheze/WikiDiscover] 07Universal-Omega 033259090 - Add numberofwikisincategory [18:11:26] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#19: Add more MagicWords for private, closed and active wikis (T6224) - 13https://git.io/JkzBq [18:12:18] [02WikiDiscover] 07Universal-Omega edited pull request 03#19: Add more MagicWords for private, closed and active wikis, and add parser for {{NUMBEROFWIKISINCATEGORY}} (T6224) - 13https://git.io/JkzBq [18:13:49] miraheze/mw-config/Reception123-patch-1/371411c - Reception123 The build was fixed. https://travis-ci.org/miraheze/mw-config/builds/744925747 [18:27:50] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.18, 20.47, 23.41 [18:31:53] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 38.77, 27.95, 25.51 [18:33:55] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.99, 5.75, 5.15 [18:36:53] [02WikiDiscover] 07JohnFLewis reviewed pull request 03#19 commit - 13https://git.io/Jk2ko [18:37:53] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.43, 4.74, 4.88 [18:39:51] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.39, 21.54, 23.49 [18:43:25] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jk2I3 [18:43:26] [02miraheze/WikiDiscover] 07Universal-Omega 031a3442b - Format [18:43:28] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#19: Add more MagicWords for private, closed and active wikis, and add parser for {{NUMBEROFWIKISINCATEGORY}} (T6224) - 13https://git.io/JkzBq [18:43:54] [02WikiDiscover] 07Universal-Omega reviewed pull request 03#19 commit - 13https://git.io/Jk2Ic [18:52:07] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 39.34, 28.13, 24.76 [18:53:46] PROBLEM - wiki.kali-team.cn - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.kali-team.cn could not be found [18:56:01] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.63, 23.06, 23.56 [18:57:20] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jk2L4 [18:57:22] [02miraheze/WikiDiscover] 07Universal-Omega 030369dc6 - Case [18:57:23] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#19: Add more MagicWords for private, closed and active wikis, and add parser for {{NUMBEROFWIKISINCATEGORY}} (T6224) - 13https://git.io/JkzBq [19:00:34] RECOVERY - wiki.kali-team.cn - reverse DNS on sslhost is OK: rDNS OK - wiki.kali-team.cn reverse DNS resolves to cp7.miraheze.org [19:01:53] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.75, 25.00, 24.10 [19:05:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk2Lh [19:05:13] [02miraheze/services] 07MirahezeSSLBot 03152a375 - BOT: Updating services config for wikis [19:07:50] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.33, 23.07, 23.80 [19:08:50] Is @Miraheze-IRC working? [19:08:54] Hello IRC? [19:10:44] ping [19:11:23] tesrt [19:11:30] s/tesrt/test [19:11:31] dmehus meant to say: test [19:13:58] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 38.98, 28.59, 25.44 [19:17:51] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 13.79, 22.05, 23.59 [19:21:51] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.44, 25.29, 24.43 [19:27:16] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.29, 5.00, 4.64 [19:29:15] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.49, 4.80, 4.60 [19:31:51] Yey you're alive [19:39:52] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.59, 22.58, 23.72 [19:41:52] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.33, 23.93, 24.08 [19:43:35] [02WikiDiscover] 07JohnFLewis closed pull request 03#19: Add more MagicWords for private, closed and active wikis, and add parser for {{NUMBEROFWIKISINCATEGORY}} (T6224) - 13https://git.io/JkzBq [19:43:36] [02miraheze/WikiDiscover] 07JohnFLewis pushed 039 commits to 03master [+0/-0/±10] 13https://git.io/Jk2Yw [19:43:38] [02miraheze/WikiDiscover] 07JohnFLewis 038f9b5f7 - Merge pull request #19 from miraheze/Universal-Omega-patch-1 Add more MagicWords for private, closed and active wikis, and add parser for {{NUMBEROFWIKISINCATEGORY}} (T6224) [19:59:50] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.83, 21.82, 23.64 [20:07:50] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.58, 23.62, 23.84 [20:09:26] PROBLEM - bacula2 Bacula Static 1 on bacula2 is CRITICAL: CRITICAL: Full, 11963030 files, 597.6GB, 2020-10-20 20:09:00 (4.4 weeks ago) [20:11:24] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 7.87, 5.24, 4.75 [20:12:44] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.39, 6.24, 5.15 [20:13:23] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.23, 5.30, 4.84 [20:14:40] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 4.73, 5.48, 4.99 [20:15:22] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 2.58, 4.43, 4.59 [20:39:55] !log depool mw[4567] and repool [20:39:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:39] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/Jk2nr [20:40:41] [02miraheze/mediawiki] 07paladox 039a96824 - Update WikiDiscover [20:41:29] PROBLEM - mw4 Puppet on mw4 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures [20:41:33] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.89, 5.09, 4.72 [20:41:44] !log rebuild lc on mw* and jobrunner* [20:42:01] !log revert depool/repool. Seems the change works without having to do that. [20:42:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:21] PROBLEM - mw7 Puppet on mw7 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures [20:42:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:24] PROBLEM - mw5 Puppet on mw5 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures [20:42:44] PROBLEM - mw6 Puppet on mw6 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 10 minutes ago with 0 failures [20:42:46] PROBLEM - cp9 Varnish Backends on cp9 is CRITICAL: 1 backends are down. mw4 [20:43:25] PROBLEM - cp7 Varnish Backends on cp7 is CRITICAL: 2 backends are down. mw4 mw5 [20:43:34] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.40, 5.31, 4.84 [20:43:49] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [20:43:51] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 8.52, 6.10, 5.00 [20:44:21] PROBLEM - cp6 Varnish Backends on cp6 is CRITICAL: 4 backends are down. mw4 mw5 mw6 mw7 [20:45:25] PROBLEM - jobrunner2 MediaWiki Rendering on jobrunner2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 15819 bytes in 0.137 second response time [20:45:26] PROBLEM - mw5 MediaWiki Rendering on mw5 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 15811 bytes in 0.113 second response time [20:45:33] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.77, 4.78, 4.71 [20:45:40] PROBLEM - mw7 MediaWiki Rendering on mw7 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 15811 bytes in 0.088 second response time [20:45:49] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 1.63, 4.37, 4.50 [20:46:01] PROBLEM - mw6 MediaWiki Rendering on mw6 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 15811 bytes in 0.098 second response time [20:46:15] PROBLEM - jobrunner1 MediaWiki Rendering on jobrunner1 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 15818 bytes in 0.094 second response time [20:46:16] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 4 backends are down. mw4 mw5 mw6 mw7 [20:46:30] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 51% [20:47:29] RECOVERY - mw5 MediaWiki Rendering on mw5 is OK: HTTP OK: HTTP/1.1 200 OK - 18942 bytes in 2.456 second response time [20:47:36] RECOVERY - mw7 MediaWiki Rendering on mw7 is OK: HTTP OK: HTTP/1.1 200 OK - 18942 bytes in 0.192 second response time [20:47:48] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [20:47:52] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.68, 21.80, 23.86 [20:48:01] RECOVERY - mw6 MediaWiki Rendering on mw6 is OK: HTTP OK: HTTP/1.1 200 OK - 18942 bytes in 0.199 second response time [20:48:28] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 7% [20:51:26] PROBLEM - mw5 MediaWiki Rendering on mw5 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 15812 bytes in 0.210 second response time [20:51:29] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 7.98, 5.84, 5.09 [20:51:50] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.38, 24.21, 24.29 [20:53:26] RECOVERY - mw5 MediaWiki Rendering on mw5 is OK: HTTP OK: HTTP/1.1 200 OK - 18942 bytes in 0.178 second response time [20:53:41] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.63, 6.34, 5.23 [20:54:15] RECOVERY - jobrunner1 MediaWiki Rendering on jobrunner1 is OK: HTTP OK: HTTP/1.1 200 OK - 18956 bytes in 0.164 second response time [20:55:39] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 2.61, 5.10, 4.93 [20:57:18] RECOVERY - jobrunner2 MediaWiki Rendering on jobrunner2 is OK: HTTP OK: HTTP/1.1 200 OK - 18956 bytes in 0.199 second response time [20:58:03] PROBLEM - mw6 MediaWiki Rendering on mw6 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 15812 bytes in 0.121 second response time [21:03:52] PROBLEM - mon1 Current Load on mon1 is WARNING: WARNING - load average: 3.81, 3.92, 2.98 [21:04:26] PROBLEM - pubwiki.lab.co.pl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pubwiki.lab.co.pl could not be found [21:04:29] PROBLEM - wiki.villagecollaborative.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.villagecollaborative.net could not be found [21:04:32] PROBLEM - dariawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dariawiki.org could not be found [21:04:36] PROBLEM - en.nocyclo.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.nocyclo.tk could not be found [21:04:37] PROBLEM - munwiki.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for munwiki.info could not be found [21:04:40] RECOVERY - mw6 MediaWiki Rendering on mw6 is OK: HTTP OK: HTTP/1.1 200 OK - 18942 bytes in 0.195 second response time [21:05:47] RECOVERY - mon1 Current Load on mon1 is OK: OK - load average: 2.38, 3.35, 2.88 [21:07:54] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.18, 5.93, 5.94 [21:11:08] RECOVERY - pubwiki.lab.co.pl - reverse DNS on sslhost is OK: rDNS OK - pubwiki.lab.co.pl reverse DNS resolves to cp6.miraheze.org [21:11:16] RECOVERY - wiki.villagecollaborative.net - reverse DNS on sslhost is OK: rDNS OK - wiki.villagecollaborative.net reverse DNS resolves to cp6.miraheze.org [21:11:21] RECOVERY - dariawiki.org - reverse DNS on sslhost is OK: rDNS OK - dariawiki.org reverse DNS resolves to cp6.miraheze.org [21:11:30] RECOVERY - en.nocyclo.tk - reverse DNS on sslhost is OK: rDNS OK - en.nocyclo.tk reverse DNS resolves to cp6.miraheze.org [21:11:40] RECOVERY - munwiki.info - reverse DNS on sslhost is OK: rDNS OK - munwiki.info reverse DNS resolves to cp7.miraheze.org [21:11:57] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.57, 6.42, 6.15 [21:13:41] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.65, 7.09, 6.28 [21:15:39] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 1.98, 5.10, 5.64 [21:16:04] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 1.83, 4.45, 5.46 [21:17:29] PROBLEM - mw7 MediaWiki Rendering on mw7 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 15811 bytes in 0.104 second response time [21:19:22] [02mediawiki] 07paladox closed pull request 03#522: Bump extensions/Editcount from `62981ed` to `c7588ea` - 13https://git.io/Jkur6 [21:19:23] [02miraheze/mediawiki] 07paladox pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/Jk2lA [21:19:25] [02miraheze/mediawiki] 07paladox 0377dba25 - Merge pull request #522 from miraheze/dependabot/submodules/REL1_35/extensions/Editcount-c7588ea Bump extensions/Editcount from `62981ed` to `c7588ea` [21:19:26] [02miraheze/mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/Editcount-c7588ea [21:19:28] [02mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/Editcount-c7588ea - 13https://git.io/vbL5b [21:19:43] [02mediawiki] 07paladox closed pull request 03#527: Bump extensions/PortableInfobox from `7efce76` to `8d2d9d6` - 13https://git.io/JkurQ [21:19:44] [02mediawiki] 07dependabot[bot] commented on pull request 03#527: Bump extensions/PortableInfobox from `7efce76` to `8d2d9d6` - 13https://git.io/Jk2lp [21:19:46] [02mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/PortableInfobox-8d2d9d6 - 13https://git.io/vbL5b [21:19:47] [02miraheze/mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/PortableInfobox-8d2d9d6 [21:20:00] [02mediawiki] 07paladox closed pull request 03#532: Bump extensions/cldr from `111c60e` to `a0d3e82` - 13https://git.io/Jkurj [21:20:02] [02miraheze/mediawiki] 07paladox pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/Jk2lh [21:20:03] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.71, 5.33, 5.59 [21:20:03] [02miraheze/mediawiki] 07paladox 03e7db7d0 - Merge pull request #532 from miraheze/dependabot/submodules/REL1_35/extensions/cldr-a0d3e82 Bump extensions/cldr from `111c60e` to `a0d3e82` [21:20:05] [02mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/cldr-a0d3e82 - 13https://git.io/vbL5b [21:20:06] [02miraheze/mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/cldr-a0d3e82 [21:20:31] [02mediawiki] 07paladox closed pull request 03#518: Bump extensions/ArticleRatings from `722fc89` to `6452d19` - 13https://git.io/Jkurg [21:20:33] [02mediawiki] 07dependabot[bot] commented on pull request 03#518: Bump extensions/ArticleRatings from `722fc89` to `6452d19` - 13https://git.io/Jk28v [21:20:34] [02mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/ArticleRatings-6452d19 - 13https://git.io/vbL5b [21:20:36] [02miraheze/mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/ArticleRatings-6452d19 [21:20:42] PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.99, 6.25, 4.39 [21:20:45] [02mediawiki] 07paladox closed pull request 03#530: Bump extensions/WikiForum from `2ffdd23` to `da0bbfc` - 13https://git.io/JkurN [21:20:47] [02mediawiki] 07dependabot[bot] commented on pull request 03#530: Bump extensions/WikiForum from `2ffdd23` to `da0bbfc` - 13https://git.io/Jk28T [21:20:48] [02mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/WikiForum-da0bbfc - 13https://git.io/vbL5b [21:20:50] [02miraheze/mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/extensions/WikiForum-da0bbfc [21:21:00] [02mediawiki] 07paladox closed pull request 03#531: Bump skins/Tweeki from `63d8cc6` to `bddddc8` - 13https://git.io/Jkurh [21:21:02] [02mediawiki] 07dependabot[bot] commented on pull request 03#531: Bump skins/Tweeki from `63d8cc6` to `bddddc8` - 13https://git.io/Jk28k [21:21:04] [02miraheze/mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/skins/Tweeki-bddddc8 [21:21:06] [02mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/skins/Tweeki-bddddc8 - 13https://git.io/vbL5b [21:21:30] RECOVERY - mw7 MediaWiki Rendering on mw7 is OK: HTTP OK: HTTP/1.1 200 OK - 18941 bytes in 0.112 second response time [21:21:33] [02mediawiki] 07paladox closed pull request 03#533: Bump skins/Medik from `489f6e4` to `9ca92c1` - 13https://git.io/Jkuov [21:21:35] [02miraheze/mediawiki] 07paladox pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/Jk28Y [21:21:36] [02miraheze/mediawiki] 07paladox 03f0d07c0 - Merge pull request #533 from miraheze/dependabot/submodules/REL1_35/skins/Medik-9ca92c1 Bump skins/Medik from `489f6e4` to `9ca92c1` [21:21:38] [02mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/skins/Medik-9ca92c1 - 13https://git.io/vbL5b [21:21:39] [02miraheze/mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_35/skins/Medik-9ca92c1 [21:22:02] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.94, 5.31, 5.56 [21:22:25] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.79, 6.56, 5.31 [21:22:41] PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 9.15, 7.05, 4.90 [21:24:21] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.63, 6.32, 5.38 [21:24:40] RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 5.12, 6.35, 4.92 [21:25:41] RECOVERY - cp7 Varnish Backends on cp7 is OK: All 7 backends are healthy [21:25:59] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 7 backends are healthy [21:26:03] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.05, 5.26, 5.44 [21:26:29] RECOVERY - cp6 Varnish Backends on cp6 is OK: All 7 backends are healthy [21:26:43] RECOVERY - cp9 Varnish Backends on cp9 is OK: All 7 backends are healthy [21:28:48] PROBLEM - mw6 Disk Space on mw6 is WARNING: DISK WARNING - free space: / 2058 MB (10% inode=73%); [21:30:02] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 3.68, 4.85, 5.27 [21:31:27] PROBLEM - meta.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for meta.gyaanipedia.co.in could not be found [21:31:35] PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [21:31:49] PROBLEM - allthetropes.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for allthetropes.org could not be found [21:34:01] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.67, 6.03, 5.63 [21:36:00] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 3.83, 5.33, 5.43 [21:37:33] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:38:16] RECOVERY - meta.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - meta.gyaanipedia.co.in reverse DNS resolves to cp7.miraheze.org [21:38:40] RECOVERY - allthetropes.org - reverse DNS on sslhost is OK: rDNS OK - allthetropes.org reverse DNS resolves to cp7.miraheze.org [21:42:05] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 9.55, 6.44, 5.78 [21:44:09] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.71, 5.81, 5.64 [21:45:19] PROBLEM - test2 APT on test2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [21:46:36] PROBLEM - test2 Current Load on test2 is CRITICAL: CRITICAL - load average: 4.06, 3.04, 1.55 [21:47:18] RECOVERY - test2 APT on test2 is OK: APT OK: 14 packages available for upgrade (0 critical updates). [21:48:32] RECOVERY - test2 Current Load on test2 is OK: OK - load average: 2.91, 2.71, 1.59 [21:52:09] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 9.44, 6.39, 5.73 [21:52:41] PROBLEM - test2 Current Load on test2 is WARNING: WARNING - load average: 2.30, 3.44, 2.20 [21:54:08] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.57, 5.43, 5.45 [21:54:36] RECOVERY - test2 Current Load on test2 is OK: OK - load average: 0.49, 2.41, 1.97 [22:00:15] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.31, 5.78, 5.53 [22:06:24] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.07, 5.89, 5.80 [22:16:20] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.07, 4.31, 5.06 [22:27:22] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.39, 5.78, 5.45 [22:29:23] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.72, 6.03, 5.58 [22:31:22] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.25, 5.39, 5.37 [22:33:52] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.36, 19.23, 23.58 [22:39:22] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.92, 4.44, 4.98 [22:41:51] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.78, 21.83, 22.93 [22:43:20] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 7.13, 5.90, 5.44 [22:43:51] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.66, 21.16, 22.54 [22:45:19] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 3.00, 4.91, 5.14 [22:46:21] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [22:46:25] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [22:47:04] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:47:20] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.46, 4.43, 4.93 [22:47:27] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [22:53:51] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.32, 23.22, 22.22 [22:55:40] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[ops_ensure_members] [23:01:21] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [23:01:51] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [23:02:45] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [23:03:37] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:03:47] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:04:29] PROBLEM - mon1 Current Load on mon1 is WARNING: WARNING - load average: 3.47, 3.30, 2.76 [23:04:34] PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 7.64, 8.45, 6.09 [23:05:46] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.73, 5.31, 4.90 [23:06:25] RECOVERY - mon1 Current Load on mon1 is OK: OK - load average: 2.54, 2.95, 2.70 [23:06:34] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 3.52, 6.74, 5.76 [23:07:20] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures [23:08:40] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:09:48] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.52, 4.77, 4.80 [23:15:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk2V8 [23:15:15] [02miraheze/services] 07MirahezeSSLBot 03d26da3e - BOT: Updating services config for wikis [23:29:50] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.42, 21.47, 23.72 [23:31:50] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 23.65, 23.44, 24.25 [23:33:50] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.53, 22.36, 23.75 [23:38:07] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 38.34, 27.72, 25.34 [23:45:54] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.57, 22.78, 23.95 [23:50:48] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.42, 5.69, 4.99 [23:52:50] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.62, 5.74, 5.08 [23:54:50] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 4.83, 5.33, 5.00 [23:55:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jk2oO [23:55:13] [02miraheze/services] 07MirahezeSSLBot 038b0fce8 - BOT: Updating services config for wikis [23:56:52] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 3.71, 4.75, 4.83