[00:03:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 33.06, 25.63, 21.96 [00:05:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.47, 22.67, 21.39 [00:09:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.74, 18.58, 20.06 [00:10:58] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:12:02] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:15:58] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [00:16:48] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:48:28] PROBLEM - www.evanswiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.evanswiki.org could not be found [00:48:30] PROBLEM - en.phgalaxy.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.phgalaxy.xyz could not be found [00:55:13] RECOVERY - www.evanswiki.org - reverse DNS on sslhost is OK: rDNS OK - www.evanswiki.org reverse DNS resolves to cp6.miraheze.org [00:55:15] RECOVERY - en.phgalaxy.xyz - reverse DNS on sslhost is OK: rDNS OK - en.phgalaxy.xyz reverse DNS resolves to cp6.miraheze.org [05:09:11] !log reception@jobrunner2:/srv/mediawiki/w/maintenance$ sudo -u www-data php deleteBatch.php --wiki testwiki --r "Requested - T6197" /home/reception/testwikidel.txt [05:09:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:15:35] PROBLEM - wiki.cyberepo.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.cyberepo.org' expires in 15 day(s) (Mon 05 Oct 2020 05:11:53 GMT +0000). [05:23:09] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUEIm [05:23:10] [02miraheze/ssl] 07MirahezeSSLBot 03059ed06 - Bot: Update SSL cert for wiki.cyberepo.org [05:36:07] RECOVERY - wiki.cyberepo.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cyberepo.org' will expire on Fri 18 Dec 2020 04:23:03 GMT +0000. [05:53:15] PROBLEM - misc1 APT on misc1 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [06:15:14] RECOVERY - misc1 APT on misc1 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:34:04] [02landing] 07ahmsaqib opened pull request 03#42: Update index.php - 13https://git.io/JUEL2 [07:55:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.57, 21.23, 16.73 [07:57:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.79, 18.17, 16.21 [08:34:05] [02landing] 07RhinosF1 commented on pull request 03#17: Polish Translation - 13https://git.io/JUEYS [08:34:07] [02landing] 07RhinosF1 closed pull request 03#17: Polish Translation - 13https://git.io/JeanF [08:42:42] [02landing] 07ahmsaqib commented on pull request 03#42: Update index.php - 13https://git.io/JUEOt [09:02:23] [02landing] 07RhinosF1 commented on pull request 03#42: Update index.php - 13https://git.io/JUEOX [10:32:11] hi [10:32:51] Reception123 i transclude Special:ShortPages into another page to show a list? https://yourcreatures.miraheze.org/wiki/Special:ShortPages [10:32:52] [ Short pages - Bestiary of the Hypogriph ] - yourcreatures.miraheze.org [10:33:07] * can i transclude [10:33:29] you can try yeah [10:33:45] I receive only the link of the page [10:35:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUEGI [10:35:12] [02miraheze/services] 07MirahezeSSLBot 0382c17ce - BOT: Updating services config for wikis [10:36:15] then it might not be possible to do, I'm not sure [10:36:41] ok, thanks [11:46:11] If it shows a link, transcluding doesn't work for that special page [13:30:38] PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 5.16, 7.96, 4.65 [13:31:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.36, 20.55, 18.74 [13:32:38] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.90, 5.81, 4.27 [13:33:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.82, 17.77, 17.95 [13:40:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUECK [13:40:19] [02miraheze/services] 07MirahezeSSLBot 033d8721c - BOT: Updating services config for wikis [13:41:19] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUECP [13:41:20] [02miraheze/mw-config] 07Reception123 030f724d2 - add ini and lua file extensions T6198 [13:46:30] [02landing] 07ahmsaqib synchronize pull request 03#42: Update index.php - 13https://git.io/JUEL2 [15:16:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.50, 22.11, 18.16 [15:18:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.67, 21.69, 18.48 [15:20:16] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.85, 20.14, 18.26 [15:24:03] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.84, 23.09, 19.77 [15:25:57] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.85, 20.01, 19.04 [15:35:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.29, 21.34, 19.19 [15:37:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.84, 19.99, 18.95 [15:49:47] PROBLEM - portalsofphereon.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.portalsofphereon.com' expires in 15 day(s) (Mon 05 Oct 2020 15:44:25 GMT +0000). [15:51:05] PROBLEM - www.portalsofphereon.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.portalsofphereon.com' expires in 15 day(s) (Mon 05 Oct 2020 15:44:25 GMT +0000). [15:58:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUE4A [15:58:09] [02miraheze/ssl] 07MirahezeSSLBot 03eda35fb - Bot: Update SSL cert for www.portalsofphereon.com [16:03:46] RECOVERY - portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Fri 18 Dec 2020 14:58:02 GMT +0000. [16:04:35] RECOVERY - www.portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Fri 18 Dec 2020 14:58:02 GMT +0000. [16:05:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.94, 20.89, 19.02 [16:07:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.84, 21.59, 19.66 [16:09:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.94, 18.35, 18.69 [16:13:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.74, 23.80, 20.87 [16:19:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 13.33, 20.40, 20.72 [16:23:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.46, 18.56, 20.10 [16:37:49] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 150s [16:39:49] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 1s [16:44:20] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JUER3 [16:44:21] [02miraheze/dns] 07Reception123 03d448943 - add opendatascot.org zone [18:33:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 53.19, 29.64, 21.00 [18:36:12] PROBLEM - commons.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commons.gyaanipedia.co.in could not be found [18:36:23] PROBLEM - wikiescola.com.br - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikiescola.com.br could not be found [18:36:38] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 9.64, 11.19, 5.99 [18:37:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 13.10, 23.79, 20.95 [18:38:38] PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 2.22, 7.88, 5.41 [18:39:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 9.10, 18.99, 19.55 [18:40:38] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 0.91, 5.52, 4.84 [18:42:52] RECOVERY - commons.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - commons.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org [18:43:12] RECOVERY - wikiescola.com.br - reverse DNS on sslhost is OK: rDNS OK - wikiescola.com.br reverse DNS resolves to cp7.miraheze.org [18:50:04] Alert to Miraheze Staff: It looks like the MirahezeRC bot has stopped! Recent Changes are no longer available from IRC. [18:50:07] !log sudo service ircrcbot restart [18:50:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:59:04] I wish that alert didn't say staff [18:59:19] We don't use the staff term in that much externally [18:59:53] I honestly hate the alerts period [19:02:20] +1 to all of the above. I tend to probably agree more with @Zppix here. Those @SigmaBotMH alerts don't seem thay help. There's usually someone around able to point out soon enough when the RC feeds have stopped [19:35:27] They're there because things rely on it and there's no monitoring [19:35:33] It does need improving [19:39:37] @RhinosF1 yeah [20:20:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUE2e [20:20:20] [02miraheze/services] 07MirahezeSSLBot 039c27571 - BOT: Updating services config for wikis [20:25:56] @Doug: it's one of those it will happen one day but not sure when tasks [20:35:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUEas [20:35:12] [02miraheze/services] 07MirahezeSSLBot 03386d5cb - BOT: Updating services config for wikis [20:38:45] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JUEaB [20:38:47] [02miraheze/mediawiki] 07paladox 039fac24a - Update Cosmos [20:41:04] !log rebuild lc on mw* and jobrunner* [20:41:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:45:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 34.71, 24.35, 19.14 [20:49:53] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [20:49:58] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [20:50:22] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [20:50:43] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [20:51:01] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [20:54:20] PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.70, 6.23, 4.50 [20:56:19] RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 5.47, 6.00, 4.63 [20:56:34] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [20:57:01] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [20:57:40] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JUEVn [20:57:41] [02miraheze/mediawiki] 07paladox 03553d4aa - Update Cosmos [20:58:12] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [20:59:15] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:06:10] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [21:07:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 11.52, 18.25, 22.68 [21:13:31] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.61, 16.09, 20.17 [21:40:46] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JUEwY [21:40:48] [02miraheze/mediawiki] 07paladox 03cc1d8eb - Update Cosmos [23:27:25] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JUEKk [23:27:26] [02miraheze/mediawiki] 07paladox 03f82c7ae - Update Cosmos