[00:03:11] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.37, 22.95, 16.69 [00:05:08] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.50, 20.89, 16.66 [00:07:08] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.08, 19.72, 16.75 [01:10:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUmti [01:10:20] [02miraheze/services] 07MirahezeSSLBot 03a3135c3 - BOT: Updating services config for wikis [03:00:22] PROBLEM - cp7 APT on cp7 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [04:08:26] PROBLEM - en.wikireserve.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'en.wikireserve.com' expires in 15 day(s) (Thu 17 Sep 2020 04:03:59 GMT +0000). [04:10:28] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUmnp [04:10:29] [02miraheze/ssl] 07MirahezeSSLBot 038f0ec39 - Bot: Update SSL cert for en.wikireserve.com [04:22:06] RECOVERY - en.wikireserve.com - LetsEncrypt on sslhost is OK: OK - Certificate 'en.wikireserve.com' will expire on Mon 30 Nov 2020 03:10:21 GMT +0000. [04:33:56] PROBLEM - wikiverte.pl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikiverte.pl' expires in 15 day(s) (Thu 17 Sep 2020 04:28:00 GMT +0000). [04:39:23] PROBLEM - aman.awiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'aman.awiki.org' expires in 15 day(s) (Thu 17 Sep 2020 04:36:54 GMT +0000). [04:39:42] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUmc9 [04:39:43] [02miraheze/ssl] 07MirahezeSSLBot 0358dd62f - Bot: Update SSL cert for wikiverte.pl [04:41:33] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUmcd [04:41:35] [02miraheze/ssl] 07MirahezeSSLBot 0313c69bc - Bot: Update SSL cert for aman.awiki.org [04:42:33] PROBLEM - wiki.ssij.se - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ssij.se' expires in 15 day(s) (Thu 17 Sep 2020 04:34:09 GMT +0000). [04:50:22] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUmCU [04:50:24] [02miraheze/ssl] 07MirahezeSSLBot 036788cb8 - Bot: Update SSL cert for wiki.ssij.se [04:53:44] PROBLEM - cp7 Puppet on cp7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:54:09] PROBLEM - cp6 Puppet on cp6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:54:58] PROBLEM - cp9 Puppet on cp9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:56:51] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:57:27] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:57:42] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:58:00] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:58:13] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:58:16] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [04:58:33] PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [05:12:08] RECOVERY - cp6 Puppet on cp6 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [05:12:56] RECOVERY - cp9 Puppet on cp9 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [05:13:44] RECOVERY - cp7 Puppet on cp7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:14:46] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [05:15:26] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [05:15:42] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures [05:15:59] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [05:16:13] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:16:17] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [05:16:32] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:49:27] !log discord webhook for sagcraftwiki [05:49:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUmWy [05:55:12] [02miraheze/services] 07MirahezeSSLBot 032d63b0f - BOT: Updating services config for wikis [06:00:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUmWN [06:00:19] [02miraheze/services] 07MirahezeSSLBot 03171d634 - BOT: Updating services config for wikis [06:08:21] RECOVERY - cp7 APT on cp7 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:40:07] PROBLEM - test2 APT on test2 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [07:10:59] PROBLEM - cp6 APT on cp6 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [09:17:52] PROBLEM - shkilev.online - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for shkilev.online could not be found [09:38:22] RECOVERY - shkilev.online - reverse DNS on sslhost is OK: rDNS OK - shkilev.online reverse DNS resolves to cp9.miraheze.org [09:54:00] PROBLEM - shkilev.online - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for shkilev.online could not be found [11:28:12] PROBLEM - misc1 APT on misc1 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (2 critical updates). [12:24:41] Hello [14:59:26] hi [14:59:41] Who is it? [15:00:56] !log reception@jobrunner1:/srv/mediawiki/w/maintenance$ sudo -u www-data php runJobs.php --wiki metawiki [15:01:06] hi hispano76 :) [15:01:19] Hello, hispano76! [15:03:33] Reception123: where's the bot? [15:03:52] Reception123: space in front [15:03:59] !log 16:00:56 <+Reception123> !log reception@jobrunner1:/srv/mediawiki/w/maintenance$ sudo -u www-data php runJobs.php --wiki metawiki [15:04:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:06:06] !log reception@jobrunner1:/srv/mediawiki/w/maintenance$ sudo -u www-data php runJobs.php --wiki metawiki [15:06:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:06:10] RhinosF1: argh silly copy/paste [15:27:08] PROBLEM - civclassic.civwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'civclassic.civwiki.org' expires in 15 day(s) (Thu 17 Sep 2020 15:21:31 GMT +0000). [15:31:39] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUm7L [15:31:41] [02miraheze/ssl] 07MirahezeSSLBot 032e07c6d - Bot: Update SSL cert for civclassic.civwiki.org [15:40:50] PROBLEM - db7 Check MariaDB Replication on db7 is WARNING: MariaDB replication - both - WARNING - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 15s [15:42:52] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 137s [15:43:44] PROBLEM - cp7 Puppet on cp7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:44:08] PROBLEM - cp6 Puppet on cp6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:44:59] PROBLEM - cp9 Puppet on cp9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:46:49] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:47:28] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:47:42] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:48:00] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:48:13] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:48:17] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:48:32] PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [15:51:44] RECOVERY - cp7 Puppet on cp7 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [15:52:08] RECOVERY - cp6 Puppet on cp6 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures [15:52:56] RECOVERY - cp9 Puppet on cp9 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [15:54:45] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures [15:54:50] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 1s [15:55:27] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [15:55:42] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures [15:55:59] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:56:04] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.10, 20.59, 17.22 [15:56:12] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:56:16] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:56:31] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:58:01] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.97, 20.37, 17.54 [16:25:47] Who is it? [16:34:10] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.22, 20.68, 17.71 [16:36:06] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.31, 18.55, 17.25 [17:10:00] .highpri [17:10:01] They are no high priority tasks that I can process, good job! [17:10:52] * hispano76 see [17:11:17] * RhinosF1 disagree with bot [17:53:29] hello, could you fix the error in my Hispano76wiki? i would like to add content [17:56:48] Is there a task yet? [17:58:09] https://phabricator.miraheze.org/T6111#119539 not resolved [17:58:10] [ ⚓ T6111 Reset hispanowiki and hispano76wiki ] - phabricator.miraheze.org [18:00:20] I've reopened, pinging Reception123 (and paladox if you want to take a look) [18:01:09] Voidwalker: thanks. I'll have another look tomorrow and see what else can be done [18:01:22] hispano76: can you please link a page that is still causing issues? [18:01:45] Any from the looks of things [18:02:15] I go just hispano76.miraheze.org and get "[324bffbe36c0d2effa66030f] 2020-09-01 18:01:37: Excepción grave de tipo "MediaWiki\Storage\NameTableAccessException"" [18:03:48] !log MariaDB [hispano76wiki]> INSERT INTO content_models (model_id, model_name) VALUES (1, 'wikitext'); [18:03:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:04:19] !log MariaDB [hispano76wiki]> INSERT INTO content_models (model_id, model_name) VALUES (2, 'css'); [18:04:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:04:27] Reception123, or paladox will fix it :D [18:04:57] Heh that's easier :) [18:05:12] !log MariaDB [hispano76wiki]> INSERT INTO content_models (model_id, model_name) VALUES (5, 'json'); [18:05:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:05:16] !log MariaDB [hispano76wiki]> INSERT INTO content_models (model_id, model_name) VALUES (3, 'javascript'); [18:05:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:05:21] !log MariaDB [hispano76wiki]> INSERT INTO content_models (model_id, model_name) VALUES (4, 'Scribunto'); [18:05:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:12:52] It seems to be working properly. Thank you very much and sorry for the inconvenience. [18:15:48] Thanks paladox [18:16:01] How does that get messed up anyway? [18:23:38] Strange things.. https://hispano.miraheze.org/ [18:23:39] [ Internal error - Hispano ] - hispano.miraheze.org [18:24:55] A mistake for sharing almost the same name? "hispano" [18:25:46] today is definitely not my day :´( [18:29:10] By the way, yesterday it worked very well [18:35:44] hmm, if that's the same issue, that should definitely get looked into, paladox [18:36:38] !log MariaDB [hispanowiki]> INSERT INTO content_models (model_id, model_name) VALUES (1, 'wikitext'); [18:36:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:37:10] !log MariaDB [hispanowiki]> INSERT INTO content_models (model_id, model_name) VALUES (2, 'css'); [18:37:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:37:16] !log MariaDB [hispanowiki]> INSERT INTO content_models (model_id, model_name) VALUES (3, 'javascript'); [18:37:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:37:21] !log MariaDB [hispanowiki]> INSERT INTO content_models (model_id, model_name) VALUES (4, 'Scribunto'); [18:37:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:37:26] !log MariaDB [hispanowiki]> INSERT INTO content_models (model_id, model_name) VALUES (5, 'json'); [18:37:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:27] !log INSERT INTO slot_roles (role_id, role_name) VALUES (1, 'main'); [18:38:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:39] hispano76 fixed [18:48:47] thanks paladox [18:53:11] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.73, 19.45, 16.54 [18:55:08] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.02, 21.74, 17.72 [18:57:08] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.78, 21.08, 18.04 [18:59:08] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.16, 18.46, 17.46 [20:23:47] Hello McSon! If you have any questions, feel free to ask and someone should answer soon. [21:27:13] PROBLEM - public.revi.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'public.revi.wiki' expires in 15 day(s) (Thu 17 Sep 2020 21:25:14 GMT +0000). [21:32:26] PROBLEM - zw.fontainebleau-avon.fr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'zw.fontainebleau-avon.fr' expires in 15 day(s) (Thu 17 Sep 2020 21:27:17 GMT +0000). [21:34:47] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUYLP [21:34:48] [02miraheze/ssl] 07MirahezeSSLBot 034c8a97b - Bot: Update SSL cert for public.revi.wiki [21:36:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4c8a97beda2d...3d6781676c40 [21:36:27] [ Comparing 4c8a97beda2d...3d6781676c40 · miraheze/ssl · GitHub ] - github.com [21:36:28] [02miraheze/ssl] 07MirahezeSSLBot 033d67816 - Bot: Update SSL cert for zw.fontainebleau-avon.fr [21:44:09] PROBLEM - cp6 Puppet on cp6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:44:57] PROBLEM - cp9 Puppet on cp9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:45:45] PROBLEM - cp7 Puppet on cp7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:47:30] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:47:42] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:48:00] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:48:13] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:48:16] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:48:33] PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:48:48] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:52:09] RECOVERY - cp6 Puppet on cp6 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [21:52:56] RECOVERY - cp9 Puppet on cp9 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [21:53:45] RECOVERY - cp7 Puppet on cp7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:54:45] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [21:55:26] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [21:55:42] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [21:55:59] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [21:56:12] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:56:17] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:56:31] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:08:22] PROBLEM - wiki.cyberepo.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.cyberepo.org All nameservers failed to answer the query. [22:15:18] RECOVERY - wiki.cyberepo.org - reverse DNS on sslhost is OK: rDNS OK - wiki.cyberepo.org reverse DNS resolves to cp6.miraheze.org [22:58:05] MH-Discord, ping [23:29:27] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [23:35:26] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures