[02:20:28] [02mw-config] 07Hispano76 closed pull request 03#2832: add ExtraSignatureNamespaces on ManageWiki - 13https://git.io/JeFTq [06:27:19] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3225 MB (13% inode=94%); [11:42:48] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [11:46:46] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [11:53:44] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [11:57:53] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [12:13:04] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:15:05] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [12:22:05] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:24:03] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [12:35:07] PROBLEM - drag.lgbt - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drag.lgbt' expires in 15 day(s) (Wed 29 Jan 2020 12:32:13 PM GMT +0000). [12:35:20] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmY [12:35:22] [02miraheze/ssl] 07MirahezeSSLBot 038507ead - Bot: Update SSL cert for drag.lgbt [12:35:35] PROBLEM - monarchists.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'monarchists.wiki' expires in 15 day(s) (Wed 29 Jan 2020 12:32:42 PM GMT +0000). [12:35:49] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmO [12:35:51] [02miraheze/ssl] 07MirahezeSSLBot 03a302da4 - Bot: Update SSL cert for monarchists.wiki [12:37:56] PROBLEM - nonciclopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nonciclopedia.org' expires in 15 day(s) (Wed 29 Jan 2020 12:34:21 PM GMT +0000). [12:38:09] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmn [12:38:10] [02miraheze/ssl] 07MirahezeSSLBot 03d590c12 - Bot: Update SSL cert for nonciclopedia.org [12:38:44] PROBLEM - stablestate.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'stablestate.org' expires in 15 day(s) (Wed 29 Jan 2020 12:36:24 PM GMT +0000). [12:38:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmW [12:38:59] [02miraheze/ssl] 07MirahezeSSLBot 03819bd42 - Bot: Update SSL cert for stablestate.org [12:39:21] PROBLEM - nonsensopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nonsensopedia.org' expires in 15 day(s) (Wed 29 Jan 2020 12:36:55 PM GMT +0000). [12:39:34] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJml [12:39:35] [02miraheze/ssl] 07MirahezeSSLBot 037209a00 - Bot: Update SSL cert for nonsensopedia.org [12:40:34] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.joust.ro' expires in 15 day(s) (Wed 29 Jan 2020 12:37:49 PM GMT +0000). [12:40:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJm4 [12:40:49] [02miraheze/ssl] 07MirahezeSSLBot 03eb87b96 - Bot: Update SSL cert for wiki.joust.ro [12:41:56] RECOVERY - nonciclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nonciclopedia.org' will expire on Sun 12 Apr 2020 11:38:02 AM GMT +0000. [12:42:43] RECOVERY - stablestate.org - LetsEncrypt on sslhost is OK: OK - Certificate 'stablestate.org' will expire on Sun 12 Apr 2020 11:38:51 AM GMT +0000. [12:43:07] RECOVERY - drag.lgbt - LetsEncrypt on sslhost is OK: OK - Certificate 'drag.lgbt' will expire on Sun 12 Apr 2020 11:35:14 AM GMT +0000. [12:43:16] PROBLEM - guiasdobrasil.com.br - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'guiasdobrasil.com.br' expires in 15 day(s) (Wed 29 Jan 2020 12:40:18 PM GMT +0000). [12:43:30] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmu [12:43:31] RECOVERY - monarchists.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'monarchists.wiki' will expire on Sun 12 Apr 2020 11:35:42 AM GMT +0000. [12:43:31] [02miraheze/ssl] 07MirahezeSSLBot 0304f2f80 - Bot: Update SSL cert for guiasdobrasil.com.br [12:48:07] PROBLEM - runzeppelin.ru - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'runzeppelin.ru' expires in 15 day(s) (Wed 29 Jan 2020 12:44:50 PM GMT +0000). [12:48:21] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJm6 [12:48:22] [02miraheze/ssl] 07MirahezeSSLBot 03edd7f1d - Bot: Update SSL cert for runzeppelin.ru [12:48:49] PROBLEM - wiki.casual4casuals.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.casual4casuals.com' expires in 15 day(s) (Wed 29 Jan 2020 12:46:34 PM GMT +0000). [12:49:02] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmX [12:49:03] [02miraheze/ssl] 07MirahezeSSLBot 03663ddce - Bot: Update SSL cert for wiki.casual4casuals.com [12:50:55] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:51:45] PROBLEM - wiki.coderdojosaintpaul.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.coderdojosaintpaul.org' expires in 15 day(s) (Wed 29 Jan 2020 12:49:44 PM GMT +0000). [12:51:49] PROBLEM - crimesciencewiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'crimesciencewiki.org' expires in 15 day(s) (Wed 29 Jan 2020 12:48:31 PM GMT +0000). [12:51:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmQ [12:52:00] [02miraheze/ssl] 07MirahezeSSLBot 036569fdf - Bot: Update SSL cert for wiki.coderdojosaintpaul.org [12:52:04] RECOVERY - runzeppelin.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'runzeppelin.ru' will expire on Sun 12 Apr 2020 11:48:14 AM GMT +0000. [12:52:11] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJm7 [12:52:12] [02miraheze/ssl] 07MirahezeSSLBot 036153c61 - Bot: Update SSL cert for crimesciencewiki.org [12:52:33] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Sun 12 Apr 2020 11:40:41 AM GMT +0000. [12:52:43] PROBLEM - wiki.casadocarvalho.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.casadocarvalho.net' expires in 15 day(s) (Wed 29 Jan 2020 12:49:09 PM GMT +0000). [12:52:49] RECOVERY - wiki.casual4casuals.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.casual4casuals.com' will expire on Sun 12 Apr 2020 11:48:56 AM GMT +0000. [12:52:56] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJm5 [12:52:58] [02miraheze/ssl] 07MirahezeSSLBot 0311246ef - Bot: Update SSL cert for wiki.casadocarvalho.net [12:53:15] RECOVERY - guiasdobrasil.com.br - LetsEncrypt on sslhost is OK: OK - Certificate 'guiasdobrasil.com.br' will expire on Sun 12 Apr 2020 11:43:23 AM GMT +0000. [12:53:22] RECOVERY - nonsensopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nonsensopedia.org' will expire on Sun 12 Apr 2020 11:39:28 AM GMT +0000. [12:54:30] PROBLEM - wiki.landan.ca - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.landan.ca' expires in 15 day(s) (Wed 29 Jan 2020 12:51:54 PM GMT +0000). [12:54:42] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmA [12:54:44] [02miraheze/ssl] 07MirahezeSSLBot 03cf97be9 - Bot: Update SSL cert for wiki.landan.ca [12:55:02] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [12:56:20] PROBLEM - bebaskanpengetahuan.id - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'bebaskanpengetahuan.id' expires in 15 day(s) (Wed 29 Jan 2020 12:52:53 PM GMT +0000). [12:56:33] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmp [12:56:35] [02miraheze/ssl] 07MirahezeSSLBot 03e56c601 - Bot: Update SSL cert for bebaskanpengetahuan.id [12:57:34] PROBLEM - wiki.ripto.gq - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ripto.gq' expires in 15 day(s) (Wed 29 Jan 2020 12:54:39 PM GMT +0000). [12:57:47] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJmj [12:57:48] [02miraheze/ssl] 07MirahezeSSLBot 03d884123 - Bot: Update SSL cert for wiki.ripto.gq [12:58:14] PROBLEM - documentation.aqfer.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'documentation.aqfer.com' expires in 15 day(s) (Wed 29 Jan 2020 12:54:26 PM GMT +0000). [12:58:28] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYv [12:58:29] [02miraheze/ssl] 07MirahezeSSLBot 03539e2d4 - Bot: Update SSL cert for documentation.aqfer.com [12:59:08] PROBLEM - theatlas.pw - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'theatlas.pw' expires in 15 day(s) (Wed 29 Jan 2020 12:56:59 PM GMT +0000). [12:59:21] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYJ [12:59:22] [02miraheze/ssl] 07MirahezeSSLBot 03584d8bd - Bot: Update SSL cert for theatlas.pw [13:01:28] PROBLEM - www.wikimicrofinanza.it - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.wikimicrofinanza.it' expires in 15 day(s) (Wed 29 Jan 2020 12:58:13 PM GMT +0000). [13:01:42] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYk [13:01:44] [02miraheze/ssl] 07MirahezeSSLBot 0377e97c4 - Bot: Update SSL cert for www.wikimicrofinanza.it [13:01:45] RECOVERY - wiki.coderdojosaintpaul.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.coderdojosaintpaul.org' will expire on Sun 12 Apr 2020 11:51:52 AM GMT +0000. [13:01:49] RECOVERY - crimesciencewiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'crimesciencewiki.org' will expire on Sun 12 Apr 2020 11:52:05 AM GMT +0000. [13:02:02] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [13:02:14] RECOVERY - documentation.aqfer.com - LetsEncrypt on sslhost is OK: OK - Certificate 'documentation.aqfer.com' will expire on Sun 12 Apr 2020 11:58:21 AM GMT +0000. [13:02:20] RECOVERY - bebaskanpengetahuan.id - LetsEncrypt on sslhost is OK: OK - Certificate 'bebaskanpengetahuan.id' will expire on Sun 12 Apr 2020 11:56:27 AM GMT +0000. [13:02:25] RECOVERY - wiki.landan.ca - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.landan.ca' will expire on Sun 12 Apr 2020 11:54:36 AM GMT +0000. [13:02:43] RECOVERY - wiki.casadocarvalho.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.casadocarvalho.net' will expire on Sun 12 Apr 2020 11:52:50 AM GMT +0000. [13:03:38] RECOVERY - wiki.ripto.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ripto.gq' will expire on Sun 12 Apr 2020 11:57:41 AM GMT +0000. [13:04:45] PROBLEM - wiki.ombre.io - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ombre.io' expires in 15 day(s) (Wed 29 Jan 2020 01:02:42 PM GMT +0000). [13:05:00] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJY3 [13:05:01] [02miraheze/ssl] 07MirahezeSSLBot 032949554 - Bot: Update SSL cert for wiki.ombre.io [13:05:29] PROBLEM - wiki.openhatch.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.openhatch.org' expires in 15 day(s) (Wed 29 Jan 2020 01:02:55 PM GMT +0000). [13:05:42] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYn [13:05:44] [02miraheze/ssl] 07MirahezeSSLBot 036e790a7 - Bot: Update SSL cert for wiki.openhatch.org [13:06:06] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [13:07:47] PROBLEM - wiki.veloren.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.veloren.net' expires in 15 day(s) (Wed 29 Jan 2020 01:04:48 PM GMT +0000). [13:07:47] PROBLEM - wiki.doverdistrictscouts.co.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.doverdistrictscouts.co.uk' expires in 15 day(s) (Wed 29 Jan 2020 01:03:45 PM GMT +0000). [13:07:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYc [13:08:01] [02miraheze/ssl] 07MirahezeSSLBot 039f1f8a2 - Bot: Update SSL cert for wiki.veloren.net [13:08:12] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYC [13:08:14] [02miraheze/ssl] 07MirahezeSSLBot 032a63fc9 - Bot: Update SSL cert for wiki.doverdistrictscouts.co.uk [13:08:33] PROBLEM - wiki.warfra.ml - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.warfra.ml' expires in 15 day(s) (Wed 29 Jan 2020 01:05:28 PM GMT +0000). [13:08:46] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYW [13:08:48] [02miraheze/ssl] 07MirahezeSSLBot 03767b2f1 - Bot: Update SSL cert for wiki.warfra.ml [13:11:44] RECOVERY - www.wikimicrofinanza.it - LetsEncrypt on sslhost is OK: OK - Certificate 'www.wikimicrofinanza.it' will expire on Sun 12 Apr 2020 12:01:36 PM GMT +0000. [13:11:46] PROBLEM - encyclopediaofastrobiology.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'encyclopediaofastrobiology.org' expires in 15 day(s) (Wed 29 Jan 2020 01:08:23 PM GMT +0000). [13:11:53] RECOVERY - wiki.veloren.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.veloren.net' will expire on Sun 12 Apr 2020 12:07:53 PM GMT +0000. [13:11:54] RECOVERY - wiki.doverdistrictscouts.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.doverdistrictscouts.co.uk' will expire on Sun 12 Apr 2020 12:08:05 PM GMT +0000. [13:12:00] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYr [13:12:01] [02miraheze/ssl] 07MirahezeSSLBot 030b186f8 - Bot: Update SSL cert for encyclopediaofastrobiology.org [13:12:29] RECOVERY - wiki.warfra.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.warfra.ml' will expire on Sun 12 Apr 2020 12:08:40 PM GMT +0000. [13:12:45] RECOVERY - wiki.ombre.io - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ombre.io' will expire on Sun 12 Apr 2020 12:04:52 PM GMT +0000. [13:13:28] PROBLEM - electowiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'electowiki.org' expires in 15 day(s) (Wed 29 Jan 2020 01:10:15 PM GMT +0000). [13:13:28] RECOVERY - wiki.openhatch.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.openhatch.org' will expire on Sun 12 Apr 2020 12:05:36 PM GMT +0000. [13:13:35] RECOVERY - theatlas.pw - LetsEncrypt on sslhost is OK: OK - Certificate 'theatlas.pw' will expire on Sun 12 Apr 2020 11:59:14 AM GMT +0000. [13:13:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYK [13:13:44] [02miraheze/ssl] 07MirahezeSSLBot 03767c7ab - Bot: Update SSL cert for electowiki.org [13:14:07] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [13:18:12] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [13:22:07] RECOVERY - encyclopediaofastrobiology.org - LetsEncrypt on sslhost is OK: OK - Certificate 'encyclopediaofastrobiology.org' will expire on Sun 12 Apr 2020 12:11:53 PM GMT +0000. [13:23:24] RECOVERY - electowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electowiki.org' will expire on Sun 12 Apr 2020 12:13:35 PM GMT +0000. [13:24:22] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [13:25:07] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJYQ [13:25:09] [02miraheze/services] 07MirahezeSSLBot 03cf2f76a - BOT: Updating services config for wikis [13:26:27] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [13:34:30] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [13:36:28] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [13:42:31] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [13:44:29] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [13:48:32] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [13:54:37] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [14:11:30] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [14:15:28] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [14:44:52] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [14:46:52] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [15:00:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJsW [15:00:10] [02miraheze/services] 07MirahezeSSLBot 03012a33b - BOT: Updating services config for wikis [15:09:05] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2646 MB (10% inode=94%); [15:11:05] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2675 MB (11% inode=94%); [15:23:46] PROBLEM - wintermoor.net - LetsEncrypt on sslhost is CRITICAL: connect to address wintermoor.net and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [15:25:46] RECOVERY - wintermoor.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wintermoor.net' will expire on Sat 28 Mar 2020 06:05:27 PM GMT +0000. [15:27:06] Zppix, paladox: that needs dropping. It's not mediawiki being served there. looks like a new registration [15:28:55] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJGu [15:28:56] [02miraheze/CreateWiki] 07translatewiki 039575901 - Localisation updates from https://translatewiki.net. [15:28:57] [ Main page - translatewiki.net ] - translatewiki.net. [15:29:00] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+1/-0/±5] 13https://git.io/JvJGz [15:29:01] [02miraheze/MirahezeMagic] 07translatewiki 03aeb48df - Localisation updates from https://translatewiki.net. [15:29:02] [ Main page - translatewiki.net ] - translatewiki.net. [15:29:07] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2622 MB (10% inode=94%); [15:29:09] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JvJG2 [15:29:11] [02miraheze/ssl] 07paladox 034fba2c8 - Remove wintermoor.net Domain either not pointing at us, or has expired. [15:29:12] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [15:29:14] [02ssl] 07paladox opened pull request 03#254: Remove wintermoor.net - 13https://git.io/JvJGa [15:29:27] thanks paladox [15:29:32] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/JvJGw [15:29:34] [02miraheze/ssl] 07paladox 038d509a7 - Delete wintermoor.net.crt [15:29:35] [02ssl] 07paladox synchronize pull request 03#254: Remove wintermoor.net - 13https://git.io/JvJGa [15:31:07] miraheze/CreateWiki/master/9575901 - translatewiki.net The build is still failing. https://travis-ci.com/miraheze/CreateWiki/builds/144173180 [15:31:11] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2652 MB (11% inode=94%); [15:31:58] !log MariaDB [mhglobal]> UPDATE cw_wikis SET wiki_settings = REPLACE(wiki_settings, '"wgServer":"https:\/\/wintermoor.net "', null ) WHERE wiki_dbname = 'wintermoorwiki'; [15:32:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:32:23] [02ssl] 07paladox closed pull request 03#254: Remove wintermoor.net - 13https://git.io/JvJGa [15:32:24] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JvJGP [15:32:26] [02miraheze/ssl] 07paladox 0392dbb8f - Remove wintermoor.net (#254) * Remove wintermoor.net Domain either not pointing at us, or has expired. * Delete wintermoor.net.crt [15:32:27] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [15:32:29] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [15:35:07] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJG9 [15:35:09] [02miraheze/services] 07MirahezeSSLBot 03d708f5a - BOT: Updating services config for wikis [15:35:16] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2646 MB (10% inode=94%); [16:00:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJZa [16:00:10] [02miraheze/services] 07MirahezeSSLBot 034c2a91c - BOT: Updating services config for wikis [18:34:12] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 43% [18:42:33] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 38% [19:13:26] PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.60, 1.84, 1.31 [19:14:38] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 40% [19:15:26] RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.47, 1.26, 1.21 [19:16:43] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 27% [19:34:52] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 44% [19:40:50] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 39% [19:59:47] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 48% [20:03:46] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 36% [20:04:13] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±2] 13https://git.io/JvJ41 [20:04:14] [02miraheze/mediawiki] 07paladox 03fac90bb - Update MsCatSelect [20:10:49] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 42% [20:14:50] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 39% [20:24:54] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 41% [20:26:58] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 34% [20:40:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJBN [20:40:11] [02miraheze/services] 07MirahezeSSLBot 03f24637c - BOT: Updating services config for wikis [20:59:54] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw2 [20:59:55] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 3 datacenters are down: 107.191.126.23/cpweb, 2400:6180:0:d0::403:f001/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [21:00:05] PROBLEM - cp2 Stunnel Http for mw2 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [21:00:09] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw2 [21:00:34] PROBLEM - cp3 Stunnel Http for mw2 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [21:00:46] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw2 [21:00:53] PROBLEM - cp4 Stunnel Http for mw2 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [21:01:55] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [21:02:31] RECOVERY - cp3 Stunnel Http for mw2 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15190 bytes in 0.494 second response time [21:02:52] RECOVERY - cp4 Stunnel Http for mw2 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 15190 bytes in 0.004 second response time [21:03:52] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 7 backends are healthy [21:03:57] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 6 backends are healthy [21:04:11] RECOVERY - cp2 Stunnel Http for mw2 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 15182 bytes in 0.294 second response time [21:04:37] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 6 backends are healthy [21:09:18] paladox: [21:09:47] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 49% [21:17:43] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 39% [21:18:32] RhinosF1 ? [21:20:51] paladox: icinga’s being moody [21:20:55] Why? [21:21:16] oh [21:21:25] * paladox dosen't know why [21:21:48] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 45% [21:24:06] paladox: i pinged you to find out [21:24:40] well that check could be inaccurate [21:25:35] Then it’s spam [21:25:41] And not very useful [21:25:51] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 33% [21:30:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JvJ03 [21:30:11] [02miraheze/services] 07MirahezeSSLBot 0367c0500 - BOT: Updating services config for wikis [22:17:24] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 42% [22:21:28] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 20% [22:22:25] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.36, 7.02, 6.00 [22:24:28] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.43, 5.80, 5.70 [22:25:09] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [22:31:42] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 41% [22:33:52] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:33:55] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 26% [22:34:11] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 2604:180:0:33b::2/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [22:36:07] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [22:59:35] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JvJuQ [22:59:36] [02miraheze/mw-config] 07paladox 0301f5825 - Globally install SpamBlacklist [22:59:38] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3 [22:59:39] [02mw-config] 07paladox opened pull request 03#2856: Globally install SpamBlacklist - 13https://git.io/JvJu7 [23:01:01] miraheze/mw-config/paladox-patch-1/01f5825 - paladox The build passed. https://travis-ci.org/miraheze/mw-config/builds/636615196 [23:01:26] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JvJuF [23:01:27] [02miraheze/mw-config] 07paladox 032997657 - Update LocalSettings.php [23:01:29] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3 [23:01:44] [02mw-config] 07paladox opened pull request 03#2857: Update LocalSettings.php - 13https://git.io/JvJub [23:02:07] [02mw-config] 07paladox closed pull request 03#2857: Update LocalSettings.php - 13https://git.io/JvJub [23:02:08] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JvJux [23:02:09] [02miraheze/mw-config] 07paladox 034152ac8 - Update LocalSettings.php (#2857) [23:02:11] [02mw-config] 07paladox synchronize pull request 03#2856: Globally install SpamBlacklist - 13https://git.io/JvJu7 [23:02:12] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [23:02:14] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3 [23:02:48] miraheze/mw-config/paladox-patch-2/2997657 - paladox The build has errored. https://travis-ci.org/miraheze/mw-config/builds/636616234 [23:04:20] PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 0.94, 2.55, 1.65 [23:04:47] [02mw-config] 07paladox synchronize pull request 03#2856: Globally install SpamBlacklist - 13https://git.io/JvJu7 [23:04:48] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JvJzU [23:04:50] [02miraheze/mw-config] 07paladox 03481ea38 - Update LocalSettings.php [23:06:11] [02mw-config] 07paladox edited pull request 03#2856: Globally install SpamBlacklist - 13https://git.io/JvJu7 [23:06:17] RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.18, 1.25, 1.32 [23:06:26] [02mw-config] 07paladox closed pull request 03#2856: Globally install SpamBlacklist - 13https://git.io/JvJu7 [23:06:27] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JvJzk [23:06:29] [02miraheze/mw-config] 07paladox 036ec3513 - Globally install SpamBlacklist (#2856) * Globally install SpamBlacklist * Update LocalSettings.php (#2857) * Update LocalSettings.php [23:06:48] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3 [23:06:50] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [23:30:10] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 49% [23:34:18] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 35% [23:46:22] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 43% [23:52:22] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 32%