[00:42:26] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+1/-0/±2] 13https://git.io/fhdXa [00:42:27] [02miraheze/ManageWiki] 07JohnFLewis 03c836e6d - add ManageWikiRequirements, deprecates restricted => from extensions [01:13:55] PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is WARNING: WARNING - NGINX Error Rate is 40% [01:21:55] RECOVERY - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 30% [01:29:10] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_32 [+0/-1/±1] 13https://git.io/fhd1f [01:29:12] [02miraheze/mediawiki] 07JohnFLewis 03caf6b63 - remove PdfBook [01:29:19] [02miraheze/mw-config] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fhd1U [01:29:21] [02miraheze/mw-config] 07JohnFLewis 03654fc9c - remove pdfbook [01:33:39] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhd1O [01:33:40] [02miraheze/mw-config] 07paladox 031db7ae5 - Enable webp on histo28wiki per T4067 [03:53:47] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_clone_phabricator-extensions] [03:54:15] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_puppet],Exec[git_pull_services],Exec[git_pull_ssl] [03:54:19] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config],Exec[git_pull_MediaWiki core],Exec[git_pull_landing] [03:54:20] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config],Exec[git_pull_MediaWiki core],Exec[git_pull_landing] [03:54:43] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_dns] [03:55:37] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown) [03:57:23] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 172 failures. Last run 3 minutes ago with 172 failures. Failed resources (up to 3 shown) [03:57:53] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 4 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core],File[/etc/logrotate.d/nginx],File[/home/johnflewis],File[/home/ndkilla] [03:58:29] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 94 failures. Last run 3 minutes ago with 94 failures. Failed resources (up to 3 shown): File[adadevelopersacademy.wiki_private],File[wiki.macc.nyc],File[wiki.macc.nyc_private],File[sdiy.info] [04:03:34] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures [04:03:47] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:04:06] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [04:04:15] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:04:20] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:04:30] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:04:42] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:05:23] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:06:28] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:17:15] PROBLEM - bacula1 Bacula Static on bacula1 is CRITICAL: CRITICAL: Diff, 409214 files, 30.47GB, 2019-01-20 05:17:00 (4.4 weeks ago) [06:54:27] !log reception@mw1:/srv/mediawiki/w/maintenance$ sudo -u www-data php importDump.php --wiki pathofexilewiki /home/paladox/Path+of+Exile+Wiki-20190211171816.xml [06:54:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [07:48:00] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_32 [+1/-0/±1] 13https://git.io/fhdSK [07:48:02] [02miraheze/mediawiki] 07Reception123 03399d0e4 - Install NumberedHeadings per T4107 [08:01:12] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fhdSS [08:01:13] [02miraheze/mw-config] 07Reception123 036746a54 - add NumberedHeadings extension [08:02:08] !log rebuild LC on all wikis [08:02:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [08:18:43] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhd9Z [08:18:45] [02miraheze/mw-config] 07Reception123 03cce42de - also add numberedheadings to ext-list [08:32:56] ^ paladox had to revert as there was an internal error when I tested it on test1. Not sure why [08:33:15] *have [08:33:23] or I'll just make it restricted so no one tries to enable [08:34:03] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhd98 [08:34:05] [02miraheze/mw-config] 07Reception123 03eed9fec - restrict numberedheadings (causing errors) [11:08:05] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:10:02] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 07 May 2019 10:15:37 PM GMT +0000. [11:24:59] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:27:00] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Wed 15 May 2019 09:02:45 PM GMT +0000. [13:30:25] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:32:21] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Wed 15 May 2019 09:02:45 PM GMT +0000. [13:32:23] [02miraheze/MirahezeMagic] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhddp [13:32:25] [02miraheze/MirahezeMagic] 07Southparkfan 03c5726bf - Use protect-level message for userright [13:36:46] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:40:49] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Wed 15 May 2019 09:02:45 PM GMT +0000. [13:42:25] [02miraheze/MirahezeMagic] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdFO [13:42:26] [02miraheze/MirahezeMagic] 07Southparkfan 03e6eaacc - fix small spelling error [13:58:32] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdFQ [13:58:33] [02miraheze/mw-config] 07paladox 036ba49a7 - Revert "restrict numberedheadings (causing errors)" This reverts commit eed9fec3483a662fb7336c33989e46c8a6112081. [14:10:04] [02miraheze/mediawiki] 07paladox pushed 0310 commits to 03REL1_32 [+0/-0/±39] 13https://git.io/fhdbW [14:10:05] [02miraheze/mediawiki] 07jdforrester 03af43f88 - RELEASE-NOTES-1.32: Add entries for 657306964d and de983a00 This means every patch on top of the 1.32.0 tag is now represented in the release notes. Change-Id: I4e86e295c973cb66f5c6c5c4f81efd62d1b7d115 [14:10:07] [02miraheze/mediawiki] 07AaronSchulz 031d7b6f9 - rdbms: add ILBFactory::redefineLocalDomain method This is intended for use with scripts like addWiki.php to avoid mismatched domain errors. Bug: T209483 Change-Id: Ie24f83f4e0fad7b01690d2055e1529a4cb0275b5 (cherry picked from commit 1c205f1822b6214ac9c17a2e2affddafeecbac1b) [14:10:08] [02miraheze/mediawiki] 07jcoc611-microsoft 03a1386a6 - Removes Google web search from exception page When a wiki is down, it is not necessarily useful to be able to search the web. Additionally, there is general consensus that the hard-coded Google search form should be removed. Bug: T208871 Change-Id: I5bcae848de1144d4fc1116c475b2e2ab1ccc3f7d (cherry picked from commit [14:10:08] 1d930860cc19513c1d6b3d4b325f77ab939c2973) [14:10:10] [02miraheze/mediawiki] ... and 7 more commits. [14:10:38] paladox: calm down jesus [14:10:46] heh [14:14:06] PROBLEM - misc3 Puppet on misc3 is WARNING: WARNING: Puppet last ran 1 hour ago [14:14:37] paladox: did you cut the puppet strings again ^ [14:14:49] no, but i think i know what it is [14:15:07] !log rebuild LC on mw* [14:15:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [14:16:06] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [14:25:40] !log shutting down salt on misc4 (and removing) [14:25:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [14:26:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdNI [14:26:22] [02miraheze/puppet] 07paladox 0360a4026 - Disable the salt master on misc4 [14:38:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdNw [14:38:12] [02miraheze/puppet] 07paladox 0338c22dc - Update config.yaml.erb [14:38:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdNr [14:38:23] [02miraheze/puppet] 07paladox 03719d3a3 - Update config.yaml.erb [15:04:31] !log shut down prometheus master on misc4 [15:04:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:06:52] PROBLEM - misc4 Prometheus on misc4 is CRITICAL: connect to address 185.52.3.121 and port 9090: Connection refused [15:07:47] PROBLEM - misc4 Puppet on misc4 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 6 minutes ago with 0 failures [15:09:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdA1 [15:09:53] [02miraheze/puppet] 07paladox 038a22e08 - Phabricator: Set fpm_max_child to 4 [15:12:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdAQ [15:12:21] [02miraheze/puppet] 07paladox 03d18b39f - Phabricator: Set post_max_size and upload_max_filesize to 10M [15:12:37] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdA5 [15:12:38] [02miraheze/puppet] 07paladox 033e5860d - phabricator: Upgrade to php 7.3 [15:13:47] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [15:14:52] RECOVERY - misc4 Prometheus on misc4 is OK: TCP OK - 0.001 second response time on 185.52.3.121 port 9090 [15:18:32] !log disabling puppet on lizardfs* [15:18:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:19:47] PROBLEM - misc4 Puppet on misc4 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 4 minutes ago with 0 failures [15:20:52] PROBLEM - misc4 Prometheus on misc4 is CRITICAL: connect to address 185.52.3.121 and port 9090: Connection refused [15:21:22] !log upgrade misc4 to debian 9.8 [15:21:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:21:36] Im going to do that now before migrating the lizardfs master to it [15:21:57] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [15:22:25] PROBLEM - lizardfs1 Puppet on lizardfs1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 11 minutes ago with 0 failures [15:22:40] PROBLEM - lizardfs2 Puppet on lizardfs2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 11 minutes ago with 0 failures [15:22:52] RECOVERY - misc4 Prometheus on misc4 is OK: TCP OK - 0.000 second response time on 185.52.3.121 port 9090 [15:23:55] PROBLEM - misc4 Puppet on misc4 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 23 seconds ago with 0 failures [15:26:52] PROBLEM - misc4 Prometheus on misc4 is CRITICAL: connect to address 185.52.3.121 and port 9090: Connection refused [15:28:06] PROBLEM - misc3 Puppet on misc3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 6 minutes ago with 0 failures [15:29:18] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [15:29:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhdx8 [15:29:21] [02miraheze/puppet] 07paladox 0300ed080 - Install lizardfs master on misc4 [15:29:23] [02puppet] 07paladox opened pull request 03#984: Install lizardfs master on misc4 - 13https://git.io/fhdx4 [15:29:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhdxB [15:29:59] [02miraheze/puppet] 07paladox 03eb99f05 - Update site.pp [15:30:00] [02puppet] 07paladox synchronize pull request 03#984: Install lizardfs master on misc4 - 13https://git.io/fhdx4 [15:32:00] what is going on with ZppixBot ... [15:33:18] [02puppet] 07paladox closed pull request 03#984: Install lizardfs master on misc4 - 13https://git.io/fhdx4 [15:33:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fhdxz [15:33:21] [02miraheze/puppet] 07paladox 033fc642f - Install lizardfs master on misc4 (#984) * Install lizardfs master on misc4 * Update site.pp [15:33:23] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [15:33:24] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [15:33:49] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:34:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdxa [15:34:09] [02miraheze/puppet] 07paladox 03425e346 - Disable prometheus master on misc4 [15:34:20] paladox: stop breaking ZppixBot damnit :P [15:34:24] heh [15:41:41] PROBLEM - misc4 Puppet on misc4 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 3 minutes ago with 0 failures [15:47:38] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [15:56:20] PROBLEM - misc4 Lizardfs Master Port 1 on misc4 is CRITICAL: connect to address 185.52.3.121 and port 9419: Connection refused [15:56:55] PROBLEM - misc4 Lizardfs Master Port 2 on misc4 is CRITICAL: connect to address 185.52.3.121 and port 9420: Connection refused [15:56:58] PROBLEM - misc4 Lizardfs Master Port 3 on misc4 is CRITICAL: connect to address 185.52.3.121 and port 9421: Connection refused [15:58:19] RECOVERY - misc4 Lizardfs Master Port 1 on misc4 is OK: TCP OK - 0.001 second response time on 185.52.3.121 port 9419 [15:58:53] RECOVERY - misc4 Lizardfs Master Port 2 on misc4 is OK: TCP OK - 0.001 second response time on 185.52.3.121 port 9420 [15:58:58] RECOVERY - misc4 Lizardfs Master Port 3 on misc4 is OK: TCP OK - 0.001 second response time on 185.52.3.121 port 9421 [16:01:30] PROBLEM - misc4 Puppet on misc4 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 3 minutes ago with 0 failures [16:10:15] PROBLEM - misc4 Lizardfs Master Port 1 on misc4 is CRITICAL: connect to address 185.52.3.121 and port 9419: Connection refused [16:10:37] PROBLEM - misc4 Lizardfs Master Port 2 on misc4 is CRITICAL: connect to address 185.52.3.121 and port 9420: Connection refused [16:11:28] I didnt do this time i swear paladox [16:11:38] heh, that's me [16:11:50] damnit i was hoping it was me [16:12:14] RECOVERY - misc4 Lizardfs Master Port 1 on misc4 is OK: TCP OK - 0.001 second response time on 185.52.3.121 port 9419 [16:12:35] RECOVERY - misc4 Lizardfs Master Port 2 on misc4 is OK: TCP OK - 0.000 second response time on 185.52.3.121 port 9420 [16:18:33] paladox: do you have SSH to ZppixBot? [16:18:45] Reception123 nope [16:18:52] ok, thought you did [16:34:05] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [16:36:45] [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+0/-0/±3] 13https://git.io/fhdhk [16:36:47] [02miraheze/puppet] 07paladox 0350502a0 - Revert "Disable prometheus master on misc4" This reverts commit 425e3460b10684945e6e5f9197d6414df432d320. [16:36:48] [02miraheze/puppet] 07paladox 034df170b - Revert "Install lizardfs master on misc4 (#984)" This reverts commit 3fc642fc7efc525b02b95c3b3ae8c1832093b1aa. [16:39:30] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [16:39:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhdht [16:39:33] [02miraheze/puppet] 07paladox 033500f52 - Install services (only parsoid for now) and salt-master on misc4 [16:39:34] [02puppet] 07paladox opened pull request 03#985: Install services (only parsoid for now) and salt-master on misc4 - 13https://git.io/fhdhq [16:41:46] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [16:42:48] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhdhs [16:42:50] [02miraheze/puppet] 07paladox 033e5a8cd - Update services.pp [16:42:51] [02puppet] 07paladox synchronize pull request 03#985: Install services (only parsoid for now) and salt-master on misc4 - 13https://git.io/fhdhq [16:43:28] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhdhG [16:43:30] [02miraheze/puppet] 07paladox 03e2698f7 - Update misc4.yaml [16:43:32] [02puppet] 07paladox synchronize pull request 03#985: Install services (only parsoid for now) and salt-master on misc4 - 13https://git.io/fhdhq [16:43:41] [02puppet] 07paladox closed pull request 03#985: Install services (only parsoid for now) and salt-master on misc4 - 13https://git.io/fhdhq [16:43:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fhdhZ [16:43:44] [02miraheze/puppet] 07paladox 0393dc6a4 - Install services (only parsoid for now) and salt-master on misc4 (#985) * Install services (only parsoid for now) and salt-master on misc4 * Update services.pp * Update misc4.yaml [16:45:08] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [16:47:06] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [16:47:08] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [16:48:28] PROBLEM - fikcyjnatv.pl - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [16:50:52] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [16:51:22] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdh2 [16:51:23] [02miraheze/dns] 07paladox 03e846c9a - Move parsoid to misc4 [16:51:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdha [16:51:58] [02miraheze/puppet] 07paladox 039004ecb - misc3: disable parsoid [16:52:47] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [16:55:30] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [16:55:42] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:55:59] PROBLEM - misc3 parsoid on misc3 is CRITICAL: connect to address 185.52.1.144 and port 8142: Connection refused [17:00:36] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [17:03:12] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [17:04:09] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [17:05:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdhx [17:05:12] [02miraheze/services] 07MirahezeSSLBot 03384f86a - BOT: Updating services config for wikis [17:07:56] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [17:09:49] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [17:10:15] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdjU [17:10:17] [02miraheze/services] 07MirahezeSSLBot 03940b4a5 - BOT: Updating services config for wikis [17:14:16] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdjt [17:14:18] [02miraheze/dns] 07paladox 03aca1ac6 - Update config [17:20:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdjn [17:20:16] [02miraheze/services] 07MirahezeSSLBot 036db630b - BOT: Updating services config for wikis [17:21:23] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [17:23:17] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [17:25:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdjB [17:25:12] [02miraheze/services] 07MirahezeSSLBot 03e73f696 - BOT: Updating services config for wikis [17:26:44] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [17:27:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdju [17:27:56] [02miraheze/puppet] 07paladox 033962b94 - Update parsoid [17:31:48] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [17:34:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdjy [17:34:21] [02miraheze/puppet] 07paladox 03e4eddf3 - fix parsoid nginx config [17:34:37] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [17:35:48] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhdj9 [17:35:49] [02miraheze/puppet] 07paladox 037611f12 - Update restbase [17:41:16] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [17:45:23] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [17:48:50] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [17:49:37] I think I'll be removing that [17:50:44] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [17:54:36] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [17:56:36] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [17:57:11] Reception123 mind removing ^^?? [17:57:14] *? [17:57:24] please [17:58:03] yeah [17:59:04] paladox: hmm is it normal that when you search a non-existing wiki https://meta.miraheze.org/wiki/Special:ManageWikiSettings/nonexistentwiki [17:59:05] Title: [ Internal error - Miraheze Meta ] - meta.miraheze.org [17:59:07] you get an error/exception [17:59:20] i've already reported that to john :) [17:59:27] so i guess that needs to report a better error [17:59:39] ok [18:00:07] yeah, though it's not a big deal since it's obvious that when that happens it means there's no wiki [18:00:36] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [18:02:36] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [18:03:22] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [18:05:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhFe8 [18:05:12] [02miraheze/services] 07MirahezeSSLBot 03945b3cb - BOT: Updating services config for wikis [18:11:23] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [18:12:36] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [18:15:22] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [18:22:36] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2019 09:44:44 PM GMT +0000. [18:31:23] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [18:33:22] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [18:36:00] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [18:42:15] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [18:54:04] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [19:11:41] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [19:15:37] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [19:32:17] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [19:43:58] someone want to look into that ^ [19:46:22] those domains need removing i think [19:49:08] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [19:49:09] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhFfC [19:49:11] [02miraheze/ssl] 07paladox 036477138 - Remove www.iceposeidonwiki.com domain as it's expired [19:49:12] [02ssl] 07paladox opened pull request 03#143: Remove www.iceposeidonwiki.com domain as it's expired - 13https://git.io/fhFfW [19:49:18] I removed from ManageWiki but didn't get a chance to remove from SSL [19:49:26] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/fhFfl [19:49:28] [02miraheze/ssl] 07paladox 032e13180 - Delete www.iceposeidonwiki.com.crt [19:49:29] [02ssl] 07paladox synchronize pull request 03#143: Remove www.iceposeidonwiki.com domain as it's expired - 13https://git.io/fhFfW [19:49:36] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/fhFf8 [19:49:38] [02miraheze/ssl] 07paladox 03f84a8d6 - Remove www.iceposeidonwiki.com domain as it's expired (#143) * Remove www.iceposeidonwiki.com domain as it's expired * Delete www.iceposeidonwiki.com.crt [19:49:39] [02ssl] 07paladox closed pull request 03#143: Remove www.iceposeidonwiki.com domain as it's expired - 13https://git.io/fhFfW [19:49:41] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [19:49:42] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [19:49:43] paladox: ^ did you remove that from MW too? [19:49:52] nope not yet [19:50:02] RECOVERY - www.iceposeidonwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceposeidonwiki.com' will expire on Tue 14 May 2019 04:37:20 PM GMT +0000. [19:50:27] paladox: ok. please do :) [19:53:39] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [19:53:41] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhFfu [19:53:42] [02miraheze/ssl] 07paladox 03d837696 - Remove wiki.joust.ro This domain is not pointing at us anymore. [19:53:44] [02ssl] 07paladox opened pull request 03#144: Remove wiki.joust.ro - 13https://git.io/fhFfz [19:53:57] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/fhFfg [19:53:58] [02miraheze/ssl] 07paladox 03311d42f - Delete wiki.joust.ro.crt [19:54:00] [02ssl] 07paladox synchronize pull request 03#144: Remove wiki.joust.ro - 13https://git.io/fhFfz [19:54:22] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.iceposeidonwiki.com] [19:54:30] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.iceposeidonwiki.com] [19:54:31] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.iceposeidonwiki.com] [19:54:39] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.iceposeidonwiki.com] [19:55:41] [02ssl] 07paladox closed pull request 03#144: Remove wiki.joust.ro - 13https://git.io/fhFfz [19:55:43] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/fhFfa [19:55:44] [02miraheze/ssl] 07paladox 033f2f750 - Remove wiki.joust.ro (#144) * Remove wiki.joust.ro This domain is not pointing at us anymore. * Delete wiki.joust.ro.crt [19:55:46] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [19:55:47] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [19:55:56] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[www.iceposeidonwiki.com],File[www.iceposeidonwiki.com_private] [19:55:58] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.iceposeidonwiki.com] [19:56:06] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.iceposeidonwiki.com] [19:57:53] PROBLEM - www.iceposeidonwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.iceposeidonwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [19:58:20] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:02:15] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [20:02:22] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [20:02:42] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [20:02:49] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [20:04:25] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:04:47] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures