[00:00:08] <icinga-miraheze>	 PROBLEM - jawright.cc - LetsEncrypt on sslhost is CRITICAL: connect to address jawright.cc and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket
[00:19:01] <Zppix>	 paladox:  ^
[00:19:19] <paladox>	 jawright.cc can be removed
[00:19:30] <paladox>	 if you want to do the patch Zppix :)
[00:19:38] <Zppix>	 paladox:  no longer pointing?
[00:19:48] <paladox>	 looks like the domain expired
[00:20:07] <Zppix>	 ok
[00:20:14] <paladox>	 http://whois.domaintools.com/jawright.cc
[00:20:15] <ZppixBot>	 [ Whois Lookup Captcha ] - whois.domaintools.com
[00:20:30] <Zppix>	 paladox:  can you handle the onwiki stuff ill do the pr
[00:20:40] <paladox>	 ok
[00:24:01] <paladox>	 looks like the domain is not set Zppix 
[00:26:23] <Not-5a0a>	 [02ssl] 07Pix1234 opened pull request 03#253: Remove jawright.cc from SSL - 13https://git.io/Jej3X
[00:26:30] <Zppix>	 paladox:  ^
[00:27:00] <Not-5a0a>	 [02ssl] 07paladox closed pull request 03#253: Remove jawright.cc from SSL - 13https://git.io/Jej3X
[00:27:01] <Not-5a0a>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/Jej31
[00:27:03] <Not-5a0a>	 [02miraheze/ssl] 07Pix1234 036d715f6 - Remove jawright.cc from SSL (#253) * Delete www.jawright.cc.crt * remove jawright.cc from SSL
[00:34:26] <icinga-miraheze>	 PROBLEM - lizardfs6 Puppet on lizardfs6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.jawright.cc]
[00:34:28] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.jawright.cc]
[00:34:42] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.jawright.cc]
[00:34:50] <icinga-miraheze>	 PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.jawright.cc]
[00:35:11] <icinga-miraheze>	 PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.jawright.cc]
[00:35:22] <icinga-miraheze>	 PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.jawright.cc]
[00:36:49] <icinga-miraheze>	 PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.jawright.cc]
[00:37:09] <icinga-miraheze>	 PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): File[www.jawright.cc]
[00:46:51] <paladox>	 hmm
[00:46:54] <paladox>	 why is it failing?
[00:47:20] <paladox>	 Jan  6 00:41:31 mw1 puppet-agent[8395]: (/Stage[main]/Ssl::Hiera/Ssl::Hiera::Certs[jwwiki]/File[www.jawright.cc]) Could not evaluate: Could not retrieve information from environment production source(s) puppet:///ssl/certificates/www.jawright.cc.crt
[00:48:02] <Not-5a0a>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JejsY
[00:48:04] <Not-5a0a>	 [02miraheze/ssl] 07paladox 03e43599e - Remove www.jawright.cc certificate Same as https://github.com/miraheze/ssl/commit/6d715f600d97a7ed8bf8a21d0d78e3295e78d93f
[00:48:04] <ZppixBot>	 [ Remove jawright.cc from SSL (#253) · miraheze/ssl@6d715f6 · GitHub ] - github.com
[00:52:06] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures
[00:52:25] <icinga-miraheze>	 RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures
[00:52:29] <icinga-miraheze>	 RECOVERY - lizardfs6 Puppet on lizardfs6 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures
[00:52:47] <icinga-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:53:13] <icinga-miraheze>	 RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:53:22] <icinga-miraheze>	 RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures
[00:53:22] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:55:04] <icinga-miraheze>	 RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[04:35:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jejce
[04:35:08] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 03e2df035 - BOT: Updating services config for wikis
[06:27:21] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3245 MB (13% inode=94%);
[11:35:33] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-redis]
[11:43:50] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[14:44:51] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown)
[14:53:12] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[15:34:56] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu]
[15:43:03] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[16:15:01] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown)
[16:15:38] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown)
[16:23:05] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures
[16:29:26] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2649 MB (10% inode=94%);
[16:43:15] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:02:39] <Not-5a0a>	 [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JejVM
[17:02:41] <Not-5a0a>	 [02miraheze/MirahezeMagic] 07translatewiki 0370257cb - Localisation updates from https://translatewiki.net.
[17:02:42] <ZppixBot>	 [ Main page - translatewiki.net ] - translatewiki.net.
[17:02:42] <Not-5a0a>	 [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JejVD
[17:02:44] <Not-5a0a>	 [02miraheze/ManageWiki] 07translatewiki 03a4c43a9 - Localisation updates from https://translatewiki.net.
[17:02:45] <ZppixBot>	 [ Main page - translatewiki.net ] - translatewiki.net.
[17:11:36] <sariomobile>	 Hello Void
[17:11:52] <Voidwalker>	 hi
[17:23:41] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 2604:180:0:33b::2/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[17:25:38] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[18:35:06] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[18:43:32] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[19:05:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JejK6
[19:05:09] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 03528ae95 - BOT: Updating services config for wikis
[19:16:50] <hispano76>	 Is wgExtraInterlanguageLinkPrefixes possible in ManageWiki?
[19:18:23] <RhinosF1>	 hispano76: does it have a docs page on mediawiki.org?
[19:19:34] <hispano76>	 RhinosF1: yes https://www.mediawiki.org/wiki/Manual:$wgExtraInterlanguageLinkPrefixes/es 
[19:19:35] <ZppixBot>	 [ Manual:$wgExtraInterlanguageLinkPrefixes - MediaWiki ] - www.mediawiki.org
[19:20:30] <RhinosF1>	 hispano76: no, i think that would need to go in LS.php
[19:20:38] <hispano76>	 I want to know before I open an request
[19:21:09] <RhinosF1>	 ManageWiki doesn’t do some arrays to well
[19:21:12] <RhinosF1>	 JohnLewis: ^
[19:22:17] <hispano76>	 Good, because I want to add interwikis on the sidebar of my wiki. Then I do it.
[19:25:07] <RhinosF1>	 hispano76: ok
[19:35:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jej6G
[19:35:08] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 0393fee36 - BOT: Updating services config for wikis
[19:49:11] <JohnLewis>	 Yeah ManageWiki doesn't have a lot of support for non-basic configs currently
[20:08:07] <hispano76>	 ok
[20:22:18] <Reception123>	 !log reception@mw2:/srv/mediawiki/w/maintenance$ sudo -u www-data php importDump.php --wiki testwiki /home/reception/Wikipedia-20200106202002.xml
[20:22:35] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[20:28:34] <RhinosF1>	 Reception123: twinkle?
[20:40:48] <Reception123>	 RhinosF1: yup
[20:40:51] <Reception123>	 slowing trying at it again
[20:42:12] <icinga-miraheze>	 PROBLEM - islamkosh.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[20:42:51] <RhinosF1>	 Ok
[20:44:32] <Reception123>	 *slowlyh
[20:44:35] <Reception123>	 *slowly :P
[20:44:46] <Reception123>	 hopefully it'll work one day
[20:46:31] <RhinosF1>	 Reception123: hopefully
[20:47:25] <RhinosF1>	 Reception123: I may be around tonight. Depends when I decide to fall asleep.
[20:49:03] <Reception123>	 Ok, I was just going to go through importing today and see when I can try the rest but feel free to yourself :)
[20:49:13] <Reception123>	 since I'm sure I won't be able to do it all by myself
[20:50:41] <RhinosF1>	 Ok
[21:06:13] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown)
[21:12:32] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures
[22:26:17] <ZppixBot>	 Hello sariomob1! If you have any questions, feel free to ask and someone should answer soon.
[22:46:51] <ZppixBot>	 Hello sariomob2! If you have any questions, feel free to ask and someone should answer soon.
[22:57:03] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/Jejyq
[22:57:04] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox 031b53e32 - Update Comments
[23:02:48] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[23:04:15] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[23:05:13] <icinga-miraheze>	 PROBLEM - cp4 Stunnel Http for mw3 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[23:06:34] <icinga-miraheze>	 PROBLEM - cp2 Stunnel Http for mw3 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[23:08:41] <icinga-miraheze>	 RECOVERY - cp2 Stunnel Http for mw3 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 15263 bytes in 0.310 second response time
[23:09:30] <icinga-miraheze>	 RECOVERY - cp4 Stunnel Http for mw3 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 15263 bytes in 0.326 second response time
[23:10:26] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[23:10:49] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[23:15:20] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[23:19:37] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 128.199.139.216/cpweb
[23:23:33] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[23:23:37] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb
[23:25:37] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[23:27:33] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online