[00:00:05] <icinga-miraheze>	 RECOVERY - interno.guiasdobrasil.com.br - LetsEncrypt on sslhost is OK: OK - Certificate 'sni61771.cloudflaressl.com' will expire on Thu 02 Apr 2020 11:59:59 PM GMT +0000.
[00:00:35] <icinga-miraheze>	 RECOVERY - wiki.valkyrienskies.org - LetsEncrypt on sslhost is OK: OK - Certificate 'sni.cloudflaressl.com' will expire on Sun 30 Aug 2020 12:00:00 PM GMT +0000.
[00:00:38] <icinga-miraheze>	 RECOVERY - nonlinearly.com - CloudFlare on sslhost is OK: OK - Certificate 'sni.cloudflaressl.com' will expire on Tue 14 Apr 2020 12:00:00 PM GMT +0000.
[00:00:49] <icinga-miraheze>	 RECOVERY - www.guiasdobrasil.com.br - LetsEncrypt on sslhost is OK: OK - Certificate 'sni61771.cloudflaressl.com' will expire on Thu 02 Apr 2020 11:59:59 PM GMT +0000.
[00:01:07] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[00:37:24] <paladox>	 resolved ^
[00:55:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Je5F9
[00:55:09] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 036a0c34e - BOT: Updating services config for wikis
[03:04:22] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is CRITICAL: DISK CRITICAL - free space: / 1426 MB (5% inode=94%);
[03:06:23] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 1454 MB (6% inode=94%);
[03:20:22] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is CRITICAL: DISK CRITICAL - free space: / 1446 MB (5% inode=94%);
[05:20:04] <Not-5a0a>	 [02mw-config] 07The-Voidwalker opened pull request 03#2826: add wgPopupsGateway to ManageWiki; fixes T4855 - 13https://git.io/Je5AY
[06:16:31] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Phabricator Static on bacula1 is CRITICAL: CRITICAL: Full, 80934 files, 2.828GB, 2019-11-20 06:16:00 (4.3 weeks ago)
[06:26:35] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2404 MB (9% inode=94%);
[10:00:35] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[10:01:08] <SantaRhino>	 icinga-miraheze: you've been quiet there
[10:02:37] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2225 MB (9% inode=94%);
[10:09:44] <icinga-miraheze>	 PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): File[wildcard.miraheze.org],File[permanentfuturelab.wiki],File[permanentfuturelab.wiki_private]
[10:13:46] <icinga-miraheze>	 RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures
[10:43:24] <ZppixBot>	 Hello Jebus! If you have any questions, feel free to ask and someone should answer soon.
[10:43:33] <SantaRhino>	 hi Jebus 
[10:43:42] <Jebus>	 Hi :3
[10:43:57] <SantaRhino>	 Jebus: how can we help?
[10:45:43] <Jebus>	 Thanks- but no need for help. I just thought i would check out the irc 
[10:46:11] <SantaRhino>	 cool
[11:11:52] <SantaRhino>	 .github miraheze/mw-config
[11:11:52] <ZppixBot>	 https://github.com/miraheze/mw-config
[13:01:12] <icinga-miraheze>	 PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw2
[13:01:17] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 2604:180:0:33b::2/cpweb, 2400:6180:0:d0::403:f001/cpweb
[13:03:13] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[13:05:02] <icinga-miraheze>	 RECOVERY - cp2 Varnish Backends on cp2 is OK: All 6 backends are healthy
[14:39:14] <BirthsideMiners>	 paladox: seems that Tweeki is already updated on RL1_33
[14:39:25] <BirthsideMiners>	 (SantaRhino told me to tell you)
[14:44:15] <paladox>	 BirthsideMiners: I’m not sure what he wants me to do with that info :)
[14:44:20] <BirthsideMiners>	 same
[14:47:07] <SantaRhino>	 paladox: remember, see discord earlier with the issues that were reported. You suggested a patch months ago (although it was declined).
[15:24:43] <paladox>	 Oh yes
[15:24:44] <paladox>	 But I still doint know what I’m suppose to do with the info :)
[15:25:39] <SantaRhino>	 paladox: maybe file an issue upstream and look at how they solved it using css at some point
[15:25:48] <SantaRhino>	 And see if it can be fixed
[15:25:52] <SantaRhino>	 Hey JohnLewis
[15:26:28] <JohnLewis>	 hey
[15:26:41] <paladox>	 SantaRhino: didn’t you see the task I closed as resolved?
[15:27:27] <SantaRhino>	 paladox: the one that you closed a few days ago before we had this report of an issue
[15:27:30] <SantaRhino>	 ???
[15:27:40] <SantaRhino>	 JohnLewis: how are you today?
[15:28:03] <JohnLewis>	 I'm good, you?
[15:28:28] <SantaRhino>	 JohnLewis: could be better
[15:29:23] <paladox>	 SantaRhino: what issue
[15:29:59] <SantaRhino>	 paladox: the one on discord a few hours back that prompted me to ask if it was updated recently
[16:09:52] * hispano76 grettings
[16:09:58] <hispano76>	 ..
[16:10:10] * hispano76 greetings 
[16:20:14] <Not-5a0a>	 [02puppet] 07joaquinito01 opened pull request 03#1164: Upgrade MediaWiki 1.33 to 1.34 - 13https://git.io/JedOX
[16:21:57] <ZppixBot>	 Hello upgrade! If you have any questions, feel free to ask and someone should answer soon.
[16:23:03] <upgrade>	 paladox Please merge me a push request https://github.com/miraheze/puppet/pull/1164
[16:23:04] <ZppixBot>	 [ Upgrade MediaWiki 1.33 to 1.34 by joaquinito01 · Pull Request #1164 · miraheze/puppet · GitHub ] - github.com
[16:23:26] <PuppyKun>	 upgrade: that's incomplete as-is, i believe
[16:23:44] <upgrade>	 PuppyKun https://github.com/miraheze/puppet/pull/1164 Please merge me a push request.
[16:23:44] <ZppixBot>	 [ Upgrade MediaWiki 1.33 to 1.34 by joaquinito01 · Pull Request #1164 · miraheze/puppet · GitHub ] - github.com
[16:23:55] <PuppyKun>	 Also upgrades are not as simple as just changing that. so, at the moment no.
[16:24:33] <upgrade>	 PuppyKun You have permission to push???
[16:25:10] <PuppyKun>	 I do, I'm going to use my ability to think to not actually push though.
[16:25:36] <upgrade>	 PuppyKun Push me now.
[16:26:52] <upgrade>	 PuppyKun Hi???
[16:28:09] <upgrade>	 PuppyKun Merge it now.
[16:28:52] <PuppyKun>	 No. Stop spamming this chat about it.
[16:29:43] <upgrade>	 paladox Merge it now
[16:30:20] <upgrade>	 PuppyKun I can deploy it in my computer???
[16:31:26] <PuppyKun>	 upgrade: stop spamming this channel doesn't mean stop pinging me but continue spamming
[16:32:09] <Not-5a0a>	 [02puppet] 07joaquinito01 synchronize pull request 03#1164: Upgrade MediaWiki 1.33 to 1.34 - 13https://git.io/JedOX
[16:33:06] <paladox>	 SantaRhino: oh
[16:33:07] <paladox>	 I updated that extension
[16:33:08] <paladox>	 So that it includes there fix for the issue we had
[16:35:44] <paladox>	 SantaRhino: see discord
[16:40:09] <SantaRhino>	 PuppyKun: it’s an LTA
[16:40:20] <SantaRhino>	 Last 3 bans are them
[16:40:32] <SantaRhino>	 See on wiki or ask Voidwalker as well
[16:55:15] <Not-5a0a>	 [02puppet] 07RhinosF1 commented on pull request 03#1164: Upgrade MediaWiki 1.33 to 1.34 - 13https://git.io/Jedsf
[16:55:53] <Not-5a0a>	 [02puppet] 07JohnFLewis closed pull request 03#1164: Upgrade MediaWiki 1.33 to 1.34 - 13https://git.io/JedOX
[17:02:49] <SantaRhino>	 grumble: see above for the block evader coming back
[17:08:57] <hispano76>	 https://phabricator.miraheze.org/T5003
[17:08:58] <ZppixBot>	 [ ⚓ T5003 Please, upgrade MediaWiki 1.33 to 1.34 ] - phabricator.miraheze.org
[17:10:37] <hispano76>	 hum, closed task
[17:10:42] <SantaRhino>	 JohnLewis: ^ can you disable
[17:10:47] <SantaRhino>	 hispano76: thanks
[17:26:02] <SantaRhino>	 .wmca Santa Claus on wheels‎
[17:26:02] <ZppixBot>	 https://meta.wikimedia.org/wiki/Special:CentralAuth/Santa Claus on wheels‎
[17:26:34] <SantaRhino>	 .wmca Santa_Claus_on_wheels‎
[17:26:34] <ZppixBot>	 https://meta.wikimedia.org/wiki/Special:CentralAuth/Santa_Claus_on_wheels‎
[17:27:01] <SantaRhino>	 .mhca Santa_Claus_on_wheels
[17:27:01] <ZppixBot>	 https://meta.miraheze.org/wiki/Special:CentralAuth/Santa_Claus_on_wheels
[17:27:26] <SantaRhino>	 @Stewards: See ur Noticeboard
[18:12:26] <icinga-miraheze>	 PROBLEM - cp3 Stunnel Http for mw2 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[18:12:27] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2604:180:0:33b::2/cpweb
[18:14:23] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[18:14:29] <icinga-miraheze>	 RECOVERY - cp3 Stunnel Http for mw2 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24668 bytes in 2.316 second response time
[21:39:45] <paladox>	 !log install jemalloc on misc2
[21:39:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:45:08] <paladox>	 !log ignore that, it appears to have version 1 installed, version 2 cannot seem to be found
[21:45:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:58:50] <SantaRhino>	 .github Miraheze/MW-config
[21:58:50] <ZppixBot>	 https://github.com/Miraheze/MW-config
[22:57:55] <icinga-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 16 seconds ago with 0 failures
[22:58:49] <Not-5a0a>	 [02miraheze/mediawiki] 07Pix1234 pushed 031 commit to 03REL1_34 [+0/-0/±4] 13https://git.io/JedlW
[22:58:51] <Not-5a0a>	 [02miraheze/mediawiki] 07Pix1234 03101ad8a - update various ext from upstream
[23:09:56] <icinga-miraheze>	 PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:16:07] <Not-5a0a>	 [02ssl] 07Pix1234 opened pull request 03#248: Add ssl for wiki.titan.land T4988 - 13https://git.io/JedlV
[23:17:40] <Not-5a0a>	 [02ssl] 07paladox closed pull request 03#248: Add ssl for wiki.titan.land T4988 - 13https://git.io/JedlV
[23:17:41] <Not-5a0a>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/Jedlw
[23:17:43] <Not-5a0a>	 [02miraheze/ssl] 07Pix1234 0385f4ee6 - Add ssl for wiki.titan.land T4988 (#248) * Create wiki.titan.land.crt * + wiki.titan.land ssl config
[23:25:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JedlM
[23:25:09] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 0371bf056 - BOT: Updating services config for wikis