[00:03:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:36:32] <icinga-miraheze>	 PROBLEM - mw2 MediaWiki Rendering on mw2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4221 bytes in 0.041 second response time
[00:37:12] <icinga-miraheze>	 PROBLEM - db4 Current Load on db4 is CRITICAL: CRITICAL - load average: 11.08, 10.76, 5.88
[00:38:30] <icinga-miraheze>	 RECOVERY - mw2 MediaWiki Rendering on mw2 is OK: HTTP OK: HTTP/1.1 200 OK - 18585 bytes in 0.274 second response time
[00:39:10] <icinga-miraheze>	 PROBLEM - db4 Current Load on db4 is WARNING: WARNING - load average: 2.63, 7.74, 5.37
[00:41:09] <icinga-miraheze>	 RECOVERY - db4 Current Load on db4 is OK: OK - load average: 2.27, 6.00, 5.01
[01:20:08] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeb4Q
[01:20:09] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 030303fee - BOT: Updating services config for wikis
[02:53:41] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 2 minutes ago with 9 failures. Failed resources (up to 3 shown): Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666]
[03:03:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[03:22:41] <icinga-miraheze>	 PROBLEM - wiki.antlersg2.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.antlersg2.info' expires in 15 day(s) (Sat 11 Jan 2020 03:18:40 AM GMT +0000).
[03:22:54] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebRp
[03:22:56] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 035f23563 - Bot: Update SSL cert for wiki.antlersg2.info
[03:32:41] <icinga-miraheze>	 RECOVERY - wiki.antlersg2.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.antlersg2.info' will expire on Wed 25 Mar 2020 02:22:48 AM GMT +0000.
[03:33:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 2 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22]
[03:41:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures
[04:05:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[salt-minion]
[04:13:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[05:23:39] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 4 failures. Last run 2 minutes ago with 4 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100]
[05:35:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeb0b
[05:35:08] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 038590b5b - BOT: Updating services config for wikis
[05:43:38] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:59:02] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is CRITICAL: DISK CRITICAL - free space: / 1440 MB (5% inode=94%);
[06:01:03] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 1470 MB (6% inode=94%);
[06:03:06] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is CRITICAL: DISK CRITICAL - free space: / 1437 MB (5% inode=94%);
[06:03:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 2 minutes ago with 9 failures. Failed resources (up to 3 shown): Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666]
[06:11:16] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 1450 MB (6% inode=94%);
[06:13:18] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is CRITICAL: DISK CRITICAL - free space: / 1429 MB (5% inode=94%);
[06:13:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:15:17] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 1481 MB (6% inode=94%);
[06:33:39] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 2 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22]
[06:43:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[08:55:09] <ZppixBot>	 Hello europesongs! If you have any questions, feel free to ask and someone should answer soon.
[08:55:43] <europesongs>	 Christmas is over and so is the song break! New year time!! @everyone
[08:55:49] <europesongs>	 We're leaving together
[08:55:49] <europesongs>	 But still it's farewell
[08:55:49] <europesongs>	 And maybe we'll come back
[08:55:49] <europesongs>	 To Earth, who can tell?
[08:55:49] <europesongs>	 I guess there is no one to blame
[08:55:50] <europesongs>	 We're leaving ground (leaving ground)
[08:55:50] <europesongs>	 Will things ever be the same again?
[08:56:08] <SantaRhino>	 Reception123: ^ ffs
[08:56:38] <Reception123>	 SantaRhino: hi
[08:56:40] <Reception123>	 :( 
[08:56:46] <Reception123>	 well at least Sigyn is back at it and they got K-lined 
[08:56:55] <SantaRhino>	 For now
[08:57:05] <SantaRhino>	 Reception123: who even could it be?
[08:57:20] * SantaRhino goes to poke james to ban their irc cloud
[08:57:23] <SantaRhino>	 grumble: ^
[08:57:34] <Reception123>	 no idea
[09:04:44] <ZppixBot>	 Hello JackFrost! If you have any questions, feel free to ask and someone should answer soon.
[09:36:22] <icinga-miraheze>	 PROBLEM - db5 Disk Space on db5 is WARNING: DISK WARNING - free space: / 20080 MB (10% inode=99%);
[09:39:02] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 0.59, 2.37, 1.67
[09:39:22] <ZppixBot>	 Hello StatusQuo! If you have any questions, feel free to ask and someone should answer soon.
[09:40:10] <SantaRhino>	 Hi StatusQuo
[09:41:01] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.46, 1.39, 1.42
[09:45:16] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[/mnt/mediawiki-static]
[10:09:59] <ZppixBot>	 Hello boneem[m]! If you have any questions, feel free to ask and someone should answer soon.
[10:12:33] <RhinosF1>	 Hi boneem[m]
[10:12:58] <grumble>	 hrm well ood thing sigyn caught them (i wasnt around when you pinged me, christmas stuff :D)
[10:13:31] <RhinosF1>	 grumble: yeah, JackFrost had a look as well.
[10:19:05] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 4.35, 4.23, 2.40
[10:27:05] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.42, 1.03, 1.69
[10:31:03] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.52, 1.43, 1.81
[10:33:01] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.19, 0.81, 1.48
[10:40:52] <icinga-miraheze>	 RECOVERY - db5 Disk Space on db5 is OK: DISK OK - free space: / 20859 MB (11% inode=99%);
[11:13:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 2 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100]
[11:31:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures
[11:33:28] <RhinosF1>	 Reception123: still here? https://phabricator.miraheze.org/T5030#95678
[11:33:29] <ZppixBot>	 [ ⚓ T5030 A xml dump request is stuck in Special:DataDump ] - phabricator.miraheze.org
[11:37:45] <Reception123>	 RhinosF1: yeah got an email about that and said a Phab task would be better
[11:38:09] <RhinosF1>	 Reception123: are you online to work on it?
[11:38:30] <Reception123>	 !log reception@mw1:/srv/mediawiki/w/maintenance$ sudo -u www-data php runJobs.php --wiki diavwiki
[11:38:32] <Reception123>	 RhinosF1: ^ empty
[11:38:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[11:39:41] <Reception123>	 paladox: ^
[11:39:56] <RhinosF1>	 Reception123: check the logs?
[11:40:30] <Reception123>	 I did, nothing related
[11:40:42] <Reception123>	 as if there's no error message there would be nothing afaik
[11:41:52] <Reception123>	 RhinosF1: fixed by deleting and redoing
[11:42:02] <RhinosF1>	 Reception123: hmm, did it complete?
[11:42:12] <Reception123>	 RhinosF1: yes, ran the jobs manually right after and this time it worked
[11:42:24] <Reception123>	 !log re-ran jobs above
[11:42:28] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[11:44:16] <RhinosF1>	 Okay
[11:53:04] <Not-5a0a>	 [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeb2A
[11:53:06] <Not-5a0a>	 [02miraheze/CreateWiki] 07translatewiki 0396d400e - Localisation updates from https://translatewiki.net.
[11:53:06] <ZppixBot>	 [ Main page - translatewiki.net ] - translatewiki.net.
[11:55:43] <Reception123>	 RhinosF1: heh didn't know jobrunner was on lizardfs6 now...
[11:55:44] <Reception123>	 that's confusing
[11:56:04] <Reception123>	 !log restarted jobrunner
[11:56:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[12:07:22] <RhinosF1>	 Reception123: I’m not sure what isn’t on lfs6
[12:21:54] <RhinosF1>	 revi: to further expand on my reply, one day Miraheze might have actual staff that want to take over staff@ is what I mean so I’m saving their back
[12:40:08] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebaN
[12:40:09] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 034688d70 - BOT: Updating services config for wikis
[13:51:27] <icinga-miraheze>	 PROBLEM - db5 Disk Space on db5 is WARNING: DISK WARNING - free space: / 20076 MB (10% inode=99%);
[14:35:40] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 3 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22]
[14:43:39] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[14:47:49] <icinga-miraheze>	 RECOVERY - db5 Disk Space on db5 is OK: DISK OK - free space: / 20830 MB (11% inode=99%);
[15:22:27] <paladox>	 Reception123 i'm back
[15:37:49] <RhinosF1>	 paladox: see linked phab task, dumps keep getting stuck
[15:37:59] <paladox>	 ok
[15:41:41] <Not-5a0a>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jebok
[15:41:43] <Not-5a0a>	 [02miraheze/mw-config] 07paladox 031ed9fa5 - Update Redis.php
[15:47:21] <paladox>	 It's working now
[15:55:07] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jebon
[15:55:08] <Not-5a0a>	 [02miraheze/services] 07MirahezeSSLBot 036c5fa75 - BOT: Updating services config for wikis
[15:55:12] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox pushed 032 commits to 03REL1_34 [+0/-0/±2] 13https://git.io/JeboC
[15:55:13] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox 03ae45c55 - Update MediaWikiChat
[15:55:15] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox 03f5351ed - Merge branch 'REL1_34' of github.com:miraheze/mediawiki into REL1_34
[15:55:42] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeboW
[15:55:44] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox 0391fa39f - Update erudite
[15:56:47] <RhinosF1>	 paladox: thx
[16:13:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 2 minutes ago with 9 failures. Failed resources (up to 3 shown): Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666]
[16:31:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures
[16:43:06] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±2] 13https://git.io/JebKi
[16:43:08] <Not-5a0a>	 [02miraheze/mediawiki] 07paladox 036497d61 - Update AutoCreateCategoryPages
[16:43:39] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 2 minutes ago with 9 failures. Failed resources (up to 3 shown): Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666]
[16:46:49] <paladox>	 !log rebuild lc on mw* and lizardfs6
[16:46:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[16:51:49] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures
[16:57:41] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2400:6180:0:d0::403:f001/cpweb
[16:59:39] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[17:02:50] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures
[17:05:18] <icinga-miraheze>	 PROBLEM - db5 Disk Space on db5 is WARNING: DISK WARNING - free space: / 20074 MB (10% inode=99%);
[17:13:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 2 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22]
[17:23:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:33:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 2 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22]
[17:43:31] <icinga-miraheze>	 PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'antiguabarbudacalypso.com' expires in 15 day(s) (Sat 11 Jan 2020 05:40:13 PM GMT +0000).
[17:43:44] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebiM
[17:43:45] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 030020e39 - Bot: Update SSL cert for antiguabarbudacalypso.com
[17:44:12] <icinga-miraheze>	 PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'permanentfuturelab.wiki' expires in 15 day(s) (Sat 11 Jan 2020 05:41:52 PM GMT +0000).
[17:44:25] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jebiy
[17:44:26] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 0391ed6db - Bot: Update SSL cert for permanentfuturelab.wiki
[17:44:44] <icinga-miraheze>	 PROBLEM - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'permanentfuturelab.wiki' expires in 15 day(s) (Sat 11 Jan 2020 05:41:52 PM GMT +0000).
[17:47:45] <icinga-miraheze>	 PROBLEM - spiral.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'spiral.wiki' expires in 15 day(s) (Sat 11 Jan 2020 05:45:42 PM GMT +0000).
[17:47:58] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebiA
[17:47:59] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 038cc7469 - Bot: Update SSL cert for spiral.wiki
[17:51:42] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures
[17:52:16] <icinga-miraheze>	 RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Wed 25 Mar 2020 04:44:19 PM GMT +0000.
[17:52:44] <icinga-miraheze>	 RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Wed 25 Mar 2020 04:44:19 PM GMT +0000.
[17:53:06] <icinga-miraheze>	 PROBLEM - publictestwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'publictestwiki.com' expires in 15 day(s) (Sat 11 Jan 2020 05:49:52 PM GMT +0000).
[17:53:20] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebPT
[17:53:21] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03f29d1cf - Bot: Update SSL cert for publictestwiki.com
[17:53:22] <icinga-miraheze>	 PROBLEM - es.publictestwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'publictestwiki.com' expires in 15 day(s) (Sat 11 Jan 2020 05:49:52 PM GMT +0000).
[17:53:40] <icinga-miraheze>	 RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Wed 25 Mar 2020 04:43:38 PM GMT +0000.
[17:53:47] <icinga-miraheze>	 RECOVERY - spiral.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'spiral.wiki' will expire on Wed 25 Mar 2020 04:47:52 PM GMT +0000.
[17:55:10] <icinga-miraheze>	 RECOVERY - db5 Disk Space on db5 is OK: DISK OK - free space: / 21835 MB (11% inode=99%);
[17:57:58] <icinga-miraheze>	 PROBLEM - wiki.valentinaproject.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.valentinaproject.org' expires in 15 day(s) (Sat 11 Jan 2020 05:55:01 PM GMT +0000).
[17:58:04] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebPn
[17:58:06] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 033f8db74 - Bot: Update SSL cert for wiki.valentinaproject.org
[18:03:06] <icinga-miraheze>	 RECOVERY - publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Wed 25 Mar 2020 04:53:14 PM GMT +0000.
[18:04:16] <icinga-miraheze>	 RECOVERY - wiki.valentinaproject.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.valentinaproject.org' will expire on Thu 12 Mar 2020 08:40:10 AM GMT +0000.
[18:05:36] <icinga-miraheze>	 RECOVERY - es.publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Wed 25 Mar 2020 04:53:14 PM GMT +0000.
[18:05:42] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 128.199.139.216/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[18:08:13] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw3
[18:09:43] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[18:10:10] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 6 backends are healthy
[18:13:15] <icinga-miraheze>	 PROBLEM - wiki.dwplive.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.dwplive.com' expires in 15 day(s) (Sat 11 Jan 2020 06:10:25 PM GMT +0000).
[18:13:28] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebPK
[18:13:30] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03df22a2e - Bot: Update SSL cert for wiki.dwplive.com
[18:13:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 2 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22]
[18:14:04] <icinga-miraheze>	 PROBLEM - wiki.grottocenter.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.grottocenter.org' expires in 15 day(s) (Sat 11 Jan 2020 06:11:18 PM GMT +0000).
[18:14:19] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebPP
[18:14:20] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03dd8905b - Bot: Update SSL cert for wiki.grottocenter.org
[18:16:20] <icinga-miraheze>	 PROBLEM - wiki.make717.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.make717.org' expires in 15 day(s) (Sat 11 Jan 2020 06:13:55 PM GMT +0000).
[18:16:34] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebPS
[18:16:35] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03196df65 - Bot: Update SSL cert for wiki.make717.org
[18:19:09] <icinga-miraheze>	 PROBLEM - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'thelonsdalebattalion.co.uk' expires in 15 day(s) (Sat 11 Jan 2020 06:16:06 PM GMT +0000).
[18:19:23] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebPA
[18:19:24] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03f1c59b5 - Bot: Update SSL cert for thelonsdalebattalion.co.uk
[18:22:22] <icinga-miraheze>	 RECOVERY - wiki.make717.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.make717.org' will expire on Wed 25 Mar 2020 05:16:27 PM GMT +0000.
[18:23:13] <icinga-miraheze>	 RECOVERY - wiki.dwplive.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dwplive.com' will expire on Wed 25 Mar 2020 05:13:22 PM GMT +0000.
[18:23:38] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[18:23:54] <icinga-miraheze>	 RECOVERY - wiki.grottocenter.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.grottocenter.org' will expire on Wed 25 Mar 2020 05:14:11 PM GMT +0000.
[18:28:20] <icinga-miraheze>	 PROBLEM - wisdomwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wisdomwiki.org' expires in 15 day(s) (Sat 11 Jan 2020 06:25:17 PM GMT +0000).
[18:28:33] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebXL
[18:28:34] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 03d181549 - Bot: Update SSL cert for wisdomwiki.org
[18:32:20] <icinga-miraheze>	 RECOVERY - wisdomwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wisdomwiki.org' will expire on Wed 25 Mar 2020 05:28:27 PM GMT +0000.
[18:33:09] <icinga-miraheze>	 RECOVERY - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thelonsdalebattalion.co.uk' will expire on Wed 25 Mar 2020 05:19:16 PM GMT +0000.
[18:33:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 6 failures. Last run 2 minutes ago with 6 failures. Failed resources (up to 3 shown): Service[salt-minion],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100],Service[puppetdb]
[18:51:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures
[19:31:23] <ZppixBot>	 Hello sen34! If you have any questions, feel free to ask and someone should answer soon.
[19:32:31] <sen34>	 firstly thank you if your involved with Miraheze. Amazing project and very high quality. I was research self hosting solutions and eventually found out about Miraheze.
[19:33:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 2 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22]
[19:34:24] <Reception123>	 sen34: thank you for the kind words :)
[19:34:32] <Reception123>	 Glad you found us
[19:34:41] <Reception123>	 If you have any questions or need anything feel free to ask here 
[19:36:23] <sen34>	 Thank you. I have a wiki I just started. Ive selected the Skin:Minerva Neue. How would i go about editing this Skin? I want to change what appears in the side bar on the left, the footer etc. I'm guessing worse case I have to develop my modifications myself outside of Miraheze (say on a self hosted instance) then create a repo, and then ask the
[19:36:23] <sen34>	 sysadmins of MH to enable?
[19:37:25] <RhinosF1>	 sen34: you can place some css in MediaWiki:Common.css to change things on wiki
[19:37:57] <sen34>	 sure, but if i want remove some elements of the drop down. is that possible with just css and js?
[19:38:34] <RhinosF1>	 sen34: try it, most likely
[19:40:17] <sen34>	 https://imgur.com/a/XdUWZga
[19:40:18] <ZppixBot>	 [ Imgur: The magic of the Internet ] - imgur.com
[19:40:48] <sen34>	 see here, the instructions of the skin talk about modifying php i believe. 
[19:41:06] <sen34>	 how would i remove 'random page' for example
[19:41:38] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures
[19:41:44] <RhinosF1>	 sen34: from the sidebar, MediaWiki:Sidebar
[19:41:52] * RhinosF1 will be back later
[19:44:48] <sen34>	 thank you RhinosF1 !
[19:46:25] * hispano76 greeting
[19:55:38] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[puppet-users_ensure_members]
[20:01:08] <icinga-miraheze>	 PROBLEM - www.zenbuddhism.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.zenbuddhism.info' expires in 15 day(s) (Sat 11 Jan 2020 07:57:52 PM GMT +0000).
[20:01:22] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JebMu
[20:01:24] <Not-5a0a>	 [02miraheze/ssl] 07MirahezeSSLBot 033642543 - Bot: Update SSL cert for www.zenbuddhism.info
[20:03:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[20:13:06] <icinga-miraheze>	 RECOVERY - www.zenbuddhism.info - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zenbuddhism.info' will expire on Wed 25 Mar 2020 07:01:16 PM GMT +0000.
[20:17:07] <robla>	 hi folks, I've met many of you via other channels (e.g. on wiki somewhere) but here's my way-too-long introduction: https://robla.blog/2019/12/23/why-donate-to-a-non-profit-with-a-hard-to-pronounce-name/
[20:17:08] <ZppixBot>	 [ Why donate to a non-profit with a hard-to-pronounce name? – RoBlaBlog ] - robla.blog
[20:24:42] <RhinosF1>	 robla: welcome! Thanks for bringing your experience to the team!
[20:25:18] <robla>	 RhinosF1: thanks!  I'm looking forward to working with you all!
[20:29:17] <PuppyKun>	 robla: the blog was a nice read! :D donations are always appreciated too. Not to ask a stupid question but what are you planning on doing around here? I'm pleasantly surprised to hear you've been using miraheze for a while since i hadn't heard of you :) anything besides just board member?
[20:31:03] <RhinosF1>	 robla: I think you’ll be a great asset with your experience
[20:31:59] <paladox>	 he's already a great asset, yet he hasen't even started :P
[20:32:05] <robla>	 PuppyKun: thanks!  Re: what I'll be doing... i may get back into MediaWiki extension development...it's been a *long* time since I've done that.
[20:32:50] <robla>	 I've also been chatting with paladox about VPS management software
[20:33:22] <RhinosF1>	 paladox: I’m sure he has
[20:33:28] <RhinosF1>	 robla: great
[20:33:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 2 minutes ago with 9 failures. Failed resources (up to 3 shown): Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666]
[20:35:09] <PuppyKun>	 robla: o/ managewiki
[20:41:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures
[20:49:21] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.35, 1.81, 1.44
[20:50:36] <ZppixBot>	 Hello sen999! If you have any questions, feel free to ask and someone should answer soon.
[20:51:40] <RhinosF1>	 Hi
[20:53:19] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.64, 1.29, 1.40
[20:54:21] <sen999>	 hello again. so I want to disable various elements, so that the wiki looks like an 'website' when somebody is not logged in. Are there some way, say like js variables that can be called from the common.js file that I could use to customise the experience for non-logged in users. or what is the correct way. im a mediawiki sysops noob. thanks : )
[20:54:46] <Zppix>	 paladox:  ^
[20:55:55] <paladox>	 I know there's a way to tell if your logged in or not under js, not sure about css.
[20:56:32] <paladox>	 mediaWiki.user.isAnon()
[20:57:12] <sen999>	 also just found this wgUserEditCount
[20:57:18] <sen999>	 https://www.mediawiki.org/wiki/Manual:Interface/JavaScript
[20:57:19] <ZppixBot>	 [ Manual:Interface/JavaScript - MediaWiki ] - www.mediawiki.org
[20:57:31] <sen999>	 The number of edits the current user made (null if not logged in).	
[20:57:50] <paladox>	 or there's that
[20:59:10] <RhinosF1>	 sen999: like https://meta.miraheze.org/wiki/Miraheze-4-year
[20:59:12] <ZppixBot>	 [ Miraheze-4-year - Miraheze Meta ] - meta.miraheze.org
[21:00:16] <sen999>	 rhino, does that page use this type of js? where?
[21:01:15] <RhinosF1>	 Sen999: with some tweaking and adding the code for only anons. This should do that. https://www.irccloud.com/pastebin/ryq2eBUT
[21:01:16] <ZppixBot>	 [ Snippet | IRCCloud ] - www.irccloud.com
[21:01:50] <RhinosF1>	 be back later
[21:02:15] <sen999>	 thank you so much. will try and get this to work 
[21:03:49] <hispano76>	 very good the publication of the blog  robla :)
[21:04:06] <Voidwalker>	 Can also setup css by making modifications to MediaWiki:Common.css and MediaWiki:Group-user.css where the Common.css edits will be shown to all users, but can be overridden by Group-user.css to show different versions to logged in users
[21:15:23] <RhinosF1>	 Voidwalker: thanks for being our css/js genius
[21:20:59] <sen999>	 sweet thanks voidwalker. will try that. simples
[21:55:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 3 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[ufw],Service[prometheus-node-exporter],Service[nagios-nrpe-server],Package[openssh-client]
[22:11:38] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures
[22:25:45] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[puppetserver]
[22:27:03] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 107.191.126.23/cpweb
[22:29:42] <icinga-miraheze>	 PROBLEM - cp3 Stunnel Http for mw3 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[22:29:53] <Not-5a0a>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fhygA
[22:29:54] <Not-5a0a>	 [02miraheze/mw-config] 07paladox 03d44a9dc - change list in siteLinkGroups to 'miraheze'
[22:29:56] <Not-5a0a>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[22:30:17] <paladox>	 wierd
[22:30:22] <paladox>	 that's not from today
[22:31:07] <RhinosF1>	 How strange paladox
[22:31:19] <paladox>	 that's from jan 31st earlier this year
[22:31:22] <travis-ci>	 miraheze/mw-config/paladox-patch-1/d44a9dc - paladox The build passed. https://travis-ci.org/miraheze/mw-config/builds/629805017
[22:31:40] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures
[22:31:42] <icinga-miraheze>	 RECOVERY - cp3 Stunnel Http for mw3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24646 bytes in 0.686 second response time
[22:31:47] <Not-5a0a>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[22:31:49] <Not-5a0a>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[22:31:50] <Not-5a0a>	 [02mw-config] 07paladox deleted branch 03revert-2826-patch-64 - 13https://git.io/vbvb3
[22:31:51] <RhinosF1>	 A long time ago
[22:31:52] <Not-5a0a>	 [02miraheze/mw-config] 07paladox deleted branch 03revert-2826-patch-64
[22:33:04] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[22:43:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 2 minutes ago with 8 failures. Failed resources (up to 3 shown): Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666]
[23:05:07] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 107.191.126.23/cpweb, 2400:6180:0:d0::403:f001/cpweb
[23:05:15] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[23:07:18] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[23:08:10] <hispano76>	 I'm afraid to bother. Is there a chance I can get this application, is there anyone who can make it operational? I'd like to monitor Spanish wiki editions and let you know if there are any problems. The current channel is really hard to read when it's not your language and there are dozens of edits every hour. I'd like to contribute more than I have.https://phabricator.miraheze.org/T4352 :/
[23:08:11] <ZppixBot>	 [ ⚓ T4352 Create the Miraheze-feed-es channel ] - phabricator.miraheze.org
[23:09:13] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[23:11:37] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures
[23:13:27] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 2604:180:0:33b::2/cpweb, 2400:6180:0:d0::403:f001/cpweb
[23:14:56] <sleepy-rhino>	 hispano76: it’s likely possible with a filter on the cw_language column of the db
[23:15:14] <sleepy-rhino>	 Just not sure whether any wants to do it that has the experince to
[23:15:24] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[23:25:37] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[ops_ensure_members],Exec[puppet-users_ensure_members]
[23:31:38] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures