[00:03:00] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 4176 MB (17% inode=93%);
[02:00:50] <icinga-miraheze>	 RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 99.99 ms
[02:41:59] <icinga-miraheze>	 PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 100.33 ms
[02:54:25] <icinga-miraheze>	 RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 99.90 ms
[03:01:44] <icinga-miraheze>	 PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 100.13 ms
[06:09:30] <icinga-miraheze>	 RECOVERY - ns1 APT on ns1 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[06:48:15] <icinga-miraheze>	 PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu]
[06:54:24] <icinga-miraheze>	 RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[09:24:08] <RhinosF1>	 Reception123: why's https://icinga.miraheze.org/dashboard#!/monitoring/service/show?host=sslhost&service=wiesepedia.ga%20-%20LetsEncrypt alerting?
[09:24:09] <ZppixBot>	 [ Icinga Web 2 Login ] - icinga.miraheze.org
[09:24:24] <RhinosF1>	 I can't see it anywhere in the ssl repo, paladox removed it
[09:26:15] <RhinosF1>	 Reception123: https://icinga.miraheze.org/dashboard#!/monitoring/service/show?host=sslhost&service=wiki.antlersg2.info%20-%20LetsEncrypt is also LE but not auto-renewed. Added by you in https://github.com/miraheze/ssl/commit/36b86639cc0488c2fa48116016e66f26430599b4
[09:26:17] <ZppixBot>	 [ Icinga Web 2 Login ] - icinga.miraheze.org
[09:26:17] <ZppixBot>	 [ add wiki.antlersg2.info cert · miraheze/ssl@36b8663 · GitHub ] - github.com
[09:26:54] <RhinosF1>	 that's never been renewed but no task in the commit message so I have to manually look at phab
[09:27:11] <Reception123>	 RhinosF1: you'd have to ask paladox since he's in charge of the bot
[09:28:09] <RhinosF1>	 Reception123: I might know why. Can you look at the wiespedia.ga one though and see if it's in referenced anywhere inc private repos.
[09:29:32] <RhinosF1>	 or github was being weird but it should auto renew
[09:29:40] <RhinosF1>	 found it in https://github.com/miraheze/ssl/commits/master/certificates/wiki.antlersg2.info.crt
[09:29:40] <ZppixBot>	 [ History for certificates/wiki.antlersg2.info.crt - miraheze/ssl · GitHub ] - github.com
[09:30:14] <RhinosF1>	 paladox: please get the bot to renew https://github.com/miraheze/ssl/commits/master/certificates/wiki.antlersg2.info.crt per https://icinga.miraheze.org/dashboard#!/monitoring/service/show?host=sslhost&service=wiki.antlersg2.info%20-%20LetsEncrypt
[09:30:15] <ZppixBot>	 [ History for certificates/wiki.antlersg2.info.crt - miraheze/ssl · GitHub ] - github.com
[09:30:16] <ZppixBot>	 [ Icinga Web 2 Login ] - icinga.miraheze.org
[09:30:24] <Reception123>	 RhinosF1: yes it was still in the private repo, removed
[09:30:30] <RhinosF1>	 Reception123: ty
[09:30:51] <RhinosF1>	 .in 15mins check icinga
[09:30:54] <ZppixBot>	 RhinosF1: Okay, will remind at 2020-05-28 - 10:45:53BST
[09:37:49] <ZppixBot>	 Hello rain1! If you have any questions, feel free to ask and someone should answer soon.
[09:37:49] <rain1>	 hey
[09:37:53] <RhinosF1>	 hi
[09:37:57] <rain1>	 can i use mathjax on a wiki?
[09:38:19] <rain1>	 i like the math formatting on math.stackexchange
[09:38:42] <Reception123>	 rain1: please see https://phabricator.miraheze.org/T5203#101978. You can try to use Math
[09:38:42] <ZppixBot>	 [ ⚓ T5203 replace extension math with mathjax (that support eqref cross references) ] - phabricator.miraheze.org
[09:40:08] <rain1>	 I see, thanks
[09:45:55] <ZppixBot>	 RhinosF1: check icinga
[09:46:21] <RhinosF1>	 Reception123: weispedia is still alerting, has puppet ran?
[09:46:56] <Reception123>	 if icinga didn't say anything then yes it did run
[09:49:38] <RhinosF1>	 Reception123: puppet running and the alert there is bad thing?
[09:50:12] <Reception123>	 RhinosF1: I've got no idea why the alert is still there
[09:50:54] <RhinosF1>	 paladox: ^ that as well pls
[10:53:30] <icinga-miraheze>	 PROBLEM - www.mcpk.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.mcpk.wiki' expires in 15 day(s) (Sat 13 Jun 2020 10:48:33 GMT +0000).
[10:58:23] <Not-1447>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfoGB
[10:58:25] <Not-1447>	 [02miraheze/ssl] 07MirahezeSSLBot 0377731b7 - Bot: Update SSL cert for www.mcpk.wiki
[11:02:40] <icinga-miraheze>	 RECOVERY - www.mcpk.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mcpk.wiki' will expire on Wed 26 Aug 2020 09:58:17 GMT +0000.
[11:13:00] <icinga-miraheze>	 PROBLEM - rivworld.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'rivworld.wiki' expires in 15 day(s) (Sat 13 Jun 2020 11:08:18 GMT +0000).
[11:16:59] <Not-1447>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfoZI
[11:17:00] <Not-1447>	 [02miraheze/ssl] 07MirahezeSSLBot 03b0349c1 - Bot: Update SSL cert for rivworld.wiki
[11:22:00] <icinga-miraheze>	 RECOVERY - rivworld.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rivworld.wiki' will expire on Wed 26 Aug 2020 10:16:53 GMT +0000.
[11:41:06] <RhinosF1>	 hi vinesh
[11:41:39] <vinesh>	 Hi RhinosF1
[11:48:20] <RhinosF1>	 paladox: JobQueue’s backed up again
[11:59:38] <ZppixBot>	 Hello THE_SNITCH! If you have any questions, feel free to ask and someone should answer soon.
[11:59:45] <THE_SNITCH>	 STUPID TROLL I HATE YOU AND I KNOW WHO YOU ARE (AND I HAVE PROOF OF YOUR IDENTITY)! IF YOU DONT SEND ME AN EMAIL @ DAVIS.MARTIN1999@OUTLOOK.COM BY 9:00 pm UTC TODAY (ANYTHING YOU WANT) I WILL SEND YOU"RE INFO TO EVERYONE!!!!
[11:59:46] <THE_SNITCH>	 STUPID TROLL I HATE YOU AND I KNOW WHO YOU ARE (AND I HAVE PROOF OF YOUR IDENTITY)! IF YOU DONT SEND ME AN EMAIL @ DAVIS.MARTIN1999@OUTLOOK.COM BY 9:00 pm UTC TODAY (ANYTHING YOU WANT) I WILL SEND YOU"RE INFO TO EVERYONE!!!!
[11:59:47] <THE_SNITCH>	 STUPID TROLL I HATE YOU AND I KNOW WHO YOU ARE (AND I HAVE PROOF OF YOUR IDENTITY)! IF YOU DONT SEND ME AN EMAIL @ DAVIS.MARTIN1999@OUTLOOK.COM BY 9:00 pm UTC TODAY (ANYTHING YOU WANT) I WILL SEND YOU"RE INFO TO EVERYONE!!!!
[12:00:09] <THE_SNITCH>	 STUPID TROLL I HATE YOU AND I KNOW WHO YOU ARE (AND I HAVE PROOF OF YOUR IDENTITY)! IF YOU DONT SEND ME AN EMAIL @ DAVIS.MARTIN1999@OUTLOOK.COM BY 9:00 pm UTC TODAY (ANYTHING YOU WANT) I WILL SEND YOU"RE INFO TO EVERYONE!!!!
[12:00:10] <THE_SNITCH>	 STUPID TROLL I HATE YOU AND I KNOW WHO YOU ARE (AND I HAVE PROOF OF YOUR IDENTITY)! IF YOU DONT SEND ME AN EMAIL @ DAVIS.MARTIN1999@OUTLOOK.COM BY 9:00 pm UTC TODAY (ANYTHING YOU WANT) I WILL SEND YOU"RE INFO TO EVERYONE!!!!
[12:00:11] <THE_SNITCH>	 STUPID TROLL I HATE YOU AND I KNOW WHO YOU ARE (AND I HAVE PROOF OF YOUR IDENTITY)! IF YOU DONT SEND ME AN EMAIL @ DAVIS.MARTIN1999@OUTLOOK.COM BY 9:00 pm UTC TODAY (ANYTHING YOU WANT) I WILL SEND YOU"RE INFO TO EVERYONE!!!!
[12:00:13] <THE_SNITCH>	 STUPID TROLL I HATE YOU AND I KNOW WHO YOU ARE (AND I HAVE PROOF OF YOUR IDENTITY)! IF YOU DONT SEND ME AN EMAIL @ DAVIS.MARTIN1999@OUTLOOK.COM BY 9:00 pm UTC TODAY (ANYTHING YOU WANT) I WILL SEND YOU"RE INFO TO EVERYONE!!!!
[12:01:39] <RhinosF1>	 *lockdown
[12:02:10] <RhinosF1>	 *gban *!?id44622?@*irccloud.com*
[12:02:10] <SigmaBot>	 04*!?id44622?@*irccloud.com* has been globally banned and will be automatically kickbanned from all channels on sight.04
[12:11:10] <icinga-miraheze>	 PROBLEM - planet.isd.dance - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'planet.isd.dance' expires in 15 day(s) (Sat 13 Jun 2020 12:06:52 GMT +0000).
[13:18:33] <icinga-miraheze>	 RECOVERY - mon1 Puppet on mon1 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures
[13:56:33] <RhinosF1>	 quirc|ping: are you able to get in ##RhinosF1 ? I saw you get forwarded
[14:05:51] <RhinosF1>	 JohnLewis, PuppyKun: see your email
[14:55:28] <AmandaCath>	 Good morning
[15:08:14] <paladox>	 hi
[15:11:48] <RhinosF1>	 Hi AmandaCath
[15:15:50] <icinga-miraheze>	 RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 99.77 ms
[15:23:02] <icinga-miraheze>	 PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 101.70 ms
[16:04:04] <icinga-miraheze>	 PROBLEM - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is CRITICAL: CRITICAL - NGINX Error Rate is 84%
[16:12:49] <icinga-miraheze>	 PROBLEM - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is WARNING: WARNING - NGINX Error Rate is 57%
[16:15:42] <icinga-miraheze>	 RECOVERY - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is OK: OK - NGINX Error Rate is 26%
[17:23:44] <MH-Discord>	 <The clueless guy> Hi
[17:23:49] <MH-Discord>	 <The clueless guy> its afternoon now
[17:23:57] <Cocopuff2018>	  Hi
[17:24:12] <Cocopuff2018>	 oh wow i finally  figured out how to use this LAMO
[17:26:33] <Cocopuff2018>	 Good afternoon
[17:30:54] <RhinosF1>	 hi
[17:37:29] <Examknow>	 hey Cocopuff2018
[17:43:46] <paladox>	 !log root@jobrunner1:/home/paladox# sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=traentorwiki --report=1 Wikipedia-20200527085418.xml -  T5665
[17:43:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[17:44:13] <paladox>	 !log root@jobrunner1:/home/paladox# sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=traentorwiki --report=1 Wikipedia-20200527085130.xml -  T5665
[17:44:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[17:52:13] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[17:52:36] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[17:52:49] <icinga-miraheze>	 PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[17:53:20] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[17:53:45] <icinga-miraheze>	 PROBLEM - wiki.galactee.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.galactee.org' expires in 15 day(s) (Sat 13 Jun 2020 17:48:31 GMT +0000).
[17:54:32] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[17:55:36] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures
[17:55:48] <icinga-miraheze>	 RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures
[17:56:18] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:57:27] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:58:13] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[18:02:46] <icinga-miraheze>	 RECOVERY - wiki.galactee.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.galactee.org' will expire on Wed 26 Aug 2020 16:54:08 GMT +0000.
[18:05:24] <Examknow>	 Reception123: Not here -overflow
[18:05:38] <Reception123>	 Yeah my bad 
[18:06:34] <icinga-miraheze>	 PROBLEM - mail1 APT on mail1 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates).
[18:19:44] <Cocopuff2018>	 Uh
[18:19:58] <Cocopuff2018>	 Welp figured out how to use this
[19:26:25] <MH-Discord>	 <Bry> hey guys
[19:26:41] <Sario>	 Hello
[19:26:48] <MH-Discord>	 <Bry> what happens if my wiki is inactive for a certain amount of time? will it be taken down or something similar?
[19:27:22] <Sario>	 [[Dormancy Policy]]
[19:27:23] <SigmaBot>	 https://meta.miraheze.org/wiki/Dormancy_Policy
[19:28:36] <MH-Discord>	 <Bry> thank you!
[19:31:45] <Sario>	 You're welcome
[20:21:55] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[20:24:53] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[20:40:24] <RhinosF1>	 paladox: meta is just downlpading a file called Miraheze again
[20:40:43] <paladox>	 works for me
[20:41:15] <RhinosF1>	 paladox: yeah resolved
[20:41:23] <RhinosF1>	 I’ll upload the file it gave to phab
[20:44:28] <icinga-miraheze>	 PROBLEM - jobrunner1 Current Load on jobrunner1 is CRITICAL: CRITICAL - load average: 15.14, 9.54, 7.33
[20:45:17] <RhinosF1>	 paladox: https://phabricator.miraheze.org/F1190541 made security because I haven’t checked what’s in it
[20:45:18] <ZppixBot>	 [ Login ] - phabricator.miraheze.org
[20:45:34] <paladox>	 that's html RhinosF1 
[20:46:09] <RhinosF1>	 paladox: rather than render though I just got a file called ‘Miraheze’ download for about a minute
[20:46:18] <RhinosF1>	 Which the contents of were that
[20:46:30] <paladox>	 yeh, that'll be because it downloaded the html for some reason.
[20:47:18] <RhinosF1>	 paladox: that reason is what I’m wondering though
[20:56:25] <icinga-miraheze>	 PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 1.68, 6.67, 7.42
[20:59:19] <icinga-miraheze>	 RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 1.68, 4.24, 6.33
[22:26:18] <paladox>	 !log upgrade libunbound8 on mail1
[22:26:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[22:26:27] <icinga-miraheze>	 RECOVERY - mail1 APT on mail1 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[22:30:16] <Cocopuff2018>	 Oof
[22:30:23] <Cocopuff2018>	 who dislikes trump?
[22:32:27] <RhinosF1>	 Cocopuff2018: #miraheze-offtopic
[22:41:30] <icinga-miraheze>	 PROBLEM - wiki.m.iufs.jp - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Cannot make SSL connection.23410630518592:error:14094410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure:../ssl/record/rec_layer_s3.c:1544:SSL alert number 40
[22:41:49] <RhinosF1>	 paladox: ^
[22:43:47] <Cocopuff2018>	 pasladox Miraheze Doo you alive bro?
[22:44:59] <Cocopuff2018>	 opss paladox
[23:06:35] <paladox>	 handled
[23:06:57] <RhinosF1>	 paladox: ty