[00:00:21] <icinga-miraheze>	 RECOVERY - gluster2 Disk Space on gluster2 is OK: DISK OK - free space: / 36748 MB (11% inode=77%);
[00:02:28] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.24, 20.70, 15.49
[00:04:28] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.76, 19.51, 15.71
[01:11:21] <icinga-miraheze>	 PROBLEM - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is WARNING: WARNING - NGINX Error Rate is 53%
[01:13:17] <icinga-miraheze>	 RECOVERY - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is OK: OK - NGINX Error Rate is 12%
[01:44:22] <icinga-miraheze>	 PROBLEM - gluster2 Disk Space on gluster2 is WARNING: DISK WARNING - free space: / 36714 MB (10% inode=77%);
[05:17:11] <MH-Discord>	 <MrJaroslavik (OFF)> ? https://meta.miraheze.org/wiki/Requests_for_Comment/Add_TheTopTens_to_Miraheze%27s_global_blacklist
[05:17:12] <MirahezeBot>	 [ Requests for Comment/Add TheTopTens to Miraheze's global blacklist - Miraheze Meta ] - meta.miraheze.org
[05:35:11] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUfrV
[05:35:12] <Not>	 [02miraheze/services] 07MirahezeSSLBot 0388cbf0f - BOT: Updating services config for wikis
[06:21:06] <MirahezeBot>	 Hello Guest60794! If you have any questions, feel free to ask and someone should answer soon.
[08:25:12] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUfMK
[08:25:13] <Not>	 [02miraheze/services] 07MirahezeSSLBot 03cdf526e - BOT: Updating services config for wikis
[08:30:24] <icinga-miraheze>	 PROBLEM - wiki.velaan.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.velaan.org' expires in 15 day(s) (Wed 09 Sep 2020 08:21:26 GMT +0000).
[08:34:47] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUfMA
[08:34:48] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 03e81f681 - Bot: Update SSL cert for wiki.velaan.org
[08:44:13] <icinga-miraheze>	 RECOVERY - wiki.velaan.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.velaan.org' will expire on Sun 22 Nov 2020 07:34:40 GMT +0000.
[09:10:17] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUfyg
[09:10:19] <Not>	 [02miraheze/services] 07MirahezeSSLBot 0312165b9 - BOT: Updating services config for wikis
[10:04:59] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.68, 22.15, 18.18
[10:08:55] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.67, 18.95, 17.90
[13:12:41] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.09, 18.79, 16.26
[13:14:40] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.15, 18.63, 16.55
[13:28:40] <Not>	 [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JUfxG
[13:28:42] <Not>	 [02miraheze/CreateWiki] 07translatewiki 03f40fb29 - Localisation updates from https://translatewiki.net.
[13:28:43] <MirahezeBot>	 [ Main page - translatewiki.net ] - translatewiki.net
[13:28:43] <Not>	 [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JUfxZ
[13:28:45] <Not>	 [02miraheze/MirahezeMagic] 07translatewiki 036d62f0f - Localisation updates from https://translatewiki.net.
[13:28:46] <MirahezeBot>	 [ Main page - translatewiki.net ] - translatewiki.net
[13:29:15] <icinga-miraheze>	 PROBLEM - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is CRITICAL: CRITICAL - NGINX Error Rate is 84%
[13:33:15] <icinga-miraheze>	 RECOVERY - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is OK: OK - NGINX Error Rate is 13%
[14:22:42] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.11, 20.18, 17.71
[14:24:40] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.92, 19.21, 17.62
[14:26:08] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[14:28:04] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 4%
[14:37:23] <Not>	 [02mw-config] 07kbos-vhs-2004 synchronize pull request 03#3208: ok - 13https://git.io/JUvPy
[14:40:04] <Not>	 [02mw-config] 07RhinosF1 edited pull request 03#3208: Add monitored by wikiapiary links for 3 sites - 13https://git.io/JUvPy
[14:50:14] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.16, 18.96, 17.75
[14:50:20] <icinga-miraheze>	 PROBLEM - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is WARNING: WARNING - NGINX Error Rate is 42%
[14:52:12] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.61, 21.16, 18.68
[14:52:17] <icinga-miraheze>	 RECOVERY - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is OK: OK - NGINX Error Rate is 19%
[14:54:10] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.36, 18.45, 17.99
[15:11:04] <Not>	 [02mw-config] 07RhinosF1 edited pull request 03#3208: Add monitored by wikiapiary links for 2 sites - 13https://git.io/JUvPy
[15:13:24] <MH-Discord>	 <Doug> > ? > https://meta.miraheze.org/wiki/Requests_for_Comment/Add_TheTopTens_to_Miraheze%27s_global_blacklist @MrJaroslavik (OFF) I have an existing requests on Stewards' noticeboard. I personally am contemplating merging Madelinefan138's comments as a reply to my SN request.
[15:13:41] <MH-Discord>	 <MrJaroslavik (OFF)> I saw
[15:13:50] <MH-Discord>	 <Doug> I don't think it needs an RfC to be honest; just an SN request, which others are welcome to contribute to.
[15:13:51] <MH-Discord>	 <MrJaroslavik (OFF)> But it's nonsense in RfC...
[15:14:21] <MH-Discord>	 <Doug> I wouldn't say it's nonsense in that it's possible as an RfC (we've had community bans as RfCs). It's not really necessary.
[15:14:34] <MH-Discord>	 <Doug> Any objection to me moving her comments to the SN thread?
[15:31:16] <Hispano76_>	 -join miraheze-feed-es
[15:31:45] * Hispano76_ huye
[15:36:27] <Hispano76_>	 hi
[15:39:03] <RhinosF1>	 Hi Hispano76_
[15:41:46] <hispano76>	 :)
[15:44:45] <RhinosF1>	 .op
[15:44:45] <MirahezeBot>	 Attempting to OP...
[15:47:20] * hispano76 wonders about the next version of MediaWiki
[15:48:04] <Zppix>	 RhinosF1: i found out which ban
[15:48:07] <Zppix>	 Ill remove it
[15:48:14] <RhinosF1>	 Zppix: ok
[15:48:31] <RhinosF1>	 Zppix: how did you confirm it?
[15:48:45] <Zppix>	 RhinosF1: i dm’d the user asking if they could provide their ip
[15:49:24] <RhinosF1>	 Zppix: fair enough
[16:04:51] <Reception123>	 !log hid an account on meta to test a possible security issue
[16:04:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:11:01] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.75, 18.76, 17.63
[16:12:59] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.69, 19.73, 18.15
[16:32:38] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.57, 19.98, 18.49
[16:36:34] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.58, 18.01, 18.18
[16:50:32] <Not>	 [02mw-config] 07Reception123 closed pull request 03#3208: Add monitored by wikiapiary links for 2 sites - 13https://git.io/JUvPy
[16:50:33] <Not>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUJTJ
[16:50:35] <Not>	 [02miraheze/mw-config] 07kbos-vhs-2004 0364744e7 - Add monitored by wikiapiary links for 2 sites (#3208) * ok i added a few wikis to wikiapiary * Update LocalSettings.php added underscore, i also added the wikis to the site. https://wikiapiary.com/wiki/Kbos_funnies https://wikiapiary.com/wiki/Ficreation
[16:50:35] <MirahezeBot>	 [ Kbos funnies - WikiApiary ] - wikiapiary.com
[16:50:36] <MirahezeBot>	 [ Ficreation - WikiApiary ] - wikiapiary.com
[17:02:16] <icinga-miraheze>	 PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 170s
[20:34:00] <icinga-miraheze>	 PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 7.92, 5.63, 2.50
[20:34:13] <icinga-miraheze>	 PROBLEM - ns1 Puppet on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[20:34:57] <icinga-miraheze>	 PROBLEM - ns1 APT on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[20:38:20] <icinga-miraheze>	 RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[20:39:01] <icinga-miraheze>	 RECOVERY - ns1 APT on ns1 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[20:43:52] <icinga-miraheze>	 PROBLEM - ns1 Current Load on ns1 is WARNING: WARNING - load average: 0.00, 0.60, 1.93
[20:45:53] <icinga-miraheze>	 RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.00, 0.27, 1.49
[21:13:20] <MirahezeBot>	 Hello Arekh! If you have any questions, feel free to ask and someone should answer soon.
[21:32:26] <SPF|Cloud>	 !log create bots account on test2 for mailbox purposes
[21:32:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:32:33] <SPF|Cloud>	 misc1*
[21:32:37] <hispano76>	 hi SPF|Cloud 
[21:32:49] <SPF|Cloud>	 (and fixed)
[21:47:39] <icinga-miraheze>	 PROBLEM - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is WARNING: WARNING - NGINX Error Rate is 41%
[21:49:35] <icinga-miraheze>	 RECOVERY - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is OK: OK - NGINX Error Rate is 15%
[22:00:49] <MirahezeBot>	 Hello Guest60794_! If you have any questions, feel free to ask and someone should answer soon.
[22:01:44] <dmehus>	 hi @Matthew
[22:05:05] <Matthew>	 Hello!
[22:06:14] <RhinosF1>	 hi
[22:06:16] <dmehus>	 Is this your first time in the #miraheze channel, or with Miraheze wikis in general?
[22:23:34] <Not>	 [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03wikiap-config [+0/-0/±2] 13https://git.io/JUJsN
[22:23:36] <Not>	 [02miraheze/mw-config] 07RhinosF1 03567ff4e - managewiki: migrate wgFooterIcons WIP, something like this will work but I am on holiday. I can finish it in 10 days or someone can add the custom option as 'text' to ManageWiki
[22:23:37] <Not>	 [02mw-config] 07RhinosF1 created branch 03wikiap-config - 13https://git.io/vbvb3
[22:23:54] <Not>	 [02mw-config] 07RhinosF1 opened pull request 03#3209: managewiki: migrate wgFooterIcons - 13https://git.io/JUJsA
[22:23:56] <Not>	 [02mw-config] 07RhinosF1 assigned pull request 03#3209: managewiki: migrate wgFooterIcons - 13https://git.io/JUJsA
[22:23:57] <Not>	 [02mw-config] 07RhinosF1 assigned pull request 03#3209: managewiki: migrate wgFooterIcons - 13https://git.io/JUJsA
[22:24:04] <RhinosF1>	 Reception123: ^
[22:24:36] <SPF|Cloud>	 !log apply sec patch (see mail) on servers with mediawiki installation in /srv/mediawiki/w
[22:24:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:25:11] <travis-ci>	 miraheze/mw-config/wikiap-config/567ff4e - RhinosF1 The build failed. https://travis-ci.org/miraheze/mw-config/builds/720813232
[22:26:05] <RhinosF1>	 yes travis-ci, i said it's messy example of what works in my head for someone to finish
[22:27:47] <dmehus>	 lol
[22:28:38] <RhinosF1>	 dmehus: remember how this was my week off
[22:29:31] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:30:06] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:31:09] <dmehus>	 @RhinosF1 ^ Are those like the load errors that we don't need to worry about so much, or is that something to look into?
[22:31:34] <dmehus>	 s/@RhinosF1/@Zppix
[22:31:34] <MirahezeBot>	 dmehus meant to say: @Zppix ^ Are those like the load errors that we don't need to worry about so much, or is that something to look into?
[22:32:54] <MH-Discord>	 <RhinosF1> @Doug: I'm on a week off. I can't even see icinga.
[22:33:23] <SPF|Cloud>	 dmehus: no, they're expected errors and you don't need to worry about them
[22:34:22] <dmehus>	 @SPF|Cloud, oh okay, thanks. No worries then. :)
[22:35:28] <SPF|Cloud>	 troubleshooting db7
[22:35:30] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures
[22:36:05] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[22:38:59] <icinga-miraheze>	 PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:39:09] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:40:26] <icinga-miraheze>	 PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:41:01] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:43:55] <SPF|Cloud>	 !log restart slave thread on db7
[22:43:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:44:59] <icinga-miraheze>	 RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures
[22:45:09] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures
[22:46:25] <icinga-miraheze>	 RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[22:46:58] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures