[00:02:00] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2965 MB (12% inode=93%);
[00:37:14] <dmehus>	 .tell RhinosF1 DM me on Discord when you get a chance tomorrow
[00:37:14] <MirahezeBot>	 dmehus: I'll pass that on when RhinosF1 is around.
[00:38:35] <dmehus>	 .seen Voidwalker
[00:38:35] <MirahezeBot>	 dmehus: I last saw Voidwalker in here 11 days, 23 hours ago, saying: No, but there is an issue with the JobQueue, since that is being slow, notifications are not being delivered on time
[00:39:19] <Voidwalker>	 heck bot, I'm right here
[00:40:03] <dmehus>	 .tell RhinosF1 ^ @ 17:38, 12 August 2020 (UTC -07:00) timestamp
[00:40:03] <MirahezeBot>	 dmehus: I'll pass that on when RhinosF1 is around.
[00:40:25] <dmehus>	 *waves at Void in the midst of his mass-blocking*
[00:40:38] <Voidwalker>	 Oh, I'm done with that now
[00:40:42] <dmehus>	 oh
[03:15:55] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2643 MB (10% inode=93%);
[03:45:12] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJ9D7
[03:45:13] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 03323f1d0 - BOT: Updating services config for wikis
[06:36:59] <RhinosF1>	 Hi
[06:37:00] <MirahezeBot>	 RhinosF1: 2020-08-13 - 01:37:14BST <dmehus> tell RhinosF1 DM me on Discord when you get a chance tomorrow
[06:37:00] <MirahezeBot>	 RhinosF1: 2020-08-13 - 01:40:03BST <dmehus> tell RhinosF1 ^ @ 17:38, 12 August 2020 (UTC -07:00) timestamp
[11:55:09] <icinga-miraheze>	 PROBLEM - ns1 Current Load on ns1 is WARNING: WARNING - load average: 1.27, 1.99, 0.99
[11:57:04] <icinga-miraheze>	 RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.09, 1.09, 0.86
[13:35:45] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is CRITICAL: DISK CRITICAL - free space: / 1398 MB (5% inode=93%);
[13:44:24] <icinga-miraheze>	 PROBLEM - puppet2 Current Load on puppet2 is WARNING: WARNING - load average: 7.67, 5.39, 4.02
[13:45:13] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJHDX
[13:45:14] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 03c9b36cc - BOT: Updating services config for wikis
[13:46:19] <icinga-miraheze>	 RECOVERY - puppet2 Current Load on puppet2 is OK: OK - load average: 1.43, 3.92, 3.65
[14:31:43] <MH-Discord>	 <MrJaroslavik> @RhinosF1 Hello, do you know what blacklist? https://discord.com/channels/407504499280707585/743072681057845378/743475340525174862
[14:31:43] <MirahezeBot>	 [ Discord ] - discord.com
[14:32:30] <MH-Discord>	 <RhinosF1> @MrJaroslavik: PM?
[14:32:43] <MH-Discord>	 <MrJaroslavik> Sure
[14:33:54] <RhinosF1>	 Done
[14:34:44] * hispano76 greetings
[14:34:57] <MH-Discord>	 <MrJaroslavik> Hello
[15:13:17] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.50, 18.52, 17.16
[15:15:11] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.86, 17.94, 17.09
[15:20:17] <icinga-miraheze>	 PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 111s
[15:22:17] <icinga-miraheze>	 RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 2s
[15:50:25] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJQ89
[15:50:27] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 036cf6830 - BOT: Updating services config for wikis
[15:56:17] <hispano76>	 hi
[15:58:28] <Reception123>	 hi hispano76 
[16:03:07] <hispano76>	 :)
[16:08:17] <icinga-miraheze>	 PROBLEM - mail1 APT on mail1 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (2 critical updates).
[16:17:25] <Reception123>	 RhinosF1: forgot to edit the topic for SRE duty :( guess it's valid again now though
[16:17:36] <RhinosF1>	 Yeah true
[16:29:37] <MirahezeBot>	 Hello NoahSmyth! If you have any questions, feel free to ask and someone should answer soon.
[16:29:40] <NoahSmyth>	 hello
[16:29:47] <RhinosF1>	 Hi
[16:30:17] <NoahSmyth>	 I was wondering how I could make columns on my main page like how you do with fandom wikis?
[16:32:30] <MirahezeBot>	 Hello Murray97! If you have any questions, feel free to ask and someone should answer soon.
[16:32:58] <hispano76>	 hi
[16:33:49] <Murray97>	 I've just made a new wiki using Miraheze, and I'm trying to get the maps extension to work. does anyone have any experience with this?
[16:35:24] <hispano76>	 NoahSmyth:  Maybe I can be useful to you  https://www.mediawiki.org/wiki/Help:Tables https://en.wikipedia.org/wiki/Help:Columns  or you can give us more information about what you want to do 
[16:35:25] <MirahezeBot>	 [ Help:Tables - MediaWiki ] - www.mediawiki.org
[16:35:25] <MirahezeBot>	 [WIKIPEDIA] Help:Columns | "..."
[16:36:34] <hispano76>	 What extension? Murray97 
[16:37:05] <Murray97>	 I'm using the maps extension maps.extension.wiki
[16:37:55] <Murray97>	 i've added a map, just as en example, but I get "loading map..."
[16:37:56] <Murray97>	 https://coastal.miraheze.org/wiki/Scottish_Shelf_Model
[16:37:57] <MirahezeBot>	 [ Permission error - National Partnership for Coastal Prediction Coastal Modelling & Applications ] - coastal.miraheze.org
[16:41:23] <hispano76>	 That extension I haven't used and the wiki being private, I can't see the code Murray97 
[16:41:55] <hispano76>	 RhinosF1: Zppix  ^
[16:43:28] <RhinosF1>	 Murray97: it loads for me in a few seconds
[16:43:38] <RhinosF1>	 Does it just stick on loading map?
[16:44:11] <NoahSmyth>	 Problem with {{col-begin}}, it shows on the wiki as *Template:Col-end*
[16:44:16] <Murray97>	 Here's my example code: {{#display_map:center=Berlin, Germany}}
[16:47:52] <RhinosF1>	 The link you gave Murray97 shows a working map for me
[16:48:49] <hispano76>	 thanks RhinosF1 
[16:49:55] <Murray97>	 OK, I  wonder if it's my local setup. My work computer is behind goodness knows how many vpn and proxy servers... I'll try on another system. OR, I wonder if someone has to approve my maps extension addtions?
[16:54:34] <Murray97>	 OK, it works on edge on the same system.. but not chrome for some reason...
[16:59:19] <MH-Discord>	 <Universal Omega> > NoahSmyth: I was wondering how I could make columns on my main page like how you do with fandom wikis? I believe Extension:DummyFandoomMainpageTags may be what your looking for. It can be enabled at Special:ManageWiki/extensions
[17:14:38] <icinga-miraheze>	 PROBLEM - puppet2 Current Load on puppet2 is WARNING: WARNING - load average: 7.24, 5.21, 3.98
[17:16:33] <icinga-miraheze>	 RECOVERY - puppet2 Current Load on puppet2 is OK: OK - load average: 1.42, 3.71, 3.58
[17:20:57] <Not-3033>	 [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JJQpJ
[17:20:59] <Not-3033>	 [02miraheze/MirahezeMagic] 07translatewiki 03f346d08 - Localisation updates from https://translatewiki.net.
[17:21:00] <Not-3033>	 [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJQpT
[17:21:02] <MirahezeBot>	 [ Main page - translatewiki.net ] - translatewiki.net
[17:21:02] <Not-3033>	 [02miraheze/CreateWiki] 07translatewiki 03bc77e40 - Localisation updates from https://translatewiki.net.
[17:21:03] <Not-3033>	 [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJQpk
[17:21:04] <MirahezeBot>	 [ Main page - translatewiki.net ] - translatewiki.net
[17:21:05] <Not-3033>	 [02miraheze/ManageWiki] 07translatewiki 036c0f387 - Localisation updates from https://translatewiki.net.
[17:21:06] <MirahezeBot>	 [ Main page - translatewiki.net ] - translatewiki.net
[18:15:16] <icinga-miraheze>	 PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 8.04, 6.72, 5.14
[18:15:18] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.28, 5.93, 5.09
[18:16:11] <icinga-miraheze>	 PROBLEM - services1 Puppet on services1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 2 minutes ago with 0 failures
[18:17:12] <icinga-miraheze>	 RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 3.21, 5.32, 4.81
[18:17:17] <icinga-miraheze>	 RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 2.58, 4.64, 4.72
[18:20:10] <icinga-miraheze>	 RECOVERY - services1 Puppet on services1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[18:24:26] <Not-3033>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JJ7ei
[18:24:28] <Not-3033>	 [02miraheze/puppet] 07paladox 032af4e81 - mediawiki: Remove unused rewrite for ^/(.+)/v1/
[18:24:29] <Not-3033>	 [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS
[18:24:31] <Not-3033>	 [02puppet] 07paladox opened pull request 03#1480: mediawiki: Remove unused rewrite for ^/(.+)/v1/ - 13https://git.io/JJ7eP
[18:25:03] <icinga-miraheze>	 PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.91, 6.47, 5.31
[18:25:13] <Not-3033>	 [02puppet] 07paladox closed pull request 03#1480: mediawiki: Remove unused rewrite for ^/(.+)/v1/ - 13https://git.io/JJ7eP
[18:25:15] <Not-3033>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJ7ey
[18:25:16] <Not-3033>	 [02miraheze/puppet] 07paladox 03c7237dd - mediawiki: Remove unused rewrite for ^/(.+)/v1/ (#1480)
[18:26:59] <icinga-miraheze>	 RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 3.96, 5.55, 5.12
[18:33:00] <Not-3033>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1
[18:33:01] <Not-3033>	 [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS
[18:39:41] <icinga-miraheze>	 PROBLEM - lodge.jsnydr.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lodge.jsnydr.com could not be found
[18:44:21] <Not-3033>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJ7vD
[18:44:22] <Not-3033>	 [02miraheze/puppet] 07paladox 032f439a5 - Allow services hosts to curl restbase-lb.miraheze.org
[18:54:39] <icinga-miraheze>	 PROBLEM - puppet2 Current Load on puppet2 is WARNING: WARNING - load average: 7.06, 5.23, 4.09
[18:56:34] <icinga-miraheze>	 RECOVERY - puppet2 Current Load on puppet2 is OK: OK - load average: 1.47, 3.81, 3.71
[18:56:49] <icinga-miraheze>	 PROBLEM - test2 Puppet on test2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 2 minutes ago with 0 failures
[19:05:02] <icinga-miraheze>	 PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.21, 5.72, 4.86
[19:05:02] <Not-3033>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJ7fy
[19:05:03] <Not-3033>	 [02miraheze/puppet] 07paladox 037ee61d5 - varnish: Remove some redirects for meta.m.miraheze.org
[19:06:58] <icinga-miraheze>	 RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 3.55, 4.81, 4.62
[19:16:04] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb
[19:16:28] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.88, 20.23, 17.79
[19:16:29] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb
[19:17:58] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[19:18:28] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[19:20:28] <Not-3033>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJ7J6
[19:20:30] <Not-3033>	 [02miraheze/puppet] 07paladox 03e712014 - Varnish: Remove temporarily blacklist of empty UA
[19:22:24] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.44, 19.22, 18.26
[19:24:28] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 9.20, 6.73, 5.17
[19:25:13] <RhinosF1>	 paladox: it can probably go forever unless it's still being abused. Reason though?
[19:26:02] <paladox>	 It can only be temporary per SPF|Cloud. If it is to be permeant you need to inform the community and also something else i forgot.
[19:26:15] <paladox>	 *permanent 
[19:26:28] <icinga-miraheze>	 RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.25, 5.74, 5.00
[19:26:58] <RhinosF1>	 paladox: I misread word order in your commit
[19:27:19] <RhinosF1>	 But yeah as long as abuse of it doesn't resume, seems fine
[19:43:19] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 8.40, 5.66, 4.96
[19:45:19] <icinga-miraheze>	 RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 4.13, 5.21, 4.90
[21:04:39] <icinga-miraheze>	 PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.42, 6.10, 4.94
[21:06:35] <icinga-miraheze>	 RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.51, 5.37, 4.80
[21:48:26] <MH-Discord>	 <noahs> Hello!
[21:49:46] <MH-Discord>	 <Lake> hello
[21:52:10] <icinga-miraheze>	 RECOVERY - lodge.jsnydr.com - reverse DNS on sslhost is OK: rDNS OK - lodge.jsnydr.com reverse DNS resolves to cp7.miraheze.org
[22:05:14] <Not-3033>	 [02miraheze/mediawiki] 07Pix1234 pushed 031 commit to 03REL1_34 [+0/-0/±3] 13https://git.io/JJ7q1
[22:05:16] <Not-3033>	 [02miraheze/mediawiki] 07Pix1234 03d3f20ff - Update CreateWiki/ManageWiki/MirahezeMagic
[22:17:39] <icinga-miraheze>	 PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:21:31] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.56, 21.03, 17.69
[22:22:58] <icinga-miraheze>	 PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:23:20] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:23:38] <icinga-miraheze>	 RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures
[22:23:39] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:24:10] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:24:11] <Zppix>	 paladox:  mw4 just refuses to pull mediawiki repo 
[22:24:20] <Zppix>	 with puppet
[22:25:06] <icinga-miraheze>	 RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[22:25:24] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.81, 24.53, 19.78
[22:26:45] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[22:27:25] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures
[22:29:12] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.67, 22.22, 20.09
[22:32:59] <paladox>	 Zppix it timed out, would have worked next round.
[22:32:59] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.67, 19.41, 19.47
[22:33:33] <Zppix>	 paladox:  this isnt the first time it hasnt i tried to manually run it too
[22:34:10] <Zppix>	 its fine now
[22:34:37] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures
[22:34:46] <Zppix>	 !log rebuildLC on jobrunner*/mw*
[22:34:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:35:39] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[22:36:10] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[22:55:53] <paladox>	 Zppix this has been well known for a long while that after a submodule bump, puppet fails. But the 2nd run should work.
[22:56:22] <Zppix>	 paladox:  yeah but i ran it after the first fail and it still failed
[22:56:40] <paladox>	 ok
[23:10:25] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJ7Yk
[23:10:26] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 03cac3874 - BOT: Updating services config for wikis
[23:25:12] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJ7YS
[23:25:13] <Not-3033>	 [02miraheze/services] 07MirahezeSSLBot 039bbc8e9 - BOT: Updating services config for wikis