[00:04:13] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[00:04:33] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3
[00:04:36] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[00:05:49] <icinga-miraheze>	 RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[00:06:00] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 77%
[00:08:40] <paladox>	 hmm
[00:09:49] <icinga-miraheze>	 PROBLEM - cp2 Puppet on cp2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 3 minutes ago with 0 failures
[00:11:32] <Not-9fc7>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjH1H
[00:11:33] <Not-9fc7>	 [02miraheze/dns] 07paladox 038e26e24 - Repool cp2 but depool cp4
[00:15:01] <paladox>	 !log add www-data to ssl-cert group on cp3
[00:15:15] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[00:17:17] <paladox>	 !log apt-get install -t stretch-backports stunnel4 - cp4
[00:17:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[00:18:08] <Not-9fc7>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjH1d
[00:18:09] <Not-9fc7>	 [02miraheze/dns] 07paladox 03655ddf4 - Repool cp4 and depool cp3
[00:30:15] <icinga-miraheze>	 PROBLEM - cp3 HTTPS on cp3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4047 bytes in 0.696 second response time
[00:40:16] <icinga-miraheze>	 RECOVERY - cp3 HTTPS on cp3 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 1496 bytes in 1.173 second response time
[00:40:33] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
[00:40:36] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[00:41:49] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[00:44:33] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3
[00:44:36] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[00:45:49] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[00:47:49] <icinga-miraheze>	 RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[00:50:33] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
[00:50:36] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[00:54:33] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3
[00:54:36] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[00:55:55] <paladox>	 !log upgraded stunnel on cp3 (a while ago)
[00:55:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[00:59:49] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[01:00:33] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
[01:00:36] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[01:04:33] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3
[01:04:36] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[01:05:49] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[01:24:15] <icinga-miraheze>	 PROBLEM - cp3 HTTPS on cp3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4049 bytes in 0.668 second response time
[01:25:49] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[01:27:12] <Not-9fc7>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjHMu
[01:27:14] <Not-9fc7>	 [02miraheze/dns] 07paladox 03f941f55 - Repool cp3
[01:28:33] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
[01:30:16] <icinga-miraheze>	 RECOVERY - cp3 HTTPS on cp3 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 1493 bytes in 1.231 second response time
[01:30:36] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[01:31:11] <icinga-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[01:34:00] <icinga-miraheze>	 RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 5%
[02:33:53] <icinga-miraheze>	 PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 20 failures. Last run 2 minutes ago with 20 failures. Failed resources (up to 3 shown)
[02:33:58] <icinga-miraheze>	 PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 219 failures. Last run 2 minutes ago with 219 failures. Failed resources (up to 3 shown)
[02:34:16] <icinga-miraheze>	 PROBLEM - lizardfs3 Puppet on lizardfs3 is CRITICAL: CRITICAL: Puppet has 13 failures. Last run 2 minutes ago with 13 failures. Failed resources (up to 3 shown)
[02:34:20] <icinga-miraheze>	 PROBLEM - db5 Puppet on db5 is CRITICAL: CRITICAL: Puppet has 14 failures. Last run 2 minutes ago with 14 failures. Failed resources (up to 3 shown)
[02:34:23] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 212 failures. Last run 2 minutes ago with 212 failures. Failed resources (up to 3 shown)
[02:34:37] <icinga-miraheze>	 PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 203 failures. Last run 2 minutes ago with 203 failures. Failed resources (up to 3 shown)
[02:34:40] <icinga-miraheze>	 PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 13 failures. Last run 3 minutes ago with 13 failures. Failed resources (up to 3 shown)
[02:34:40] <icinga-miraheze>	 PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Puppet has 33 failures. Last run 2 minutes ago with 33 failures. Failed resources (up to 3 shown)
[02:34:42] <icinga-miraheze>	 PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 53 failures. Last run 2 minutes ago with 53 failures. Failed resources (up to 3 shown)
[02:35:03] <icinga-miraheze>	 PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 215 failures. Last run 3 minutes ago with 215 failures. Failed resources (up to 3 shown)
[02:35:04] <icinga-miraheze>	 PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:35:09] <icinga-miraheze>	 PROBLEM - lizardfs2 Puppet on lizardfs2 is CRITICAL: CRITICAL: Puppet has 14 failures. Last run 3 minutes ago with 14 failures. Failed resources (up to 3 shown)
[02:35:11] <icinga-miraheze>	 PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:35:17] <icinga-miraheze>	 PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[02:35:21] <icinga-miraheze>	 PROBLEM - lizardfs1 Puppet on lizardfs1 is CRITICAL: CRITICAL: Puppet has 15 failures. Last run 3 minutes ago with 15 failures. Failed resources (up to 3 shown)
[02:35:25] <icinga-miraheze>	 PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 31 failures. Last run 3 minutes ago with 31 failures. Failed resources (up to 3 shown)
[02:35:27] <icinga-miraheze>	 PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Puppet has 16 failures. Last run 3 minutes ago with 16 failures. Failed resources (up to 3 shown)
[02:35:34] <icinga-miraheze>	 PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 160 failures. Last run 3 minutes ago with 160 failures. Failed resources (up to 3 shown): File[authority certificates],File[/etc/apt/apt.conf.d/50unattended-upgrades],File[/etc/apt/apt.conf.d/20auto-upgrades],File[/root/ufw-fix]
[02:35:50] <icinga-miraheze>	 PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 202 failures. Last run 3 minutes ago with 202 failures. Failed resources (up to 3 shown): File[/etc/rsyslog.conf],File[authority certificates],File[/etc/apt/apt.conf.d/50unattended-upgrades],File[/etc/apt/apt.conf.d/20auto-upgrades]
[02:42:40] <icinga-miraheze>	 RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures
[02:43:02] <icinga-miraheze>	 RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures
[02:43:08] <icinga-miraheze>	 RECOVERY - lizardfs2 Puppet on lizardfs2 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures
[02:43:19] <icinga-miraheze>	 RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures
[02:43:20] <icinga-miraheze>	 RECOVERY - lizardfs1 Puppet on lizardfs1 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures
[02:43:25] <icinga-miraheze>	 RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures
[02:43:27] <icinga-miraheze>	 RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures
[02:43:49] <icinga-miraheze>	 RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures
[02:43:53] <icinga-miraheze>	 RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:44:16] <icinga-miraheze>	 RECOVERY - lizardfs3 Puppet on lizardfs3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:44:20] <icinga-miraheze>	 RECOVERY - db5 Puppet on db5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:44:28] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures
[02:44:36] <icinga-miraheze>	 RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:44:40] <icinga-miraheze>	 RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:44:41] <icinga-miraheze>	 RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:45:05] <icinga-miraheze>	 RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:45:11] <icinga-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:45:39] <icinga-miraheze>	 RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures
[02:45:49] <icinga-miraheze>	 RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:32:08] <icinga-miraheze>	 PROBLEM - pc-architect.tk - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[06:27:11] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3016 MB (12% inode=94%);
[06:37:38] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.95, 6.16, 4.78
[06:39:38] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.06, 5.91, 4.86
[09:19:38] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.89, 6.29, 5.06
[09:21:38] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.04, 5.79, 5.02
[10:16:27] <Not-9fc7>	 [02miraheze/IncidentReporting] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjH71
[10:16:28] <Not-9fc7>	 [02miraheze/IncidentReporting] 07translatewiki 03e1c2d38 - Localisation updates from https://translatewiki.net.
[10:16:30] <Not-9fc7>	 [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fjH7M
[10:16:31] <Not-9fc7>	 [02miraheze/ManageWiki] 07translatewiki 03c189a07 - Localisation updates from https://translatewiki.net.
[10:20:30] <travis-ci>	 miraheze/IncidentReporting/master/e1c2d38 - translatewiki.net The build is still failing. https://travis-ci.org/miraheze/IncidentReporting/builds/567813504
[10:32:21] <icinga-miraheze>	 PROBLEM - knuxwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[10:34:18] <icinga-miraheze>	 RECOVERY - knuxwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'knuxwiki.com' will expire on Fri 12 Jun 2020 11:59:59 PM GMT +0000.
[15:03:11] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2649 MB (10% inode=94%);
[15:12:36] <icinga-miraheze>	 PROBLEM - cp4 Puppet on cp4 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures
[15:13:11] <icinga-miraheze>	 PROBLEM - test1 Puppet on test1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 6 minutes ago with 0 failures
[16:05:11] <icinga-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures
[16:08:15] <paladox>	 !log hacked stunnel config on puppet1 again
[16:08:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[16:18:36] <icinga-miraheze>	 RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[16:20:13] <Not-9fc7>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjHpo
[16:20:15] <Not-9fc7>	 [02miraheze/services] 07MirahezeSSLBot 035c9b277 - BOT: Updating services config for wikis
[16:23:49] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[16:24:33] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3
[16:24:36] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb
[16:26:00] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 61%
[16:26:03] <paladox>	 huh
[16:26:54] <paladox>	 fixed
[16:27:49] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[16:28:00] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 48%
[16:28:33] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy
[16:28:36] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[16:30:00] <icinga-miraheze>	 RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 2%
[17:15:21] <Reception123>	 paladox: what was it?
[17:15:53] <paladox>	 Was a configuation change (cp3 needs to have a PTR, but dosen't so i changed verify = back to 2 from 3)
[17:21:20] <Reception123>	 paladox: what is a PTR? ;)
[17:21:47] <paladox>	 Reception123 https://en.wikipedia.org/wiki/List_of_DNS_record_types#PTR
[17:21:47] <ZppixBot>	 [WIKIPEDIA] List of DNS record types#PTR | "This list of DNS record types is an overview of resource records (RRs) permissible in zone files of the Domain Name System (DNS). It also contains pseudo-RRs...."
[17:22:18] <Reception123>	 Oh ok
[18:11:59] <AmandaCath>	 Hello
[18:14:45] <paladox>	 hi
[18:20:59] * AmandaCath scrolls through Phab and notices the intense backlog of import requests
[18:21:17] <AmandaCath>	 paladox: any chance you can make a dent on it?
[18:22:10] <paladox>	 ok
[18:27:38] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.16, 6.85, 5.68
[18:28:36] <RhinosF1>	 AmandaCath: backlog was due to Reception being away for a few days and storage issues
[18:28:42] <RhinosF1>	 and she keaves
[18:28:50] <RhinosF1>	 s/ke/le
[18:28:50] <ZppixBot>	 RhinosF1 meant to say: and she leaves
[18:29:28] <RhinosF1>	 AmandaCath: backlog was due to reception being away for a few days and storage issues
[18:29:42] <RhinosF1>	 i was going to give Reception a poke when they were back
[18:29:56] <AmandaCath>	 Ok
[18:30:29] <Reception123>	 Won't be able to take care of it until Thursday 
[18:30:40] <Reception123>	 paladox: ^ maybe you can?
[18:31:09] <paladox>	 ok, i can.
[18:37:38] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.73, 6.57, 6.20
[18:41:13] <Reception123>	 paladox: thanks :)
[18:41:29] <Reception123>	 We don't want there to be a large backlog 
[18:41:43] <Reception123>	 And now of course disk space is not an issue anymore 
[18:43:03] <paladox>	 !log starting import for trollpastawikiwiki - T4215
[18:43:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[18:43:55] <RhinosF1>	 Paladox: can I get a PM?
[18:44:24] <paladox>	 sure
[18:45:12] <RhinosF1>	 Paladox: see pms
[18:45:48] <paladox>	 yup, replied
[18:55:56] <Not-9fc7>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQeR
[18:55:58] <Not-9fc7>	 [02miraheze/mw-config] 07paladox 03daada4f - Compress incubatorwiki
[18:58:29] <paladox>	 !log starting import for incubatorwiki - T4517
[18:58:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[18:59:45] <Not-9fc7>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQeg
[18:59:46] <Not-9fc7>	 [02miraheze/mw-config] 07paladox 03d304480 - Compress evilbabeswiki
[19:01:53] <paladox>	 !log starting import for evilbabeswiki - T4571
[19:01:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[19:04:21] <icinga-miraheze>	 PROBLEM - db4 Disk Space on db4 is WARNING: DISK WARNING - free space: / 27549 MB (7% inode=96%);
[19:41:53] <Hispano76>	 hii
[19:42:21] <paladox>	 hi
[19:52:26] <RhinosF1>	 Paladox, JohnLewis: found a task describing the issue last time but no fix on :( looks like IRC cloud has glitched and deleted the log as we
[19:52:28] <RhinosF1>	 We
[19:52:31] <RhinosF1>	 Well
[20:07:46] <JohnLewis>	 I saw on phab
[20:10:30] <RhinosF1>	 JohnLewis: okay, I'm trying to see if bawolff has his copy of the logs still from our conversation with a fix on but i can't find him (he's also left the WMF)
[20:39:06] <RhinosF1>	 JohnLewis: okay, I have no record of the fix
[20:46:59] <Albionic>	 hi i'm new to using miraheze/mediawiki and i was wondering if anyone could help me w infoboxes? :)
[20:47:58] <RhinosF1>	 Albionic: what about them?
[20:48:17] <Albionic>	 how to get them to work lol
[20:49:05] <RhinosF1>	 Albionic: have u got an infobox on your wiki thats broke?
[20:49:14] <Albionic>	 i feel like every help thing i look through i must be missing something bc i'm able to put information into it in edit source but then when i load my page i get "Template:Infobox country"
[20:49:35] <Albionic>	 n it's making me feel proper thick
[20:49:48] <RhinosF1>	 Albionic: on what page
[20:49:58] <RhinosF1>	 infoboxes are complicated things
[20:50:05] <Albionic>	 the page i'm trying to put it on
[20:50:09] <Albionic>	 yea i realised that lol
[20:51:06] <RhinosF1>	 Albionic: what page is that save it broke and i'll have a look
[20:53:16] <Albionic>	 https://commonwealth.miraheze.org/wiki/England
[20:53:17] <ZppixBot>	 [ England - Commonwealth of England ] - commonwealth.miraheze.org
[20:54:11] <Albionic>	 now it's just not loading at all
[20:54:39] <RhinosF1>	 Albionic: can u give me import rights?
[20:56:09] <Albionic>	 done i think
[20:56:27] <RhinosF1>	 Albionic: I think it needs the Albonic or sysop group
[20:56:34] <Albionic>	 o chill hold on
[20:57:04] <Albionic>	 ignore the whole narcissism thing w my role lol
[20:57:12] <Albionic>	 given sysop
[20:57:24] <RhinosF1>	 Albionic: thanks, will import the right stuff when enwiki loads
[20:57:35] <Albionic>	 noice ty
[20:59:06] <RhinosF1>	 Albionic: in progress
[21:01:27] <RhinosF1>	 paladox: Error 503 Backend fetch failed, forwarded for 2a00:23c4:9e1e:e900:1dfb:4b05:4d6d:e60d, 127.0.0.1 
[21:01:27] <RhinosF1>	 (Varnish XID 44402916) via cp4 at Mon, 05 Aug 2019 21:00:58 GMT. 
[21:01:35] <paladox>	 hmm
[21:01:37] <paladox>	 me checks
[21:01:45] <paladox>	 works for me
[21:01:48] <RhinosF1>	 paladox: did I break it importing the infobox stuff
[21:01:55] <paladox>	 oh
[21:01:56] <paladox>	 yes
[21:01:59] <RhinosF1>	 on commonwealth wiki
[21:02:01] <paladox>	 you probably hit the timeout
[21:02:14] <RhinosF1>	 paladox: will pm you the file if you could do it for Albionic 
[21:06:28] <Albionic>	 sorry i got called away did you need me to do anything?
[21:06:37] <RhinosF1>	 Albionic: no, we're working on it - sorry I've stuck a load of errors on the page - it will be fixed
[21:06:44] <Albionic>	 ah no worries
[21:07:00] <Albionic>	 i gave paladox sysop as well in case they needed it
[21:07:07] <Not-9fc7>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQJr
[21:07:08] <Not-9fc7>	 [02miraheze/mw-config] 07paladox 03a2b42c2 - Compress commonwealthwiki
[21:08:25] <RhinosF1>	 Albionic: please don't edit any templates to try and fix the issues. This may cause more of a delay
[21:08:46] <Albionic>	 i'm not dw i exited the editor
[21:09:14] <RhinosF1>	 Albionic: okay, hopefully paladox won't take long and then i'll double check everything
[21:09:27] <paladox>	 !log starting import for commonwealthwiki
[21:09:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[21:09:41] <Albionic>	 thank you so much for all this help btw am honestly hopeless sometimes
[21:13:11] <RhinosF1>	 Albionic: infoboxes just require way too modules and templates to make them work - it's not you
[21:25:40] <Albionic>	 ah righto
[21:26:04] <Hispano76>	 paladox, :)
[21:26:38] <RhinosF1>	 Hispano76: hey
[21:28:21] <Hispano76>	 hi RhinosF1 :D
[21:28:30] <RhinosF1>	 Hispano76: whats up
[21:40:25] <Hispano76>	 Nothing. I just say hi. ;) RhinosF1 
[21:41:01] <RhinosF1>	 Hispano76: cool
[21:57:09] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.76, 1.63, 1.35
[21:59:05] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.69, 2.01, 1.52
[22:03:42] <Albionic>	 how are things going? i'd ask if you needed me to do anything but there's probably nothing i can do haha
[22:04:32] <paladox>	 Albionic it may be a while (due to the size of the file)
[22:05:14] <Albionic>	 paladox no worries dude
[22:07:48] <paladox>	 :)
[22:08:28] <RhinosF1>	 paladox: if you've got a free moment - https://phabricator.miraheze.org/T4614
[22:08:29] <ZppixBot>	 [ ⚓ T4614 Google Maps API ] - phabricator.miraheze.org
[22:11:03] <paladox>	 I won't be able to do that today
[22:11:28] <RhinosF1>	 paladox: okay
[22:21:47] <ZppixBot>	 Hello lcpsseac! If you have any questions feel free to ask and someone should answer soon.
[22:22:33] <lcpsseac>	 If we have a Wiki that's been created and being used, and we'd like to rename the Wiki, is that something that the admins can do? How big a deal is it? Thank you.
[22:24:59] <paladox>	 Hi, yes we can rename wikis, if you follow a request like https://phabricator.miraheze.org/T4606
[22:25:00] <ZppixBot>	 [ ⚓ T4606 Database name and URL change (UcroniasWiki --> ucroniasantiguowiki) ] - phabricator.miraheze.org
[22:26:18] <lcpsseac>	 I'll do that when it's time. Thank you for the help.
[22:26:46] <paladox>	 your welcome :)
[22:47:15] <Hispano76>	 ucroniaswiki :D
[23:07:21] <paladox>	 !log reset puppet repo on puppet1 (removing hacks for stunnel)
[23:07:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[23:26:14] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.76, 0.81, 1.96
[23:30:14] <icinga-miraheze>	 RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.41, 0.52, 1.57
[23:52:46] <Not-9fc7>	 [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://git.io/vbiAS
[23:52:47] <Not-9fc7>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://git.io/fjQTj
[23:52:49] <Not-9fc7>	 [02miraheze/puppet] 07paladox 03a9561e5 - Add stunnel http port monitoring
[23:52:50] <Not-9fc7>	 [02puppet] 07paladox opened pull request 03#1065: Add stunnel http port monitoring - 13https://git.io/fjQke
[23:56:28] <Not-9fc7>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://git.io/fjQkI
[23:56:30] <Not-9fc7>	 [02miraheze/puppet] 07paladox 03ffc6388 - Update init.pp
[23:56:31] <Not-9fc7>	 [02puppet] 07paladox synchronize pull request 03#1065: Add stunnel http port monitoring - 13https://git.io/fjQke
[23:57:01] <Not-9fc7>	 [02puppet] 07paladox closed pull request 03#1065: Add stunnel http port monitoring - 13https://git.io/fjQke
[23:57:02] <Not-9fc7>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fjQkq
[23:57:04] <Not-9fc7>	 [02miraheze/puppet] 07paladox 03937e365 - Add stunnel http port monitoring (#1065) * Add stunnel http port monitoring * Update init.pp
[23:57:05] <Not-9fc7>	 [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://git.io/vbiAS
[23:57:07] <Not-9fc7>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5