[00:02:11] <icinga-miraheze>	 RECOVERY - cp8 Disk Space on cp8 is OK: DISK OK - free space: / 3752 MB (19% inode=93%);
[00:02:55] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 25.58, 22.40, 15.58
[00:04:54] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.07, 20.42, 15.71
[00:06:52] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.84, 20.33, 16.29
[00:11:07] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.01, 20.82, 17.47
[00:13:03] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.95, 19.66, 17.50
[01:22:45] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.47, 19.89, 17.06
[01:24:44] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.18, 17.00, 16.35
[02:35:05] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is CRITICAL: CRITICAL - load average: 2.04, 1.62, 1.20
[02:37:03] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 1.22, 1.43, 1.18
[04:06:50] <icinga-miraheze>	 PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[04:25:16] <icinga-miraheze>	 RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:36:32] <icinga-miraheze>	 PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[05:52:56] <icinga-miraheze>	 RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[09:59:15] <Not-1447>	 [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JfyWT
[09:59:17] <Not-1447>	 [02miraheze/mediawiki] 07Reception123 031a34355 - Update Citizen
[10:06:00] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 4.87, 4.00, 2.99
[10:08:09] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 3.64, 3.68, 3.00
[10:10:14] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[10:10:14] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[10:10:14] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 3.59, 4.41, 3.41
[10:10:48] <RhinosF1>	 icinga-miraheze: tell puppet to work then
[10:11:00] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[10:11:05] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[10:12:20] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 1.60, 3.44, 3.18
[10:13:12] <RhinosF1>	 hi JohnLewis 
[10:14:16] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[10:14:22] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.37, 2.84, 3.00
[10:16:14] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures
[10:16:56] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[10:17:02] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[11:22:44] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 2.70, 4.53, 3.28
[11:24:45] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 2.70, 3.79, 3.15
[11:28:50] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.73, 3.10, 3.03
[11:43:06] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 2.43, 3.56, 3.20
[11:45:06] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.52, 3.29, 3.15
[12:01:40] <RhinosF1>	 .mh SAL
[12:01:41] <ZppixBot>	 https://meta.miraheze.org/wiki/SAL
[12:22:51] <Not-1447>	 [02miraheze/ManageWiki] 07JohnFLewis pushed 032 commits to 03master [+0/-0/±3] 13https://git.io/JfyuI
[12:22:53] <Not-1447>	 [02miraheze/ManageWiki] 07JohnFLewis 03c639760 - Ternary operator for property variable access
[12:22:54] <Not-1447>	 [02miraheze/ManageWiki] 07JohnFLewis 037bb1a83 - Merge remote-tracking branch 'origin/master'
[12:25:58] <Not-1447>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JfyuZ
[12:25:59] <Not-1447>	 [02miraheze/mediawiki] 07paladox 030eec641 - Update Cargo
[12:26:21] <Not-1447>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/Jfyun
[12:26:23] <Not-1447>	 [02miraheze/mediawiki] 07paladox 0309f9b07 - Update ManageWiki
[12:37:46] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb, 51.161.32.127/cpweb, 2607:5300:205:200::17f6/cpweb
[12:37:53] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 44%
[12:38:02] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb, 51.161.32.127/cpweb, 2607:5300:205:200::17f6/cpweb
[12:39:43] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[12:39:51] <icinga-miraheze>	 RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 5%
[12:40:00] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[12:40:18] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[12:40:20] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[12:41:05] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[12:42:17] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures
[12:42:18] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures
[12:43:04] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures
[12:49:19] <icinga-miraheze>	 PROBLEM - ping4 on dbt1 is CRITICAL: CRITICAL - Host Unreachable (51.77.109.151)
[12:49:27] <icinga-miraheze>	 PROBLEM - cp8 Varnish Backends on cp8 is CRITICAL: 4 backends are down. mw4 mw5 mw6 mw7
[12:50:00] <icinga-miraheze>	 PROBLEM - dbt1 Current Load on dbt1 is CRITICAL: connect to address 51.77.109.151 port 5666: No route to hostconnect to host 51.77.109.151 port 5666: No route to host
[12:50:06] <icinga-miraheze>	 PROBLEM - cp7 Varnish Backends on cp7 is CRITICAL: 4 backends are down. mw4 mw5 mw6 mw7
[12:50:12] <icinga-miraheze>	 PROBLEM - dbt1 APT on dbt1 is CRITICAL: connect to address 51.77.109.151 port 5666: No route to hostconnect to host 51.77.109.151 port 5666: No route to host
[12:50:18] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb, 51.161.32.127/cpweb, 2607:5300:205:200::17f6/cpweb
[12:50:27] <icinga-miraheze>	 PROBLEM - dbt1 Puppet on dbt1 is CRITICAL: connect to address 51.77.109.151 port 5666: No route to hostconnect to host 51.77.109.151 port 5666: No route to host
[12:50:30] <icinga-miraheze>	 PROBLEM - Host dbt1 is DOWN: CRITICAL - Host Unreachable (51.77.109.151)
[12:50:33] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 54%
[12:50:44] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb, 51.161.32.127/cpweb, 2607:5300:205:200::17f6/cpweb
[12:50:53] <icinga-miraheze>	 PROBLEM - cp6 Varnish Backends on cp6 is CRITICAL: 4 backends are down. mw4 mw5 mw6 mw7
[12:50:59] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 83%
[12:51:22] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 45%
[12:51:27] <icinga-miraheze>	 PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 4 backends are down. mw4 mw5 mw6 mw7
[12:52:23] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases dbt1 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[12:52:44] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[12:52:53] <Not-1447>	 [02mw-config] 07Amanda-Catherine opened pull request 03#3100: Fix T5708 - 13https://git.io/JfyzZ
[12:53:35] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 74%
[12:55:26] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 59%
[12:57:58] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 51%
[13:00:04] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 63%
[13:01:16] <icinga-miraheze>	 RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 35%
[13:01:51] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[13:01:54] <paladox>	 !log soft reboot dbt1 - kernel panic
[13:02:18] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 57%
[13:02:19] <Reception123>	 paladox: let's hope that works
[13:02:25] <paladox>	 yup
[13:04:39] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 78%
[13:06:09] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 67%
[13:06:27] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 40%
[13:09:07] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 67%
[13:11:16] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 50%
[13:16:17] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 65%
[13:17:28] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 57%
[13:19:24] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 50%
[13:19:50] <Not-1447>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfyg8
[13:19:51] <Not-1447>	 [02miraheze/dns] 07paladox 0396d2235 - Add dbt2 to dns
[13:20:00] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 64%
[13:22:02] <icinga-miraheze>	 RECOVERY - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is OK: OK - NGINX Error Rate is 39%
[13:22:44] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 53%
[13:23:59] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 58%
[13:24:24] <Not-1447>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfyg2
[13:24:25] <Not-1447>	 [02miraheze/dns] 07paladox 0373e6bd5 - dbt2 -> db8 also add ipv6 address
[13:25:31] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 64%
[13:28:56] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 61%
[13:31:06] <Not-1447>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfygD
[13:31:07] <Not-1447>	 [02miraheze/dns] 07paladox 03d6ecce1 - db8 update ips
[13:31:33] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 46%
[13:31:50] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 46%
[13:33:07] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 48%
[13:35:48] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 72%
[13:36:29] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 79%
[13:38:26] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 54%
[13:39:06] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 49%
[13:39:21] <icinga-miraheze>	 RECOVERY - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is OK: OK - NGINX Error Rate is 23%
[13:41:02] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 76%
[13:43:24] <icinga-miraheze>	 PROBLEM - db8 Puppet on db8 is UNKNOWN: UNKNOWN: Failed to check. Reason is: no_summary_file
[13:44:32] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 66%
[13:45:46] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 61%
[13:45:59] <icinga-miraheze>	 PROBLEM - db8 Puppet on db8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): User[johnflewis]
[13:49:09] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 46%
[13:51:15] <icinga-miraheze>	 RECOVERY - db8 Puppet on db8 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures
[13:52:10] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 44%
[13:53:03] <Not-1447>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+1/-0/±0] 13https://git.io/Jfy26
[13:53:05] <Not-1447>	 [02miraheze/puppet] 07paladox 033ee7298 - Add mariadb to db8
[13:53:06] <Not-1447>	 [02puppet] 07paladox created branch 03paladox-patch-6 - 13https://git.io/vbiAS
[13:53:08] <Not-1447>	 [02puppet] 07paladox opened pull request 03#1400: Add mariadb to db8 - 13https://git.io/Jfy2i
[13:53:37] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 43%
[13:54:28] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 62%
[13:54:51] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 69%
[13:56:40] <Not-1447>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+0/-0/±1] 13https://git.io/Jfy25
[13:56:41] <Not-1447>	 [02miraheze/puppet] 07paladox 03bcf97bd - Update site.pp
[13:56:49] <Not-1447>	 [02puppet] 07paladox synchronize pull request 03#1400: Add mariadb to db8 - 13https://git.io/Jfy2i
[13:56:51] <Not-1447>	 [02miraheze/puppet] 07paladox pushed 033 commits to 03master [+2/-0/±2] 13https://git.io/Jfy2F
[13:56:52] <Not-1447>	 [02miraheze/puppet] 07paladox 03d5b6e6c - Merge pull request #1400 from miraheze/paladox-patch-6 Add mariadb to db8
[13:56:54] <Not-1447>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-6
[13:56:56] <Not-1447>	 [02puppet] 07paladox closed pull request 03#1400: Add mariadb to db8 - 13https://git.io/Jfy2i
[13:56:58] <Not-1447>	 [02puppet] 07paladox deleted branch 03paladox-patch-6 - 13https://git.io/vbiAS
[13:59:41] <Not-1447>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+0/-0/±1] 13https://git.io/JfyaU
[13:59:42] <Not-1447>	 [02miraheze/puppet] 07paladox 03014d584 - db8: Increase innodb_buffer_pool_instances to 3
[13:59:44] <Not-1447>	 [02puppet] 07paladox created branch 03paladox-patch-6 - 13https://git.io/vbiAS
[13:59:45] <Not-1447>	 [02puppet] 07paladox opened pull request 03#1401: db8: Increase innodb_buffer_pool_instances to 3 - 13https://git.io/JfyaT
[14:00:03] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 46%
[14:02:24] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[14:03:01] <icinga-miraheze>	 PROBLEM - db8 Puppet on db8 is CRITICAL: connect to address 51.75.168.251 port 5666: Connection refusedconnect to host 51.75.168.251 port 5666: Connection refused
[14:03:20] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[14:04:00] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is WARNING: WARNING - NGINX Error Rate is 57%
[14:05:34] <icinga-miraheze>	 PROBLEM - db8 MySQL on db8 is CRITICAL: Can't connect to MySQL server on '51.75.168.251' (115)
[14:06:46] <icinga-miraheze>	 PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 81%
[14:06:50] <icinga-miraheze>	 PROBLEM - db8 Current Load on db8 is CRITICAL: connect to address 51.75.168.251 port 5666: Connection refusedconnect to host 51.75.168.251 port 5666: Connection refused
[14:07:43] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 50%
[14:07:56] <icinga-miraheze>	 PROBLEM - db8 Disk Space on db8 is CRITICAL: connect to address 51.75.168.251 port 5666: Connection refusedconnect to host 51.75.168.251 port 5666: Connection refused
[14:08:21] <icinga-miraheze>	 PROBLEM - db8 APT on db8 is CRITICAL: connect to address 51.75.168.251 port 5666: Connection refusedconnect to host 51.75.168.251 port 5666: Connection refused
[14:08:39] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 59%
[14:09:34] <icinga-miraheze>	 PROBLEM - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is WARNING: WARNING - NGINX Error Rate is 41%
[14:11:14] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[14:12:15] <icinga-miraheze>	 PROBLEM - mw7 MediaWiki Rendering on mw7 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4348 bytes in 0.017 second response time
[14:12:54] * hispano76 greetings
[14:13:05] <Texas>	 !status
[14:13:07] <SigmaBot>	 Miraheze Service Status:
[14:13:08] <SigmaBot>	 https://meta.miraheze.org is 04DOWN04
[14:13:09] <SigmaBot>	 https://icinga.miraheze.org is 04DOWN04
[14:13:11] <SigmaBot>	 https://phabricator.miraheze.org is 03UP03
[14:13:13] <SigmaBot>	 https://grafana.miraheze.org is 03UP03
[14:13:14] <icinga-miraheze>	 PROBLEM - test2 MediaWiki Rendering on test2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4348 bytes in 0.031 second response time
[14:13:14] <icinga-miraheze>	 PROBLEM - jobrunner1 MediaWiki Rendering on jobrunner1 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4348 bytes in 0.032 second response time
[14:13:15] <icinga-miraheze>	 PROBLEM - mw4 MediaWiki Rendering on mw4 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4348 bytes in 0.027 second response time
[14:13:15] <SigmaBot>	 https://publictestwiki.com is 04DOWN04
[14:13:15] <icinga-miraheze>	 PROBLEM - mw6 MediaWiki Rendering on mw6 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4348 bytes in 0.017 second response time
[14:13:17] <SigmaBot>	 https://miraheze.org is 04DOWN04
[14:13:19] <SigmaBot>	 Texas: Status report finished. There are currently 4 dead services and 2 alive services.
[14:13:22] <Texas>	 :(
[14:13:52] <icinga-miraheze>	 PROBLEM - mw5 MediaWiki Rendering on mw5 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4348 bytes in 0.037 second response time
[14:13:55] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 57%
[14:15:24] <Voidwalker>	 why does the landing page go down with everything else?
[14:15:46] <Texas>	 no idea
[14:17:24] <SPF|Cloud>	 because varnish depools servers (landing page and wikis are on the same servers), not services
[14:17:30] <Texas>	 oh
[14:17:42] <Texas>	 SPF|Cloud: Is this simply an outage with OVH?
[14:18:03] <SPF|Cloud>	 issue with the host dbt1 is hosted on
[14:18:22] <icinga-miraheze>	 RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 26%
[14:18:26] <SPF|Cloud>	 I have been told they're working on it, so
[14:18:32] <icinga-miraheze>	 PROBLEM - db8 Puppet on db8 is UNKNOWN: UNKNOWN: Failed to check. Reason is: no_summary_file
[14:18:34] <icinga-miraheze>	 RECOVERY - db8 Disk Space on db8 is OK: DISK OK - free space: / 94641 MB (97% inode=98%);
[14:18:57] <icinga-miraheze>	 RECOVERY - db8 APT on db8 is OK: APT OK: 3 packages available for upgrade (0 critical updates).
[14:20:07] <icinga-miraheze>	 RECOVERY - db8 Current Load on db8 is OK: OK - load average: 0.95, 0.61, 0.27
[14:21:37] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 63%
[14:24:15] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 55%
[14:24:28] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 51%
[14:26:51] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 61%
[14:27:06] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 63%
[14:28:59] <Not-1447>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JfyVs
[14:29:00] <Not-1447>	 [02miraheze/mw-config] 07paladox 036a479d8 - dbt1 -> db8
[14:29:14] <Not-1447>	 [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3
[14:29:16] <Not-1447>	 [02mw-config] 07paladox opened pull request 03#3101: dbt1 -> db8 - 13https://git.io/JfyVZ
[14:29:28] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 49%
[14:29:48] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 53%
[14:30:47] <travis-ci>	 miraheze/mw-config/paladox-patch-2/6a479d8 - paladox The build passed. https://travis-ci.org/miraheze/mw-config/builds/696488909
[14:32:03] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 77%
[14:34:37] <icinga-miraheze>	 RECOVERY - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is OK: OK - NGINX Error Rate is 36%
[14:40:27] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 80%
[14:43:07] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 42%
[14:48:21] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 65%
[14:49:29] <icinga-miraheze>	 PROBLEM - db8 Puppet on db8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 seconds ago with 1 failures. Failed resources (up to 3 shown): File[/etc/ssl/private]
[14:50:38] <icinga-miraheze>	 RECOVERY - db8 MySQL on db8 is OK: Uptime: 514 Threads: 10 Questions: 303 Slow queries: 4 Opens: 34 Flush tables: 1 Open tables: 28 Queries per second avg: 0.589
[14:52:06] <icinga-miraheze>	 RECOVERY - db8 Puppet on db8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[14:52:34] <Not-1447>	 [02miraheze/mw-config] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfywD
[14:52:36] <Not-1447>	 [02miraheze/mw-config] 07Southparkfan 037a80def - dbt1 -> db8
[14:54:49] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is CRITICAL: CRITICAL - NGINX Error Rate is 66%
[14:56:20] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 59%
[14:56:22] <icinga-miraheze>	 PROBLEM - db8 MySQL on db8 is CRITICAL: Can't connect to MySQL server on '51.75.168.251' (115)
[14:58:54] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 63%
[14:59:06] <Not-1447>	 [02miraheze/mw-config] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfywx
[14:59:07] <Not-1447>	 [02miraheze/mw-config] 07Southparkfan 033bc374d - Revert "dbt1 -> db8" This reverts commit 7a80def22c2a8fd99e36fe619484d395c6b01052.
[14:59:56] <icinga-miraheze>	 PROBLEM - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is WARNING: WARNING - NGINX Error Rate is 53%
[15:01:36] <icinga-miraheze>	 RECOVERY - db8 MySQL on db8 is OK: Uptime: 522 Threads: 9 Questions: 1252 Slow queries: 3 Opens: 58 Flush tables: 1 Open tables: 52 Queries per second avg: 2.398
[15:01:37] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 59%
[15:02:33] <Not-1447>	 [02miraheze/mw-config] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfyrT
[15:02:34] <Not-1447>	 [02miraheze/mw-config] 07Southparkfan 034242ce3 - Revert "Revert "dbt1 -> db8"" This reverts commit 3bc374d10e34f671dcc0d65c9e945ee09ff0e700.
[15:04:25] <icinga-miraheze>	 PROBLEM - cp6 HTTPS on cp6 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 4275 bytes in 0.009 second response time
[15:04:26] <icinga-miraheze>	 PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 63%
[15:04:46] <icinga-miraheze>	 RECOVERY - jobrunner1 MediaWiki Rendering on jobrunner1 is OK: HTTP OK: HTTP/1.1 200 OK - 18365 bytes in 4.346 second response time
[15:04:55] <icinga-miraheze>	 RECOVERY - test2 MediaWiki Rendering on test2 is OK: HTTP OK: HTTP/1.1 200 OK - 18373 bytes in 0.032 second response time
[15:04:57] <icinga-miraheze>	 RECOVERY - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is OK: OK - NGINX Error Rate is 11%
[15:04:57] <icinga-miraheze>	 RECOVERY - mw7 MediaWiki Rendering on mw7 is OK: HTTP OK: HTTP/1.1 200 OK - 18374 bytes in 0.048 second response time
[15:05:09] <icinga-miraheze>	 RECOVERY - cp8 HTTP 4xx/5xx ERROR Rate on cp8 is OK: OK - NGINX Error Rate is 1%
[15:05:14] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[15:05:46] <icinga-miraheze>	 RECOVERY - mw4 MediaWiki Rendering on mw4 is OK: HTTP OK: HTTP/1.1 200 OK - 18374 bytes in 0.035 second response time
[15:05:48] <icinga-miraheze>	 RECOVERY - cp8 Varnish Backends on cp8 is OK: All 7 backends are healthy
[15:06:10] <icinga-miraheze>	 RECOVERY - mw6 MediaWiki Rendering on mw6 is OK: HTTP OK: HTTP/1.1 200 OK - 18374 bytes in 0.032 second response time
[15:06:27] <icinga-miraheze>	 RECOVERY - mw5 MediaWiki Rendering on mw5 is OK: HTTP OK: HTTP/1.1 200 OK - 18375 bytes in 0.032 second response time
[15:06:43] <icinga-miraheze>	 RECOVERY - cp6 Varnish Backends on cp6 is OK: All 7 backends are healthy
[15:07:07] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[15:07:14] <icinga-miraheze>	 RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 5%
[15:07:15] <icinga-miraheze>	 RECOVERY - cp6 HTTPS on cp6 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 1694 bytes in 0.013 second response time
[15:07:17] <icinga-miraheze>	 RECOVERY - cp3 Varnish Backends on cp3 is OK: All 7 backends are healthy
[15:07:34] <icinga-miraheze>	 RECOVERY - cp7 Varnish Backends on cp7 is OK: All 7 backends are healthy
[15:10:16] <Not-1447>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfyr4
[15:10:18] <Not-1447>	 [02miraheze/puppet] 07Southparkfan 03bf1ff44 - mariadb: fix install order
[15:10:54] <Not-1447>	 [02mw-config] 07paladox closed pull request 03#3101: dbt1 -> db8 - 13https://git.io/JfyVZ
[15:10:56] <Not-1447>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2
[15:10:57] <Not-1447>	 [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3
[15:15:50] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 4.04, 3.57, 2.02
[15:17:05] <Not-1447>	 [02miraheze/mw-config] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfyr7
[15:17:07] <Not-1447>	 [02miraheze/mw-config] 07Southparkfan 03925a33f - Disable RO for c1
[15:21:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.20, 23.34, 16.11
[15:22:18] <icinga-miraheze>	 RECOVERY - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is OK: OK - NGINX Error Rate is 39%
[15:24:57] <RhinosF1>	 That sounded bad SPF|Cloud
[15:25:06] <SPF|Cloud>	 what?
[15:25:47] <RhinosF1>	 SPF|Cloud: the outage
[15:26:02] <SPF|Cloud>	 yep, OVH issues
[15:26:34] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 10.88, 16.51, 15.47
[15:32:44] <hispano76>	 :)
[15:35:34] <Not-1447>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfyoa
[15:35:35] <Not-1447>	 [02miraheze/dns] 07paladox 0390bb830 - Re add dbt1, removed by mistake
[15:36:45] <Not-1447>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfyor
[15:36:47] <Not-1447>	 [02miraheze/dns] 07paladox 03f1db728 - Update miraheze.org
[15:45:49] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 1.55, 3.01, 3.65
[15:53:45] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.79, 2.59, 3.30
[16:13:29] <Cyberpower678>	 I need a sysadmin
[16:13:54] <Cyberpower678>	 paladox: ?
[16:15:55] <Cyberpower678>	 paladox: do you have access to the DB with the OAuth grants?
[16:20:00] <Cyberpower678>	 Nevermind
[16:28:25] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 3.53, 3.11, 2.70
[16:28:30] <Cyberpower678>	 paladox: actually ping me when you are available
[16:31:11] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.97, 3.04, 2.73
[16:35:59] <RhinosF1>	 Cyberpower678: not a sysadmin but what you stuck with?
[16:36:05] * RhinosF1 thinks he might know
[16:36:40] <ZppixBot>	 Hello peekpock! If you have any questions, feel free to ask and someone should answer soon.
[16:36:58] <RhinosF1>	 Hi peekpock
[16:37:35] <Texas>	 Bye peekpock. Nice try though.
[16:37:36] <Texas>	 *gban *!*@134.209.153.66
[16:37:36] <SigmaBot>	 04*!*@134.209.153.66 has been globally banned and will be automatically kickbanned from all channels on sight.04
[16:39:27] <Texas>	 paladox, Voidwalker, Reception123: What do you guys think about putting Sygnal in here? She has had no issues today.
[16:40:17] <Texas>	 if there are any questions/comments/concerns I would be happy to answer them in a non-logged channel
[16:45:12] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfyin
[16:45:14] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot 03c2019b0 - BOT: Updating services config for wikis
[16:50:52] <Cyberpower678>	 RhinosF1: if you can alter the OAuth callback URL of my grants, then I can work with you. :-)
[16:51:27] <RhinosF1>	 Cyberpower678: You probably want a steward for that
[16:51:39] * RhinosF1 looks at Voidwalker and PuppyKun
[16:51:44] <RhinosF1>	 Hi Zppix
[16:51:50] <Cyberpower678>	 RhinosF1: stewards can't do that.
[16:51:54] <Cyberpower678>	 Only sysadmins
[16:52:09] * RhinosF1 looks at Reception123 then
[16:52:44] <Texas>	 they are all out getting coffee
[16:52:47] <Texas>	 at the same time
[16:52:57] * Cyberpower678 gets lunch then
[16:54:23] <PuppyKun>	 Busy for the next 2.5 hours but pm me if it doesnt get handled
[16:58:03] <RhinosF1>	 Reception123: you have mail
[16:58:54] <Zppix>	 What needs sysadmim?
[16:59:16] <RhinosF1>	 Zppix: Cyberpower678 does
[16:59:35] <Zppix>	 Cyberpower678: whats up
[17:00:17] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfyiD
[17:00:18] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot 031dc5f05 - BOT: Updating services config for wikis
[17:04:26] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 15.96, 6.50, 3.89
[17:05:28] <Cyberpower678>	 Zppix: can you update my OAuth grants.  The callback URL needs to change from https://tools.wmflabs.org/iabot/oauthcallback.php to https://iabot.toolforge.org/oauthcallback.php
[17:05:39] <Cyberpower678>	 That can only be done directly in the DB.
[17:06:03] <Zppix>	 Cyberpower678: do you know where that db entry would be?
[17:06:13] <Cyberpower678>	 Ummm....
[17:06:20] <Cyberpower678>	 Let me look that up.
[17:06:29] <Zppix>	 Like what table?
[17:08:22] <Cyberpower678>	 Zppix: it would be somewhere where the central auth stuff is I think.  OAuth is global
[17:11:26] <Cyberpower678>	 Zppix: they tables are in the metawiki DB
[17:11:55] <Zppix>	 Ok
[17:11:57] <Cyberpower678>	 Apparently should be somewhat obvious to recognize.
[17:12:17] <Zppix>	 Ill look at it if i cant figure it out ill bug someone else
[17:12:24] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 3.71, 3.58, 3.35
[17:14:06] <Cyberpower678>	 Zppix: oauth_registered_consumer is the table name.
[17:14:23] <Zppix>	 Ok
[17:15:05] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.38, 3.17, 3.23
[17:15:46] <Cyberpower678>	 UPDATE oauth_registered_consumer SET oarc_callback_url='https://iabot.toolforge.org/oauthcallback.php' WHERE oarc_callback_url='https://tools.wmflabs.org/iabot/oauthcallback.php'
[17:15:48] <Cyberpower678>	 Zppix: ^
[17:16:36] <Cyberpower678>	 Should update 2 rows
[17:16:54] <Zppix>	 Ok ill do that now
[17:19:17] <Zppix>	 It updated 3 Cyberpower678
[17:19:23] <Zppix>	 Can you see if it worked
[17:19:26] * Cyberpower678 looks
[17:21:00] <Cyberpower678>	 Ah yes, there are three consumers.
[17:21:09] * Cyberpower678 does a test login.
[17:23:03] * Zppix hopes nothing broke
[17:24:59] <ZppixBot>	 Hello gagook! If you have any questions, feel free to ask and someone should answer soon.
[17:25:47] <Cyberpower678>	 Zppix: yep it works.
[17:25:51] <Zppix>	 Yay
[17:25:56] <Cyberpower678>	 :-)
[17:26:08] <Zppix>	 !log UPDATE oauth_registered_consumer SET oarc_callback_url='https://iabot.toolforge.org/oauthcallback.php' WHERE oarc_callback_url='https://tools.wmflabs.org/iabot/oauthcallback.php'; using sql.php on jobrunner1
[17:26:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[18:21:07] <ZppixBot>	 Hello gognork! If you have any questions, feel free to ask and someone should answer soon.
[18:45:11] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfyMm
[18:45:13] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot 03eed0136 - BOT: Updating services config for wikis
[18:45:41] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is CRITICAL: CRITICAL - load average: 1.87, 2.08, 1.57
[18:51:11] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is WARNING: WARNING - load average: 1.26, 1.81, 1.67
[18:53:51] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 1.25, 1.61, 1.61
[19:05:27] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is CRITICAL: CRITICAL - load average: 6.13, 3.98, 2.49
[19:10:39] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is WARNING: WARNING - load average: 0.56, 1.70, 1.90
[19:16:13] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 0.20, 0.87, 1.48
[20:24:36] <paladox>	 !log MariaDB [mhglobal]> update mw_permissions set perm_autopromote = NULL where perm_dbname = 'toramwiki' and perm_group = 'autoconfirmed'; - db8 & T5725
[20:24:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[20:25:14] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfySA
[20:25:15] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot 03a2deda6 - BOT: Updating services config for wikis
[21:26:04] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 2.25, 3.48, 3.17
[21:28:51] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.05, 2.47, 2.83
[22:10:21] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfy5l
[22:10:22] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot 035ed4a80 - BOT: Updating services config for wikis
[22:19:33] <icinga-miraheze>	 PROBLEM - cp8 Disk Space on cp8 is WARNING: DISK WARNING - free space: / 2105 MB (10% inode=93%);
[22:45:33] <RhinosF1>	 ping: seen as you have such a tempting nick, want something to do?
[22:58:53] <paladox>	 Texas fine by me as long as it doesn't start kicking everyone
[22:59:36] <Texas>	 paladox: Just do /invite Sygnal
[22:59:44] <Texas>	 it will give you instructions upon join
[22:59:47] <Sygnal>	 ** Warning: if there is any bot or IP in #miraheze which should be exempted from Sygnal, contact my operators before it gets caught **
[22:59:48] <Sygnal>	 ** Please ensure that I have the +o flag in chanserv so that I am able to take action when neeeded. **
[22:59:48] <Sygnal>	 ** Any channel contacts should request access to #sygnal-alerts so that they can be notified of events in the channel **
[23:00:11] <Texas>	 paladox: The second step is very important
[23:00:34] <paladox>	 'Any channel contacts should request access to #sygnal-alerts so that they can be notified of events in the channel'?
[23:00:47] <Texas>	 no
[23:00:58] <Texas>	 paladox: 17:59:48 <@Sygnal> ** Please ensure that I have the +o flag in chanserv so that I am able to take action when neeeded. **
[23:01:04] <paladox>	 it seems to have +o
[23:01:12] <paladox>	 since as soon as it came in it +o'd
[23:01:36] <Texas>	 paladox: No it has +O because it shares an account with SigmaBot. It needs +o.
[23:01:42] <Texas>	 they are different
[23:01:43] <paladox>	 oh
[23:02:27] <Texas>	 they are different
[23:02:56] <Texas>	 paladox: Just do /msg ChanServ FLAGS SigmaBot +o
[23:02:56] <paladox>	 -ChanServ- Sygnal is not registered.
[23:03:10] <RhinosF1>	 paladox: what Texas said
[23:03:18] <RhinosF1>	 or not 
[23:03:18] <paladox>	 done
[23:03:21] <Texas>	 ty paladox
[23:03:23] <RhinosF1>	 you did it
[23:04:31] <Sygnal>	 ** Warning: if there is any bot or IP in #miraheze which should be exempted from Sygnal, contact my operators before it gets caught **
[23:04:33] <Sygnal>	 ** Please ensure that I have the +o flag in chanserv so that I am able to take action when neeeded. **
[23:04:34] <Sygnal>	 ** Any channel contacts should request access to #sygnal-alerts so that they can be notified of events in the channel **
[23:11:01] <ZppixBot>	 Hello GAGOOSHKA! If you have any questions, feel free to ask and someone should answer soon.
[23:24:09] <ZppixBot>	 Hello beeshka! If you have any questions, feel free to ask and someone should answer soon.
[23:35:17] <ZppixBot>	 Hello koonga! If you have any questions, feel free to ask and someone should answer soon.
[23:35:19] <Sygnal>	 !btset ~12h Open Proxy
[23:35:21] <Sygnal>	 !btset ~12h Trolling
[23:43:16] <ZppixBot>	 Hello NaKNEEE! If you have any questions, feel free to ask and someone should answer soon.