[00:02:31] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.76, 22.02, 17.83 [00:04:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.84, 22.28, 18.43 [00:06:27] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 33.12, 25.28, 19.92 [00:08:26] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.43, 20.96, 18.96 [00:10:23] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.73, 19.80, 18.78 [00:12:01] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:12:06] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:16:02] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [00:16:03] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [00:17:23] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.69, 22.07, 20.22 [00:19:24] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.69, 18.85, 19.24 [00:44:35] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 5.19, 4.13, 2.00 [00:46:34] PROBLEM - ns1 Current Load on ns1 is WARNING: WARNING - load average: 0.10, 1.87, 1.55 [00:48:34] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.00, 0.84, 1.20 [01:57:12] [02mw-config] 07Ultracane1997 opened pull request 03#3261: Updating LocalSettings.php for my wiki projects - 13https://git.io/JU0qV [02:00:52] [02mw-config] 07Ultracane1997 commented on pull request 03#3261: Updating LocalSettings.php for my wiki projects - 13https://git.io/JU0qS [02:01:24] PROBLEM - misc1 APT on misc1 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (2 critical updates). [02:10:24] [02mw-config] 07Ultracane1997 commented on pull request 03#3261: Updating LocalSettings.php for my wiki projects - 13https://git.io/JU0ml [02:16:56] [02mw-config] 07Universal-Omega reviewed pull request 03#3261 commit - 13https://git.io/JU0mD [02:18:27] [02mw-config] 07Ultracane1997 reviewed pull request 03#3261 commit - 13https://git.io/JU0m7 [02:19:00] [02mw-config] 07Ultracane1997 edited pull request 03#3261: Updating LocalSettings.php for my wiki projects - 13https://git.io/JU0qV [02:21:56] [02mw-config] 07Ultracane1997 synchronize pull request 03#3261: Updating LocalSettings.php for my wiki projects - 13https://git.io/JU0qV [02:23:54] [02mw-config] 07Ultracane1997 reviewed pull request 03#3261 commit - 13https://git.io/JU0YU [02:28:01] [02mw-config] 07Ultracane1997 commented on pull request 03#3261: Updating LocalSettings.php for my wiki projects - 13https://git.io/JU0YZ [02:29:15] [02mw-config] 07Ultracane1997 edited pull request 03#3261: configuration changes for hypopedia and scratchpad - 13https://git.io/JU0qV [02:32:49] !log GDPR removal [02:32:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:05:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0sH [04:05:13] [02miraheze/services] 07MirahezeSSLBot 038c3bd97 - BOT: Updating services config for wikis [04:23:53] PROBLEM - ns1 APT on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:24:07] PROBLEM - ns1 SSH on ns1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:24:26] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:24:56] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:25:01] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 15.17, 10.94, 5.19 [04:25:54] RECOVERY - ns1 APT on ns1 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [04:26:08] RECOVERY - ns1 SSH on ns1 is OK: SSH OK - OpenSSH_7.9p1 Debian-10+deb10u2 (protocol 2.0) [04:26:23] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [04:26:51] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 15 minutes ago with 0 failures [04:32:59] PROBLEM - ns1 Current Load on ns1 is WARNING: WARNING - load average: 0.10, 0.55, 1.97 [04:34:59] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.00, 0.25, 1.52 [05:35:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0ZA [05:35:13] [02miraheze/services] 07MirahezeSSLBot 0384601ac - BOT: Updating services config for wikis [05:39:23] !log reception@jobrunner2:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --report=1 --wiki callipediawiki /home/reception/Wikipedia-20200917231201.xml [05:39:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:37] !log reception@jobrunner1:/srv/mediawiki/w/maintenance$ sudo -u www-data php deleteBatch.php --wiki callipediawiki --r "Requested - T6193" /home/reception/callipedadel.txt [05:49:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:23] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JU0cJ [05:53:25] [02miraheze/ssl] 07Reception123 0379aad1a - add wiki.wysteria.ga cert [06:03:00] PROBLEM - puppet2 Puppet on puppet2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-11] [06:12:42] RECOVERY - puppet2 Puppet on puppet2 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [06:59:14] RECOVERY - misc1 APT on misc1 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [07:15:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0lR [07:15:16] [02miraheze/services] 07MirahezeSSLBot 03e08eb6c - BOT: Updating services config for wikis [07:30:19] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0lx [07:30:21] [02miraheze/services] 07MirahezeSSLBot 0355fa345 - BOT: Updating services config for wikis [07:33:33] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 1.37, 2.19, 1.06 [07:35:30] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.07, 1.01, 0.83 [08:57:33] Hello ju! If you have any questions, feel free to ask and someone should answer soon. [09:01:47] Hi everyone. On the FAQ, there is a section called "Why am I on another wiki's Special:ListUsers page?" explaining why "Every time you view a Miraheze wiki while being logged in to any other Miraheze wiki, your user name is attached to the local wiki, and therefore to its user list". How can I remove myself from that list? I visited random wikis before reading that section and now under my global account info everybody can see [09:01:47] that I visited "terriblepornagraphys.miraheze.org" for instance. [09:16:49] You can't [09:18:23] Can an admin fix that in the database? [09:19:31] We don't do that, no. [09:21:48] OK. So basically I need to close my wiki, delete my account, create another account and recreate my wiki from scratch. Fair enough. Thanks [09:22:48] I mean you could create a new account and transfer the rights of the wiki over and delete the log entry [09:23:30] But no one is going to care. Most of us unfortunately have an amazing number of questionable wikis on our own list. [09:24:47] lol; you made it almost acceptable [09:28:00] I fully get your point. Not all of us want every wiki that we have on their on. We just don't have a way that isn't insane to deal with it. [10:15:31] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.83, 23.02, 17.63 [10:16:38] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 7.98, 10.70, 5.81 [10:17:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.00, 19.02, 16.84 [10:18:38] PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 3.24, 7.83, 5.33 [10:20:38] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.22, 5.64, 4.84 [10:29:52] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [10:35:51] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [11:02:41] Hello Guest43492! If you have any questions, feel free to ask and someone should answer soon. [11:45:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.04, 18.18, 15.41 [11:47:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.11, 16.27, 15.07 [12:43:58] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.78, 20.82, 17.38 [12:44:38] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 7.22, 8.37, 4.74 [12:46:39] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 3.25, 6.52, 4.51 [12:47:47] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.27, 20.01, 17.73 [12:49:40] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.11, 18.60, 17.48 [13:47:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.94, 19.79, 17.13 [13:49:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.64, 16.73, 16.34 [14:16:46] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 8.48, 6.02, 3.94 [14:17:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.35, 22.36, 19.56 [14:18:43] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 4.13, 5.44, 3.98 [14:19:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.48, 19.53, 18.86 [14:25:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.69, 24.34, 21.07 [14:27:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.70, 23.05, 21.00 [14:29:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.91, 20.18, 20.15 [14:36:51] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:44:04] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 34.67, 23.13, 20.79 [14:46:30] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JU0MC [14:46:32] [02miraheze/mediawiki] 07paladox 0301bfeef - Update Cosmos [14:48:51] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [14:49:46] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.61, 21.68, 21.02 [14:50:20] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0Mg [14:50:21] [02miraheze/services] 07MirahezeSSLBot 039668baa - BOT: Updating services config for wikis [14:51:41] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 38.86, 25.43, 22.30 [14:59:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.90, 21.94, 22.17 [15:01:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.82, 23.17, 22.57 [15:03:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.82, 21.29, 22.00 [15:07:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 10.65, 16.77, 20.13 [15:30:21] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0yk [15:30:22] [02miraheze/services] 07MirahezeSSLBot 03600d498 - BOT: Updating services config for wikis [15:35:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0yZ [15:35:12] [02miraheze/services] 07MirahezeSSLBot 03b013895 - BOT: Updating services config for wikis [15:35:22] PROBLEM - wiki.worldsofweary.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.worldsofweary.com' expires in 15 day(s) (Sun 04 Oct 2020 15:27:55 GMT +0000). [15:37:33] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0y8 [15:37:34] [02miraheze/mw-config] 07paladox 03d74fde6 - Linter: Whitelist parsoid ip (services1 & services2) [15:39:45] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0yE [15:39:46] [02miraheze/ssl] 07MirahezeSSLBot 03b10d273 - Bot: Update SSL cert for wiki.worldsofweary.com [15:55:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.27, 22.26, 20.26 [15:56:12] RECOVERY - wiki.worldsofweary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worldsofweary.com' will expire on Thu 17 Dec 2020 14:39:38 GMT +0000. [15:59:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.38, 19.51, 19.73 [16:05:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.08, 20.91, 20.25 [16:07:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 44.72, 27.76, 22.71 [16:11:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.64, 23.11, 22.06 [16:19:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.38, 17.35, 19.83 [16:27:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.13, 22.41, 21.33 [16:31:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.69, 23.09, 21.73 [16:35:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.87, 22.66, 21.94 [16:49:31] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.27, 17.99, 20.12 [17:05:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.06, 22.13, 20.47 [17:09:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.77, 19.54, 19.92 [17:11:49] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 111s [17:13:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 23.21, 24.37, 22.03 [17:13:49] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [17:15:30] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 15.30, 21.40, 21.25 [17:19:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.74, 17.89, 19.83 [17:19:59] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [17:25:56] RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [18:47:21] [02landing] 07ahmsaqib opened pull request 03#41: Update translations.php - 13https://git.io/JU0df [19:26:48] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 40.32, 28.24, 21.15 [19:28:41] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.19, 23.97, 20.38 [19:32:29] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 31.41, 25.55, 21.64 [19:34:22] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.36, 23.08, 21.22 [19:36:16] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 36.19, 28.25, 23.31 [19:42:00] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.43, 21.79, 21.98 [19:45:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JU0FN [19:45:49] [02miraheze/puppet] 07paladox 0306ea758 - varnish: Change rate limit rules * Increase rate limiting to 20/s. * Increase bursts to 35. * Use nodelay (reference https://www.nginx.com/blog/rate-limiting-nginx/#Queueing-with-No-Delay). [19:45:49] [ NGINX Rate Limiting ] - www.nginx.com [19:45:50] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [19:45:52] [02puppet] 07paladox opened pull request 03#1494: varnish: Change rate limit rules - 13https://git.io/JU0FA [19:47:43] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 9.53, 14.98, 19.13 [19:47:53] [02puppet] 07paladox synchronize pull request 03#1494: varnish: Change rate limit rules - 13https://git.io/JU0FA [19:47:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JU0Fp [19:47:56] [02miraheze/puppet] 07paladox 039b934ee - Update mediawiki.conf [19:49:26] [02puppet] 07paladox edited pull request 03#1494: varnish: Change rate limit rules - 13https://git.io/JU0FA [19:54:39] [02puppet] 07paladox synchronize pull request 03#1494: varnish: Change rate limit rules - 13https://git.io/JU0FA [19:54:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JU0bL [19:54:42] [02miraheze/puppet] 07paladox 03e158564 - Update mediawiki.conf [19:54:58] [02puppet] 07paladox edited pull request 03#1494: varnish: Change rate limit rules - 13https://git.io/JU0FA [19:57:13] [02puppet] 07paladox synchronize pull request 03#1494: varnish: Change rate limit rules - 13https://git.io/JU0FA [19:57:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JU0b4 [19:57:16] [02miraheze/puppet] 07paladox 035f13110 - Update mediawiki.conf [19:57:40] [02puppet] 07paladox closed pull request 03#1494: varnish: Change rate limit rules - 13https://git.io/JU0FA [19:57:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0b0 [19:57:43] [02miraheze/puppet] 07paladox 03971f71d - varnish: Change rate limit rules (#1494) * Increase rate limiting to 20/s. * Increase bursts to 35. * Use nodelay (reference https://www.nginx.com/blog/rate-limiting-nginx/#Queueing-with-No-Delay). [19:57:44] [ NGINX Rate Limiting ] - www.nginx.com [19:57:45] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [19:57:46] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [20:03:58] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JU0bH [20:04:00] [02miraheze/puppet] 07paladox 038eeb564 - varnish: Tweek rate limit to 50r/m [20:04:01] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [20:04:08] [02puppet] 07paladox opened pull request 03#1495: varnish: Tweek rate limit to 50r/m - 13https://git.io/JU0bQ [20:04:51] [02puppet] 07paladox synchronize pull request 03#1495: varnish: Tweek rate limit to 50r/m - 13https://git.io/JU0bQ [20:04:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JU0bN [20:04:54] [02miraheze/puppet] 07paladox 030ff85b2 - Update mediawiki.conf [20:07:23] [02puppet] 07paladox closed pull request 03#1495: varnish: Tweek rate limit to 50r/m - 13https://git.io/JU0bQ [20:07:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0bx [20:07:26] [02miraheze/puppet] 07paladox 03bf5064f - varnish: Tweek rate limit to 50r/m (#1495) * varnish: Tweek rate limit to 50r/m * Update mediawiki.conf [20:07:27] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [20:07:29] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [20:12:39] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 47% [20:14:39] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 39% [20:33:24] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 54% [20:37:14] Ty Paladox [20:37:18] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 39% [20:42:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.84, 19.68, 17.94 [20:44:25] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 10.89, 16.45, 16.96 [20:46:08] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 51% [20:48:05] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 39% [20:48:38] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 8.12, 7.71, 4.82 [20:48:49] SPF|Cloud ^ [20:50:38] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.76, 5.37, 4.31 [20:53:17] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 1.83, 2.18, 1.10 [20:55:17] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.15, 1.02, 0.86 [20:58:56] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 40% [21:00:54] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 35% [21:04:53] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 43% [21:06:51] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 36% [21:08:08] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.31, 19.21, 18.13 [21:10:02] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 20.00, 19.76, 18.48 [21:23:35] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 46% [21:25:32] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 33% [21:29:29] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 48% [21:31:26] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 38% [21:35:22] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 55% [21:37:19] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 32% [21:44:13] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 54% [21:46:10] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 29% [21:50:06] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [21:52:03] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 24% [21:52:36] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JU0pn [21:52:37] [02miraheze/mediawiki] 07paladox 030da705c - Update Cosmos [21:53:55] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.69, 19.81, 16.59 [21:55:49] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.78, 17.80, 16.26 [21:58:56] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 46% [22:00:54] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is CRITICAL: CRITICAL - NGINX Error Rate is 62% [22:02:53] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 49% [22:08:48] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 33% [22:16:40] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 51% [22:21:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU0hn [22:21:32] [02miraheze/puppet] 07paladox 0368d54f2 - varnish: Change rate limit for staticratelimit to /m rather than /s Also increase to 500r/m [22:24:39] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 36% [22:28:39] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 47% [22:30:39] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 32% [22:31:49] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 231s [22:54:17] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 41% [22:58:11] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 38% [23:05:05] PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 50% [23:08:59] RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 31% [23:12:54] [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/JU0jg [23:12:55] [02miraheze/puppet] 07paladox 03f637c73 - Revert "varnish: Change rate limit for staticratelimit to /m rather than /s" This reverts commit 68d54f207b746eb7270ffb411bb64d6d4ac0e469. [23:12:57] [02miraheze/puppet] 07paladox 0361a7fe5 - Revert "varnish: Tweek rate limit to 50r/m (#1495)" This reverts commit bf5064f3f1722699a803bbfd975f395b43c461bc. [23:31:30] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 33.03, 24.99, 17.28 [23:34:36] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [23:47:41] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 11.45, 19.69, 23.91 [23:53:30] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 9.09, 14.11, 20.19