[00:04:56] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.17, 6.94, 5.84 [00:06:56] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.16, 6.30, 5.74 [00:13:38] replied JohnLewis, I have to head off now, but looking forward to your comments [00:15:17] I don’t really have additional comments for it, so far the current use case and the need to implement seems around MediaWiki tasks than Infra, therefore it being tagged as MW seems appropriate for the MW team to triage [00:15:44] the immediate need is MediaWiki, yes [00:17:12] The use case until now presented is MW, therefore to present a use case to change tram focus only when asked seems to defeat the purpose of primacy for tasking which we developed. Team task does not prevent cross collaboration so it is a MW-SRE task [00:18:37] So far the tool works as intended, although the installation process is questionable). I would like to hear what needs to be monitored, if the specific KPIs are known, we can help them implementing the queries and graphs [00:19:41] API requests (T6979) and exception rates are good examples. [00:19:42] The MW team are aware that they can ask for support if needed, there is also pre-existing collaboration on similar projects but to my knowledge MW-SRE haven’t resourced the task yet [00:22:41] Agreed. I do have enough ideas for monitoring, but I'll wait for their reply [00:25:01] night [00:31:06] PROBLEM - wiki.yapsavun.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:44:24] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JYa6L [00:44:25] [02miraheze/ManageWiki] 07Universal-Omega 03a509706 - Use $this instead of nonexistent $mwReturn for $logAP [00:45:24] miraheze/ManageWiki - Universal-Omega the build passed. [00:50:44] RECOVERY - dbbackup1 Check MariaDB Replication c2 on dbbackup1 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [00:51:04] I'm gettin 503s [00:51:38] and it went away, okay [01:42:37] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.54, 3.01, 2.74 [01:44:36] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.71, 2.84, 2.71 [01:51:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.08, 6.60, 7.87 [01:52:10] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.21, 6.91, 7.85 [01:53:15] PROBLEM - wiki.yapsavun.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yapsavun.com reverse DNS resolves to 85-159-66-62.cizgi.net.tr [01:58:09] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.36, 7.52, 7.78 [02:02:10] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.98, 7.69, 7.81 [02:03:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.89, 7.64, 7.69 [02:04:11] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.29, 8.30, 8.02 [02:06:10] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.08, 7.44, 7.74 [02:08:10] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.11, 8.20, 8.01 [02:10:09] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.23, 7.59, 7.81 [02:14:08] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.14, 7.69, 7.77 [02:16:07] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.59, 7.48, 7.68 [02:18:07] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.70, 8.25, 7.95 [02:45:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.24, 6.78, 7.71 [02:46:07] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.33, 7.13, 7.96 [02:51:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.49, 7.18, 7.51 [02:53:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.46, 7.02, 7.43 [03:01:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.58, 7.49, 7.42 [03:02:08] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.38, 7.89, 7.71 [03:08:07] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.59, 7.54, 7.69 [03:09:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.63, 7.84, 7.72 [03:11:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.72, 8.29, 7.89 [03:12:05] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.63, 7.85, 7.77 [03:14:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.18, 7.61, 7.70 [03:16:05] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.22, 7.58, 7.66 [03:18:04] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.49, 7.20, 7.51 [03:19:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.91, 7.60, 7.79 [03:25:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.80, 7.88, 7.75 [03:26:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.20, 7.01, 7.20 [03:28:04] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.46, 7.17, 7.24 [03:29:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.49, 7.44, 7.58 [03:34:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.29, 7.66, 7.36 [03:35:55] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.25, 1.80, 1.45 [03:36:06] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.57, 7.54, 7.35 [03:37:54] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.38, 1.63, 1.42 [03:44:09] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.33, 7.10, 7.08 [03:46:09] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.08, 6.95, 7.02 [03:51:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.53, 7.78, 7.53 [03:53:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.21, 7.53, 7.46 [03:54:09] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.24, 7.39, 7.09 [03:56:08] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.02, 7.63, 7.25 [03:58:08] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.91, 7.89, 7.37 [04:03:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 10.89, 7.84, 7.43 [04:13:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.67, 7.75, 7.84 [04:18:04] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.77, 7.39, 7.75 [04:19:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.82, 7.72, 7.74 [04:20:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.82, 8.00, 7.90 [04:21:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.99, 7.83, 7.78 [04:23:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.82, 8.09, 7.88 [04:53:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.45, 7.08, 7.86 [04:58:07] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.67, 7.14, 7.92 [04:58:56] PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 295s [05:01:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.04, 6.53, 7.17 [05:04:08] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.50, 7.55, 7.78 [05:06:08] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.48, 7.54, 7.75 [05:10:09] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.12, 7.65, 7.74 [05:12:09] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.35, 7.65, 7.73 [05:19:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.55, 7.85, 7.88 [05:26:05] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.53, 5.67, 6.66 [05:33:07] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.76, 5.97, 6.68 [05:41:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.82, 6.41, 6.54 [05:43:06] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.73, 6.23, 6.46 [05:44:56] RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [06:03:41] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 10.29, 8.12, 7.02 [06:05:02] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.91, 7.39, 6.67 [06:07:02] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.46, 7.61, 6.82 [06:09:01] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.67, 7.28, 6.80 [06:11:18] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.90, 7.71, 7.30 [06:13:00] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.10, 7.24, 6.86 [06:13:12] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.30, 7.98, 7.45 [06:15:00] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.09, 7.48, 7.02 [06:15:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.68, 7.62, 7.39 [06:15:57] RECOVERY - dbbackup1 APT on dbbackup1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:20:58] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.92, 7.90, 7.31 [06:23:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.96, 7.43, 7.25 [06:25:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.85, 6.91, 7.07 [06:27:02] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.42, 7.45, 7.34 [06:29:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.06, 7.41, 7.23 [06:31:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.84, 7.59, 7.33 [06:33:02] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.07, 7.30, 7.27 [06:33:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.50, 8.05, 7.51 [06:37:06] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.85, 7.56, 7.43 [06:39:07] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.60, 8.08, 7.65 [06:41:08] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.35, 7.72, 7.56 [06:43:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.58, 8.00, 7.87 [06:43:08] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.70, 7.98, 7.67 [06:47:07] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.60, 7.12, 7.42 [06:51:08] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.99, 7.25, 7.39 [06:55:07] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.65, 7.91, 7.56 [06:59:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.23, 7.49, 7.66 [06:59:07] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.22, 7.00, 7.32 [07:05:05] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.47, 7.78, 7.45 [07:07:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.67, 7.51, 7.41 [07:11:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 10.01, 8.29, 7.75 [07:17:02] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.71, 7.70, 7.45 [07:25:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.30, 7.26, 7.77 [07:27:01] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.15, 7.92, 7.98 [07:48:58] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.44, 6.14, 6.72 [07:53:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.04, 7.22, 7.03 [07:54:58] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.79, 6.95, 6.93 [07:55:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.70, 7.40, 7.12 [08:03:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.95, 7.44, 7.19 [08:07:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.98, 7.60, 7.37 [08:12:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.45, 6.58, 6.79 [08:15:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.55, 7.91, 7.55 [08:16:55] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.33, 8.07, 7.33 [08:24:56] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.09, 7.85, 7.56 [08:38:54] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.16, 6.78, 6.95 [08:39:56] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [08:40:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.54, 6.71, 6.89 [08:43:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.88, 7.01, 7.75 [08:44:53] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.89, 6.11, 6.63 [08:50:29] RECOVERY - erikapedia.com - reverse DNS on sslhost is OK: rDNS OK - erikapedia.com reverse DNS resolves to cp11.miraheze.org [08:52:52] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.98, 7.25, 6.90 [08:54:53] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.01, 7.59, 7.07 [08:55:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.86, 7.50, 7.45 [08:56:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.48, 7.25, 7.01 [09:00:49] [02mediawiki] 07dependabot[bot] opened pull request 03#1402: Bump y18n from 3.2.1 to 3.2.2 - 13https://git.io/JYVQ6 [09:00:50] [02mediawiki] 07dependabot[bot] labeled pull request 03#1402: Bump y18n from 3.2.1 to 3.2.2 - 13https://git.io/JYVQ6 [09:00:52] [02mediawiki] 07dependabot[bot] labeled pull request 03#1402: Bump y18n from 3.2.1 to 3.2.2 - 13https://git.io/JYVQ6 [09:00:53] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/y18n-3.2.2 [+0/-0/±1] 13https://git.io/JYVQP [09:00:55] [02miraheze/mediawiki] 07dependabot[bot] 030a26953 - Bump y18n from 3.2.1 to 3.2.2 [09:00:56] [02mediawiki] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/y18n-3.2.2 - 13https://git.io/vbL5b [09:01:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.66, 7.93, 7.73 [09:02:53] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.18, 7.49, 7.17 [09:03:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.29, 8.04, 7.79 [09:03:07] RECOVERY - www.erikapedia.com - reverse DNS on sslhost is OK: rDNS OK - www.erikapedia.com reverse DNS resolves to cp10.miraheze.org [09:06:53] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.36, 7.45, 7.26 [09:07:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.12, 7.88, 7.86 [09:07:34] RECOVERY - cp12 Varnish Backends on cp12 is OK: All 7 backends are healthy [09:07:41] !log repool mw8 on cp12 (was missed during maintenance yesterday) [09:07:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:10:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.87, 6.07, 6.73 [09:17:08] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.17, 5.74, 6.69 [11:46:23] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JYw4P [11:46:24] [02miraheze/ManageWiki] 07translatewiki 03aaa2b0d - Localisation updates from https://translatewiki.net. [11:46:25] [ Main page - translatewiki.net ] - translatewiki.net [11:46:26] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JYw41 [11:46:27] [02miraheze/MirahezeMagic] 07translatewiki 03835afd2 - Localisation updates from https://translatewiki.net. [11:46:29] [ Main page - translatewiki.net ] - translatewiki.net [11:47:24] miraheze/MirahezeMagic - translatewiki the build passed. [11:47:25] miraheze/ManageWiki - translatewiki the build passed. [12:40:04] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JYwKc [12:40:05] [02miraheze/ssl] 07Reception123 033d6225a - add www.hoolehistoryheritagesociety.org.uk cert [13:38:54] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.08, 6.69, 4.99 [13:39:59] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.94, 7.01, 5.40 [13:40:19] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.54, 7.22, 5.42 [13:40:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.56, 6.78, 5.26 [13:41:58] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.23, 6.47, 5.40 [13:42:17] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.64, 6.68, 5.44 [14:05:19] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.66, 6.24, 5.43 [14:09:21] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.68, 5.59, 5.37 [14:17:35] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.82, 7.09, 6.08 [14:20:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.90, 6.57, 5.82 [14:21:42] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.85, 6.22, 5.71 [14:22:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.53, 6.60, 5.93 [14:23:34] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.97, 6.54, 6.21 [14:23:42] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.50, 6.43, 5.86 [14:26:30] Reception123, wow, did that Hoole History wiki finally respond to that Phabricator task? [14:33:38] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 15.78, 9.92, 7.23 [14:39:22] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.10, 7.16, 7.14 [14:39:34] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 21.75, 17.19, 10.63 [14:43:21] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 12.90, 9.00, 7.75 [14:45:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.21, 7.77, 7.45 [14:46:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.80, 6.91, 6.33 [14:47:59] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.49, 6.43, 6.23 [14:48:38] Yeah heh, I forgot about it until I saw their reply [14:51:34] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.06, 6.64, 7.95 [14:52:45] Reception123, oh heh [14:55:34] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.02, 6.84, 7.67 [14:57:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.06, 6.26, 6.77 [14:57:29] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 13.55, 10.08, 7.66 [14:57:34] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.99, 7.04, 7.66 [14:59:34] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.65, 7.46, 7.71 [15:05:06] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.69, 8.00, 7.80 [15:05:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 32.38, 15.01, 9.65 [15:05:27] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.72, 7.15, 6.05 [15:09:34] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.02, 7.46, 7.81 [15:11:26] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.28, 7.31, 6.73 [15:15:24] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.36, 6.54, 6.53 [15:17:34] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.27, 7.21, 7.40 [15:20:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.51, 6.34, 6.77 [15:21:21] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.60, 7.26, 7.94 [15:21:35] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.70, 7.16, 7.36 [15:25:37] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 11.06, 7.87, 7.51 [15:26:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.15, 7.04, 6.95 [15:28:24] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.13, 7.25, 6.84 [15:29:35] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.26, 7.21, 7.34 [15:30:24] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.64, 6.25, 6.52 [15:30:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.40, 6.13, 6.64 [15:31:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.09, 5.07, 6.57 [15:37:36] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.16, 5.64, 6.55 [15:46:20] PROBLEM - cp3 Stunnel Http for test3 on cp3 is CRITICAL: HTTP CRITICAL - No data received from host [15:46:21] PROBLEM - cp12 Stunnel Http for test3 on cp12 is CRITICAL: HTTP CRITICAL - No data received from host [15:46:43] PROBLEM - cp11 Stunnel Http for test3 on cp11 is CRITICAL: HTTP CRITICAL - No data received from host [15:46:56] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: connect to address 51.195.236.247 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [15:46:56] PROBLEM - cp10 Stunnel Http for test3 on cp10 is CRITICAL: HTTP CRITICAL - No data received from host [15:47:07] PROBLEM - test3 HTTPS on test3 is CRITICAL: connect to address 51.195.236.247 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [15:47:22] paladox: can I blame you and assume it'll be up by 21:30 tonight? [15:47:39] well test3 is me but it is a test server [15:48:20] RECOVERY - cp3 Stunnel Http for test3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15202 bytes in 1.042 second response time [15:48:21] RECOVERY - cp12 Stunnel Http for test3 on cp12 is OK: HTTP OK: HTTP/1.1 200 OK - 15210 bytes in 0.320 second response time [15:48:34] paladox: yeah and I wanna test tonight around 21:30/10ish [15:48:43] RECOVERY - cp11 Stunnel Http for test3 on cp11 is OK: HTTP OK: HTTP/1.1 200 OK - 15202 bytes in 0.005 second response time [15:48:44] ok [15:48:56] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20760 bytes in 0.339 second response time [15:48:57] RECOVERY - cp10 Stunnel Http for test3 on cp10 is OK: HTTP OK: HTTP/1.1 200 OK - 15216 bytes in 0.006 second response time [15:49:06] RECOVERY - test3 HTTPS on test3 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 561 bytes in 0.006 second response time [15:50:07] [02puppet] 07RhinosF1 opened pull request 03#1725: Switch firejail to py3 - 13https://git.io/JYrar [15:50:41] [02puppet] 07RhinosF1 synchronize pull request 03#1725: Switch firejail to py3 - 13https://git.io/JYrar [15:51:09] [02puppet] 07RhinosF1 commented on pull request 03#1725: Switch firejail to py3 - 13https://git.io/JYraA [15:51:24] That's safe whenever [15:52:00] [02puppet] 07paladox closed pull request 03#1725: Switch firejail to py3 - 13https://git.io/JYrar [15:52:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JYrVs [15:52:03] [02miraheze/puppet] 07RhinosF1 030c4e538 - Switch firejail to py3 (#1725) [15:52:06] [02puppet] 07RhinosF1 edited a comment on pull request 03#1725: Switch firejail to py3 - 13https://git.io/JYraA [15:52:43] Ty [15:59:34] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.97, 7.13, 6.52 [16:01:34] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.14, 6.19, 6.26 [16:05:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 12.31, 9.26, 6.96 [16:13:19] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.28, 7.27, 7.20 [16:21:21] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.26, 5.88, 6.67 [16:26:29] PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 6.73, 7.55, 3.67 [16:30:28] PROBLEM - cp11 Current Load on cp11 is WARNING: WARNING - load average: 0.36, 3.59, 2.91 [16:32:29] RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 1.15, 2.76, 2.68 [16:44:54] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 17.03, 9.71, 6.97 [16:51:19] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.94, 6.64, 6.02 [16:52:56] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.82, 7.64, 7.33 [16:53:19] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.91, 6.59, 6.09 [16:55:57] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 12.56, 7.89, 6.39 [16:57:55] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.66, 7.31, 6.34 [17:01:50] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.79, 6.44, 6.21 [17:02:17] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.83, 6.87, 6.02 [17:05:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.73, 6.88, 6.31 [17:06:17] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.97, 7.38, 6.47 [17:06:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.04, 6.03, 6.57 [17:07:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.72, 6.14, 6.11 [17:07:42] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.11, 6.95, 6.48 [17:09:41] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.46, 6.69, 6.43 [17:10:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.68, 6.98, 6.83 [17:11:21] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.38, 7.06, 6.47 [17:13:21] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.12, 6.45, 6.31 [17:16:17] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.39, 6.31, 6.46 [17:18:55] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 11.22, 8.23, 7.35 [17:20:55] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.29, 7.01, 7.01 [17:22:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.79, 5.83, 6.57 [17:29:35] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 15.00, 11.27, 8.13 [17:35:36] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.56, 7.27, 7.32 [17:37:17] !log jobrunner3: sudo -u www-data php rollbackEdits.php --user MarioFanatic69 --bot --wiki greatestmovieswiki [17:37:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:41:34] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.82, 6.08, 6.75 [17:41:49] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp10.miraheze.org [18:15:12] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.15, 6.29, 5.63 [18:17:11] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.02, 7.37, 6.09 [18:21:09] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.22, 7.35, 6.43 [18:23:10] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.41, 6.29, 6.15 [18:26:12] PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 2.90, 5.43, 3.02 [18:28:11] PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 0.50, 3.67, 2.66 [18:30:03] !log remove all greatestmovieswiki jobs from redis [18:30:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:30:11] RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.28, 2.55, 2.38 [18:47:34] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.93, 6.64, 6.01 [18:49:35] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.82, 6.44, 6.03 [18:55:34] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.28, 7.69, 6.64 [18:55:43] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.05, 6.87, 5.96 [18:57:34] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.72, 7.18, 6.58 [18:57:36] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.31, 6.16, 5.80 [19:01:34] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.08, 6.46, 6.45 [19:04:54] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.37, 7.29, 6.08 [19:06:53] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.16, 6.98, 6.13 [19:08:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.31, 6.08, 5.90 [19:46:55] PROBLEM - cloud4 APT on cloud4 is CRITICAL: APT CRITICAL: 61 packages available for upgrade (2 critical updates). [19:47:56] PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 13.60, 7.01, 3.48 [19:50:06] PROBLEM - cloud3 APT on cloud3 is CRITICAL: APT CRITICAL: 107 packages available for upgrade (2 critical updates). [19:51:59] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.79, 6.38, 5.60 [19:53:03] PROBLEM - mon2 APT on mon2 is CRITICAL: APT CRITICAL: 29 packages available for upgrade (1 critical updates). [19:53:52] PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.95, 3.92, 3.19 [19:53:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.65, 6.34, 5.67 [19:56:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.12, 6.36, 5.54 [19:57:49] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.75, 7.02, 6.14 [19:57:49] PROBLEM - cloud5 APT on cloud5 is CRITICAL: APT CRITICAL: 61 packages available for upgrade (2 critical updates). [19:57:50] RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.79, 2.64, 2.86 [20:00:08] PROBLEM - mail2 APT on mail2 is CRITICAL: APT CRITICAL: 23 packages available for upgrade (1 critical updates). [20:00:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.61, 6.07, 5.66 [20:01:44] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.02, 7.45, 6.49 [20:03:41] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.20, 7.24, 6.55 [20:04:36] PROBLEM - mw8 APT on mw8 is CRITICAL: APT CRITICAL: 33 packages available for upgrade (2 critical updates). [20:04:39] PROBLEM - mw9 APT on mw9 is CRITICAL: APT CRITICAL: 33 packages available for upgrade (2 critical updates). [20:04:56] PROBLEM - mw11 APT on mw11 is CRITICAL: APT CRITICAL: 33 packages available for upgrade (2 critical updates). [20:05:13] PROBLEM - jobrunner3 APT on jobrunner3 is CRITICAL: APT CRITICAL: 35 packages available for upgrade (2 critical updates). [20:05:38] PROBLEM - phab2 APT on phab2 is CRITICAL: APT CRITICAL: 23 packages available for upgrade (1 critical updates). [20:05:41] PROBLEM - jobrunner4 APT on jobrunner4 is CRITICAL: APT CRITICAL: 33 packages available for upgrade (2 critical updates). [20:06:18] PROBLEM - test3 APT on test3 is CRITICAL: APT CRITICAL: 34 packages available for upgrade (2 critical updates). [20:06:19] PROBLEM - mw10 APT on mw10 is CRITICAL: APT CRITICAL: 33 packages available for upgrade (2 critical updates). [20:06:45] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.54, 6.96, 6.22 [20:08:44] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.88, 7.41, 6.46 [20:09:34] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.61, 6.56, 6.52 [20:10:13] PROBLEM - services4 APT on services4 is CRITICAL: APT CRITICAL: 23 packages available for upgrade (1 critical updates). [20:10:44] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.01, 6.61, 6.27 [20:12:37] PROBLEM - services3 APT on services3 is CRITICAL: APT CRITICAL: 23 packages available for upgrade (1 critical updates). [20:12:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.27, 7.24, 6.42 [20:14:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+61/-0/±0] 13https://git.io/JYonH [20:14:54] [02miraheze/puppet] 07paladox 0302aa5f8 - Introduce trafficserver module [20:14:54] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.42, 6.70, 6.33 [20:14:55] [02puppet] 07paladox created branch 03patch-1 - 13https://git.io/vbiAS [20:15:05] [02puppet] 07paladox opened pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:17:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYocv [20:17:14] [02miraheze/puppet] 07paladox 03e4843fc - Update site.pp [20:17:16] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:18:42] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.13, 6.66, 6.34 [20:19:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYocg [20:19:11] [02miraheze/puppet] 07paladox 035265557 - Update trafficserver.pp [20:19:13] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:19:37] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.80, 7.02, 6.66 [20:20:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYocy [20:20:29] [02miraheze/puppet] 07paladox 03e570bbe - Update trafficserver.pp [20:20:30] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:20:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.85, 7.06, 6.61 [20:21:21] PROBLEM - test4 Puppet on test4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:22:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoCJ [20:22:22] [02miraheze/puppet] 07paladox 0393c401b - Update log.pp [20:22:24] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:22:41] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.06, 7.59, 6.80 [20:22:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoCL [20:22:57] [02miraheze/puppet] 07paladox 03ffe5896 - Update test4.yaml [20:22:58] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:23:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.66, 7.02, 6.36 [20:23:35] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.74, 6.52, 6.56 [20:24:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoCC [20:24:19] [02miraheze/puppet] 07paladox 03a6287e7 - Update test4.yaml [20:24:21] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:24:40] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.63, 7.11, 6.72 [20:25:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoC0 [20:25:05] [02miraheze/puppet] 07paladox 03978cda6 - Update trafficserver.pp [20:25:06] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:25:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.95, 6.52, 6.26 [20:25:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+1/-1/±0] 13https://git.io/JYoCK [20:25:44] [02miraheze/puppet] 07paladox 039abb255 - Rename errorpage.html.erb.yaml to errorpage.html.erb [20:25:46] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:25:47] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:26:54] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.45, 7.73, 7.04 [20:27:04] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoCh [20:27:06] [02miraheze/puppet] 07paladox 03238147a - Update init.pp [20:27:07] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:27:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoWT [20:27:54] [02miraheze/puppet] 07paladox 03049fd6b - Update instance.pp [20:27:55] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:28:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.38, 7.45, 7.01 [20:32:41] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.55, 6.79, 6.75 [20:34:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±3] 13https://git.io/JYoW7 [20:34:29] [02miraheze/puppet] 07paladox 03a0c2c6c - Update [20:34:30] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:34:55] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.85, 6.42, 6.70 [20:35:21] RECOVERY - test4 Puppet on test4 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [20:36:19] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.96, 7.25, 6.71 [20:38:16] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.99, 6.86, 6.64 [20:38:55] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.95, 6.95, 6.87 [20:40:13] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.70, 6.78, 6.64 [20:40:55] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.60, 6.17, 6.60 [20:44:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±3] 13https://git.io/JYolo [20:44:22] [02miraheze/puppet] 07paladox 030db259f - Update [20:44:24] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:45:50] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [20:45:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoli [20:45:59] [02miraheze/puppet] 07paladox 03a458bba - Update [20:46:00] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [20:50:34] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.02, 6.85, 6.56 [20:52:33] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.06, 6.98, 6.62 [20:54:31] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.45, 6.16, 6.38 [21:00:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±2] 13https://git.io/JYo4Z [21:00:17] [02miraheze/puppet] 07paladox 03431b0c3 - Update [21:00:18] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [21:03:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±2] 13https://git.io/JYo4S [21:03:26] [02miraheze/puppet] 07paladox 0330be5bf - Update [21:03:27] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [21:04:17] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYo4F [21:04:18] [02miraheze/puppet] 07paladox 03a45a189 - Update [21:04:20] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [21:05:25] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoBv [21:05:26] [02miraheze/puppet] 07paladox 034bbcc25 - Update [21:05:28] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [21:22:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYoRj [21:22:39] [02miraheze/puppet] 07paladox 036606923 - Update test4.yaml [21:22:41] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [21:30:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYo0Q [21:30:55] [02miraheze/puppet] 07paladox 0365f0d0e - Update trafficserver.pp [21:30:57] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [21:31:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYo07 [21:31:06] [02miraheze/puppet] 07paladox 0388b4e9b - Update test4.yaml [21:31:08] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [21:59:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±2] 13https://git.io/JYozo [21:59:46] [02miraheze/puppet] 07paladox 039c17606 - Update [21:59:48] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [22:05:38] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.70, 6.88, 6.35 [22:06:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±1] 13https://git.io/JYogG [22:06:40] [02miraheze/puppet] 07paladox 03f43f272 - Update [22:06:41] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [22:07:32] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.80, 6.73, 6.37 [22:19:53] PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 2.53, 4.17, 2.27 [22:21:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.94, 6.09, 6.02 [22:21:53] RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 0.58, 2.92, 2.05 [22:23:19] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.38, 6.00, 5.99 [22:36:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03patch-1 [+0/-0/±2] 13https://git.io/JYoa1 [22:36:48] [02miraheze/puppet] 07paladox 0309e1f2b - Update [22:36:50] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [23:40:58] [02puppet] 07Southparkfan reviewed pull request 03#1726 commit - 13https://git.io/JYoiL [23:40:59] [02puppet] 07Southparkfan reviewed pull request 03#1726 commit - 13https://git.io/JYoit [23:41:01] [02puppet] 07Southparkfan reviewed pull request 03#1726 commit - 13https://git.io/JYoiq [23:41:02] [02puppet] 07Southparkfan reviewed pull request 03#1726 commit - 13https://git.io/JYoim [23:41:04] [02puppet] 07Southparkfan reviewed pull request 03#1726 commit - 13https://git.io/JYoiY [23:41:05] [02puppet] 07Southparkfan reviewed pull request 03#1726 commit - 13https://git.io/JYoiO