[00:01:27] RECOVERY - es1 Puppet on es1 is OK: OK: Puppet is currently enabled, last run 8 minutes ago with 0 failures [00:02:14] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 11.41, 6.92, 4.29 [00:02:29] PROBLEM - es4 Current Load on es4 is WARNING: WARNING - load average: 2.90, 3.92, 3.04 [00:04:28] RECOVERY - es4 Current Load on es4 is OK: OK - load average: 1.08, 2.89, 2.77 [00:06:13] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 0.91, 3.68, 3.58 [00:08:13] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 1.80, 3.00, 3.33 [00:12:39] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 2.58, 2.84, 3.91 [00:16:38] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 0.60, 1.64, 3.17 [00:20:29] PROBLEM - es4 Current Load on es4 is CRITICAL: CRITICAL - load average: 10.23, 8.33, 4.89 [00:20:36] PROBLEM - es3 SSH on es3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:20:48] PROBLEM - es3 Current Load on es3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:21:48] PROBLEM - es3 Puppet on es3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:22:33] RECOVERY - es3 SSH on es3 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [00:22:56] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 11.64, 6.32, 4.43 [00:23:51] RECOVERY - es3 Puppet on es3 is OK: OK: Puppet is currently enabled, last run 6 minutes ago with 0 failures [00:26:54] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 0.56, 3.18, 3.58 [00:26:57] PROBLEM - es3 SSH on es3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:28:54] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 0.31, 2.28, 3.20 [00:28:54] RECOVERY - es3 SSH on es3 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [00:31:42] PROBLEM - es3 Puppet on es3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:35:53] RECOVERY - es3 Puppet on es3 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures [00:39:13] PROBLEM - es1 Puppet on es1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:39:34] PROBLEM - es1 Current Load on es1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:41:12] RECOVERY - es1 Puppet on es1 is OK: OK: Puppet is currently enabled, last run 9 minutes ago with 0 failures [00:42:13] PROBLEM - bacula1 Disk Space on bacula1 is CRITICAL: DISK CRITICAL - free space: / 26911 MB (5% inode=99%); [00:44:48] PROBLEM - es4 Current Load on es4 is WARNING: WARNING - load average: 1.09, 2.33, 3.79 [00:45:32] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 0.84, 3.53, 3.78 [00:47:31] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 0.74, 2.59, 3.40 [00:48:46] RECOVERY - es4 Current Load on es4 is OK: OK - load average: 2.24, 2.09, 3.33 [00:57:16] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 0.42, 1.82, 3.97 [01:02:35] PROBLEM - es2 Current Load on es2 is CRITICAL: CRITICAL - load average: 5.24, 3.34, 2.20 [01:03:40] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 4.26, 4.62, 3.64 [01:04:31] PROBLEM - es2 Current Load on es2 is WARNING: WARNING - load average: 3.75, 3.57, 2.43 [01:05:39] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 1.37, 3.36, 3.29 [01:06:27] RECOVERY - es2 Current Load on es2 is OK: OK - load average: 3.16, 3.40, 2.50 [01:07:19] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 5.67, 3.87, 3.81 [01:11:19] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 1.89, 3.36, 3.69 [01:15:20] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 2.54, 2.79, 3.37 [01:46:43] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 3.66, 4.02, 3.10 [01:48:43] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 1.15, 2.92, 2.80 [02:25:54] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 5.61, 6.39, 3.79 [02:29:54] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 0.70, 3.28, 3.10 [02:35:12] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 7.15, 4.94, 2.65 [02:37:11] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 1.62, 3.67, 2.47 [02:39:11] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 0.25, 2.47, 2.17 [02:44:05] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 9.24, 5.56, 3.78 [02:48:04] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 0.91, 3.17, 3.22 [02:56:12] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 3.19, 3.79, 3.39 [02:58:12] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 1.25, 2.87, 3.10 [03:02:11] PROBLEM - es4 Current Load on es4 is CRITICAL: CRITICAL - load average: 6.99, 3.97, 2.48 [03:06:10] PROBLEM - es4 Current Load on es4 is WARNING: WARNING - load average: 1.77, 4.00, 2.96 [03:08:09] RECOVERY - es4 Current Load on es4 is OK: OK - load average: 0.38, 2.74, 2.62 [04:14:04] PROBLEM - es4 Current Load on es4 is WARNING: WARNING - load average: 3.43, 2.79, 1.77 [04:16:03] RECOVERY - es4 Current Load on es4 is OK: OK - load average: 1.89, 2.46, 1.78 [04:34:04] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 4.33, 2.48, 1.69 [04:38:04] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 3.07, 2.97, 2.10 [04:54:04] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 4.22, 3.45, 2.48 [04:56:03] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 0.88, 2.44, 2.23 [04:59:43] PROBLEM - es2 Current Load on es2 is CRITICAL: CRITICAL - load average: 5.08, 3.41, 2.28 [05:01:39] PROBLEM - es2 Current Load on es2 is WARNING: WARNING - load average: 3.48, 3.49, 2.45 [05:01:55] PROBLEM - es4 Puppet on es4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [05:03:17] PROBLEM - es4 Current Load on es4 is CRITICAL: CRITICAL - load average: 8.70, 5.66, 3.39 [05:03:35] PROBLEM - es2 Current Load on es2 is CRITICAL: CRITICAL - load average: 6.56, 4.70, 3.02 [05:04:04] RECOVERY - es4 Puppet on es4 is OK: OK: Puppet is currently enabled, last run 15 minutes ago with 0 failures [05:08:39] PROBLEM - es4 Puppet on es4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [05:09:28] PROBLEM - es2 Current Load on es2 is WARNING: WARNING - load average: 2.66, 3.77, 3.16 [05:11:34] PROBLEM - es2 Current Load on es2 is CRITICAL: CRITICAL - load average: 9.22, 5.15, 3.70 [05:12:05] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 3.75, 2.34, 1.89 [05:14:07] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 2.32, 2.50, 2.02 [05:14:13] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 11.31, 4.97, 2.72 [05:15:26] RECOVERY - es2 Current Load on es2 is OK: OK - load average: 0.74, 3.13, 3.23 [05:17:13] RECOVERY - es4 Puppet on es4 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [05:19:40] PROBLEM - es2 Current Load on es2 is WARNING: WARNING - load average: 2.62, 3.52, 3.38 [05:21:41] PROBLEM - es2 Current Load on es2 is CRITICAL: CRITICAL - load average: 7.22, 4.14, 3.58 [05:25:34] RECOVERY - es2 Current Load on es2 is OK: OK - load average: 1.79, 3.32, 3.40 [05:28:49] PROBLEM - es3 SSH on es3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:30:46] RECOVERY - es3 SSH on es3 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [05:35:09] PROBLEM - es1 Puppet on es1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [05:35:33] PROBLEM - es2 Current Load on es2 is CRITICAL: CRITICAL - load average: 8.03, 6.16, 4.18 [05:35:37] PROBLEM - es4 Puppet on es4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [05:36:24] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 10.98, 6.18, 3.22 [05:37:05] RECOVERY - es1 Puppet on es1 is OK: OK: Puppet is currently enabled, last run 14 minutes ago with 0 failures [05:38:45] PROBLEM - es1 SSH on es1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:39:26] RECOVERY - es2 Current Load on es2 is OK: OK - load average: 0.53, 3.05, 3.34 [05:40:48] RECOVERY - es1 SSH on es1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [05:44:16] RECOVERY - es4 Puppet on es4 is OK: OK: Puppet is currently enabled, last run 18 minutes ago with 0 failures [05:48:30] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 0.72, 3.12, 3.82 [05:52:29] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 2.00, 2.50, 3.39 [05:58:44] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 0.84, 2.18, 3.74 [06:00:44] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 0.74, 1.71, 3.38 [06:04:43] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 3.32, 3.23, 3.65 [06:08:42] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 0.52, 2.04, 3.10 [06:11:03] PROBLEM - es4 Current Load on es4 is WARNING: WARNING - load average: 0.37, 1.29, 3.86 [06:17:07] RECOVERY - es4 Current Load on es4 is OK: OK - load average: 1.51, 1.88, 3.30 [06:26:28] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 3.96, 3.18, 2.54 [06:26:48] !log purge binary logs before '2019-07-21 05:00:00'; [06:26:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [06:28:28] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 3.38, 3.27, 2.66 [06:33:49] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 5.24, 3.82, 2.84 [06:35:49] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 1.51, 2.99, 2.66 [06:49:51] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 5.03, 3.52, 2.73 [06:53:50] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 0.93, 3.25, 2.93 [07:15:15] PROBLEM - es1 Puppet on es1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [07:16:30] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 6.51, 5.22, 3.28 [07:17:09] RECOVERY - es1 Puppet on es1 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [07:18:04] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 7.44, 5.28, 3.00 [07:18:29] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 1.50, 3.76, 2.98 [07:20:29] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 0.59, 2.66, 2.67 [07:22:04] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 0.80, 3.31, 2.76 [08:06:04] PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 1.94, 1.29, 0.67 [08:08:04] RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 1.28, 1.20, 0.70 [09:41:55] Reception123, can you see https://phabricator.miraheze.org/T4561? Can’t reproduce on any other page. [09:41:56] [ ⚓ T4561 Flow fatal on commonswiki ] - phabricator.miraheze.org [11:58:00] RF1|pingonreply: I'll look a bit later [11:58:16] No access atm so can't properly investigate [12:51:45] @Reception123 thx [12:53:06] why didn’t I change tgat [13:25:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjMVV [13:25:11] [02miraheze/services] 07MirahezeSSLBot 031c4d33d - BOT: Updating services config for wikis [14:12:48] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 8.48, 4.28, 1.83 [14:13:13] PROBLEM - es3 Puppet on es3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [14:15:22] RECOVERY - es3 Puppet on es3 is OK: OK: Puppet is currently enabled, last run 12 minutes ago with 0 failures [14:26:49] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 0.66, 3.66, 3.64 [14:28:49] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 2.23, 3.01, 3.38 [14:33:13] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.91, 1.84, 1.47 [14:37:13] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.05, 1.91, 1.57 [14:39:13] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.24, 1.66, 1.52 [14:45:13] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.03, 1.72, 1.55 [14:46:53] https://phabricator.miraheze.org/T4562 [14:46:54] [ ⚓ T4562 Custom Domain and SSL Certificate for Wiesepedia ] - phabricator.miraheze.org [14:46:56] :) [14:49:12] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.97, 1.59, 1.56 [14:57:13] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.02, 1.71, 1.59 [14:57:49] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 4.20, 3.44, 2.86 [14:59:12] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.60, 1.62, 1.57 [14:59:49] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 1.51, 2.79, 2.70 [15:03:13] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.38, 1.90, 1.68 [15:05:13] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.69, 1.84, 1.68 [15:05:48] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 6.33, 5.72, 3.92 [15:07:13] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.29, 1.62, 1.62 [15:09:47] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 1.62, 3.16, 3.25 [15:15:27] PROBLEM - es2 Current Load on es2 is WARNING: WARNING - load average: 3.82, 2.44, 1.35 [15:17:26] RECOVERY - es2 Current Load on es2 is OK: OK - load average: 2.55, 2.46, 1.49 [15:25:48] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 3.74, 3.18, 2.90 [15:29:47] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 1.90, 2.73, 2.81 [15:35:50] PROBLEM - es3 Current Load on es3 is CRITICAL: CRITICAL - load average: 8.55, 6.31, 4.20 [15:53:43] PROBLEM - es4 Current Load on es4 is CRITICAL: CRITICAL - load average: 5.49, 3.73, 2.15 [15:55:42] RECOVERY - es4 Current Load on es4 is OK: OK - load average: 1.49, 2.84, 2.01 [15:57:56] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 6.01, 3.33, 2.04 [16:03:39] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.76, 1.88, 1.85 [16:05:39] PROBLEM - es4 Current Load on es4 is CRITICAL: CRITICAL - load average: 5.13, 5.26, 3.33 [16:07:28] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.35, 1.94, 1.85 [16:09:22] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.51, 1.79, 1.81 [16:09:38] PROBLEM - es4 Current Load on es4 is WARNING: WARNING - load average: 2.52, 3.68, 3.12 [16:11:37] PROBLEM - es4 Current Load on es4 is CRITICAL: CRITICAL - load average: 4.60, 3.96, 3.28 [16:12:48] PROBLEM - es2 Puppet on es2 is CRITICAL: connect to address 168.235.110.5 port 5666: Connection refusedconnect to host 168.235.110.5 port 5666: Connection refused [16:13:03] PROBLEM - es2 Disk Space on es2 is CRITICAL: connect to address 168.235.110.5 port 5666: Connection refusedconnect to host 168.235.110.5 port 5666: Connection refused [16:13:31] PROBLEM - es2 SSH on es2 is CRITICAL: connect to address 168.235.110.5 and port 22: Connection refused [16:13:43] that's me ^^ [16:14:04] PROBLEM - es2 Current Load on es2 is CRITICAL: connect to address 168.235.110.5 port 5666: Connection refusedconnect to host 168.235.110.5 port 5666: Connection refused [16:14:49] PROBLEM - es1 Current Load on es1 is CRITICAL: CRITICAL - load average: 10.65, 6.17, 3.04 [16:15:09] PROBLEM - es1 Puppet on es1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [16:15:11] Paladox: What happened with the flow fatal? [16:15:57] I'm not exactly sure what the problem is. But i managed to fix it (we couldn't find the exception in log) [16:17:13] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.94, 2.37, 2.02 [16:17:16] Okay, thx, I asked u on the task but ignore it if you want and I’ll post what u just said later [16:18:48] PROBLEM - Host es2 is DOWN: PING CRITICAL - Packet loss = 100% [16:19:13] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.67, 1.70, 1.81 [16:19:22] RECOVERY - es1 Puppet on es1 is OK: OK: Puppet is currently enabled, last run 15 minutes ago with 0 failures [16:21:13] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.51, 1.29, 1.64 [16:23:10] RECOVERY - Host es2 is UP: PING OK - Packet loss = 0%, RTA = 78.50 ms [16:23:29] PROBLEM - es4 Puppet on es4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [16:23:41] PROBLEM - es1 SSH on es1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:46] PROBLEM - es1 Puppet on es1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [16:25:31] RECOVERY - es4 Puppet on es4 is OK: OK: Puppet is currently enabled, last run 9 minutes ago with 0 failures [16:25:43] RECOVERY - es1 SSH on es1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [16:26:04] PROBLEM - es2 SSH on es2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:26:13] PROBLEM - es3 Current Load on es3 is WARNING: WARNING - load average: 2.14, 2.91, 3.97 [16:27:13] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.78, 1.72, 1.67 [16:27:45] RECOVERY - es1 Puppet on es1 is OK: OK: Puppet is currently enabled, last run 24 minutes ago with 0 failures [16:27:58] RECOVERY - es2 SSH on es2 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [16:29:13] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.33, 1.57, 1.62 [16:30:17] RECOVERY - es3 Current Load on es3 is OK: OK - load average: 1.75, 1.90, 3.29 [16:32:17] PROBLEM - es2 SSH on es2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:33:13] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 3.19, 3.22, 2.34 [16:33:54] PROBLEM - Host es2 is DOWN: PING CRITICAL - Packet loss = 100% [16:35:55] !log rebuilding es2 [16:35:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:38:16] RECOVERY - Host es2 is UP: PING OK - Packet loss = 0%, RTA = 78.21 ms [16:38:21] RECOVERY - es2 SSH on es2 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [16:39:14] PROBLEM - es1 Current Load on es1 is WARNING: WARNING - load average: 0.01, 1.25, 3.89 [16:39:51] PROBLEM - es4 Current Load on es4 is WARNING: WARNING - load average: 0.37, 1.47, 3.80 [16:43:13] RECOVERY - es1 Current Load on es1 is OK: OK - load average: 1.61, 1.40, 3.33 [16:43:50] RECOVERY - es4 Current Load on es4 is OK: OK - load average: 0.65, 1.15, 3.14 [16:44:35] PROBLEM - es2 SSH on es2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:46:29] RECOVERY - es2 SSH on es2 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [16:58:17] PROBLEM - Host es2 is DOWN: PING CRITICAL - Packet loss = 100% [17:05:27] RECOVERY - Host es2 is UP: PING WARNING - Packet loss = 82%, RTA = 78.91 ms [17:05:31] PROBLEM - es2 SSH on es2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:06:35] RECOVERY - es2 SSH on es2 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [17:33:56] PROBLEM - es2 SSH on es2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:35:50] RECOVERY - es2 SSH on es2 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [18:17:56] PROBLEM - es2 SSH on es2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:09] PROBLEM - Host es2 is DOWN: PING CRITICAL - Packet loss = 100% [19:13:48] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.00, 6.62, 5.49 [19:15:48] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.66, 5.83, 5.33 [19:27:13] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.74, 1.19, 1.99 [19:29:48] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.07, 6.43, 5.63 [19:31:13] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.76, 0.95, 1.70 [19:35:48] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.21, 6.25, 5.89 [19:49:52] @NDKilla [19:55:30] @GOTILON someone will do the Pham task soon - don’t worry [19:55:38] *phab task [19:56:41] Ok thanks. [19:58:34] Give it 24-48 hrs and if it isn’t done then poke someone again [20:01:57] !log purge binary logs before '2019-07-21 18:00:00'; [20:02:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:18:25] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.76, 1.91, 1.48 [20:20:19] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 3.00, 2.25, 1.65 [20:31:45] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.71, 1.67, 1.87 [20:33:40] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 3.25, 2.41, 2.12 [22:33:13] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.19, 1.55, 2.00 [22:41:13] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.96, 1.23, 1.68 [22:56:41] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjMXQ [22:56:42] [02miraheze/mediawiki] 07paladox 0344cdd61 - Update PortableInfobox [23:04:21] RECOVERY - Host es2 is UP: PING OK - Packet loss = 0%, RTA = 78.15 ms [23:04:22] PROBLEM - es2 Puppet on es2 is UNKNOWN: UNKNOWN: Failed to check. Reason is: no_summary_file [23:08:19] PROBLEM - es2 Puppet on es2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 0 seconds ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-cli],File[/etc/php/7.3/cli/conf.d],File[/etc/php/7.3/cli/php.ini],Package[php7.3-fpm] [23:14:17] RECOVERY - es2 Puppet on es2 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [23:14:51] PROBLEM - es2 HTTPS on es2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:38:59] !log root@db4:/home/paladox# rm /srv/mariadb/mysql-bin.000982 (bin log was not in /srv/mariadb/mysql-bin.index) [23:39:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master