[00:02:14] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.30, 6.84, 6.76 [00:03:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:08:13] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.71, 6.30, 6.66 [00:12:12] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.04, 6.77, 6.74 [00:14:10] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.79, 6.63, 6.72 [00:20:08] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.17, 6.79, 6.68 [00:22:07] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.13, 6.64, 6.66 [00:26:05] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.70, 7.06, 6.90 [00:36:01] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.86, 6.49, 6.75 [00:45:14] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ssh] [00:53:16] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:53:55] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.04, 7.14, 6.79 [00:57:53] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.28, 6.52, 6.61 [01:32:39] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.76, 7.32, 6.59 [01:34:40] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.31, 7.23, 6.72 [01:35:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 4 failures. Last run 3 minutes ago with 4 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [01:36:39] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.50, 6.71, 6.62 [01:40:37] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.54, 7.28, 6.95 [01:43:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:44:34] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.87, 6.07, 6.57 [02:05:12] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 12 failures. Last run 3 minutes ago with 12 failures. Failed resources (up to 3 shown): Package[openssh-server],Service[ssh],Package[exim4],Service[postfix] [02:13:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:20:34] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.21, 7.42, 6.56 [02:25:28] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 12 failures. Last run 3 minutes ago with 12 failures. Failed resources (up to 3 shown): Package[openssh-server],Service[ssh],Package[exim4],Service[postfix] [02:28:39] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.98, 7.70, 7.56 [02:33:20] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:34:38] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.79, 5.78, 6.64 [02:44:40] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.54, 7.24, 6.72 [02:50:41] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.13, 6.46, 6.66 [02:54:39] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.10, 7.15, 6.90 [02:56:38] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.52, 6.66, 6.79 [03:02:36] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.68, 7.16, 6.96 [03:05:12] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [03:10:32] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.21, 5.71, 6.46 [03:13:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:23:28] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.40, 7.13, 6.66 [03:25:10] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [03:25:31] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.26, 6.33, 6.42 [03:33:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:44:23] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.54, 6.85, 6.38 [03:46:23] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.92, 5.87, 6.10 [04:05:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [04:25:25] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.50, 7.24, 6.87 [04:27:25] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.85, 6.14, 6.52 [04:43:12] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:52:27] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:52:35] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:52:39] PROBLEM - db5 Puppet on db5 is CRITICAL: CRITICAL: Puppet has 16 failures. Last run 2 minutes ago with 16 failures. Failed resources (up to 3 shown) [04:53:10] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:53:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:53:16] PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:53:19] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:53:19] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:53:22] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:53:28] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:53:48] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:53:51] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:54:07] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:54:08] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:54:13] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [04:54:18] PROBLEM - lizardfs6 Puppet on lizardfs6 is CRITICAL: CRITICAL: Puppet has 230 failures. Last run 3 minutes ago with 230 failures. Failed resources (up to 3 shown) [04:54:21] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:04:13] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [05:04:32] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [05:04:38] RECOVERY - db5 Puppet on db5 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures [05:05:16] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:05:17] RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:05:18] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:05:23] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [05:05:24] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures [05:05:29] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [05:05:51] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:06:00] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:06:08] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:06:30] RECOVERY - lizardfs6 Puppet on lizardfs6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:06:34] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [05:06:35] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:07:12] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:07:24] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.31, 7.21, 6.57 [05:07:34] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:11:22] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.96, 6.62, 6.57 [06:12:15] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.91, 7.27, 6.69 [06:18:12] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.55, 6.67, 6.74 [06:22:11] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.31, 8.18, 7.36 [06:23:51] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2400:6180:0:d0::403:f001/cpweb [06:25:10] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [06:25:51] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [06:27:20] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2669 MB (11% inode=94%); [06:32:10] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.18, 6.94, 7.41 [06:40:13] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.66, 5.88, 6.53 [06:43:11] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:54:13] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2649 MB (10% inode=94%); [07:04:26] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.61, 7.36, 6.96 [07:06:27] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.06, 6.74, 6.79 [07:35:13] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[ops_ensure_members] [07:43:12] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:15:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [09:23:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:35:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[ops_ensure_members] [09:43:12] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:55:10] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[ops_ensure_members] [10:03:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:35:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [10:43:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:05:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [11:23:13] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:03:43] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.27, 6.83, 6.33 [12:05:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.44, 6.42, 6.25 [12:15:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ssh] [12:23:09] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:40:08] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeXdJ [12:40:09] [02miraheze/services] 07MirahezeSSLBot 038f956d0 - BOT: Updating services config for wikis [12:42:27] Hello artoo__! If you have any questions, feel free to ask and someone should answer soon. [12:55:13] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[ops_ensure_members] [13:03:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:25:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 11 failures. Last run 3 minutes ago with 11 failures. Failed resources (up to 3 shown): Service[ssh],Package[exim4],Service[postfix],Exec[ufw-logging-low] [13:33:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:05:10] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 7 failures. Last run 3 minutes ago with 7 failures. Failed resources (up to 3 shown): Package[exim4],Service[postfix],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [14:13:15] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:25:14] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 12 failures. Last run 3 minutes ago with 12 failures. Failed resources (up to 3 shown): Package[openssh-server],Service[ssh],Package[exim4],Service[postfix] [14:43:12] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:10:07] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeXAL [15:10:09] [02miraheze/services] 07MirahezeSSLBot 0386fe841 - BOT: Updating services config for wikis [15:14:56] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.41, 6.82, 6.23 [15:16:56] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.89, 6.13, 6.07 [15:24:27] Sysadmins and stewards - who is higher? [15:43:51] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.00, 6.83, 6.63 [15:45:50] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.50, 6.41, 6.49 [15:55:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [15:59:46] Wolf20482: They do different tasks, they aren't in a hierarchy [15:59:49] so none is 'higher' [16:05:59] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.90, 7.16, 6.62 [16:08:00] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.41, 6.47, 6.43 [16:33:14] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:54:23] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.00, 6.93, 6.66 [16:55:10] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[prometheus-node-exporter] [16:58:23] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.84, 6.16, 6.40 [17:03:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:43:40] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.13, 7.17, 6.73 [17:45:41] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.68, 6.50, 6.56 [17:55:41] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.88, 7.12, 6.92 [17:56:31] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 81.4.109.133/cpweb [17:58:30] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [18:05:52] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.24, 7.48, 7.16 [18:07:52] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.37, 7.47, 7.22 [18:13:53] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.35, 5.71, 6.56 [18:17:50] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.38, 7.43, 7.06 [18:25:12] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [18:27:55] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.21, 7.73, 7.70 [18:33:10] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:41:57] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.09, 8.13, 7.74 [18:45:08] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Je1ej [18:45:09] [02miraheze/services] 07MirahezeSSLBot 03ae3a5dd - BOT: Updating services config for wikis [18:45:15] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [18:46:02] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.21, 7.66, 7.76 [18:48:06] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.51, 7.91, 7.82 [18:48:21] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 107.191.126.23/cpweb [18:50:16] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [18:51:45] hi [18:52:08] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.76, 7.75, 7.84 [18:53:11] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:54:09] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 7.87, 8.08, 7.98 [18:56:08] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.30, 7.58, 7.80 [18:56:48] wgExtraInterlanguageLinkPrefixes is somewhere else in GitHub or ManageWiki? because it works in nonbinary but I don't see it configured. Or maybe I'm missing something. paladox RhinosF1 :( [18:57:51] hispano76 https://github.com/miraheze/mw-config/search?utf8=✓&q=wgExtraInterlanguageLinkPrefixes&type= [18:57:52] [ Search · wgExtraInterlanguageLinkPrefixes · GitHub ] - github.com [19:00:08] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Je1vC [19:00:09] [02miraheze/services] 07MirahezeSSLBot 0391fdb1a - BOT: Updating services config for wikis [19:00:22] Settings.php not paladox [19:00:55] in Localwiki.php I see that setting but for another wiki. [19:01:47] It’s in LocalSettings.php [19:01:58] or will it be an old configuration that was deleted but the cache was left? [19:02:08] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.66, 7.64, 7.66 [19:04:03] I only see nonciclopediawiki enabled but I can't explain that it already appears in sidebar other languages https://nonbinary.wiki/wiki/Agender [19:04:05] [ Agender - Nonbinary Wiki ] - nonbinary.wiki [19:04:05] paladox: [19:05:36] see https://usercontent.irccloud-cdn.com/file/vyhHunVJ/Anotaci%C3%B3n%202019-11-28%20130510.png [19:06:09] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.74, 7.81, 7.81 [19:10:43] I guess you didn't understand me. paladox :) [19:10:47] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.40, 5.80, 6.77 [19:14:52] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.79, 7.33, 7.20 [19:16:56] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/Je1vp [19:16:58] [02miraheze/dns] 07Reception123 035b8054d - add portalsofphereon.com zone [19:21:02] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.47, 7.70, 7.35 [19:23:06] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.81, 7.84, 7.49 [19:23:45] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 12 failures. Last run 2 minutes ago with 12 failures. Failed resources (up to 3 shown): Package[openssh-server],Service[ssh],Package[exim4],Service[postfix] [19:29:05] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.64, 7.91, 7.65 [19:31:05] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.87, 7.84, 7.68 [19:33:08] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.70, 8.67, 8.05 [19:33:27] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 107.191.126.23/cpweb, 2400:6180:0:d0::403:f001/cpweb [19:34:19] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 107.191.126.23/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [19:35:09] PROBLEM - cp2 Stunnel Http for mw3 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [19:35:27] PROBLEM - cp3 Stunnel Http for mw3 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [19:36:17] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [19:37:09] RECOVERY - cp2 Stunnel Http for mw3 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 5.554 second response time [19:37:22] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [19:37:29] RECOVERY - cp3 Stunnel Http for mw3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24655 bytes in 6.768 second response time [19:39:18] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.28, 7.92, 7.99 [19:41:18] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 7.98, 8.08, 8.05 [19:41:48] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [19:47:34] PROBLEM - cp2 Stunnel Http for mw3 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [19:48:19] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 107.191.126.23/cpweb, 128.199.139.216/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [19:51:09] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 2a00:d880:5:8ea::ebc7/cpweb [19:51:22] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.46, 7.73, 7.98 [19:51:37] RECOVERY - cp2 Stunnel Http for mw3 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24661 bytes in 3.654 second response time [19:52:24] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [19:53:29] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.68, 8.24, 8.13 [19:56:59] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [19:58:59] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [20:02:45] PROBLEM - cp4 Stunnel Http for mw3 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:02:51] PROBLEM - cp3 Stunnel Http for mw3 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:03:08] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 107.191.126.23/cpweb [20:03:22] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures [20:03:31] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2400:6180:0:d0::403:f001/cpweb [20:04:45] RECOVERY - cp4 Stunnel Http for mw3 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 2.635 second response time [20:04:50] RECOVERY - cp3 Stunnel Http for mw3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24661 bytes in 4.738 second response time [20:05:04] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [20:05:30] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [20:05:36] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.76, 6.79, 7.55 [20:13:36] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.04, 7.95, 7.69 [20:15:36] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.25, 7.45, 7.54 [20:15:59] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:23:47] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 7.91, 8.04, 7.79 [20:23:57] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 11 failures. Last run 2 minutes ago with 11 failures. Failed resources (up to 3 shown): Service[ssh],Package[exim4],Service[postfix],Exec[ufw-logging-low] [20:24:28] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:25:46] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.90, 7.41, 7.58 [20:32:01] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [20:45:00] PROBLEM - cp4 Stunnel Http for mw3 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:45:11] PROBLEM - cp2 Stunnel Http for mw3 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:45:26] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 81.4.109.133/cpweb [20:45:41] PROBLEM - cp3 Stunnel Http for mw3 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:47:36] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [20:47:46] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.35, 5.64, 6.43 [20:49:13] RECOVERY - cp2 Stunnel Http for mw3 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24655 bytes in 3.286 second response time [20:49:13] RECOVERY - cp4 Stunnel Http for mw3 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 24661 bytes in 2.936 second response time [20:49:50] RECOVERY - cp3 Stunnel Http for mw3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24655 bytes in 2.580 second response time [20:53:21] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 5 datacenters are down: 107.191.126.23/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [20:53:33] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 81.4.109.133/cpweb [20:53:49] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.78, 7.18, 6.92 [20:53:56] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 2 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [20:59:16] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [20:59:32] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [21:03:44] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:17:40] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.74, 5.80, 6.46 [21:23:37] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.76, 7.06, 6.60 [21:25:36] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.43, 6.34, 6.37 [21:33:32] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.76, 7.22, 6.66 [21:35:31] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.30, 6.59, 6.52 [21:43:27] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.20, 6.96, 6.59 [21:45:11] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 12 failures. Last run 3 minutes ago with 12 failures. Failed resources (up to 3 shown): Package[openssh-server],Service[ssh],Package[exim4],Service[postfix] [21:45:26] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.69, 6.57, 6.50 [21:53:14] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:04:18] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.82, 6.86, 6.66 [22:06:17] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.01, 6.53, 6.57 [22:25:15] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[ops_ensure_members] [22:33:13] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:34:00] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.19, 6.83, 6.36 [22:35:59] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.16, 6.62, 6.38 [22:43:58] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.54, 6.81, 6.46 [22:47:57] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.49, 6.41, 6.46 [22:54:01] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.59, 7.49, 6.98 [22:56:40] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 1 datacenter is down: 2604:180:0:33b::2/cpweb [22:58:34] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [23:02:20] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.07, 7.87, 7.34 [23:04:25] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.50, 6.83, 7.08 [23:05:14] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666],Exec[ufw-allow-tcp-from-185.52.3.121-to-any-port-9100] [23:06:11] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [23:12:44] PROBLEM - cp3 Stunnel Http for mw3 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [23:12:58] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.29, 7.65, 7.29 [23:13:15] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb [23:13:19] PROBLEM - cp2 Stunnel Http for mw3 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [23:13:43] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:14:02] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 3 datacenters are down: 107.191.126.23/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb [23:14:40] RECOVERY - cp3 Stunnel Http for mw3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 0.681 second response time [23:14:58] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.16, 6.83, 7.11 [23:15:18] RECOVERY - cp2 Stunnel Http for mw3 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 4.061 second response time [23:17:16] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [23:17:52] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [23:23:34] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [23:29:04] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.18, 6.42, 6.73