[01:59:37] Hello test1234! If you have any questions, feel free to ask and someone should answer soon. [02:17:34] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.50, 6.66, 5.75 [02:19:32] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.19, 6.50, 5.80 [02:23:35] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.13, 7.14, 6.20 [02:25:33] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.51, 7.29, 6.37 [02:31:31] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.55, 6.55, 6.41 [02:34:58] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.69, 7.39, 6.05 [02:38:53] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.60, 8.03, 6.56 [02:40:47] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.46, 7.90, 6.69 [02:42:42] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 10.13, 8.66, 7.09 [02:58:31] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 3.33, 6.73, 7.65 [03:00:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeRgb [03:00:10] [02miraheze/services] 07MirahezeSSLBot 03d97d0fa - BOT: Updating services config for wikis [03:02:33] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 2.84, 4.71, 6.59 [04:29:30] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.19, 6.33, 5.27 [04:33:31] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.44, 7.16, 5.83 [04:37:31] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.89, 7.14, 6.13 [04:43:30] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.06, 7.35, 6.46 [04:45:31] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.16, 7.08, 6.46 [04:53:32] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.08, 7.55, 6.81 [04:55:30] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.22, 7.02, 6.71 [04:57:30] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.21, 6.78, 6.66 [05:01:31] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.09, 7.17, 6.86 [05:03:32] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.90, 7.68, 7.07 [05:07:31] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.69, 7.60, 7.18 [05:11:30] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.46, 6.31, 6.78 [06:27:08] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3056 MB (12% inode=94%); [06:44:32] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 2 minutes ago with 9 failures. Failed resources (up to 3 shown) [06:44:54] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 282 failures. Last run 2 minutes ago with 282 failures. Failed resources (up to 3 shown) [06:44:58] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 25 failures. Last run 2 minutes ago with 25 failures. Failed resources (up to 3 shown) [06:45:16] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 287 failures. Last run 2 minutes ago with 287 failures. Failed resources (up to 3 shown) [06:45:48] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 290 failures. Last run 3 minutes ago with 290 failures. Failed resources (up to 3 shown) [06:45:54] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 282 failures. Last run 3 minutes ago with 282 failures. Failed resources (up to 3 shown) [06:46:14] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 178 failures. Last run 2 minutes ago with 178 failures. Failed resources (up to 3 shown): File[espiral.org],File[espiral.org_private],File[wiki.lbcomms.co.za],File[wiki.lbcomms.co.za_private] [06:46:38] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 295 failures. Last run 3 minutes ago with 295 failures. Failed resources (up to 3 shown) [06:46:52] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 259 failures. Last run 3 minutes ago with 259 failures. Failed resources (up to 3 shown): File[wikiescola.com.br],File[wikiescola.com.br_private],File[wiki.jacksonheights.nyc],File[wiki.jacksonheights.nyc_private] [06:54:33] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures [06:54:51] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:54:56] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [06:54:58] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [06:55:21] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures [06:55:43] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:56:03] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:56:15] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [06:56:43] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:23:04] PROBLEM - lizardfs5 Current Load on lizardfs5 is WARNING: WARNING - load average: 3.70, 2.92, 1.47 [08:25:06] RECOVERY - lizardfs5 Current Load on lizardfs5 is OK: OK - load average: 0.65, 2.00, 1.31 [11:12:53] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.70, 7.32, 5.39 [11:14:52] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.78, 6.57, 5.35 [11:15:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeR18 [11:15:11] [02miraheze/services] 07MirahezeSSLBot 033c035b5 - BOT: Updating services config for wikis [11:55:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeRMw [11:55:12] [02miraheze/services] 07MirahezeSSLBot 0313af0e6 - BOT: Updating services config for wikis [13:00:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeRyT [13:00:11] [02miraheze/services] 07MirahezeSSLBot 030c128a9 - BOT: Updating services config for wikis [14:03:14] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2649 MB (10% inode=94%); [14:20:14] paladox: 503 [14:21:48] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.47, 7.39, 6.14 [14:23:42] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.90, 7.07, 6.16 [14:25:37] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.52, 6.47, 6.04 [14:52:49] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.60, 8.04, 5.79 [14:56:53] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.47, 7.13, 5.81 [14:58:41] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [14:58:53] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.73, 6.66, 5.82 [14:59:03] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [15:00:35] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 3.45, 6.63, 6.38 [15:00:37] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [15:01:00] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [15:08:09] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 10.16, 7.33, 6.34 [15:10:04] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.97, 7.51, 6.53 [15:12:00] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.09, 6.51, 6.28 [15:14:48] Ok, well looks like it’s recovered [15:17:52] paladox: you around? [15:18:06] Yes but mobile [15:19:19] paladox: when were the discord webhooks last changed? I think it was you following a staff email [15:19:36] I changed it a few days ago [15:19:43] I replied to the email [15:20:00] Only ops can change it as it requires access to the puppet private repo [15:20:26] paladox: one stopped working 28 hours ago, could that be linked? [15:21:17] Only one? [15:21:23] Which one? [15:21:31] Is it the one from the email? [15:22:19] paladox: cwarswiki - it broke about 40 mins after the change (found the email) [15:22:53] Well carn’t be related if it broke 40 minutes after [15:22:59] Puppet runs every 10 minutes [15:23:52] paladox: forget that, i didn't read the timestamp of your reply [15:24:10] the last edit was 11:57 - you responded 14:34 [15:24:14] paladox: ^ [15:24:43] Ok [15:24:49] Then definitely not related [15:25:04] paladox: the wiki isn't ever so active though [15:26:58] paladox: looks like that could have been the last edit before [15:37:17] !log added discord webhok for cwarswiki [15:37:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:38:17] JohnLewis: webhok? [15:38:20] webhook [15:39:37] !log added discord webhook for nbdbwiki [15:39:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:02:37] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.06, 6.10, 5.24 [16:03:17] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [16:03:55] That doesn’t look good [16:04:36] PROBLEM - lizardfs5 Current Load on lizardfs5 is CRITICAL: CRITICAL - load average: 4.53, 2.98, 1.66 [16:05:53] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.86, 8.67, 7.08 [16:06:31] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.17, 5.26, 5.11 [16:06:35] RECOVERY - lizardfs5 Current Load on lizardfs5 is OK: OK - load average: 0.83, 2.09, 1.48 [16:07:26] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [16:07:46] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 4.85, 7.24, 6.74 [16:08:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeRQH [16:08:37] [02miraheze/puppet] 07paladox 031de0b77 - mediawiki: Lower mfswriteworkers to 3 [16:10:00] !log depool mw1 [16:10:16] !log repool mw1 [16:10:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:10:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:10:52] !log depool mw2 [16:10:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:11:05] !log repool mw2 [16:11:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:11:21] !log depool mw3 [16:11:33] !log repool mw1 [16:11:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:11:36] err [16:11:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:11:40] * paladox fixes [16:13:35] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.38, 6.39, 6.56 [16:15:34] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.88, 7.06, 5.84 [16:17:30] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.67, 6.15, 5.66 [16:19:22] !log install iotop on lizardfs4 [16:19:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:23:22] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 10.62, 7.52, 6.25 [16:27:11] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.65, 7.15, 6.39 [16:29:31] PROBLEM - lizardfs5 Current Load on lizardfs5 is CRITICAL: CRITICAL - load average: 4.61, 2.90, 1.98 [16:31:02] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.93, 6.54, 6.29 [16:31:30] RECOVERY - lizardfs5 Current Load on lizardfs5 is OK: OK - load average: 1.52, 2.28, 1.86 [16:39:00] !log hacked fstab on mw[123] [16:39:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:40:19] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [16:40:38] PROBLEM - mw2 Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [16:41:03] PROBLEM - mw3 Puppet on mw3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 8 minutes ago with 0 failures [16:47:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeR76 [16:47:16] [02miraheze/puppet] 07paladox 039232197 - Update config.yaml [16:49:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeR7D [16:50:01] [02miraheze/puppet] 07paladox 035da3a5a - Update mediawiki.pp [16:58:29] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeR5v [16:58:30] [02miraheze/dns] 07Reception123 03045c175 - add data subdomain to nonbinary.wiki [17:00:38] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [17:01:05] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [17:02:20] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:19:01] PROBLEM - mw3 Puppet on mw3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 5 minutes ago with 0 failures [17:19:42] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.31, 6.29, 5.50 [17:20:23] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 6 minutes ago with 0 failures [17:20:37] PROBLEM - mw2 Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [17:21:41] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.95, 5.96, 5.49 [17:24:38] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JeR5D [17:24:39] [02miraheze/ssl] 07Reception123 038628c8b - add data.nonbinary.wiki cert [17:25:44] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 11.20, 8.53, 6.58 [17:29:48] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.96, 7.60, 6.68 [17:34:19] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 20.35, 11.53, 8.23 [17:36:24] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JeR5p [17:36:26] [02miraheze/ssl] 07Reception123 033ad5b20 - add glp.ink cert [17:40:13] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.11, 7.56, 7.39 [17:45:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeRdT [17:45:14] [02miraheze/services] 07MirahezeSSLBot 031f6f839 - BOT: Updating services config for wikis [17:52:59] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.70, 6.08, 6.79 [17:55:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeRdl [17:55:35] [02miraheze/puppet] 07paladox 03a839c23 - Update mediawiki.pp [17:56:34] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:57:21] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [17:58:09] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:07:27] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.80, 6.95, 6.69 [18:07:27] Hello dross! If you have any questions, feel free to ask and someone should answer soon. [18:09:22] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.42, 6.69, 6.62 [18:13:14] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.30, 7.03, 6.78 [18:17:05] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.51, 6.28, 6.60 [18:22:55] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.07, 7.45, 6.94 [18:24:50] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.88, 7.23, 6.91 [18:28:43] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.42, 8.12, 7.31 [18:32:34] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.29, 7.71, 7.31 [18:38:24] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.98, 6.88, 6.97 [18:44:09] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.91, 6.66, 6.84 [18:46:04] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 5.33, 6.14, 6.62 [19:20:46] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.17, 6.81, 6.57 [19:22:42] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.65, 7.90, 7.00 [19:34:17] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.65, 7.87, 7.59 [19:36:13] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 7.83, 8.01, 7.67 [19:38:11] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.55, 7.45, 7.51 [19:40:10] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.06, 7.48, 7.49 [19:46:02] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 4.93, 7.00, 7.41 [19:50:06] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 10.65, 8.18, 7.70 [19:58:04] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.93, 7.24, 7.62 [20:00:04] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.53, 7.99, 7.83 [20:02:02] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.11, 7.37, 7.63 [20:06:02] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 10.75, 8.25, 7.85 [20:08:01] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 4.56, 7.03, 7.46 [20:10:58] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [20:12:01] PROBLEM - mw2 Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures [20:12:01] PROBLEM - mw3 Puppet on mw3 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures [20:16:03] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 3.42, 5.05, 6.43 [20:39:42] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [20:39:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JeRNY [20:39:45] [02miraheze/puppet] 07paladox 03130d592 - mediawiki: Tweak php config Also increase max_requests to 3000 [20:39:53] [02puppet] 07paladox opened pull request 03#1113: mediawiki: Tweak php config - 13https://git.io/JeRNO [20:40:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JeRN3 [20:40:21] [02miraheze/puppet] 07paladox 03ed07b2e - Update pool.pp [20:40:22] [02puppet] 07paladox synchronize pull request 03#1113: mediawiki: Tweak php config - 13https://git.io/JeRNO [20:40:46] [02puppet] 07paladox closed pull request 03#1113: mediawiki: Tweak php config - 13https://git.io/JeRNO [20:40:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JeRNs [20:40:49] [02miraheze/puppet] 07paladox 0315a73b5 - mediawiki: Tweak php config (#1113) * mediawiki: Tweak php config Also increase max_requests to 3000 * Update pool.pp [20:40:50] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [20:40:52] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [20:41:58] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [20:42:00] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [20:42:51] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [22:23:35] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.98, 8.04, 6.44 [22:25:34] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.98, 7.19, 6.32 [22:27:33] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.94, 6.80, 6.28 [23:49:05] PROBLEM - lizardfs4 Current Load on lizardfs4 is CRITICAL: CRITICAL - load average: 4.04, 2.50, 1.26 [23:51:05] PROBLEM - lizardfs4 Current Load on lizardfs4 is WARNING: WARNING - load average: 3.58, 2.72, 1.49 [23:55:07] RECOVERY - lizardfs4 Current Load on lizardfs4 is OK: OK - load average: 1.89, 2.71, 1.81