[00:00:52] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 6 minutes ago with 0 failures [00:01:03] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw2 [00:01:25] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 5 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [00:01:35] PROBLEM - cp3 Stunnel Http for mw2 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:02:39] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 2 backends are down. mw2 mw3 [00:02:42] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 4 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [00:02:46] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw3 [00:03:11] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures [00:03:24] uh [00:04:13] PROBLEM - cp2 Stunnel Http for mw2 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:04:23] PROBLEM - cp4 Stunnel Http for mw2 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:05:28] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.07, 7.17, 6.63 [00:06:28] RECOVERY - cp4 Stunnel Http for mw2 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 24661 bytes in 2.897 second response time [00:09:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeuTh [00:09:02] [02miraheze/puppet] 07paladox 03aed477f - Update mfschunkserver.cfg.erb [00:09:22] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 10.10, 8.48, 7.29 [00:10:36] RECOVERY - cp2 Stunnel Http for mw2 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24661 bytes in 3.123 second response time [00:10:55] !log restart lizardfs-chunkserver on lizardfs[45] [00:10:55] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [00:13:28] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.14, 6.53, 5.49 [00:14:18] PROBLEM - cp4 Stunnel Http for mw3 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:14:28] PROBLEM - cp3 Stunnel Http for mw3 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:14:49] PROBLEM - mw1 HTTPS on mw1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:15:00] PROBLEM - mw3 HTTPS on mw3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:15:10] PROBLEM - mw2 HTTPS on mw2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:15:36] PROBLEM - cp3 Stunnel Http for mw1 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:15:51] PROBLEM - cp4 Stunnel Http for mw2 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:15:53] PROBLEM - cp2 Stunnel Http for mw1 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:15:57] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 2.41, 4.66, 4.94 [00:16:21] PROBLEM - cp4 Stunnel Http for mw1 on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:16:22] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 2.28, 6.29, 7.00 [00:16:38] PROBLEM - cp2 Stunnel Http for mw2 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:16:46] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [00:16:48] RECOVERY - cp3 Stunnel Http for mw3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 0.639 second response time [00:16:57] RECOVERY - mw1 HTTPS on mw1 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 442 bytes in 0.017 second response time [00:16:59] RECOVERY - mw3 HTTPS on mw3 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 442 bytes in 0.015 second response time [00:17:03] RECOVERY - mw2 HTTPS on mw2 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 442 bytes in 0.014 second response time [00:17:26] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 3.51, 5.32, 7.52 [00:17:34] RECOVERY - cp3 Stunnel Http for mw1 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24661 bytes in 0.713 second response time [00:17:50] RECOVERY - cp2 Stunnel Http for mw1 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 0.392 second response time [00:18:18] RECOVERY - cp4 Stunnel Http for mw1 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 0.053 second response time [00:20:35] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.52, 7.65, 7.36 [00:20:55] RECOVERY - cp4 Stunnel Http for mw3 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 24655 bytes in 0.004 second response time [00:21:29] PROBLEM - cp3 Stunnel Http for mw3 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:21:32] PROBLEM - cp2 Stunnel Http for mw3 on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:22:01] RECOVERY - cp4 Stunnel Http for mw2 on cp4 is OK: HTTP OK: HTTP/1.1 200 OK - 24655 bytes in 0.006 second response time [00:22:01] RECOVERY - cp3 Stunnel Http for mw2 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 0.690 second response time [00:22:32] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.73, 7.10, 7.21 [00:23:05] RECOVERY - cp2 Stunnel Http for mw2 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 8.434 second response time [00:23:29] RECOVERY - cp3 Stunnel Http for mw3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 1.374 second response time [00:23:33] RECOVERY - cp2 Stunnel Http for mw3 on cp2 is OK: HTTP OK: HTTP/1.1 200 OK - 24639 bytes in 0.389 second response time [00:23:42] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 11.10, 7.46, 7.56 [00:24:05] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [00:24:31] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.21, 7.85, 7.48 [00:24:54] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [00:25:01] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [00:26:27] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.49, 7.70, 7.46 [00:26:38] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:27:33] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.64, 7.34, 7.53 [00:28:10] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [00:28:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeuk6 [00:28:38] [02miraheze/puppet] 07paladox 036014c2f - Revert "Send thumbnail generation requests to mw2 (also send thumbernails to mw2) (#1124)" This reverts commit 659a0eebf012b44cf9e99a78368777570406eaf7. [00:29:29] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.74, 8.26, 7.84 [00:34:09] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.47, 7.74, 7.43 [00:49:38] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.32, 7.82, 7.81 [00:51:34] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.18, 8.11, 7.90 [00:59:12] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.78, 7.52, 7.80 [01:01:12] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.04, 8.06, 7.96 [01:03:07] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.94, 7.93, 7.91 [01:05:06] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.56, 8.00, 7.93 [01:07:02] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.03, 7.77, 7.86 [01:11:00] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.69, 7.95, 7.88 [01:12:58] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.94, 7.91, 7.87 [01:14:55] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.31, 8.05, 7.92 [01:20:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeuIt [01:20:14] [02miraheze/services] 07MirahezeSSLBot 03557551a - BOT: Updating services config for wikis [01:20:45] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.78, 7.51, 7.75 [01:22:24] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.69, 7.09, 7.95 [01:22:46] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.19, 7.78, 7.81 [01:24:43] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.97, 7.40, 7.66 [01:28:43] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.80, 7.59, 7.62 [01:31:45] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.03, 5.85, 5.18 [01:33:48] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.47, 5.40, 5.10 [01:34:08] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.12, 7.32, 7.50 [01:34:45] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.86, 7.76, 7.75 [01:36:08] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.44, 7.37, 7.49 [01:40:11] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.36, 7.56, 7.46 [01:46:12] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.47, 7.19, 7.32 [01:52:10] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.67, 7.49, 7.34 [01:58:08] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.38, 7.00, 7.24 [01:58:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.53, 6.08, 6.78 [02:02:09] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.34, 5.58, 6.59 [02:25:24] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.90, 6.73, 6.32 [02:27:19] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.02, 7.51, 6.64 [02:31:16] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.70, 7.69, 6.91 [02:31:46] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.83, 7.25, 6.66 [02:43:28] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.19, 6.65, 6.77 [02:46:43] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.08, 7.44, 7.13 [02:48:43] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.25, 7.31, 7.12 [02:56:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.45, 6.28, 6.71 [03:02:58] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 10.38, 7.51, 6.68 [03:04:48] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.06, 7.07, 6.82 [03:04:54] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.44, 7.58, 6.82 [03:08:44] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.30, 6.80, 6.77 [03:08:51] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.72, 6.26, 6.45 [03:20:47] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.53, 7.10, 6.78 [03:24:33] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.66, 6.82, 6.48 [03:26:29] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.81, 6.10, 6.25 [03:26:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.35, 6.68, 6.71 [03:35:34] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.50, 6.64, 5.25 [03:37:30] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.03, 5.74, 5.09 [03:42:26] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.74, 6.69, 6.45 [03:43:24] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.01, 7.19, 6.84 [03:46:18] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.17, 7.48, 6.82 [03:47:13] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.68, 7.71, 7.15 [03:50:15] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.31, 7.49, 6.96 [03:52:57] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.11, 6.31, 6.72 [03:54:08] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 5.27, 6.23, 6.55 [04:04:14] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2400:6180:0:d0::403:f001/cpweb [04:05:10] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.71, 7.41, 7.03 [04:06:12] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [04:08:31] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.48, 7.54, 6.69 [04:18:14] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.77, 7.64, 7.59 [04:22:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.76, 6.41, 6.72 [04:30:08] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 5.25, 6.09, 6.77 [04:48:43] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.16, 6.49, 6.16 [04:50:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.10, 6.38, 6.16 [06:12:43] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.27, 6.47, 5.77 [06:16:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.08, 6.69, 6.04 [06:22:44] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.08, 6.64, 6.18 [06:24:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.93, 6.34, 6.12 [06:26:42] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2787 MB (11% inode=94%); [06:30:46] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.05, 6.70, 6.32 [06:34:46] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.60, 6.72, 6.41 [07:10:24] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.88, 6.35, 5.37 [07:12:20] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.29, 6.27, 5.45 [08:06:08] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.77, 6.87, 5.61 [08:08:08] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.40, 6.52, 5.63 [09:01:42] This user is now online in #wm-bot. I'll let you know when they show some activity (talk, etc.) [09:01:42] @notify Examknow you’ve got mail [09:06:44] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.63, 6.86, 6.11 [09:08:43] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.75, 7.53, 6.45 [09:10:43] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.62, 7.30, 6.48 [09:12:43] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.01, 6.80, 6.39 [09:23:50] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2647 MB (10% inode=94%); [09:25:33] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.95, 7.14, 6.73 [09:27:28] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.37, 7.86, 7.03 [09:33:15] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.66, 7.93, 7.39 [09:38:59] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.61, 5.93, 6.66 [10:12:52] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.32, 6.26, 5.52 [10:14:51] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.79, 6.10, 5.55 [10:16:16] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.00, 7.45, 6.44 [10:17:55] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.84, 6.56, 6.33 [10:18:12] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.11, 6.88, 6.35 [10:19:53] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.44, 6.63, 6.39 [10:20:08] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.70, 6.74, 6.35 [10:42:37] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.39, 7.34, 6.47 [10:44:37] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.88, 7.72, 6.72 [10:48:35] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.45, 6.25, 6.33 [10:54:42] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.88, 6.60, 6.43 [10:56:00] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.20, 6.68, 6.39 [10:56:42] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.98, 6.06, 6.26 [11:03:38] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.64, 6.76, 6.60 [11:10:04] Reception123: ? why are we having so much load issues [11:10:24] RhinosF1: no idea I've finished wikibackups [11:10:39] Reception123: I'll keep an eye out and try and catch it [11:20:25] revi: hi. you still planning on doing https://meta.miraheze.org/wiki/Community_noticeboard#CoCC_election ? [11:20:26] [ Community noticeboard - Miraheze Meta ] - meta.miraheze.org [11:20:29] If you're busy I can do it [11:23:03] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.09, 6.85, 6.49 [11:26:52] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.17, 6.81, 6.57 [11:28:47] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.72, 6.76, 6.58 [11:33:56] Reception123: yes, tonight [11:34:04] revi: ok, thanks [11:43:47] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 10.20, 7.16, 5.71 [11:44:09] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.92, 6.37, 5.69 [11:45:42] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.99, 6.82, 6.60 [11:45:48] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.31, 7.41, 5.99 [11:46:08] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.22, 6.44, 5.81 [11:51:46] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.92, 6.33, 5.97 [11:56:56] revi: can you look at updating your private wiki's ssl cert [11:57:14] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.49, 6.26, 6.50 [11:57:15] planned for now as well [11:57:22] ok [11:57:23] gonna do it this weekend or so [11:57:52] as long as it's done before icinga moans at me again [12:01:31] just suppress it /-p [12:03:04] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.31, 7.18, 6.76 [12:04:45] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.61, 7.38, 6.40 [12:04:59] hello [12:05:41] revi: i suppose I can if it gets past it [12:05:45] ErtasVideos: hi [12:06:21] finally someone active on irc [12:06:41] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.98, 6.45, 6.18 [12:06:54] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.63, 6.74, 6.71 [12:07:22] ErtasVideos: what do you need? [12:08:26] idk im bored [12:08:37] im on windows 2000 rn [12:08:59] because whynot [12:10:09] ErtasVideos: why don't you try #miraheze-offtopic, there's normally someone there and most of the time it links to discord which is pretty active as well [12:11:05] im actually on the discord but i want to talk here [12:14:52] oh ok [12:38:44] .mh sal [12:38:45] https://meta.miraheze.org/wiki/sal [12:38:55] .mh SAL [12:38:55] https://meta.miraheze.org/wiki/SAL [12:55:21] .tell johnlewis wiki exists errors don't work for blank dbs per exception bd7b358c2339fcd58a8330b0 [12:55:22] RhinosF1: I'll pass that on when johnlewis is around. [13:19:50] PROBLEM - studentwiki.ddns.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'studentwiki.ddns.net' expires in 15 day(s) (Wed 13 Nov 2019 01:17:03 PM GMT +0000). [13:20:11] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeunr [13:20:12] [02miraheze/ssl] 07MirahezeSSLBot 03c467a82 - Bot: Update SSL cert for studentwiki.ddns.net [13:20:14] PROBLEM - wiki.svenskabriardklubben.se - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.svenskabriardklubben.se' expires in 15 day(s) (Wed 13 Nov 2019 01:17:42 PM GMT +0000). [13:20:28] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeuno [13:20:30] [02miraheze/ssl] 07MirahezeSSLBot 03e78e224 - Bot: Update SSL cert for wiki.svenskabriardklubben.se [13:21:20] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.86, 6.31, 5.96 [13:22:03] PROBLEM - holonet.pw - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'holonet.pw' expires in 15 day(s) (Wed 13 Nov 2019 01:19:35 PM GMT +0000). [13:22:20] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeunX [13:22:21] [02miraheze/ssl] 07MirahezeSSLBot 0362e2c11 - Bot: Update SSL cert for holonet.pw [13:23:29] PROBLEM - wiki.ngscott.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ngscott.net' expires in 15 day(s) (Wed 13 Nov 2019 01:19:47 PM GMT +0000). [13:23:47] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeunS [13:23:48] [02miraheze/ssl] 07MirahezeSSLBot 03f0e7cd6 - Bot: Update SSL cert for wiki.ngscott.net [13:25:14] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.22, 7.06, 6.33 [13:27:10] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 5.08, 6.29, 6.13 [13:33:22] RECOVERY - wiki.ngscott.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ngscott.net' will expire on Sun 26 Jan 2020 12:23:38 PM GMT +0000. [13:33:48] RECOVERY - studentwiki.ddns.net - LetsEncrypt on sslhost is OK: OK - Certificate 'studentwiki.ddns.net' will expire on Sun 26 Jan 2020 12:19:59 PM GMT +0000. [13:33:55] RECOVERY - holonet.pw - LetsEncrypt on sslhost is OK: OK - Certificate 'holonet.pw' will expire on Sun 26 Jan 2020 12:22:13 PM GMT +0000. [13:34:17] RECOVERY - wiki.svenskabriardklubben.se - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.svenskabriardklubben.se' will expire on Sun 26 Jan 2020 12:20:22 PM GMT +0000. [13:49:46] PROBLEM - wiki.dobots.nl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.dobots.nl' expires in 15 day(s) (Wed 13 Nov 2019 01:47:13 PM GMT +0000). [13:50:01] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeucy [13:50:03] [02miraheze/ssl] 07MirahezeSSLBot 036d06731 - Bot: Update SSL cert for wiki.dobots.nl [13:52:07] PROBLEM - wiki.pupilliam.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.pupilliam.com' expires in 15 day(s) (Wed 13 Nov 2019 01:48:55 PM GMT +0000). [13:52:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeucd [13:52:27] [02miraheze/ssl] 07MirahezeSSLBot 03bc71d2c - Bot: Update SSL cert for wiki.pupilliam.com [13:53:10] PROBLEM - wiki.mikrodev.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mikrodev.com' expires in 15 day(s) (Wed 13 Nov 2019 01:50:54 PM GMT +0000). [13:53:32] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeucb [13:53:34] [02miraheze/ssl] 07MirahezeSSLBot 033d80e15 - Bot: Update SSL cert for wiki.mikrodev.com [13:53:47] PROBLEM - enc.for.uz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'enc.for.uz' expires in 15 day(s) (Wed 13 Nov 2019 01:50:42 PM GMT +0000). [13:54:02] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeucA [13:54:04] [02miraheze/ssl] 07MirahezeSSLBot 03cb8a9ed - Bot: Update SSL cert for enc.for.uz [13:54:56] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.66, 7.19, 6.55 [13:55:27] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.57, 6.98, 6.36 [13:55:38] PROBLEM - wiki.campaign-labour.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.campaign-labour.org' expires in 15 day(s) (Wed 13 Nov 2019 01:52:19 PM GMT +0000). [13:55:55] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeuch [13:55:57] [02miraheze/ssl] 07MirahezeSSLBot 03f5c6d47 - Bot: Update SSL cert for wiki.campaign-labour.org [13:57:23] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.96, 6.33, 6.20 [13:57:28] PROBLEM - wiki.bonessdiving.club - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.bonessdiving.club' expires in 15 day(s) (Wed 13 Nov 2019 01:53:42 PM GMT +0000). [13:57:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeuCJ [13:57:45] [02miraheze/ssl] 07MirahezeSSLBot 038e6e4d5 - Bot: Update SSL cert for wiki.bonessdiving.club [13:58:52] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.88, 6.60, 6.45 [14:03:08] RECOVERY - wiki.mikrodev.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mikrodev.com' will expire on Sun 26 Jan 2020 12:53:25 PM GMT +0000. [14:03:25] RECOVERY - wiki.bonessdiving.club - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.bonessdiving.club' will expire on Sun 26 Jan 2020 12:57:36 PM GMT +0000. [14:03:38] RECOVERY - wiki.campaign-labour.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.campaign-labour.org' will expire on Sun 26 Jan 2020 12:55:48 PM GMT +0000. [14:03:44] RECOVERY - enc.for.uz - LetsEncrypt on sslhost is OK: OK - Certificate 'enc.for.uz' will expire on Sun 26 Jan 2020 12:53:56 PM GMT +0000. [14:03:45] RECOVERY - wiki.dobots.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dobots.nl' will expire on Sun 26 Jan 2020 12:49:55 PM GMT +0000. [14:04:09] RECOVERY - wiki.pupilliam.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.pupilliam.com' will expire on Sun 26 Jan 2020 12:52:17 PM GMT +0000. [14:15:11] PROBLEM - wiki.rmbrk.sk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.rmbrk.sk' expires in 15 day(s) (Wed 13 Nov 2019 02:12:19 PM GMT +0000). [14:15:16] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.15, 6.73, 6.45 [14:15:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeuCa [14:15:29] [02miraheze/ssl] 07MirahezeSSLBot 03fe9b7ab - Bot: Update SSL cert for wiki.rmbrk.sk [14:16:57] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.58, 7.05, 6.61 [14:18:54] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.85, 7.81, 6.94 [14:20:49] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.23, 7.76, 7.03 [14:21:01] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.03, 6.70, 6.56 [14:23:11] RECOVERY - wiki.rmbrk.sk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rmbrk.sk' will expire on Sun 26 Jan 2020 01:15:21 PM GMT +0000. [14:28:12] PROBLEM - vsfan.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'vsfan.net' expires in 15 day(s) (Wed 13 Nov 2019 02:25:14 PM GMT +0000). [14:28:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeuCh [14:28:28] [02miraheze/ssl] 07MirahezeSSLBot 034278544 - Bot: Update SSL cert for vsfan.net [14:28:33] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 5.80, 6.60, 6.76 [14:29:27] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'infectowiki.com' expires in 15 day(s) (Wed 13 Nov 2019 02:26:38 PM GMT +0000). [14:29:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeuWv [14:29:42] [02miraheze/ssl] 07MirahezeSSLBot 037ab29d4 - Bot: Update SSL cert for infectowiki.com [14:31:36] PROBLEM - wiki.whentheycry.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.whentheycry.org' expires in 15 day(s) (Wed 13 Nov 2019 02:29:27 PM GMT +0000). [14:31:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeuWk [14:31:59] [02miraheze/ssl] 07MirahezeSSLBot 031f0de58 - Bot: Update SSL cert for wiki.whentheycry.org [14:32:22] PROBLEM - tensegritywiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'tensegritywiki.com' expires in 15 day(s) (Wed 13 Nov 2019 02:30:15 PM GMT +0000). [14:32:38] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeuWL [14:32:40] [02miraheze/ssl] 07MirahezeSSLBot 03ca8a30f - Bot: Update SSL cert for tensegritywiki.com [14:34:20] RECOVERY - vsfan.net - LetsEncrypt on sslhost is OK: OK - Certificate 'vsfan.net' will expire on Sun 26 Jan 2020 01:28:19 PM GMT +0000. [14:34:27] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.80, 7.12, 6.90 [14:37:58] Hello sphinx! If you have any questions, feel free to ask and someone should answer soon. [14:38:09] Hi [14:40:25] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.84, 7.51, 7.07 [14:40:39] Hello live_in_the_405! If you have any questions, feel free to ask and someone should answer soon. [14:41:52] sorry to be a bother, but I am trying to create a new account and am receiving the following error: [14:41:56] [a051414decbb06e88e0296f2] 2019-10-28 14:33:59: Fatal exception of type "Wikimedia\Rdbms\DBQueryError" [14:42:05] ^ paladox [14:42:07] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.68, 6.70, 5.72 [14:42:50] I’m mobile, you need to look in the exception log reception123 [14:43:26] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Sun 26 Jan 2020 01:29:34 PM GMT +0000. [14:43:42] RECOVERY - wiki.whentheycry.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.whentheycry.org' will expire on Sun 26 Jan 2020 01:31:50 PM GMT +0000. [14:44:03] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 6.16, 6.44, 5.74 [14:44:20] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.83, 7.75, 7.25 [14:44:32] RECOVERY - tensegritywiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'tensegritywiki.com' will expire on Sun 26 Jan 2020 01:32:32 PM GMT +0000. [14:52:11] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.08, 7.25, 7.10 [14:54:13] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.64, 7.32, 7.14 [14:56:12] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 10.22, 7.83, 7.30 [14:58:14] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.76, 7.56, 7.26 [15:10:14] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.06, 7.03, 6.98 [15:10:43] Error: 1146 Table 'mw1wiki.user' doesn't exist (mediawiki-internal-db-master.mir aheze.org) [15:10:44] ^ paladox [15:11:14] and ^ RhinosF1 [15:12:09] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.27, 6.96, 6.98 [15:12:57] That’s because rhinosF1 created a fake db [15:13:22] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.45, 7.44, 6.73 [15:15:19] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.34, 7.00, 6.65 [15:17:16] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.19, 6.40, 6.47 [15:18:08] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.54, 7.04, 6.94 [15:18:38] paladox: why is it blocking account creation? [15:19:07] Ask JohnLewis, seeing as it's CW :) [15:19:09] Reception123: you’re not confusing the log from the CW error I tested are you? [15:19:57] could be [15:20:07] live_in_the_405: on what wiki did you try to create the account? [15:20:08] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.97, 6.87, 6.88 [15:20:30] meta.miraheze.org [15:20:50] paladox: that's not CW [15:20:53] JohnLewis: 2019-10-28 - 12:55:22UTC tell JohnLewis wiki exists errors don't work for blank dbs per exception bd7b358c2339fcd58a8330b0 [15:20:56] ok [15:21:16] wiki exists error should work [15:21:26] the core check is "DOES THIS DB EXIST?" and if yes, it fails [15:21:35] JohnLewis: it doesn’t - not when it’s an empty dB - see that log [15:21:49] Tested using mw1wiki as the wiki being created [15:22:08] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.26, 7.13, 6.95 [15:22:42] Why is mw1 linked in CA? [15:22:56] i've never used miraheze before, so i'm attempting to create my first account on the service via this webform: https://meta.miraheze.org/wiki/Special:CreateAccount [15:22:57] [ Create account - Miraheze Meta ] - meta.miraheze.org [15:23:39] sounds like someone created the wiki, and didn't clean it up knowing it failed? [15:24:03] JohnLewis: hmm [15:24:34] JohnLewis yup [15:24:35] MariaDB [mhglobal]> select * from cw_wikis where wiki_dbname = 'mw1wiki'; [15:24:44] 20191028125221 [15:24:53] someone created it today?!?! [15:26:08] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 6.85, 7.81, 7.33 [15:26:13] paladox: that means when I tested that dummy dbs still generate a dB exists error and found that it doesn’t work it went through somehow [15:26:16] I removed the default fall back failure [15:26:30] but that still doesn't explain why someone knowingly didn't remove it knowing it failed [15:26:44] JohnLewis drop from cw_wikis where wiki_dbname = 'mw1wiki'; sane? [15:26:44] this issue is caused by the person who created the wiki, not by CW [15:26:57] paladox: WikiManager()->delete [15:26:57] *delete [15:27:02] oh [15:27:10] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeuln [15:27:12] [02miraheze/ManageWiki] 07translatewiki 033c14f15 - Localisation updates from https://translatewiki.net. [15:27:13] [ Main page - translatewiki.net ] - translatewiki.net. [15:27:13] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jeulc [15:27:15] [02miraheze/MirahezeMagic] 07translatewiki 03c1f0057 - Localisation updates from https://translatewiki.net. [15:27:16] [ Main page - translatewiki.net ] - translatewiki.net. [15:28:25] WikiManager()->delete(true); [15:28:27] JohnLewis ^ [15:28:59] paladox: WikiManager()?? [15:29:05] you have never done that [15:29:08] docs have never said that [15:29:10] oh right [15:29:24] new WikiManager->delete(true); [15:29:32] oh! [15:30:07] !log $wm = new WikiManager( 'mw1wiki' ); $wm->delete( true ); on mw1 [15:30:09] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 8.34, 7.57, 7.31 [15:30:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:30:37] JohnLewis hmm, dosen't seem to have removed it from cw_wikis [15:32:05] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeulR [15:32:07] [02miraheze/CreateWiki] 07JohnFLewis 038e13d60 - rearrange order of operations [15:32:09] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 5.42, 6.61, 6.99 [15:32:39] paladox: was there an error? [15:32:43] nope [15:33:11] is wiki_deleted = 1 on the entry? [15:33:24] nope [15:33:26] it's 0 [15:33:32] * paladox faceplams [15:33:37] *facepalms [15:33:43] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 9.72, 7.82, 6.86 [15:34:36] hmm [15:34:37] https://meta.miraheze.org/wiki/Special:ManageWiki/core/mw1wiki#mw-section-handling [15:34:39] [ Manage a wiki - Miraheze Meta ] - meta.miraheze.org [15:34:42] pressing save fails [15:34:50] i see in the console An invalid form control with name='wpsitename' is not focusable. [15:35:04] paladox: db... [15:35:06] use the damn db [15:35:10] ok [15:35:12] JohnLewis: don’t forget to update the actual running version of CW [15:35:17] RhinosF1: I know [15:35:26] I'd rather fix the actual issue than push a solution rn [15:36:24] !log update cw_wikis set wiki_deleted = 1 where wiki_dbname = 'mw1wiki'; - db4 [15:36:28] That’s a point [15:36:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [15:36:50] JohnLewis worked! [15:36:53] (it's gone now!) [15:40:08] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.34, 7.22, 7.04 [15:42:00] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/Jeuli [15:42:02] [02miraheze/mediawiki] 07JohnFLewis 030196cdd - update CW [15:42:41] JohnLewis: can you test that account creation can’t break like that again? [15:43:10] RhinosF1: account creation will always break like that if a wiki fails half way through creation [15:43:25] JohnLewis: okay [15:43:34] the onus is on the creator to either fix it or notify a mw-admin immediately [15:44:07] would you like me to re-attempt to create that account now? [15:44:16] live_in_the_405: please :) [15:44:16] live_in_the_405 yes please! [15:45:54] An account has just been created so it must work [15:46:07] I'm in! Thank you all so much for working together and getting that fixed impressively quickly <3 [15:46:08] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.07, 7.75, 7.37 [15:46:55] live_in_the_405: you're welcome, any further issues you know where to find us! [15:49:03] JohnLewis: does i18n for https://meta.miraheze.org/wiki/Special:ManageWikiDefaultPermissions come from MW or CW? [15:49:03]