[00:00:46] PROBLEM - cp10 HTTP 4xx/5xx ERROR Rate on cp10 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:00:54] PROBLEM - cp11 HTTP 4xx/5xx ERROR Rate on cp11 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:02:12] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.86, 21.31, 17.37 [00:02:46] PROBLEM - cp10 HTTP 4xx/5xx ERROR Rate on cp10 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [00:02:57] PROBLEM - cp11 HTTP 4xx/5xx ERROR Rate on cp11 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [00:05:05] @System Administrators Getting extremely high load times on `reviwikiwiki`...`12210ms (PHP7 via reviwikiwiki@mw4 / cp12)` [00:06:12] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.85, 21.91, 18.67 [00:08:11] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.72, 19.82, 18.30 [00:10:36] I have an idea how I can have mulple worlds on one wiki if needed - ujsing namespaces or categories [00:13:52] dmehus: Odd, not seeing anything wrong [00:14:05] loads normally for me [00:14:54] BurningPrincess1, we use namespaces [00:15:08] but you can use which fits better for you [00:15:21] Would you use the same namespaces for all eras or just one era> [00:17:16] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.09, 5.36, 4.79 [00:19:19] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.31, 5.09, 4.77 [00:23:16] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.43, 5.42, 4.98 [00:24:32] PROBLEM - gluster1 APT on gluster1 is UNKNOWN: APT UNKNOWN: 0 packages available for upgrade (0 critical updates). errors detected. [00:26:29] RECOVERY - gluster1 APT on gluster1 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [00:28:44] @BurningPrincess1 Yeah, using namespaces and/or categories is the simplest way for hosting multiple worlds. There's also the Incubator extension, but I've heard it's a bit complicated and limited. [00:29:11] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.72, 4.92, 4.96 [00:35:04] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.37, 5.09, 4.97 [00:35:49] dmehus: never ever recommend WikimediaIncubator ext [00:35:53] it is god-made hell [00:36:33] revi, lol okay... consider that a 👎 and 👎 then? :) [00:36:49] 5x [00:36:56] haha [00:37:01] lol [00:37:01] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 5.09, 5.02, 4.96 [00:37:04] and unsuitable for almost all wikis [00:37:21] why have it, then [00:37:26] it has very specific use-case and doesn't cater for others [00:37:33] 👍🏽 [00:37:43] I should see if any Miraheze wikis are using it besides Incubator Plus Wiki [00:37:44] there's one wiki that fits in that use case, hence there's it [00:37:58] dmehus: requires managewiki-restricted so probably nope [00:38:01] revi: Which wiki? [00:38:09] doug said it [00:38:18] 👍🏽 [00:38:45] just use subpages or namespace for almost all case and that is almost always fine [00:39:08] wondering if we need a global CVT team [00:39:14] kind of like FANDOM's SOAP [00:39:20] We have one. [00:39:26] we definitely don't have enough [00:39:34] I can count on one hand [00:39:43] how many there are [00:39:47] Stewards and Global sysops are that. [00:39:52] not a lot [00:40:36] like, jaroslavik, dmehus, and voidwalker [00:40:47] accidental ping ^ sorry [00:40:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.62, 5.29, 5.07 [00:41:31] What happened to our dear friend icinga? [00:41:43] not relayed? [00:41:57] revi, 2 wikis use `wikimediaincubator` extension on Miraheze, https://revi.wiki/w/index.php?title=%EC%82%AC%EC%9A%A9%EC%9E%90:Dmehus/sandbox&oldid=3457 [00:41:59] [ 사용자:Dmehus/sandbox - ReviNet ] - revi.wiki [00:42:00] blackwidowmovie0: Reception123, John, and NDKilla also. [00:42:16] heh. [00:42:29] Universal_Omega: Don't count, as they have other responsibilites [00:42:32] all are SRE [00:42:40] I'm saying CVT only [00:42:44] revi, ah, didn't realize it needed `managewiki-restricted` to enable heh [00:42:52] ye [00:42:59] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.29, 5.76, 5.28 [00:43:04] dmehus: Yeah, otherwise the wiki would break :) [00:43:07] it requires some LocalSettings settings iirc [00:43:15] LocalSettings.php [00:43:28] blackwidowmovie0, we have a CVT team. It's an umbrella term for Stewards and Global Sysops. [00:43:38] dmehus: Again, not big enough [00:44:02] there are 3 members that don't have other responsibilities to Miraheze [00:44:17] you, void, and jaroslavik [00:44:25] Well, unlike the Wikimedia wikis, Global Sysops includes `centralauth-lock` user right, so is a serious role. Have to be quite active globally + very trusted + mentored [00:44:56] You can't bring people from nowhere, at least. [00:44:56] dmehus: GS has that right on WMF [00:44:58] revi, ah [00:44:59] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.93, 5.93, 5.41 [00:45:00] nope. [00:45:11] GS on WMF cannot issue global lock. [00:45:23] Global Sysops doesn't even have global IP blocking capability on Wikimedia. [00:45:23] revi: I saw it confirmed on #wikimedia at somepoint [00:45:27] that is exclusively vested for Stewards [00:45:30] Odd [00:45:32] Hey, I am a steward. [00:45:37] maybe someone was wrong, then [00:45:45] I know much more about how things are run, than that guy. [00:45:56] whoever that is. [00:46:12] heh and I think revi even locked one of blackwidowmovie0's alt accounts, too, iirc [00:46:15] revi: No, not #wikimedia, Global Sysop RfC on Meta at somepoint [00:46:24] dmehus: No need to bring that up........ [00:46:28] that sounds like a proposal. [00:46:39] revi: It's from 2012 [00:46:48] yeah, and that is not accepted. [00:46:48] I browse old RfCs, idk why [00:46:55] blackwidowmovie0, yeah... probably a proposal. There's lots of successful and unsuccessful proposals on Wikimedia Meta [00:46:57] hmmmmmm.....ok [00:46:59] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.09, 6.38, 5.64 [00:47:20] dmehus: Yeah. Hoping to get GS one day on Miraheze, although not likely soon [00:48:35] possible? [00:48:55] Only entity entitled for lock is WMF Office IT/T&S/Stewards (and maybe Sysadmin for emergency) [00:48:55] Also, what happened to `icinga-miraheze` [00:49:16] revi: Ah, yes [00:49:40] good to know [00:51:02] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.87, 5.87, 5.63 [00:52:29] PROBLEM - gluster1 APT on gluster1 is UNKNOWN: APT UNKNOWN: 0 packages available for upgrade (0 critical updates). errors detected. [00:56:29] RECOVERY - gluster1 APT on gluster1 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [01:08:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.24, 5.70, 5.48 [01:12:59] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.96, 5.92, 5.62 [01:17:37] PROBLEM - mon1 Current Load on mon1 is CRITICAL: CRITICAL - load average: 4.97, 3.40, 2.65 [01:19:34] RECOVERY - mon1 Current Load on mon1 is OK: OK - load average: 2.73, 3.04, 2.61 [01:24:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.11, 5.28, 5.29 [01:26:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.38, 5.30, 5.29 [01:32:25] @Universal Omega Can you run a quick DB query for him using sql.php to see which two wikis are currently using the wikimediaincubator extension? I'm really curious to see what the second wiki is. [01:32:34] Unless it's maybe test2wiki 😛 [01:32:59] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.17, 5.41, 5.30 [01:35:00] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.45, 4.95, 5.15 [01:35:03] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.06, 19.87, 17.62 [01:37:01] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.44, 17.78, 17.13 [01:39:02] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.55, 4.79, 5.04 [01:42:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.52, 5.20, 5.15 [01:44:59] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.73, 4.98, 5.07 [01:52:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.21, 5.78, 5.37 [01:54:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.30, 5.66, 5.37 [02:00:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.83, 5.92, 5.56 [02:02:26] It's not test2wiki. I can do so tomorrow if you'd like? [02:02:59] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.37, 5.78, 5.55 [02:03:05] @Universal_Omega Sure, that's fine. [02:04:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.52, 5.97, 5.65 [02:17:05] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.80, 5.86, 5.91 [02:23:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.37, 5.57, 5.70 [02:25:00] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.75, 5.24, 5.56 [02:26:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.35, 6.03, 5.81 [02:28:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.86, 5.85, 5.77 [02:36:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.80, 6.01, 5.83 [02:39:00] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.08, 5.51, 5.66 [02:43:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.33, 6.24, 5.90 [02:47:04] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.57, 5.57, 5.72 [02:49:05] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.24, 5.86, 5.80 [02:51:04] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.86, 5.45, 5.66 [02:55:06] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.11, 5.70, 5.70 [02:57:05] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.37, 5.42, 5.59 [03:15:02] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.59, 5.32, 5.28 [03:17:04] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.31, 5.39, 5.32 [03:26:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.17, 5.57, 5.37 [03:28:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.21, 5.44, 5.35 [03:38:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.18, 5.51, 5.41 [03:40:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.48, 5.14, 5.29 [03:59:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.25, 6.12, 5.65 [04:03:00] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.85, 5.99, 5.71 [04:06:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.04, 6.29, 5.86 [04:15:01] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.12, 5.68, 5.80 [04:26:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.03, 5.53, 5.55 [04:28:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.89, 5.17, 5.41 [04:36:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.56, 4.39, 5.00 [05:01:48] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.67, 5.15, 4.93 [05:03:52] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.73, 4.54, 4.74 [05:52:29] PROBLEM - gluster1 APT on gluster1 is UNKNOWN: APT UNKNOWN: 0 packages available for upgrade (0 critical updates). errors detected. [05:56:29] RECOVERY - gluster1 APT on gluster1 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [07:10:40] CptViraj Welcome! [08:51:07] PROBLEM - wiki.ct777.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.ct777.cf could not be found [08:51:08] PROBLEM - ipv6bolivia.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ipv6bolivia.tk could not be found [08:55:50] PROBLEM - rothwell-leeds.co.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rothwell-leeds.co.uk could not be found [08:55:51] PROBLEM - www.erikapedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.erikapedia.com could not be found [08:57:47] RECOVERY - wiki.ct777.cf - reverse DNS on sslhost is OK: rDNS OK - wiki.ct777.cf reverse DNS resolves to cp6.miraheze.org [08:57:49] RECOVERY - ipv6bolivia.tk - reverse DNS on sslhost is OK: rDNS OK - ipv6bolivia.tk reverse DNS resolves to cp6.miraheze.org [09:02:37] RECOVERY - rothwell-leeds.co.uk - reverse DNS on sslhost is OK: rDNS OK - rothwell-leeds.co.uk reverse DNS resolves to cp7.miraheze.org [09:02:45] RECOVERY - www.erikapedia.com - reverse DNS on sslhost is OK: rDNS OK - www.erikapedia.com reverse DNS resolves to cp7.miraheze.org [09:05:10] PROBLEM - ping6 on dbbackup1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 102.43 ms [09:09:22] RECOVERY - ping6 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 104.55 ms [10:23:23] Hello Cerealsss! If you have any questions, feel free to ask and someone should answer soon. [10:23:36] Hey! [10:23:38] I was recently invited to participate in a project, but I just can't even log in or register an account. [10:23:39] "There seems to be a problem with your login session; this action was canceled as a precaution against session hijacking. Go back to the previous page, reload the page and try again." [10:23:39] This is a message in question. Can someone help me? [10:24:13] Hi, Cerealsss. Could you please clear your cookies for .miraheze.org? [10:27:34] Ok [10:36:32] I cleared my cookies and it still doesn't work [10:43:21] What is your web browser? [10:43:39] Chrome [11:54:49] How the fuck do I get autowikibroswer working with miraheze [11:55:09] Tried taerelvari.miraheze.org/wiki/ and still not working [12:46:47] Hi [12:48:33] Can someone help me with my error please [12:48:34] BurningPrincess1: Pinging Reception123, Zppix, PuppyKun, Voidwalker, or RhinosF1 who might be able to help you. [12:49:18] Auto wiki broswer says "root element not found" when trying to set https://taerelvari.miraheze.org/wiki/ as the site [12:49:19] [ Taerel Vari ] - taerelvari.miraheze.org [12:50:41] Manged to fix by replacing /wiki/ with /w/. [12:52:07] Can't login [12:54:27] Using your web browser or AWB? [12:54:32] AWB [12:54:38] Fuck off bot [12:55:06] Oh. [12:55:27] has no experience with AWB [12:56:09] i think sigyn's settings for caps lock might be too harsh in here [13:02:19] jess, agreed [13:02:29] i'll ask the botmaster [13:04:50] * BurningPrincess1 hugs jess [13:11:18] Please can you tell me how to get it wokring on AWB ASAP [13:12:23] Please read [[AQC#BePatient]]. [13:12:23]

https://meta.miraheze.org/wiki/AQC#BePatient [13:12:24] [ Asking questions correctly - Miraheze Meta ] - meta.miraheze.org [13:13:25] I can't do it via browser as it keeps crashing my computer [13:44:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtgQX [13:44:40] [02miraheze/puppet] 07paladox 03a311804 - Add n to list [13:44:48] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtgQM [13:44:50] [02miraheze/mw-config] 07paladox 03a8817d0 - Switch over wikis beginning with n to new file storage [13:45:48] Hm I got it working, but the move botten does not work [13:45:53] miraheze/mw-config - paladox the build passed. [13:45:59] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtgQ7 [13:46:01] [02miraheze/mw-config] 07paladox 03f33f0e5 - Switch over wikis beginning with s to new file storage [13:46:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtgQb [13:46:16] [02miraheze/puppet] 07paladox 03f8ded19 - Add s to list [13:46:44] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtgQx [13:46:45] [02miraheze/mw-config] 07paladox 0317f9309 - Switch over wikis beginning with t to new file storage [13:47:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtgQh [13:47:01] [02miraheze/puppet] 07paladox 03ccd4e86 - Add t to list [13:47:08] miraheze/mw-config - paladox the build passed. [13:47:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jtg7v [13:47:40] [02miraheze/puppet] 07paladox 0394d4eaa - Add u to list [13:47:44] miraheze/mw-config - paladox the build passed. [13:47:49] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jtg7J [13:47:50] [02miraheze/mw-config] 07paladox 036afb75d - Switch over wikis beginning with u to new file storage [13:48:49] miraheze/mw-config - paladox the build passed. [13:54:30] PROBLEM - gluster2 Current Load on gluster2 is WARNING: WARNING - load average: 5.47, 4.10, 2.15 [13:58:31] RECOVERY - gluster2 Current Load on gluster2 is OK: OK - load average: 4.03, 4.41, 2.76 [14:05:16] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.16, 21.35, 17.23 [14:07:15] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.04, 18.09, 16.55 [14:12:36] PROBLEM - cp3 Current Load on cp3 is CRITICAL: CRITICAL - load average: 2.07, 1.53, 1.02 [14:12:41] PROBLEM - cp3 Current Load on cp3 is WARNING: WARNING - load average: 1.90, 1.51, 1.01 [14:14:36] RECOVERY - cp3 Current Load on cp3 is OK: OK - load average: 1.21, 1.34, 1.00 [14:14:39] RECOVERY - cp3 Current Load on cp3 is OK: OK - load average: 1.12, 1.32, 1.00 [14:14:49] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.64, 5.32, 4.16 [14:16:47] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.11, 5.67, 4.43 [14:18:45] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.53, 5.61, 4.56 [14:24:38] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.66, 4.59, 4.45 [14:34:12] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtgFP [14:34:14] [02miraheze/mw-config] 07paladox 0375bf3d1 - Fix wgDataDumpDirectory for wikis migrated to new file storage [14:34:50] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 23.56, 19.99, 17.76 [14:35:17] miraheze/mw-config - paladox the build passed. [14:36:48] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.95, 18.15, 17.39 [14:44:38] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb [14:44:49] PROBLEM - cp7 Varnish Backends on cp7 is WARNING: No backends detected. If this is an error, see readme.txt [14:44:51] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb [14:45:19] PROBLEM - cp7 HTTP 4xx/5xx ERROR Rate on cp7 is CRITICAL: CRITICAL - NGINX Error Rate is 98% [14:45:23] PROBLEM - cp7 HTTPS on cp7 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 0.004 second response time [14:48:12] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.22, 5.33, 4.94 [14:50:10] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.74, 5.94, 5.21 [14:54:05] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.97, 5.78, 5.31 [15:02:04] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.96, 4.88, 5.00 [15:15:14] * hispano76 greet [15:15:31] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JtgAX [15:15:32] [02miraheze/ManageWiki] 07Universal-Omega 0340998bb - Remove "Extension Default" content module [15:15:34] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vpSns [15:15:35] [02ManageWiki] 07Universal-Omega opened pull request 03#237: Remove "Extension Default" content module - 13https://git.io/JtgA1 [15:16:42] miraheze/ManageWiki - Universal-Omega the build passed. [15:27:52] [02miraheze/ManageWiki] 07JohnFLewis pushed 032 commits to 03master [+0/-0/±8] 13https://git.io/Jtgx9 [15:27:53] [02miraheze/ManageWiki] 07JohnFLewis 038c2f57e - Allow removing perms and namespaces when removing extensions [15:27:55] [02miraheze/ManageWiki] 07JohnFLewis 03bd619db - Merge remote-tracking branch 'origin/master' [15:29:08] miraheze/ManageWiki - JohnFLewis the build passed. [15:48:55] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.01, 19.90, 18.61 [15:50:53] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.36, 18.56, 18.28 [15:52:44] [02ManageWiki] 07Universal-Omega closed pull request 03#237: Remove "Extension Default" content module - 13https://git.io/JtgA1 [15:52:45] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jtgh2 [15:52:47] [02miraheze/ManageWiki] 07Universal-Omega 037ebbf71 - Remove "Extension Default" content module (#237) [15:52:48] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vpSns [15:52:50] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [15:53:50] miraheze/ManageWiki - Universal-Omega the build passed. [15:55:41] PROBLEM - wiki.yumeka.team - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.yumeka.team could not be found [15:57:50] PROBLEM - wiki.yumeka.team - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Cannot make SSL connection.22808736761664:error:14094438:SSL routines:ssl3_read_bytes:tlsv1 alert internal error:../ssl/record/rec_layer_s3.c:1544:SSL alert number 80 [16:02:24] RECOVERY - wiki.yumeka.team - reverse DNS on sslhost is OK: rDNS OK - wiki.yumeka.team reverse DNS resolves to cp6.miraheze.org [16:02:45] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.68, 21.81, 19.60 [16:06:42] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.17, 19.31, 19.21 [16:11:00] PROBLEM - wiki.yumeka.team - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.yumeka.team could not be found [16:14:08] [02dns] 07MacFan4000 opened pull request 03#188: remove support.bots subdomain - 13https://git.io/Jt2e3 [16:14:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-5 [+0/-0/±1] 13https://git.io/Jt2eZ [16:14:46] [02miraheze/mw-config] 07Universal-Omega 03e5a8db0 - Remove namespaces that add content models, with extensions [16:14:47] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-5 - 13https://git.io/vbvb3 [16:14:49] [02mw-config] 07Universal-Omega opened pull request 03#3711: Remove namespaces that add content models, with extensions - 13https://git.io/Jt2en [16:15:58] miraheze/mw-config - Universal-Omega the build passed. [16:17:32] [02dns] 07MacFan4000 commented on pull request 03#175: miraheze-wiki: add 2 new domains - 13https://git.io/Jt2eB [16:21:05] dmehus: stop and read the talk apge [16:21:08] page* on wikimedia meta [16:24:27] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jt2eN [16:24:28] [02miraheze/ManageWiki] 07Universal-Omega 0304a5e6a - use switch instead of multiple elseif [16:24:30] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vpSns [16:24:31] [02ManageWiki] 07Universal-Omega opened pull request 03#238: use switch instead of multiple elseif - 13https://git.io/Jt2eA [16:25:38] miraheze/ManageWiki - Universal-Omega the build passed. [16:29:53] I just moved the 345+ pages by hand in the end [16:32:51] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2v2 [16:32:52] [02miraheze/mw-config] 07Universal-Omega 038452179 - Fix tabbing/spacing [16:33:13] [02ManageWiki] 07Universal-Omega closed pull request 03#238: use switch instead of multiple elseif - 13https://git.io/Jt2eA [16:33:14] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2vw [16:33:16] [02miraheze/ManageWiki] 07Universal-Omega 03aa85bbf - use switch instead of multiple elseif (#238) [16:33:17] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vpSns [16:33:19] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [16:33:53] miraheze/mw-config - Universal-Omega the build passed. [16:34:13] miraheze/ManageWiki - Universal-Omega the build passed. [16:35:42] revi, sorry about that, and thanks :) [16:36:18] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 21.44, 24.89, 20.82 [16:37:19] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2v5 [16:37:21] [02miraheze/mw-config] 07Universal-Omega 031f20fa2 - add 'remove' to comment [16:38:21] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.30, 23.59, 20.90 [16:38:33] miraheze/mw-config - Universal-Omega the build passed. [16:42:16] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.77, 20.16, 20.19 [16:43:58] @JohnLewis There seems to be an issue with @miraheze-github not being cloaked. I think @jess raised this a few days ago...perhaps you or another SRE team member could investigate? [16:44:20] s/cloaked/cloaked anymore [16:44:20] dmehus meant to say: @JohnLewis There seems to be an issue with @miraheze-github not being cloaked anymore. I think @jess raised this a few days ago...perhaps you or another SRE team member could investigate? [16:44:26] PROBLEM - wiki.yumeka.team - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:48:56] dmehus, Hi dem [16:49:31] dmehus, I amanged to get autowiki broseer working with miraheze, turns out /wiki/ in the url does not work, but /w/ does [16:51:29] @BurningPrincess1 Ah, yeah, that makes sense, an access URL issue. :) [16:52:57] dmehus: it's because of the migration [16:55:30] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2JY [16:55:31] [02miraheze/mw-config] 07paladox 03b2e58c3 - Switch over wikis beginning with x to new file storage [16:55:42] @JohnLewis Ah, okay, right, doh...yeah, because some commits are to the new servers and some to the old servers? [16:55:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2J3 [16:55:46] [02miraheze/puppet] 07paladox 03058fcde - Add x to list [16:56:03] no, commits are to GitHub [16:56:28] @JohnLewis Well yeah, so I'm a bit confused by why it's because of the migration. Can you clarify that a bit? [16:56:38] miraheze/mw-config - paladox the build passed. [16:56:47] @paladox Are you going in random order? Last time I checked you did `r`, so you only have x, y, and z to do? [16:56:51] Freenode only allows a set number of sessions attached to an account [16:57:06] @JohnLewis ah, ok, thanks...that makes sense now :) [16:57:06] please don't @ me as it also pings me on discord [16:57:13] which means i get two notifications [16:57:26] oops, sorry, yeah [16:57:29] but also no, i'm doing it alphabetically but things take longer depending on which letter [16:57:39] ah, cool [16:57:46] that's great that we're on `x` then :) [16:58:00] i then have to do the non alphabet [16:58:08] ah, right [16:58:41] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2J0 [16:58:42] [02miraheze/mw-config] 07paladox 036e7b8f2 - Switch over wikis beginning with y to new file storage [16:58:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2JE [16:58:57] [02miraheze/puppet] 07paladox 03f1e988e - Add y to list [16:59:44] .gj paladox [16:59:44] You're doing good work, paladox! [16:59:48] miraheze/mw-config - paladox the build passed. [17:00:15] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2Ja [17:00:17] [02miraheze/mw-config] 07paladox 03fbdc08b - Switch over wikis beginning with z to new file storage [17:00:20] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 43.24, 28.91, 22.38 [17:00:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2Jo [17:00:35] [02miraheze/puppet] 07paladox 032bcd2df - Add z to list [17:00:58] PROBLEM - gluster2 Current Load on gluster2 is CRITICAL: CRITICAL - load average: 6.74, 5.24, 4.54 [17:01:13] miraheze/mw-config - paladox the build passed. [17:03:00] PROBLEM - gluster2 Current Load on gluster2 is WARNING: WARNING - load average: 5.63, 5.34, 4.67 [17:06:20] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 15.29, 21.89, 21.53 [17:09:00] PROBLEM - gluster2 Current Load on gluster2 is CRITICAL: CRITICAL - load average: 6.25, 5.84, 5.10 [17:10:59] PROBLEM - gluster2 Current Load on gluster2 is WARNING: WARNING - load average: 6.00, 5.91, 5.22 [17:12:45] dmehus, I think you are right about that [17:14:18] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.65, 19.05, 20.30 [17:17:00] PROBLEM - gluster2 Current Load on gluster2 is CRITICAL: CRITICAL - load average: 6.61, 5.93, 5.42 [17:18:59] PROBLEM - gluster2 Current Load on gluster2 is WARNING: WARNING - load average: 5.29, 5.65, 5.37 [17:19:43] Hey what ius the new file strage thing? [17:22:34] PROBLEM - cp6 HTTP 4xx/5xx ERROR Rate on cp6 is CRITICAL: CRITICAL - NGINX Error Rate is 99% [17:22:41] PROBLEM - cp6 HTTPS on cp6 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 0.006 second response time [17:23:00] RECOVERY - gluster2 Current Load on gluster2 is OK: OK - load average: 3.84, 4.73, 5.07 [17:23:14] PROBLEM - cp6 Varnish Backends on cp6 is WARNING: No backends detected. If this is an error, see readme.txt [17:32:42] [02dns] 07RhinosF1 closed pull request 03#175: miraheze-wiki: add 2 new domains - 13https://git.io/JUWN4 [17:33:11] [02dns] 07RhinosF1 closed pull request 03#181: miraheze-wiki: [do not merge] Switch to new docs CDN - 13https://git.io/JtcPx [17:42:19] Please tell me about the reason you hjave a new file storage system [17:45:37] Getting error `502 Bad Gateway` on `testwiki` [17:46:03] to all mw-admins [17:47:02] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/Jt2k0 [17:47:04] [02miraheze/mw-config] 07paladox 0340b141d - Set new directory by default temporarily [17:47:05] [02mw-config] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbvb3 [17:47:07] [02mw-config] 07paladox opened pull request 03#3712: Set new directory by default temporarily - 13https://git.io/Jt2kE [17:47:49] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2k2 [17:47:50] [02miraheze/mw-config] 07paladox 0358a737e - Switch over wikis beginning with 0,1,2,3,4,5,6,7,8,9 to new file storage [17:48:16] miraheze/mw-config - paladox the build passed. [17:48:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2kr [17:48:22] [02miraheze/puppet] 07paladox 0313c24de - Add 0,1,2,3,4,5,6,7,8,9 to list [17:48:37] [02mw-config] 07paladox closed pull request 03#3712: Set new directory by default temporarily - 13https://git.io/Jt2kE [17:48:39] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-3 [17:48:41] [02mw-config] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbvb3 [17:48:51] miraheze/mw-config - paladox the build passed. [17:50:55] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2ky [17:50:57] [02miraheze/mw-config] 07paladox 034881930 - Switch over wikis beginning with v to new file storage [17:51:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2kS [17:51:12] [02miraheze/puppet] 07paladox 03c0a2ee4 - Add v to list [17:51:53] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2k7 [17:51:54] [02miraheze/mw-config] 07paladox 03f050381 - Switch over wikis beginning with w to new file storage [17:52:01] miraheze/mw-config - paladox the build passed. [17:52:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2kp [17:52:20] [02miraheze/puppet] 07paladox 0368b6c29 - Add w to list [17:52:31] PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [17:52:43] PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [17:52:48] PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [17:52:56] miraheze/mw-config - paladox the build passed. [17:52:56] PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [17:55:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt2Is [17:55:51] [02miraheze/puppet] 07paladox 03c5e5dd1 - Fix [17:58:32] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:58:42] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:58:46]