[01:01:03] @blackwidowmovie0 What did you need? [01:31:00] PROBLEM - cp9 Current Load on cp9 is CRITICAL: CRITICAL - load average: 2.25, 1.85, 1.24 [01:32:57] RECOVERY - cp9 Current Load on cp9 is OK: OK - load average: 0.80, 1.44, 1.16 [01:46:14] dmehus: I'll tell you in a sec if you're still available [01:51:17] ok [01:54:28] dmehus: Basically, I wanted to discuss an idea I had if you're interested. [01:54:36] In DMs, or on Discord [01:57:41] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.27, 4.72, 3.33 [01:59:41] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.95, 4.78, 3.53 [02:00:22] dmehus: you there? [02:03:31] [02puppet] 07dmehus opened pull request 03#1602: Add The Internet Archive to CSP whitelist - 13https://git.io/Jtn5V [02:03:39] dmehus: I have to run, but check your discord DMs, I've provided a brief summary of the project [02:05:25] [02puppet] 07dmehus commented on pull request 03#1601: Add translate.yandex.net to CSP to maybe? make yandex translate work - 13https://git.io/Jtn5X [02:05:41] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.69, 5.24, 4.12 [02:06:17] @blackwidowmovie0 Okay, I'll take a look at the DMs after dinner. [02:11:40] PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.05, 5.72, 4.71 [02:15:40] PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.83, 5.83, 5.00 [02:26:55] dmehus: Cool, thanks. Note: You might not be 100% about the idea at first, but if you need additional details, I can provide them. As I'm 99.9% certain you live in California (based on your global userpage), I'm available at 8:15 am PST tomorrow morning. [02:31:41] RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.51, 5.08, 5.10 [02:57:45] Hello aristo! If you have any questions, feel free to ask and someone should answer soon. [03:02:30] Hello artist0_! If you have any questions, feel free to ask and someone should answer soon. [03:12:59] @blackwidowmovie I don't live in California, but you have my timezone correct. [03:13:22] s/blackwidowmovie/blackwidowmovie0 [03:13:22] dmehus meant to say: @blackwidowmovie0 I don't live in California, but you have my timezone correct. [04:12:33] PROBLEM - wiki.counterculturelabs.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.counterculturelabs.org could not be found [04:12:35] PROBLEM - wikien.wildterra2.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikien.wildterra2.com could not be found [04:13:44] PROBLEM - mw5 MediaWiki Rendering on mw5 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 0.006 second response time [04:14:01] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [04:14:07] PROBLEM - wiki.insideearth.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:14:10] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [04:14:15] PROBLEM - cp9 Stunnel Http for mw5 on cp9 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:14:41] PROBLEM - cp6 Stunnel Http for mw5 on cp6 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:14:44] PROBLEM - cp3 Stunnel Http for mw6 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:15:06] PROBLEM - cp7 Stunnel Http for mw6 on cp7 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:15:13] PROBLEM - cp7 Stunnel Http for mw5 on cp7 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:15:24] PROBLEM - cp3 Stunnel Http for mw5 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:15:43] PROBLEM - mw6 MediaWiki Rendering on mw6 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:16:06] PROBLEM - cp9 Stunnel Http for mw6 on cp9 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:16:17] PROBLEM - wiki.yapsavun.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:16:23] PROBLEM - cp6 Stunnel Http for mw6 on cp6 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:16:26] RECOVERY - cp9 Stunnel Http for mw5 on cp9 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 6.799 second response time [04:16:48] RECOVERY - cp6 Stunnel Http for mw5 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15145 bytes in 2.260 second response time [04:17:25] RECOVERY - cp7 Stunnel Http for mw5 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15145 bytes in 7.108 second response time [04:17:36] RECOVERY - cp3 Stunnel Http for mw5 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 8.612 second response time [04:17:51] PROBLEM - mw7 MediaWiki Rendering on mw7 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:18:03] PROBLEM - cp6 Stunnel Http for mw4 on cp6 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:18:09] PROBLEM - mw4 MediaWiki Rendering on mw4 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:18:32] PROBLEM - cp9 Stunnel Http for mw4 on cp9 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:18:54] PROBLEM - cp7 Stunnel Http for mw4 on cp7 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:19:17] RECOVERY - wiki.counterculturelabs.org - reverse DNS on sslhost is OK: rDNS OK - wiki.counterculturelabs.org reverse DNS resolves to cp6.miraheze.org [04:19:17] RECOVERY - wikien.wildterra2.com - reverse DNS on sslhost is OK: rDNS OK - wikien.wildterra2.com reverse DNS resolves to cp6.miraheze.org [04:19:27] PROBLEM - cp3 Stunnel Http for mw4 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:20:43] RECOVERY - cp6 Stunnel Http for mw6 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 9.660 second response time [04:21:02] RECOVERY - cp7 Stunnel Http for mw4 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 6.425 second response time [04:21:04] RECOVERY - wiki.insideearth.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sni.cloudflaressl.com' will expire on Thu 02 Sep 2021 12:00:00 GMT +0000. [04:21:17] RECOVERY - cp3 Stunnel Http for mw6 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 0.944 second response time [04:21:21] RECOVERY - cp7 Stunnel Http for mw6 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 0.031 second response time [04:21:23] RECOVERY - cp3 Stunnel Http for mw4 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 0.922 second response time [04:21:55] RECOVERY - mw7 MediaWiki Rendering on mw7 is OK: HTTP OK: HTTP/1.1 200 OK - 20047 bytes in 0.211 second response time [04:21:57] RECOVERY - mw6 MediaWiki Rendering on mw6 is OK: HTTP OK: HTTP/1.1 200 OK - 20047 bytes in 0.210 second response time [04:21:58] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [04:22:10] RECOVERY - cp6 Stunnel Http for mw4 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 0.012 second response time [04:22:14] RECOVERY - mw4 MediaWiki Rendering on mw4 is OK: HTTP OK: HTTP/1.1 200 OK - 20047 bytes in 0.226 second response time [04:22:17] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [04:22:28] RECOVERY - cp9 Stunnel Http for mw6 on cp9 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 0.333 second response time [04:22:29] RECOVERY - mw5 MediaWiki Rendering on mw5 is OK: HTTP OK: HTTP/1.1 200 OK - 20047 bytes in 0.273 second response time [04:22:35] RECOVERY - cp9 Stunnel Http for mw4 on cp9 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 0.333 second response time [04:23:06] RECOVERY - wiki.yapsavun.com - LetsEncrypt on sslhost is OK: OK - Certificate 'sni.cloudflaressl.com' will expire on Tue 25 May 2021 12:00:00 GMT +0000. [08:41:19] [02puppet] 07R4356th commented on pull request 03#1601: Add translate.yandex.net to CSP to maybe? make yandex translate work - 13https://git.io/JtcIl [08:41:53] [02puppet] 07Universal-Omega closed pull request 03#1601: Add translate.yandex.net to CSP to maybe? make yandex translate work - 13https://git.io/Jt3Ez [12:33:17] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 1.92, 5.28, 3.23 [12:35:17] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 0.77, 3.72, 2.90 [13:45:16] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 5.97, 4.94, 2.59 [13:47:16] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 1.29, 3.56, 2.37 [13:50:53] [02puppet] 07dmehus commented on pull request 03#1602: Add The Internet Archive to CSP whitelist - 13https://git.io/JtcEx [15:07:44] [02puppet] 07Universal-Omega commented on pull request 03#1602: Add The Internet Archive to CSP whitelist - 13https://git.io/JtcaF [16:07:14] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/Jtcom [16:07:15] [02miraheze/mediawiki] 07paladox 03e2b5870 - Update PageForms [16:23:38] * blackwidowmovie0 says good morning! [16:24:34] dmehus: I don't believe you responded to my DMs on Discord, maybe you did, I don't see them..... [16:33:13] Good morning, Zppix! [16:45:39] [02mw-config] 07R4356th opened pull request 03#3679: Add Naver site verification key for linkwikiwiki (T6764) - 13https://git.io/Jtc65 [16:46:49] miraheze/mw-config - R4356th the build passed. [16:48:09] @R4356th: see review [16:48:39] Okay. [16:50:06] [02mw-config] 07Universal-Omega commented on pull request 03#3679: Add Naver site verification key for linkwikiwiki (T6764) - 13https://git.io/JtciY [16:50:29] [02mw-config] 07R4356th commented on pull request 03#3679: Add Naver site verification key for linkwikiwiki (T6764) - 13https://git.io/JtciO [16:51:36] RhinosF1|NotHere: What do you think of global rollback/patroller on Miraheze? [16:52:06] For? [16:52:06] [02mw-config] 07R4356th synchronize pull request 03#3679: Add Naver site verification key for linkwikiwiki (T6764) - 13https://git.io/Jtc65 [16:52:26] RhinosF1: Um... what? [16:53:11] [02mw-config] 07RhinosF1 commented on pull request 03#3679: Add Naver site verification key for linkwikiwiki (T6764) - 13https://git.io/Jtci2 [16:53:24] Universal_Omega answered it [16:53:24] miraheze/mw-config - R4356th the build passed. [16:54:52] [02mw-config] 07R4356th commented on pull request 03#3679: Add Naver site verification key for linkwikiwiki (T6764) - 13https://git.io/Jtci1 [16:54:59] RhinosF1|NotHere: For countervandalism purposes, as the only GS without additional permissions is MrJaroslavik, and all Stewards are extremely busy [16:55:19] Yes but re who [16:55:31] what do you mean? [16:56:47] Is that for me? [16:57:55] @R4356th: I trust you more than very old random example [16:58:10] blackwidowmovie0: are you asking should someone else have it or about the role? [16:58:34] Sounds good. 🙂 [16:59:37] RhinosF1|NotHere: I'm asking if there is a need for the permission on Miraheze [16:59:55] blackwidowmovie0: yes [17:00:03] do we have it? [17:00:35] Oh I thought you meant need for GS [17:00:41] We discussed GR [17:00:46] we did? [17:00:49] We never came to an agreement as a community [17:00:57] There was consensus for it [17:01:06] But no consensus on how to implement it [17:01:15] hmmm, I'll see what we can do if I can get unblocked at somepoint [17:01:27] [02mw-config] 07Universal-Omega reviewed pull request 03#3679 commit - 13https://git.io/JtcPO [17:01:29] [02mw-config] 07Universal-Omega reviewed pull request 03#3679 commit - 13https://git.io/JtcP3 [17:01:59] Rhinos: About that list of books you were going to send me.... [17:02:20] Ah no [17:02:25] GR RfC failed [17:02:25] ? [17:02:29] ok [17:02:32] It was 7 support, 5 against [17:02:38] So borderline [17:02:46] blackwidowmovie0: yes but I've had a full day [17:02:47] We still need more GS users [17:02:53] fair point [17:03:01] We need more volunteers [17:03:43] I mean, I'd be happy to go for GS when unblocked [17:04:37] RhinosF1: What was the Meta tag supposed to do? [17:05:01] There should be a link to the task [17:05:11] But it's for some website [17:05:23] Can't see any. [17:05:57] https://phabricator.miraheze.org/T5981 [17:05:58] Wait, it looks like it was needed for some bot. [17:05:58] [ ⚓ T5981 Add custom meta tag to entire Wiki ] - phabricator.miraheze.org [17:06:09] 👍 [17:10:35] [02mw-config] 07R4356th synchronize pull request 03#3679: Add Naver site verification key for linkwikiwiki (T6764) - 13https://git.io/Jtc65 [17:11:12] [02mw-config] 07R4356th reviewed pull request 03#3679 commit - 13https://git.io/JtcP9 [17:11:49] [02dns] 07RhinosF1 opened pull request 03#181: miraheze-wiki: [do not merge] Switch to new docs CDN - 13https://git.io/JtcPx [17:11:53] miraheze/mw-config - R4356th the build passed. [17:14:34] [02mw-config] 07R4356th reviewed pull request 03#3679 commit - 13https://git.io/JtcXq [18:05:04] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JtcDY [18:05:06] [02miraheze/ssl] 07Reception123 03e7caff0 - add wiki.slimeapedia.org cert [18:05:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtcD3 [18:05:14] [02miraheze/services] 07MirahezeSSLBot 0360e46e4 - BOT: Updating services config for wikis [18:05:30] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.09, 19.68, 15.91 [18:07:27] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.53, 18.77, 16.06 [18:10:36] PROBLEM - phab1 APT on phab1 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:11:05] PROBLEM - gluster2 APT on gluster2 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:11:57] PROBLEM - puppet2 APT on puppet2 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:14:12] PROBLEM - cp3 APT on cp3 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:16:37] PROBLEM - rdb2 APT on rdb2 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:20:02] PROBLEM - bacula2 APT on bacula2 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:20:03] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:20:11] PROBLEM - graylog1 APT on graylog1 is CRITICAL: APT CRITICAL: 5 packages available for upgrade (1 critical updates). [18:20:24] PROBLEM - mon1 APT on mon1 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:21:32] PROBLEM - rdb1 APT on rdb1 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:21:43] PROBLEM - cloud3 APT on cloud3 is CRITICAL: APT CRITICAL: 81 packages available for upgrade (1 critical updates). [18:21:53] PROBLEM - db11 APT on db11 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (1 critical updates). [18:21:55] PROBLEM - db12 APT on db12 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (1 critical updates). [18:22:12] PROBLEM - ldap1 APT on ldap1 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:24:26] PROBLEM - db13 APT on db13 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:25:15] PROBLEM - cloud2 APT on cloud2 is CRITICAL: APT CRITICAL: 101 packages available for upgrade (1 critical updates). [18:26:38] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:27:56] PROBLEM - gluster1 APT on gluster1 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:30:28] PROBLEM - cp7 APT on cp7 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:32:24] PROBLEM - cp6 APT on cp6 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:33:58] PROBLEM - services1 APT on services1 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:33:58] PROBLEM - services2 APT on services2 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:34:38] PROBLEM - mw4 APT on mw4 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:35:11] PROBLEM - jobrunner2 APT on jobrunner2 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:35:18] PROBLEM - jobrunner1 APT on jobrunner1 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:35:30] PROBLEM - mw7 APT on mw7 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:35:33] PROBLEM - cloud1 APT on cloud1 is CRITICAL: APT CRITICAL: 100 packages available for upgrade (1 critical updates). [18:35:43] PROBLEM - test2 APT on test2 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:35:47] PROBLEM - mw6 APT on mw6 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:36:28] PROBLEM - mw5 APT on mw5 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [18:36:34] PROBLEM - mail1 APT on mail1 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:37:11] PROBLEM - cp9 APT on cp9 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (1 critical updates). [18:48:26] dmehus: see your PMs when you're around [19:17:53] to Reception123's point, dmehus: see your Discord DMs when you're around [19:49:27] PROBLEM - mon1 Current Load on mon1 is WARNING: WARNING - load average: 3.84, 3.00, 2.49 [19:51:25] RECOVERY - mon1 Current Load on mon1 is OK: OK - load average: 2.03, 2.61, 2.41 [21:09:50] dmehus, JohnLewis, Voidwalker_: Can a Steward close this wiki creator request? Clear consensus for support, and has been sitting for well over 7 days, close to 14. https://meta.miraheze.org/wiki/Meta:Requests_for_permissions#Integer_(Wiki_creator) [21:10:22] [02miraheze/DataDump] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtcNX [21:10:24] [02miraheze/DataDump] 07paladox 0349e0eb2 - Minor tweaks * Supports downloading directly from storage. * Minor optimisation in code. [21:10:25] [02DataDump] 07paladox created branch 03paladox-patch-1 - 13https://git.io/fhhKV [21:10:27] [02DataDump] 07paladox opened pull request 03#18: Minor tweaks - 13https://git.io/JtcN1 [21:11:27] miraheze/DataDump - paladox the build passed. [21:11:28] [02miraheze/DataDump] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtcNy [21:11:30] [02miraheze/DataDump] 07paladox 03cebb858 - Update extension.json [21:11:32] [02DataDump] 07paladox synchronize pull request 03#18: Minor tweaks - 13https://git.io/JtcN1 [21:12:32] miraheze/DataDump - paladox the build passed. [21:19:45] [02miraheze/DataDump] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JtcAZ [21:19:47] [02miraheze/DataDump] 07paladox 03049e5e4 - Update DataDump.php [21:19:48] [02DataDump] 07paladox synchronize pull request 03#18: Minor tweaks - 13https://git.io/JtcN1 [21:20:52] miraheze/DataDump - paladox the build passed. [21:33:36] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.51, 21.19, 18.77 [21:35:35] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.47, 23.02, 19.78 [21:37:10] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [21:37:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [21:37:41] paladox: things do seem slow today [21:37:47] PROBLEM - cp3 Stunnel Http for mw5 on cp3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 5.905 second response time [21:38:17] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 6.84, 5.34, 3.25 [21:38:38] 502 Bad Gateway Can definitely reproduce, RhinosF1. [21:39:09] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [21:39:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [21:39:46] Fixed on refresh, as you would expect. [21:39:47] RECOVERY - cp3 Stunnel Http for mw5 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15131 bytes in 0.972 second response time [21:40:11] Yeah everything came back [21:40:16] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 2.78, 4.43, 3.17 [21:41:41] 👍 [21:44:00] PROBLEM - gluster2 Current Load on gluster2 is WARNING: WARNING - load average: 5.37, 4.83, 3.87 [21:45:57] RECOVERY - gluster2 Current Load on gluster2 is OK: OK - load average: 2.21, 4.00, 3.69 [21:46:03] Seems to work for me now, though there's high i/o on cp6/gluster2 [21:46:17] which means the disk will be slower for everthing else [21:47:34] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.95, 23.58, 23.02 [21:51:38] paladox: yeah outage was short [21:51:43] But still a concern [21:57:20] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.33, 16.92, 19.82 [22:12:06] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 23.49, 20.78, 19.88 [22:16:03] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.74, 19.23, 19.53 [22:33:41] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 41.91, 23.24, 19.43 [22:35:39] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.04, 21.64, 19.38 [22:37:36] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.92, 20.11, 19.07 [22:41:28] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.28, 22.12, 20.22 [22:45:24] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.71, 18.16, 19.08 [22:59:13] !sre trying to protect site a wiki, and it's giving me the error message `Invalid timeout.` [22:59:24] hi [22:59:29] which wiki [23:00:28] wizardwiki.wiki [23:01:44] blackwidowmovie0: what you putting for timeout? [23:01:53] indefinite [23:01:57] which I set [23:02:06] on Special:ManageWiki/settings [23:02:49] very true [23:03:24] RhinosF1|NotHere: I just set 10 years [23:04:57] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.83, 22.01, 19.14 [23:05:17] blackwidowmovie0: asking around [23:05:24] ok [23:05:35] I gtg, ping if you figure anything out [23:06:54] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.18, 19.29, 18.49 [23:10:03] blackwidowmovie0: it is invalid but I'm not sure when it broke. Asked a maintainer. [23:21:05] Hello WandererLagomorp! If you have any questions, feel free to ask and someone should answer soon. [23:21:17] Hello