[00:01:49] [02puppet] 07Southparkfan commented on commit 03644aacb2e8ce69da86f0fa293c956f4bcc3c2114 - 13https://git.io/fjRZA [00:02:46] [02puppet] 07paladox commented on commit 03644aacb2e8ce69da86f0fa293c956f4bcc3c2114 - 13https://git.io/fjRZx [01:07:41] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRnI [01:07:42] [02miraheze/mw-config] 07paladox 03e08090f - Move wgMaxImageArea to the restricted section Change-Id: I71af5a32585c7edae3496187b90572ff936b2ae6 [01:10:12] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fjRnq [01:10:13] [02miraheze/mw-config] 07paladox 03a8424df - Add some cirrus/elastic configs to ManageWiki Change-Id: Iccd43bdfecaa7a8661332e4e067251631ea460a2 [06:18:38] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 540 [06:25:25] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 5450 MB (22% inode=95%); [06:26:38] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [07:00:39] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 2389 [10:22:38] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [11:01:46] PROBLEM - adadevelopersacademy.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:01:46] PROBLEM - nonsensopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:01:53] PROBLEM - wiki.landan.ca - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:02:47] PROBLEM - misc4 Current Load on misc4 is WARNING: WARNING - load average: 3.41, 1.80, 0.77 [11:03:28] PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 3.68, 2.91, 1.31 [11:03:40] PROBLEM - adadevelopersacademy.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'adadevelopersacademy.wiki' expires in 8 day(s) (Tue 04 Jun 2019 08:12:37 PM GMT +0000). [11:03:40] PROBLEM - nonsensopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nonsensopedia.org' expires in 9 day(s) (Wed 05 Jun 2019 02:50:17 PM GMT +0000). [11:03:48] PROBLEM - wiki.landan.ca - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.landan.ca' expires in 9 day(s) (Wed 05 Jun 2019 03:26:20 PM GMT +0000). [11:04:08] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.74, 1.76, 0.85 [11:04:44] RECOVERY - misc4 Current Load on misc4 is OK: OK - load average: 0.61, 1.28, 0.70 [11:05:28] PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.53, 1.97, 1.16 [11:06:08] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.58, 1.31, 0.80 [11:07:28] RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.34, 1.40, 1.04 [13:58:18] PROBLEM - wiki.ldmsys.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:58:25] PROBLEM - wiki.kybermc.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:58:26] PROBLEM - wiki.lostminecraftminers.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:00:15] PROBLEM - wiki.ldmsys.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ldmsys.net' expires in 8 day(s) (Tue 04 Jun 2019 08:03:43 PM GMT +0000). [14:00:22] PROBLEM - wiki.kybermc.tk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.kybermc.tk' expires in 9 day(s) (Wed 05 Jun 2019 02:45:30 PM GMT +0000). [14:00:24] PROBLEM - wiki.lostminecraftminers.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.lostminecraftminers.org' expires in 8 day(s) (Wed 05 Jun 2019 12:36:51 PM GMT +0000). [14:51:21] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/fjREw [14:51:23] [02miraheze/ManageWiki] 07translatewiki 0352a926b - Localisation updates from https://translatewiki.net. [14:51:24] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjREr [14:51:26] [02miraheze/CreateWiki] 07translatewiki 03b3c5228 - Localisation updates from https://translatewiki.net. [14:51:27] [02miraheze/IncidentReporting] 07translatewiki pushed 031 commit to 03master [+0/-0/±6] 13https://git.io/fjREo [14:51:29] [02miraheze/IncidentReporting] 07translatewiki 03c474328 - Localisation updates from https://translatewiki.net. [14:51:30] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fjREK [14:51:32] [02miraheze/MirahezeMagic] 07translatewiki 031f3e878 - Localisation updates from https://translatewiki.net. [15:30:14] PROBLEM - wiki.lbcomms.co.za - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.lbcomms.co.za' expires in 7 day(s) (Tue 04 Jun 2019 03:30:06 PM GMT +0000). [15:43:57] * Hispano76 saluda [16:11:57] PROBLEM - wiki.hackdown.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.hackdown.org' expires in 7 day(s) (Tue 04 Jun 2019 04:10:11 PM GMT +0000). [16:23:40] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.meeusen.net' expires in 7 day(s) (Tue 04 Jun 2019 04:22:57 PM GMT +0000). [16:27:08] PROBLEM - wiki.drones4nature.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.drones4nature.info' expires in 7 day(s) (Tue 04 Jun 2019 04:25:23 PM GMT +0000). [16:31:46] PROBLEM - wikipuk.cl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wikipuk.cl' expires in 7 day(s) (Tue 04 Jun 2019 04:30:05 PM GMT +0000). [16:39:31] PROBLEM - wiki.jacksonheights.nyc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.jacksonheights.nyc' expires in 7 day(s) (Tue 04 Jun 2019 04:39:01 PM GMT +0000). [16:48:59] Hello udia! If you have any questions feel free to ask and someone should answer soon. [17:05:03] Hello, I just applied for a wiki on Miraheze. Looking forward to being a part of this community [17:07:22] Udia, Cool, Whats your wiki called? [17:08:55] I requested the subdomain udia, I would like to eventually add it to wiki.udia.ca [17:09:52] Udia, Yeah just seen it. Just created a wiki myself recently. [17:12:35] I like the philosophy behind making the finances freely available [17:13:48] udia: wiki should be created now :) [17:14:09] I just got the email. Thank you! [17:14:30] You're welcome! :) [17:32:36] PROBLEM - wiki.besuccess.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.besuccess.com' expires in 7 day(s) (Tue 04 Jun 2019 05:31:50 PM GMT +0000). [17:35:32] I have a wiki page that is like 90% listing drop down menu items. I'd like to replace it with an actual drop down menu [17:36:02] is there any extension available on miraheze that allows this? [17:37:38] example? Mikeee [17:38:00] well this is the actual menu I'm trying to detail for users https://robodk.com/doc/en/Robots-Fanuc_files/img7.png [17:39:06] this would be acceptable, but isn't visually ideal https://www.mediawiki.org/wiki/Extension:TreeAndMenu [17:39:07] [ Extension:TreeAndMenu - MediaWiki ] - www.mediawiki.org [17:40:58] Um, I don't remember an extension that does that. Sorry [17:42:07] yeah I'll have to ask one of the miraheze people if they'd be willing to install it [18:15:52] Yes, hello [18:15:58] Please request on Phabricator and we will look into it [18:16:25] Reception123: No, Bye [18:16:34] already did, thank you [18:20:32] Hello udiai! If you have any questions feel free to ask and someone should answer soon. [18:23:13] JohnLewis: :P [18:23:26] giving all the work to JohnLewis :D [18:23:45] Does anyone know a good way to advertise wikis? [18:24:55] RhinosF1: Outside of Miraheze? [18:26:14] Reception123: Inside or Outside [18:27:07] facebook's advertising system is pretty good [18:28:22] hi! Reception123 :D [18:29:23] RhinosF1: You can use https://meta.miraheze.org/wiki/Gazetteer_of_wikis inside [18:29:24] [ Gazetteer of wikis - Miraheze Meta ] - meta.miraheze.org [18:41:43] Reception123: ?? https://usercontent.irccloud-cdn.com/file/3joGV1D8/DD2EDA2B-BE83-42DF-B2D1-0227F112334B.png [18:43:09] RhinosF1: there must be some unclosed translate tags [18:43:48] Reception123: Where? I've not touched any I don't think [18:43:53] *[[mh:QuIRC|QuIRC Wiki]] is a wiki to host information on and help develop the QuIRC bot framework. [18:44:07] Was what I was trying to add [18:44:09] that's strange then if you haven't changed them [18:46:28] Reception123: Can you try it? [18:47:09] sure [18:48:07] RhinosF1: worked for me, weird [18:48:42] Reception123: Very weird. Thanks [18:49:39] RhinosF1: you're welcome :) [19:32:29] PROBLEM - speleo.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'speleo.wiki' expires in 7 day(s) (Tue 04 Jun 2019 07:31:46 PM GMT +0000). [19:34:36] PROBLEM - disabled.life - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'disabled.life' expires in 7 day(s) (Tue 04 Jun 2019 07:33:19 PM GMT +0000). [19:35:18] PROBLEM - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.teessidehackspace.org.uk' expires in 7 day(s) (Tue 04 Jun 2019 07:34:37 PM GMT +0000). [19:39:40] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRVz [19:39:41] [02miraheze/mw-config] 07paladox 03912a80a - Annouce Miraheze maintenance windows for our servers Change-Id: Ia44fac6ce0d952385ee387d55c7e73e3fa317217 [19:41:07] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRVa [19:41:08] [02miraheze/puppet] 07paladox 0305d8c45 - Whitelist cdn.discordapp.com (CSP) - T4389 [19:41:18] PROBLEM - wiki.thunis.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.thunis.eu' expires in 7 day(s) (Tue 04 Jun 2019 07:40:42 PM GMT +0000). [19:41:40] PROBLEM - wiki.tulpa.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.tulpa.info' expires in 7 day(s) (Tue 04 Jun 2019 07:41:18 PM GMT +0000). [19:42:42] Paladox: When is https://github.com/miraheze/mw-config/blob/master/Sitenotice.php [19:42:43] [ mw-config/Sitenotice.php at master · miraheze/mw-config · GitHub ] - github.com [19:43:06] 9:30pm utc time which is 10:30pm bst time your time RhinosF1 [19:43:50] Paladox: Cool - Is it worth ensuring edits are saved before 10:30 then [19:43:55] yup [19:44:22] Cool, How long for message to come through to all wikis you've put up Paladox? [19:44:38] it should take ~10mins (should have deployed by now) [19:44:59] is there a way to view traffic statistics for a page [19:46:01] PROBLEM - lodge.jsnydr.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'lodge.jsnydr.com' expires in 7 day(s) (Tue 04 Jun 2019 07:45:49 PM GMT +0000). [19:46:56] !log rename commonswikiwiki to commonswiki [19:47:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:47:32] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRVi [19:47:33] PROBLEM - wiki.hanaoto.me - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.hanaoto.me' expires in 7 day(s) (Tue 04 Jun 2019 07:45:36 PM GMT +0000). [19:47:33] [02miraheze/mw-config] 07paladox 032c45c67 - Rename commonswikiwiki to commonswiki Change-Id: I99d6600cc417a26cbfb61d943108b17b2be0ec77 [19:50:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRVX [19:50:15] [02miraheze/services] 07MirahezeSSLBot 037113ab5 - BOT: Updating services config for wikis [19:50:55] PROBLEM - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.worlduniversityandschool.org' expires in 7 day(s) (Tue 04 Jun 2019 07:49:09 PM GMT +0000). [19:54:49] PROBLEM - froggy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'froggy.info' expires in 7 day(s) (Tue 04 Jun 2019 07:53:58 PM GMT +0000). [19:56:50] PROBLEM - wiki.inebriation-confederation.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.inebriation-confederation.com' expires in 7 day(s) (Tue 04 Jun 2019 07:55:16 PM GMT +0000). [19:59:24] PROBLEM - madgenderscience.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'madgenderscience.wiki' expires in 7 day(s) (Tue 04 Jun 2019 07:59:23 PM GMT +0000). [19:59:44] PROBLEM - wiki.autocountsoft.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.autocountsoft.com' expires in 7 day(s) (Tue 04 Jun 2019 07:58:05 PM GMT +0000). [20:02:48] PROBLEM - wiki.kourouklides.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.kourouklides.com' expires in 7 day(s) (Tue 04 Jun 2019 08:02:30 PM GMT +0000). [20:04:08] PROBLEM - wiki.ldmsys.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.ldmsys.net' expires in 7 day(s) (Tue 04 Jun 2019 08:03:43 PM GMT +0000). [20:08:15] !log rebooting misc1 to enable TUN [20:10:37] PROBLEM - wiki.ldmsys.net - LetsEncrypt on sslhost is UNKNOWN: [20:10:40] !log rebooting misc1 to enable TUN [20:10:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:10:52] !log upgrade icinga2 to 2.10.5 [20:10:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:11:12] PROBLEM - wiki.ameciclo.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.ameciclo.org' expires in 7 day(s) (Tue 04 Jun 2019 08:09:27 PM GMT +0000). [20:11:31] !log upgrade grafana to 6.2.1 [20:11:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:12:34] PROBLEM - wiki.ldmsys.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.ldmsys.net' expires in 7 day(s) (Tue 04 Jun 2019 08:03:43 PM GMT +0000). [20:13:07] PROBLEM - adadevelopersacademy.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'adadevelopersacademy.wiki' expires in 7 day(s) (Tue 04 Jun 2019 08:12:37 PM GMT +0000). [20:14:20] PROBLEM - wiki.macc.nyc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.macc.nyc' expires in 7 day(s) (Tue 04 Jun 2019 08:13:45 PM GMT +0000). [20:22:01] PROBLEM - wikibase.revi.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wikibase.revi.wiki' expires in 7 day(s) (Tue 04 Jun 2019 08:21:45 PM GMT +0000). [20:26:55] PROBLEM - wiki.gesamtschule-nordkirchen.de - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.gesamtschule-nordkirchen.de' expires in 7 day(s) (Tue 04 Jun 2019 08:26:39 PM GMT +0000). [20:32:28] There is no logon attempt in progress :/ [20:36:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRwI [20:36:45] [02miraheze/puppet] 07paladox 039efd6b3 - Add vpncloud to misc1 [20:36:47] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [20:36:50] [02puppet] 07paladox opened pull request 03#1006: Add vpncloud to misc1 - 13https://git.io/fjRwL [20:37:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRwt [20:37:36] [02miraheze/puppet] 07paladox 03dedff6d - Update vpncloud.pp [20:37:38] [02puppet] 07paladox synchronize pull request 03#1006: Add vpncloud to misc1 - 13https://git.io/fjRwL [20:38:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRwm [20:38:05] [02miraheze/puppet] 07paladox 03ddc8ee0 - Update miraheze-internal.net.erb [20:38:06] [02puppet] 07paladox synchronize pull request 03#1006: Add vpncloud to misc1 - 13https://git.io/fjRwL [20:38:25] PROBLEM - wiki.ciptamedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.ciptamedia.org' expires in 7 day(s) (Tue 04 Jun 2019 08:37:52 PM GMT +0000). [20:38:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRwY [20:39:01] [02miraheze/puppet] 07paladox 03d13a7a6 - Update misc1.yaml [20:39:02] [02puppet] 07paladox synchronize pull request 03#1006: Add vpncloud to misc1 - 13https://git.io/fjRwL [20:40:19] PROBLEM - athenapedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'athenapedia.org' expires in 7 day(s) (Tue 04 Jun 2019 08:38:56 PM GMT +0000). [20:41:02] PROBLEM - podpedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'podpedia.org' expires in 7 day(s) (Tue 04 Jun 2019 08:40:10 PM GMT +0000). [20:42:15] [02puppet] 07paladox closed pull request 03#1006: Add vpncloud to misc1 - 13https://git.io/fjRwL [20:42:17] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/fjRws [20:42:18] [02miraheze/puppet] 07paladox 039a9f532 - Add vpncloud to misc1 (#1006) * Add vpncloud to misc1 * Update vpncloud.pp * Update miraheze-internal.net.erb * Update misc1.yaml [20:42:20] [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS [20:42:21] paladox: What is the downtime for tonight? (Our wiki is tracking it at https://quirc.freshstatus.io/incident/2793) - Is there a phab task for it? [20:42:21] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3 [20:42:22] [ QuIRC's Statuspage Powered by Freshstatus | Incident details ] - quirc.freshstatus.io [20:43:31] RhinosF1 the only task os https://phabricator.miraheze.org/T4346 [20:43:32] [ ⚓ T4346 Enable TUN/TAP on servers ] - phabricator.miraheze.org [20:45:58] PROBLEM - pwiki.arkcls.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'pwiki.arkcls.com' expires in 7 day(s) (Tue 04 Jun 2019 08:45:19 PM GMT +0000). [20:46:11] paladox: Thx, I've updated our status page with that task - I'm going to lock editing anyway during the window [20:46:16] ok [20:54:03] PROBLEM - kunwok.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'kunwok.org' expires in 7 day(s) (Tue 04 Jun 2019 08:52:53 PM GMT +0000). [20:55:11] Is my session disconnected, is it related to the sitenotice? ehm paladox [20:55:13] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [20:55:15] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [20:55:16] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [20:55:19] PROBLEM - elasticsearch1 Puppet on elasticsearch1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [20:55:23] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [20:55:26] Hispano76 is this for commons wiki? [20:55:58] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [20:56:27] it always happens when I enter commonswiki. paladox [20:56:33] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [20:56:42] ok, you need to log into metawiki then log out of metawiki [20:56:46] then log into commonswiki [20:56:51] Hispano76 ^^ [20:57:08] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [20:57:27] I always login to Meta before entering my wikis paladox [20:58:03] you need to log out afterwards [20:58:04] then log ino commons [20:59:15] But then I get "centralized session..." or " There is no logon attempt in progress" [20:59:33] yup, then retry until it works [20:59:37] i got the same as you. [21:00:12] PROBLEM - nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'nonbinary.wiki' expires in 7 day(s) (Tue 04 Jun 2019 08:59:49 PM GMT +0000). [21:00:32] PROBLEM - pl.nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'nonbinary.wiki' expires in 7 day(s) (Tue 04 Jun 2019 08:59:49 PM GMT +0000). [21:03:08] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [21:03:12] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [21:03:12] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:03:19] RECOVERY - elasticsearch1 Puppet on elasticsearch1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:03:20] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [21:03:58] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:04:28] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:05:08] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:05:10] Paladox: ^ What happened? [21:05:39] that is a puppet run dosen't affect anything visable. (it basically helps us to maintain the servers) [21:06:37] paladox: Cool [21:22:23] paladox: My wiki is down - Are we early on the downtime? [21:22:30] huh [21:22:43] https://meta.miraheze.org/wiki/Miraheze looks up [21:22:44] [ Meta ] - meta.miraheze.org [21:22:48] what do you get on your wiki? [21:23:39] Paladox: see this https://usercontent.irccloud-cdn.com/file/ADxlXaGe/image.png [21:23:50] hmm [21:23:55] that's not us [21:24:04] that's because it cannot find the ip [21:24:14] https://quirc.miraheze.org/wiki/Main_Page works for me [21:24:14] [ QuIRC ] - quirc.miraheze.org [21:25:06] "mirahzee.org" [21:25:10] Paladox: Spotted it - check the link I was using [21:25:26] ah wrong name [21:33:36] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRwp [21:33:38] [02miraheze/mw-config] 07paladox 0307dc069 - Set wikis into readonly mode Change-Id: I8d856b33e34bf31fc693d733178dced5c9eef81c [21:34:25] I've protected ours to only me anyway [21:37:45] !log upgrade mariadb to 10.2.24 on db4 [21:39:25] PROBLEM - misc1 webmail.miraheze.org HTTPS on misc1 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 200 OK [21:39:32] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - check plugin (check_jobqueue) or PHP errors [21:39:36] PROBLEM - misc4 phabricator.miraheze.org HTTPS on misc4 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 4228 bytes in 0.035 second response time [21:39:55] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is CRITICAL: CRITICAL - NGINX Error Rate is 95% [21:40:02] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [21:40:15] PROBLEM - misc4 phab.miraheze.wiki HTTPS on misc4 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 500 Internal Server Error [21:40:20] PROBLEM - db4 MySQL on db4 is CRITICAL: Can't connect to MySQL server on '81.4.109.166' (111 "Connection refused") [21:40:23] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [21:40:43] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [21:40:59] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [21:41:14] PROBLEM - misc2 HTTPS on misc2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 2339 bytes in 0.060 second response time [21:41:25] PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is CRITICAL: CRITICAL - NGINX Error Rate is 70% [21:41:33] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [21:43:01] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 75% [21:45:14] RECOVERY - misc2 HTTPS on misc2 is OK: HTTP OK: HTTP/1.1 200 OK - 41137 bytes in 0.177 second response time [21:45:23] RECOVERY - misc1 webmail.miraheze.org HTTPS on misc1 is OK: HTTP OK: Status line output matched "HTTP/1.1 401 Unauthorized" - 5806 bytes in 0.060 second response time [21:45:25] RECOVERY - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 35% [21:45:32] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [21:45:33] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [21:45:36] RECOVERY - misc4 phabricator.miraheze.org HTTPS on misc4 is OK: HTTP OK: HTTP/1.1 200 OK - 19058 bytes in 0.238 second response time [21:45:42] PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[mariadb-server] [21:45:55] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 4% [21:46:02] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [21:46:04] !log upgrade mariadb to 10.2.24 on db4 (at 21:37) [21:46:15] RECOVERY - misc4 phab.miraheze.wiki HTTPS on misc4 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17724 bytes in 0.192 second response time [21:46:21] RECOVERY - db4 MySQL on db4 is OK: Uptime: 220 Threads: 66 Questions: 67217 Slow queries: 4895 Opens: 3268 Flush tables: 1 Open tables: 800 Queries per second avg: 305.531 [21:46:23] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [21:46:37] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [21:46:41] !log upgrade postfix postfix-sqlite python3-jinja2 rsync tzdata unzip on db4 [21:46:55] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [21:47:01] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 51% [21:47:18] !log upgrade libmariadb3 libmariadbclient18 galera-3 on db4 [21:49:01] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 20% [21:53:08] !log stopping lizardfs-chunkserver on lizardfs3 [21:53:25] !log rebooting lizardfs3 for TUN change [21:53:39] RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:55:58] !log stopping lizardfs-chunkserver on lizardfs2 [21:56:01] !log rebooting lizardfs2 for TUN change [21:58:02] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [21:59:38] !log stopping lizardfs-chunkserver on lizardfs1 [21:59:44] !log rebooting lizardfs1 for TUN change [22:01:01] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 44% [22:01:33] PROBLEM - lizardfs1 Lizardfs Chunkserver Port on lizardfs1 is CRITICAL: connect to address 81.4.101.157 and port 9422: Connection refused [22:02:08] PROBLEM - lizardfs1 Current Load on lizardfs1 is CRITICAL: connect to address 81.4.101.157 port 5666: Connection refusedconnect to host 81.4.101.157 port 5666: Connection refused [22:02:08] PROBLEM - lizardfs1 Disk Space on lizardfs1 is CRITICAL: connect to address 81.4.101.157 port 5666: Connection refusedconnect to host 81.4.101.157 port 5666: Connection refused [22:02:40] PROBLEM - lizardfs1 SSH on lizardfs1 is CRITICAL: connect to address 81.4.101.157 and port 22: Connection refused [22:03:17] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [22:03:21] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [22:03:24] PROBLEM - mw3 HTTPS on mw3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:03:25] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [22:03:26] PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is CRITICAL: CRITICAL - NGINX Error Rate is 62% [22:03:28] RECOVERY - lizardfs1 Lizardfs Chunkserver Port on lizardfs1 is OK: TCP OK - 0.001 second response time on 81.4.101.157 port 9422 [22:03:36] PROBLEM - mw1 HTTPS on mw1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:03:37] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is CRITICAL: CRITICAL - NGINX Error Rate is 81% [22:03:41] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [22:04:06] RECOVERY - lizardfs1 Current Load on lizardfs1 is OK: OK - load average: 0.75, 0.22, 0.07 [22:04:06] RECOVERY - lizardfs1 Disk Space on lizardfs1 is OK: DISK OK - free space: / 34325 MB (22% inode=98%); [22:04:36] RECOVERY - lizardfs1 SSH on lizardfs1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u6 (protocol 2.0) [22:05:01] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 30% [22:05:03] !log upgrade nodejs postfix postfix-sqlite puppet-agent python3-jinja2 tzdata unzip on misc3 [22:05:15] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [22:05:21] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [22:05:21] RECOVERY - mw3 HTTPS on mw3 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 444 bytes in 0.011 second response time [22:05:22] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [22:05:26] RECOVERY - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 11% [22:05:31] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 4% [22:05:34] RECOVERY - mw1 HTTPS on mw1 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 444 bytes in 0.012 second response time [22:05:39] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [22:06:01] !log upgrade nginx on misc3 [22:06:02] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [22:06:37] !log stop lizardfs-master on misc3 (and reboot for TUN change) [22:09:05] PROBLEM - misc3 Lizardfs Master Port 2 on misc3 is CRITICAL: connect to address 185.52.1.144 and port 9420: Connection refused [22:09:17] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [22:09:35] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [22:10:03] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [22:10:59] RECOVERY - misc3 Lizardfs Master Port 2 on misc3 is OK: TCP OK - 0.001 second response time on 185.52.1.144 port 9420 [22:11:14] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [22:11:23] !log upgrade php to 7.3.5 on misc2 [22:11:34] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [22:12:02] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [22:12:50] !log upgrade postfix postfix-sqlite puppet-agent tzdata unzip on misc2 [22:14:17] !log upgrade mariadb-client on misc2 [22:14:40] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 2 minutes ago with 5 failures. Failed resources (up to 3 shown): Package[php7.3-cli],Package[php7.3-fpm],Package[php7.3-dev],Package[php7.3-common] [22:14:53] !log upgrade nginx libmariadbclient18 on misc2 [22:15:56] !log reboot misc2 for TUN change [22:18:46] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [22:19:56] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRrd [22:19:58] [02miraheze/mw-config] 07paladox 0361e2102 - Revert "Set wikis into readonly mode" This reverts commit 07dc069028b27ad94d94dbd2e5cded52a179f6c9. Change-Id: I0a84ac30629624632ae1ee9a419bad704eaf3242 [22:20:13] [02miraheze/mw-config] 07paladox pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/fjRrF [22:20:14] [02miraheze/mw-config] 07paladox 03e1f581d - Revert "Annouce Miraheze maintenance windows for our servers" This reverts commit 912a80ab72ac50b6bb4c77e552a03bfea870312b. Change-Id: I1e6dd673ff5f50a62705833e94e8cacdcb78eb0e [22:20:16] [02miraheze/mw-config] 07paladox 032d54150 - Merge "Revert "Annouce Miraheze maintenance windows for our servers"" [22:21:47] Paladox: Is maintenance over then? [22:21:52] yup [22:22:07] Paladox: Well done - I make that only 1hr15 [22:22:21] heh, thanks :) [22:22:33] i think it's less then an hour (only started at 10:30 pm) [22:24:50] paladox - np [22:25:31] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [22:25:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRrx [22:25:34] [02miraheze/puppet] 07paladox 031f6963a - Add vpncloud to lizardfs[1-3] [22:25:35] [02puppet] 07paladox opened pull request 03#1007: Add vpncloud to lizardfs[1-3] - 13https://git.io/fjRrh [22:26:45] paladox: You'll be thanked on https://quirc.freshstatus.io/incident/2793 soon [22:26:46] [ QuIRC's Statuspage Powered by Freshstatus | Incident details ] - quirc.freshstatus.io [22:26:59] ok, thanks! [22:27:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRof [22:27:38] [02miraheze/puppet] 07paladox 03cb08b51 - Update vpncloud.pp [22:27:39] [02puppet] 07paladox synchronize pull request 03#1007: Add vpncloud to lizardfs[1-3] - 13https://git.io/fjRrh [22:28:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRoJ [22:28:25] [02miraheze/puppet] 07paladox 03bed9b39 - Update lizardfs1.yaml [22:28:27] [02puppet] 07paladox synchronize pull request 03#1007: Add vpncloud to lizardfs[1-3] - 13https://git.io/fjRrh [22:28:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRoU [22:28:37] [02miraheze/puppet] 07paladox 039af838b - Update lizardfs2.yaml [22:28:38] [02puppet] 07paladox synchronize pull request 03#1007: Add vpncloud to lizardfs[1-3] - 13https://git.io/fjRrh [22:28:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRoT [22:28:46] [02miraheze/puppet] 07paladox 03c1cecf6 - Update lizardfs3.yaml [22:28:48] [02puppet] 07paladox synchronize pull request 03#1007: Add vpncloud to lizardfs[1-3] - 13https://git.io/fjRrh [22:29:04] [02puppet] 07paladox closed pull request 03#1007: Add vpncloud to lizardfs[1-3] - 13https://git.io/fjRrh [22:29:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±5] 13https://git.io/fjRok [22:29:07] [02miraheze/puppet] 07paladox 035573c01 - Add vpncloud to lizardfs[1-3] (#1007) * Add vpncloud to lizardfs[1-3] * Update vpncloud.pp * Update lizardfs1.yaml * Update lizardfs2.yaml * Update lizardfs3.yaml [22:29:08] [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS [22:29:10] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3 [22:30:34] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [22:30:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRoq [22:30:37] [02miraheze/puppet] 07paladox 0334ea7a6 - Add vpncloud to misc[234] [22:30:39] [02puppet] 07paladox opened pull request 03#1008: Add vpncloud to misc[234] - 13https://git.io/fjRom [22:32:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRos [22:32:57] [02miraheze/puppet] 07paladox 0353a2aad - Update vpncloud.pp [22:33:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRoG [22:33:40] [02miraheze/puppet] 07paladox 031b82cc9 - Update misc2.yaml [22:33:41] [02puppet] 07paladox synchronize pull request 03#1008: Add vpncloud to misc[234] - 13https://git.io/fjRom [22:33:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRoZ [22:33:56] [02miraheze/puppet] 07paladox 03601daa0 - Update misc3.yaml [22:33:57] [02puppet] 07paladox synchronize pull request 03#1008: Add vpncloud to misc[234] - 13https://git.io/fjRom [22:34:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRon [22:34:13] [02miraheze/puppet] 07paladox 0346be047 - Update misc3.yaml [22:34:15] [02puppet] 07paladox synchronize pull request 03#1008: Add vpncloud to misc[234] - 13https://git.io/fjRom [22:34:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRoc [22:34:24] [02miraheze/puppet] 07paladox 03961c3ab - Update misc4.yaml [22:34:25] [02puppet] 07paladox synchronize pull request 03#1008: Add vpncloud to misc[234] - 13https://git.io/fjRom [22:34:34] [02puppet] 07paladox closed pull request 03#1008: Add vpncloud to misc[234] - 13https://git.io/fjRom [22:34:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/fjRoC [22:34:37] [02miraheze/puppet] 07paladox 038aaeb24 - Add vpncloud to misc[234] (#1008) * Add vpncloud to misc[234] * Update misc2.yaml * Update misc3.yaml * Update misc3.yaml * Update misc4.yaml [22:34:38] [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS [22:34:40] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3 [22:34:47] By the way, because it always (every month) takes a long time to log in to AllTheTropes when I do it from Metawiki?. paladox [22:35:22] Hispano76 is that on the main page? [22:35:46] i think the main page is cache thus reduces the loading time (att main page seems to have something expensive (i think images)) [22:36:07] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRo4 [22:36:08] [02miraheze/puppet] 07paladox 039fd7e45 - Update vpncloud.pp [22:36:39] hum, always open wikis with Special:RechentChanges paladox [22:36:46] oh [22:37:39] (that also happens to me with CommonsWiki, test1wiki, publictestwiki, espublictestwiki..) [22:39:06] Hispano76 do you know how long in seconds it takes to load? [22:39:28] PROBLEM - bconnected.aidanmarkham.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'bconnected.aidanmarkham.com' expires in 7 day(s) (Tue 04 Jun 2019 10:38:49 PM GMT +0000). [22:41:04] hum, maximum 2-5 seconds. But he behaved just like eswikipedia or Wikia. [22:42:04] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjRou [22:42:05] (but takes longer if the page has more than 15 000-100 000 bytes) [22:42:05] [02miraheze/puppet] 07paladox 039bd1f6b - Update miraheze-internal.net.erb [22:42:17] Hispano76 that's expected. [22:45:41] hum, ok [22:54:53] PROBLEM - lizardfs3 Puppet on lizardfs3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:09] PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:13] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:14] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:16] PROBLEM - lizardfs1 Puppet on lizardfs1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:17] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:17] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:19] PROBLEM - elasticsearch1 Puppet on elasticsearch1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:39] PROBLEM - lizardfs2 Puppet on lizardfs2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:53] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:55:58] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:56:36] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [22:57:08] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[vpncloud@miraheze-internal] [23:02:33] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [23:02:47] RECOVERY - lizardfs3 Puppet on lizardfs3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:03:06] RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:03:10] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [23:03:12] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [23:03:12] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:03:15] RECOVERY - lizardfs1 Puppet on lizardfs1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:03:16] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:03:19] RECOVERY - elasticsearch1 Puppet on elasticsearch1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:03:38] RECOVERY - lizardfs2 Puppet on lizardfs2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:03:43] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [23:03:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fjRo5 [23:03:46]