[00:00:15] PROBLEM - cp4 Stunnel Http for misc2 on cp4 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 309 bytes in 0.011 second response time [00:00:21] PROBLEM - cp4 Stunnel Http for misc3 on cp4 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 309 bytes in 0.015 second response time [00:02:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQk3 [00:02:54] [02miraheze/puppet] 07paladox 03a4fc374 - nrpe: Expect a response code of 502 for misc2 and misc3 [00:03:59] PROBLEM - cp3 Stunnel Http for misc2 on cp3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 309 bytes in 0.538 second response time [00:04:08] RECOVERY - cp4 Stunnel Http for misc3 on cp4 is OK: HTTP OK: Status line output matched "502" - 309 bytes in 0.004 second response time [00:04:11] PROBLEM - cp3 Stunnel Http for misc3 on cp3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 309 bytes in 0.493 second response time [00:04:13] RECOVERY - cp4 Stunnel Http for misc2 on cp4 is OK: HTTP OK: Status line output matched "502" - 309 bytes in 0.007 second response time [00:04:34] PROBLEM - cp2 Stunnel Http for misc3 on cp2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 309 bytes in 0.293 second response time [00:04:50] PROBLEM - cp2 Stunnel Http for misc2 on cp2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 309 bytes in 0.293 second response time [00:06:05] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQkn [00:06:06] [02miraheze/dns] 07paladox 03f8065a8 - Add acme challenge for miraheze.com [00:08:09] RECOVERY - cp3 Stunnel Http for misc3 on cp3 is OK: HTTP OK: Status line output matched "502" - 309 bytes in 0.500 second response time [00:08:23] RECOVERY - cp2 Stunnel Http for misc3 on cp2 is OK: HTTP OK: Status line output matched "502" - 309 bytes in 0.293 second response time [00:08:47] RECOVERY - cp2 Stunnel Http for misc2 on cp2 is OK: HTTP OK: Status line output matched "502" - 309 bytes in 0.293 second response time [00:08:52] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQk8 [00:08:54] [02miraheze/ssl] 07paladox 039ba8885 - Renew miraheze.com [00:08:59] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±0] 13https://git.io/fjQk4 [00:09:00] [02miraheze/ssl] 07paladox 03a621b6c - Update miraheze.com.crt [00:09:31] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQkB [00:09:32] [02miraheze/dns] 07paladox 034300b83 - Remove old acme challenges for miraheze.com [00:09:48] RECOVERY - cp3 Stunnel Http for misc2 on cp3 is OK: HTTP OK: Status line output matched "502" - 309 bytes in 0.500 second response time [00:10:05] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQkR [00:10:07] [02miraheze/dns] 07paladox 033dec7ba - Add acme challenges for miraheze.wiki [00:13:06] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQkE [00:13:07] [02miraheze/ssl] 07paladox 03b5b3426 - Renew miraheze.wiki [00:13:21] RECOVERY - miraheze.com - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.com' will expire on Sun 03 Nov 2019 11:08:19 PM GMT +0000. [00:13:27] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQku [00:13:29] [02miraheze/dns] 07paladox 03f02668f - Remove old acme challenges for miraheze.wiki [00:14:26] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQkz [00:14:28] [02miraheze/dns] 07paladox 0378e61f8 - Add acme challenges for orain.org [00:15:38] miraheze/dns/master/f02668f - paladox The build has errored. https://travis-ci.org/miraheze/dns/builds/568139673 [00:16:48] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQkV [00:16:50] [02miraheze/dns] 07paladox 03882b324 - Update orain.org [00:18:16] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQkw [00:18:17] [02miraheze/ssl] 07paladox 03ce26807 - Renew orain.org [00:18:40] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQko [00:18:41] [02miraheze/dns] 07paladox 03b899352 - Remove old acme challenges for orain [00:19:52] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQkK [00:19:53] [02miraheze/ssl] 07paladox 030a166a1 - Renew eerstelijnszones.be [00:22:36] RECOVERY - eerstelijnszones.be - LetsEncrypt on sslhost is OK: OK - Certificate 'eerstelijnszones.be' will expire on Sun 03 Nov 2019 11:19:23 PM GMT +0000. [00:22:39] RECOVERY - www.eerstelijnszones.be - LetsEncrypt on sslhost is OK: OK - Certificate 'eerstelijnszones.be' will expire on Sun 03 Nov 2019 11:19:23 PM GMT +0000. [00:22:43] RECOVERY - orain.org - LetsEncrypt on sslhost is OK: OK - Certificate 'orain.org' will expire on Sun 03 Nov 2019 11:17:52 PM GMT +0000. [00:23:17] RECOVERY - allthetropes.orain.org - LetsEncrypt on sslhost is OK: OK - Certificate 'orain.org' will expire on Sun 03 Nov 2019 11:17:52 PM GMT +0000. [00:23:32] RECOVERY - poserdazfreebies.orain.org - LetsEncrypt on sslhost is OK: OK - Certificate 'orain.org' will expire on Sun 03 Nov 2019 11:17:52 PM GMT +0000. [00:23:40] RECOVERY - miraheze.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.wiki' will expire on Sun 03 Nov 2019 11:12:42 PM GMT +0000. [00:24:05] RECOVERY - meta.orain.org - LetsEncrypt on sslhost is OK: OK - Certificate 'orain.org' will expire on Sun 03 Nov 2019 11:17:52 PM GMT +0000. [06:26:41] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3079 MB (12% inode=94%); [07:13:33] paladox, Reception123, PuppyKun: can u help https://meta.miraheze.org/w/index.php?diff=79184&oldid=79183&rcid=285788? [07:13:34] [ Difference between revisions of "User talk:RhinosF1" - Miraheze Meta ] - meta.miraheze.org [07:27:01] As I said won't be able until late to so paladox ^ [07:28:24] Reception123: okay thanks, ive given them the custom domains page but theyre going on about needing your ip [07:28:39] so i dont think theyve done any of the steps [08:50:00] PROBLEM - db4 Disk Space on db4 is CRITICAL: DISK CRITICAL - free space: / 21977 MB (5% inode=96%); [13:15:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQZD [13:15:15] [02miraheze/services] 07MirahezeSSLBot 033b2fc87 - BOT: Updating services config for wikis [15:42:06] hey all, does anyone know how to change default url from example.com/wiki to example.com [15:42:49] example.com/wiki/test to example.com/test [15:43:24] hi, we doin't currently support that, sorry for the inconvenience [15:44:19] np :) [15:45:37] PROBLEM - bacula1 Bacula Static on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:47:33] PROBLEM - bacula1 Bacula Static on bacula1 is WARNING: WARNING: Full, 4375781 files, 364.8GB, 2019-07-11 14:36:00 (3.7 weeks ago) [16:36:41] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2649 MB (10% inode=94%); [16:53:17] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 4.36, 2.92, 1.68 [17:27:23] PROBLEM - espiral.org - Gandi on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:29:19] PROBLEM - espiral.org - Gandi on sslhost is WARNING: WARNING - Certificate 'espiral.org' expires in 17 day(s) (Fri 23 Aug 2019 11:59:59 PM GMT +0000). [18:35:17] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.17, 0.33, 1.82 [18:37:17] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.13, 0.25, 1.61 [19:16:52] hi [20:10:13] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 6.18, 3.12, 1.49 [20:23:55] hi [20:24:45] Hispano76: hi [20:26:37] JohnLewis: any chance u could get the AFv5 and Poll extension usage stats again. Or Paladox [21:12:53] I guess JohnLewis used some mysql query to get that info [21:13:56] * paladox checked the history log file [21:13:58] SELECT COUNT(*) FROM cw_wikis WHERE wiki_extensions LIKE '%articlefeedbackv5%'; [21:14:28] paladox: yes exactly that - i want to know if the notice had an impact [21:14:43] RhinosF1 57 for AFv5 and 161 for poll [21:16:11] work? [21:16:14] :) [21:16:15] poll has gone up and afv5 down 1 [21:16:33] paladox: nit good really [21:17:02] paladox: how'd you do poll? [21:17:11] JohnLewis SELECT COUNT(*) FROM cw_wikis WHERE wiki_extensions LIKE '%poll%'; [21:17:15] oh [21:17:23] which would match poll, pollny and ajaxpoll :) [21:17:25] RhinosF1 155 [21:17:32] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.15, 0.76, 1.97 [21:17:40] SELECT COUNT(*) FROM cw_wikis WHERE wiki_extensions LIKE '%poll,%'; [21:17:44] paladox: still up 55 [21:17:53] which would match poll and ajaxpoll :) [21:17:53] ok [21:17:58] hmm [21:18:07] JohnLewis SELECT COUNT(*) FROM cw_wikis WHERE wiki_extensions LIKE '%,poll,%'; [21:18:07] ? [21:18:15] RhinosF1 105 [21:18:19] assuming poll isn't the first extension yeah [21:18:31] paladox: up 5 so not as bad [21:19:04] hi JohnLewis [21:19:08] JohnLewis: my follow up was any idea when the two would be removed per issues but that doesn't show many are removing it [21:19:18] any clue about just open wikis [21:19:25] RhinosF1: whenever realistically [21:20:07] JohnLewis: well they've had 1wk notice so far - can u check what usage is on open wikis to see if thats just from closed wikis not caring [21:20:43] paladox: ^ [21:21:17] ok [21:21:30] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.22, 0.49, 1.58 [21:21:38] JohnLewis wiki_closed is a 0 if the wiki is open right? [21:21:49] yes [21:22:14] JohnLewis: that sounds really obvious [21:22:39] RhinosF1 78 [21:22:53] paladox: for? [21:22:58] for poll [21:23:05] paladox: and afv5 [21:23:09] and 44 for AFv5 [21:23:11] paladox: what about active and open? [21:23:19] That's for open :) [21:23:25] paladox: what about active and open? [21:23:37] i'm not sure what you mean? [21:23:45] i did "SELECT COUNT(*) FROM cw_wikis WHERE wiki_extensions LIKE '%,poll,%' and wiki_closed = 0;" [21:23:53] we have three states of wikis. Active, inactive and closed [21:23:58] oh [21:24:10] how do i get Active? [21:24:18] i see no column for that [21:24:22] i suppose it's: [21:24:39] SELECT COUNT(*) FROM cw_wikis WHERE wiki_extensions LIKE '%,poll,%' and wiki_closed = 0 and wiki_inactive = 0; [21:24:41] JohnLewis ^? [21:24:44] yes [21:24:56] RhinosF1 74 for poll [21:25:12] and 41 for AFv5 [21:25:46] JohnLewis: thoughts? would have a big impact if they went (even though they don't work properly) [21:26:03] but they don't work [21:26:09] so impact is moot really [21:26:26] JohnLewis: true, i'll let u merge when u are ready [21:32:43] paladox: can [21:34:35] RhinosF1 which one do you want merged first? [21:34:51] paladox: does it matter? whichever shows up first [21:36:57] ok [21:36:59] nope [21:38:10] [02mw-config] 07paladox closed pull request 03#2707: Remove Extension:Poll - 13https://git.io/fjSVZ [21:38:11] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fjQ0j [21:38:13] [02miraheze/mw-config] 07RhinosF1 03614e808 - Remove Extension:Poll (#2707) * Remove Extension:Poll T4585 * Finish Removing Poll * Update extension-list * Drop Poll related settings [21:39:08] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjQEv [21:39:10] [02miraheze/mw-config] 07paladox 037b44934 - Remove poll [21:41:20] [02mw-config] 07paladox synchronize pull request 03#2708: remove article feedback - 13https://git.io/fjS1K [21:41:30] [02mw-config] 07paladox edited pull request 03#2708: remove ArticleFeedbackv5 - 13https://git.io/fjS1K [21:41:37] [02mw-config] 07paladox closed pull request 03#2708: remove ArticleFeedbackv5 - 13https://git.io/fjS1K [21:41:39] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/fjQEJ [21:41:40] [02miraheze/mw-config] 07RhinosF1 031094366 - remove ArticleFeedbackv5 (#2708) * remove article feedback drop Article Feedback per T4583 * remove article feedback * remove article feedback * Update extension-list [21:45:10] @Void do you want to confirm they're removed in #announcements [21:46:45] https://phabricator.miraheze.org/T4607 Sorry to bother you but could you do the import today or tomorrow? paladox Reception123 [21:46:46] [ ⚓ T4607 Import for ucronias.miraheze.org ] - phabricator.miraheze.org [21:47:01] i can do that now [21:47:13] Hispano76: reception isn't around while thurs btw [21:48:01] !log starting import for ucroniaswiki [21:48:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:51:29] miraheze/mw-config/master/614e808 - RhinosF1 The build has errored. https://travis-ci.org/miraheze/mw-config/builds/568570944 [21:51:54] paladox: erm ^ [21:52:04] although it's fine on wiki [21:52:15] fatal: unable to access 'https://github.com/miraheze/mw-config.git/': Failed to connect to github.com port 443: Connection timed out [21:52:16] 170 [21:52:16] 171 [21:52:25] and it only failed for the php 7.3 test [21:53:17] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 4.17, 2.15, 1.33 [21:53:23] !log starting import for usruwiki - T4575 [21:53:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:53:50] paladox: the change is on meta and looks fine (and we're up so) - maybe it just needs a re-run or check github [21:53:59] yup [21:54:04] tanks, thanks paladox :) [21:54:25] your welcome :) [21:54:30] i've restarted the test [21:55:17] paladox: thx [21:55:25] your welcome :) [21:56:16] paladox: np [22:02:27] paladox: passed this time [22:02:32] ok [22:02:41] * RhinosF1 can relax [22:12:30] paladox: im off now - thx again for deploying [22:12:34] ok [22:12:51] paladox: u love saying okay [22:12:57] yup :P [22:13:00] okay [22:13:04] JohnLewis LOL [22:14:32] JohnLewis: it's the only thing he says half the time. Not even 'okay' or 'k' just 'ok' [22:16:20] RhinosF1: (o)k(ay) [22:16:31] JohnLewis: :) [23:01:17] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.30, 1.14, 1.98 [23:09:17] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.24, 1.26, 1.69 [23:14:17] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_clone_phabricator-extensions] [23:15:28] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_arcanist] [23:21:25] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:24:57] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_puppet],Exec[git_pull_services],Exec[git_pull_ssl] [23:25:14] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_dns] [23:25:33] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 3 minutes ago with 5 failures. Failed resources (up to 3 shown): Exec[git_pull_libphutil],Exec[git_pull_arcanist],Exec[git_pull_MediaWiki config],Exec[git_pull_MediaWiki core] [23:26:43] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 4 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config],Exec[git_pull_MediaWiki core],Exec[git_pull_landing] [23:26:44] PROBLEM - test1 Puppet on test1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [23:26:50] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config],Exec[git_pull_MediaWiki core],Exec[git_pull_landing] [23:32:57] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [23:33:00] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [23:33:14] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [23:33:30] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [23:34:15] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:35:00] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:35:05] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:42:09] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.83, 1.66, 1.48 [23:44:07] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.48, 1.59, 1.47