[00:20:41] RECOVERY - Varnish Backends on cp4 is OK: All 3 backends are healthy [00:21:11] RECOVERY - Varnish Backends on cp5 is OK: All 3 backends are healthy [00:21:51] RECOVERY - Varnish Backends on cp2 is OK: All 3 backends are healthy [00:43:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWnU [00:43:35] [02miraheze/puppet] 07paladox 03b6284ec - Increase CHUNKS_LOOP_MAX_CPU to 50 [00:43:40] PROBLEM - Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 2 minutes ago with 5 failures. Failed resources (up to 3 shown): [00:43:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWnT [00:43:55] [02miraheze/puppet] 07paladox 031e7e74a - Set maxtrashtime to 0 [00:51:40] RECOVERY - Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [00:59:51] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate antiguabarbudacalypso.com expires in 15 day(s) (Mon 06 Aug 2018 12:57:00 AM GMT +0000). [01:02:57] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWn7 [01:02:59] [02miraheze/ssl] 07paladox 03749bdac - Update antiguabarbudacalypso.com.crt [01:03:29] PROBLEM - wikibase.revi.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate wikibase.revi.wiki expires in 15 day(s) (Mon 06 Aug 2018 01:01:05 AM GMT +0000). [01:03:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWnF [01:03:41] [02miraheze/ssl] 07MirahezeSSLBot 030cfb6a6 - Bot: Update SSL cert for wikibase.revi.wiki [01:11:30] RECOVERY - wikibase.revi.wiki - LetsEncrypt on sslhost is OK: OK - Certificate wikibase.revi.wiki will expire on Fri 19 Oct 2018 12:03:35 AM GMT +0000. [01:11:50] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate antiguabarbudacalypso.com will expire on Fri 19 Oct 2018 12:02:36 AM GMT +0000. [04:13:30] PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 2677 [05:07:31] RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [10:35:29] PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 2715 [11:29:29] RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [13:15:50] PROBLEM - Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [13:16:50] PROBLEM - Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [13:17:50] PROBLEM - Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [13:22:54] I will let you know when I see Zppix around here [13:22:54] @notify Zppix [13:24:51] RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:25:51] PROBLEM - Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [13:36:49] PROBLEM - Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [14:13:50] RECOVERY - Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:13:52] RECOVERY - Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:14:50] RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:25:50] RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [14:33:51] RECOVERY - Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:13:43] Hello [16:03:30] PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 2737 [16:37:20] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [16:37:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWXu [16:37:23] [02miraheze/puppet] 07paladox 034d8c1d7 - Backup /var/lib/lizardfs [16:37:24] [02puppet] 07paladox opened pull request 03#778: Backup /var/lib/lizardfs - 13https://git.io/fNWXz [16:40:30] [02puppet] 07paladox synchronize pull request 03#778: Backup /var/lib/lizardfs - 13https://git.io/fNWXz [16:40:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWXK [16:40:33] [02miraheze/puppet] 07paladox 037f015c3 - Update bacula-dir.conf [16:47:48] [02puppet] 07paladox commented on pull request 03#778: Backup /var/lib/lizardfs - 13https://git.io/fNWXp [16:57:29] RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [17:07:06] [02puppet] 07paladox synchronize pull request 03#778: Backup /var/lib/lizardfs - 13https://git.io/fNWXz [17:07:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNW11 [17:07:09] [02miraheze/puppet] 07paladox 0352752db - Update bacula-dir.conf [17:07:19] [02puppet] 07paladox closed pull request 03#778: Backup /var/lib/lizardfs - 13https://git.io/fNWXz [17:07:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNW1M [17:07:22] [02miraheze/puppet] 07paladox 0300f42c5 - Backup /var/lib/lizardfs (#778) * Backup /var/lib/lizardfs * Update bacula-dir.conf * Update bacula-dir.conf [17:08:09] [02puppet] 07paladox deleted branch 03paladox-patch-3 - 13https://git.io/vbiAS [17:08:11] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-3 [17:11:30] PROBLEM - allthetropes.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate allthetropes.org expires in 15 day(s) (Mon 06 Aug 2018 05:08:25 PM GMT +0000). [17:11:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNW1F [17:11:45] [02miraheze/ssl] 07MirahezeSSLBot 031d2916c - Bot: Update SSL cert for allthetropes.org [17:11:54] PROBLEM - www.allthetropes.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate allthetropes.org expires in 15 day(s) (Mon 06 Aug 2018 05:08:25 PM GMT +0000). [17:12:02] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fNW1A [17:12:04] [02miraheze/ssl] 07MirahezeSSLBot 03d612608 - Bot: Update SSL cert for www.allthetropes.org [17:12:12] Reception123: ^^ [17:12:26] Why does att have mutiple certs in one cert [17:12:35] Multiple [17:21:33] RECOVERY - allthetropes.org - LetsEncrypt on sslhost is OK: OK - Certificate allthetropes.org will expire on Fri 19 Oct 2018 04:11:39 PM GMT +0000. [17:21:55] RECOVERY - www.allthetropes.org - LetsEncrypt on sslhost is OK: OK - Certificate allthetropes.org will expire on Fri 19 Oct 2018 04:11:39 PM GMT +0000. [17:28:05] paladox: I guess www was grouped with it? [17:28:49] Reception123: hmm maybe [17:40:52] [02mw-config] 07The-Voidwalker opened pull request 03#2288: followup on T3234 - 13https://git.io/fNWDJ [17:41:25] [02mw-config] 07paladox closed pull request 03#2288: followup on T3234 - 13https://git.io/fNWDJ [17:41:27] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWDk [17:41:28] [02miraheze/mw-config] 07The-Voidwalker 03c1c2836 - followup on T3234 (#2288) [17:52:11] [02mw-config] 07CnocBride opened pull request 03#2289: Updating wikibookwiki namespaces - 13https://git.io/fNWD2 [17:59:15] [02mw-config] 07paladox closed pull request 03#2289: Updating wikibookwiki namespaces - 13https://git.io/fNWD2 [17:59:16] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWDM [17:59:18] [02miraheze/mw-config] 07CnocBride 03dc9df05 - Updating wikibookwiki namespaces (#2289) Per request T335. Also put namespace list for said wiki in alphabetical order. [18:03:54] PROBLEM - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate permanentfuturelab.wiki expires in 15 day(s) (Mon 06 Aug 2018 06:01:20 PM GMT +0000). [18:04:09] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fNWDA [18:04:10] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate permanentfuturelab.wiki expires in 15 day(s) (Mon 06 Aug 2018 06:01:20 PM GMT +0000). [18:04:10] [02miraheze/ssl] 07MirahezeSSLBot 039aeb552 - Bot: Update SSL cert for www.permanentfuturelab.wiki [18:04:20] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWDx [18:04:21] [02miraheze/ssl] 07MirahezeSSLBot 0391a65ec - Bot: Update SSL cert for permanentfuturelab.wiki [18:11:50] RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate permanentfuturelab.wiki will expire on Fri 19 Oct 2018 05:04:15 PM GMT +0000. [18:11:52] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate permanentfuturelab.wiki will expire on Fri 19 Oct 2018 05:04:15 PM GMT +0000. [19:46:09] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=riptowiki --report=1 /home/paladox/imaspeedrunner_pages_full_07-08-2018.xml on mw2 [19:46:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:07:31] PROBLEM - programming.red - LetsEncrypt on sslhost is WARNING: WARNING - Certificate programming.red expires in 15 day(s) (Mon 06 Aug 2018 08:04:36 PM GMT +0000). [20:07:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNW7f [20:07:45] PROBLEM - www.programming.red - LetsEncrypt on sslhost is WARNING: WARNING - Certificate programming.red expires in 15 day(s) (Mon 06 Aug 2018 08:04:36 PM GMT +0000). [20:07:46] [02miraheze/ssl] 07MirahezeSSLBot 03a45e632 - Bot: Update SSL cert for programming.red [20:07:53] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fNW7J [20:07:54] [02miraheze/ssl] 07MirahezeSSLBot 030c006dc - Bot: Update SSL cert for www.programming.red [20:11:34] RECOVERY - www.programming.red - LetsEncrypt on sslhost is OK: OK - Certificate programming.red will expire on Fri 19 Oct 2018 07:07:40 PM GMT +0000. [20:43:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNW53 [20:43:48] [02miraheze/puppet] 07paladox 032511794 - Enable bi writes in lizardfs client [20:45:34] PROBLEM - bconnected.aidanmarkham.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate bconnected.aidanmarkham.com expires in 15 day(s) (Mon 06 Aug 2018 08:42:22 PM GMT +0000). [20:45:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNW5l [20:45:45] [02miraheze/ssl] 07MirahezeSSLBot 03c669d53 - Bot: Update SSL cert for bconnected.aidanmarkham.com [20:46:04] PROBLEM - Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 3 minutes ago with 0 failures [20:46:54] PROBLEM - Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 3 minutes ago with 0 failures [20:51:34] RECOVERY - bconnected.aidanmarkham.com - LetsEncrypt on sslhost is OK: OK - Certificate bconnected.aidanmarkham.com will expire on Fri 19 Oct 2018 07:45:38 PM GMT +0000. [21:18:54] RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:24:05] RECOVERY - Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:28:05] RECOVERY - Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [22:05:26] .tell 12h Happy anniversary Miraheze! [22:05:26] Reception123: I'll pass that on when 12h is around. [22:05:37] Hmm I forgot how this works [22:05:43] MacFan4000: ^ [22:05:57] .remind 12h Happy anniversary Miraheze! [22:07:07] wasn't it .in? [22:07:18] .in [22:07:18] Missing arguments for reminder command. [22:08:04] PROBLEM - sdiy.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate sdiy.info expires in 15 day(s) (Mon 06 Aug 2018 10:04:25 PM GMT +0000). [22:08:19] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWFp [22:08:20] PROBLEM - www.sdiy.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate sdiy.info expires in 15 day(s) (Mon 06 Aug 2018 10:04:25 PM GMT +0000). [22:08:21] [02miraheze/ssl] 07MirahezeSSLBot 033e7fbea - Bot: Update SSL cert for sdiy.info [22:08:28] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/fNWFh [22:08:30] [02miraheze/ssl] 07MirahezeSSLBot 03976964e - Bot: Update SSL cert for www.sdiy.info [22:11:58] RECOVERY - www.sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate sdiy.info will expire on Fri 19 Oct 2018 09:08:14 PM GMT +0000. [22:27:27] PROBLEM - wiki.macc.nyc - LetsEncrypt on sslhost is WARNING: WARNING - Certificate wiki.macc.nyc expires in 15 day(s) (Mon 06 Aug 2018 10:25:10 PM GMT +0000). [22:27:39] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNWbz [22:27:40] [02miraheze/ssl] 07MirahezeSSLBot 03a9a07ac - Bot: Update SSL cert for wiki.macc.nyc [22:31:29] RECOVERY - wiki.macc.nyc - LetsEncrypt on sslhost is OK: OK - Certificate wiki.macc.nyc will expire on Fri 19 Oct 2018 09:27:34 PM GMT +0000. [23:10:10] PROBLEM - Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [23:15:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWNK [23:15:09] [02miraheze/puppet] 07paladox 03a45942f - Rename swift* to lizardfs* [23:15:11] [02puppet] 07paladox created branch 03paladox-patch-3 - 13https://git.io/vbiAS [23:15:12] [02puppet] 07paladox opened pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:15:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+1/-1/±0] 13https://git.io/fNWNi [23:15:43] [02miraheze/puppet] 07paladox 038db43f1 - Update and rename swift1.yaml to lizardfs1.yaml [23:15:44] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:16:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+1/-1/±0] 13https://git.io/fNWNP [23:16:04] [02miraheze/puppet] 07paladox 0369fc809 - Update and rename swift2.yaml to lizardfs2.yaml [23:16:06] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:16:10] RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures [23:16:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWNX [23:16:41] [02miraheze/puppet] 07paladox 03637b766 - Update storage_firewall.yaml [23:16:42] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:21:28] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWNy [23:21:29] [02miraheze/puppet] 07paladox 039215d08 - Update director.pp [23:21:31] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:23:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWN9 [23:23:01] [02miraheze/puppet] 07paladox 03855262b - Update bacula-dir.conf [23:23:03] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:27:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWNd [23:27:35] [02miraheze/puppet] 07paladox 03f40271b - Update nrpe.cfg.erb [23:27:37] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:28:17] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWNA [23:28:19] [02miraheze/puppet] 07paladox 030971553 - Update bacula-dir.conf [23:28:20] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:30:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWNh [23:30:23] [02miraheze/puppet] 07paladox 037c9ca53 - Update director.pp [23:30:25] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:31:04] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWAf [23:31:05] [02miraheze/puppet] 07paladox 031dcef66 - Update prometheus.yml [23:31:07] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:33:11] [02puppet] 07paladox synchronize pull request 03#779: Rename swift* to lizardfs* - 13https://git.io/fNWN6 [23:33:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://git.io/fNWAk [23:33:14] [02miraheze/puppet] 07paladox 03020a731 - Update director.pp [23:37:44] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNWAs [23:37:45] [02miraheze/dns] 07paladox 03bc23517 - Rename swift* to lizardfs* [23:37:47] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbQXl [23:37:48] [02dns] 07paladox opened pull request 03#92: Rename swift* to lizardfs* - 13https://git.io/fNWAG [23:38:10] PROBLEM - Puppet on swift1 is WARNING: WARNING: Puppet is currently disabled, message: paladox pending rename, last run 7 minutes ago with 0 failures [23:38:51] do you not see eu cookies? [23:39:09] Wiki-1776 only eu users see cookies [23:39:32] and if it cannot figure out if your in the eu or not [23:39:36] it will show you it [23:39:55] as a pre caution. [23:40:29] Hmm, well, that's strange. Could it be that when you fix LC, you change that? Because I'm from Latin America. [23:41:11] Wiki-1776 nope [23:41:14] or will it be a bug in my browser? [23:41:38] Wiki-1776 it is not a bug in your browser, but rather it coulden't figure out from your ip that your not in the EU [23:41:41] that makes me think I'm in Europe. [23:42:02] ah [23:43:11] Well, on another subject. Any news from the Poll of Miraheze? [23:58:50] Wiki-1776 try now [23:58:56] see if you see the cookie notice