[00:02:29] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:02:31] PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:02:45] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:02:53] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:02:59] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:05] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:07] PROBLEM - lizardfs2 Puppet on lizardfs2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:13] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:15] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:27] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:03:39] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:01] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:04:21] PROBLEM - lizardfs1 Puppet on lizardfs1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [00:05:53] Hello [00:06:29] Reception123, Are you here currently? [00:08:45] hey there [00:08:54] I don't think he is [00:09:30] Oh [00:11:00] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [00:11:08] RECOVERY - lizardfs2 Puppet on lizardfs2 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures [00:11:14] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures [00:11:16] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [00:11:23] sysadmin_wannabe, Is it ok if I private message you? [00:11:28] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [00:12:00] it's ok [00:12:00] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures [00:12:22] RECOVERY - lizardfs1 Puppet on lizardfs1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:30] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:32] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3 [00:12:34] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fpcmd [00:12:35] oh, it seems I need to be registered to do that :) [00:12:35] [02miraheze/mw-config] 07paladox 030bddc50 - Fix Nonciclopedia namespaces numbers [00:12:37] [02mw-config] 07paladox opened pull request 03#2558: Fix Nonciclopedia namespaces numbers - 13https://git.io/fpcmF [00:12:44] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [00:12:46] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:12:52] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:13:04] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [00:13:38] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:13:44] what's up dude? need any help? [00:13:56] miraheze/mw-config/paladox-patch-2/0bddc50 - paladox The build was fixed. https://travis-ci.org/miraheze/mw-config/builds/456491059 [00:16:06] [02mw-config] 07paladox closed pull request 03#2558: Fix Nonciclopedia namespaces numbers - 13https://git.io/fpcmF [00:16:08] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpcmp [00:16:09] [02miraheze/mw-config] 07paladox 037811ddc - Fix Nonciclopedia namespaces numbers (#2558) [00:16:10] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3 [00:16:12] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [00:21:48] has anyone tried caddy webserver? [00:22:00] seems nice [00:22:08] wrong channel [00:22:09] lol [02:07:34] cya soon [08:32:05] Has there been any consideration to including a GoogleDocs/sheets embedding plug in, or is there some alternative already available installed? [08:32:54] I see one on Mediawiki's extension list, but don't seem to see anything of the same effect when scrolling through the ones installed to miraheze [09:18:17] of your possible interest: https://meta.miraheze.org/wiki/Community_noticeboard#Tie [09:18:18] Title: [ Community noticeboard - Miraheze Meta ] - meta.miraheze.org [10:32:13] revi: yeah, I was thinking about that too [10:33:37] @Kat: You can make a request on Phabricator [10:33:45] and if it passes review we can get that extension for you on your wiki [12:51:51] Hello Reception123 [12:52:26] hi unmannedkite [12:52:32] Need anything? :) [12:52:45] Yes :) [12:52:52] Is it possible to private message you? [12:52:57] unmannedkite: of course, feel free [12:53:10] hmmm [12:53:22] It seems that only registered users can do this. [12:53:39] on IRC? [12:53:46] yes [12:53:58] I am a registered user in miraheze, of course :) [12:54:04] you can email me if you don't want to make an account on IRC [12:55:17] I have a few questions before I fill form #14 in phabricator (to ask for a custom domain). [12:55:39] if they aren't private you can always ask here too [12:55:52] I'm wondering if it's possible to email you the details or ask for it here, because I understand that everything I write in the phabricator is public. [13:00:44] unmannedkite: Yes, Phabricator is public usually (thought there can be private tasks) [13:00:54] unmannedkite: feel free to email me at reception123[at]miraheze[dot]org [13:01:09] thanks [13:01:23] (I'm working on registering my nick in the meanwhile) [13:01:31] ok :) [14:51:16] PROBLEM - aman.info.tm - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'aman.info.tm' expires in 15 day(s) (Tue 04 Dec 2018 02:48:13 PM GMT +0000). [14:51:36] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpcz2 [14:51:38] [02miraheze/ssl] 07MirahezeSSLBot 0379bb0ba - Bot: Update SSL cert for aman.info.tm [14:52:42] PROBLEM - nenawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nenawiki.org' expires in 15 day(s) (Tue 04 Dec 2018 02:49:21 PM GMT +0000). [14:52:53] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpczo [14:52:55] [02miraheze/ssl] 07MirahezeSSLBot 03176f10b - Bot: Update SSL cert for nenawiki.org [14:53:02] PROBLEM - pwiki.arkcls.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pwiki.arkcls.com' expires in 15 day(s) (Tue 04 Dec 2018 02:50:47 PM GMT +0000). [14:53:16] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpczK [14:53:17] [02miraheze/ssl] 07MirahezeSSLBot 0337f809c - Bot: Update SSL cert for pwiki.arkcls.com [14:53:24] PROBLEM - wiki.lbcomms.co.za - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.lbcomms.co.za' expires in 15 day(s) (Tue 04 Dec 2018 02:51:00 PM GMT +0000). [14:53:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpcz6 [14:53:36] [02miraheze/ssl] 07MirahezeSSLBot 03c6d9fa0 - Bot: Update SSL cert for wiki.lbcomms.co.za [14:54:08] PROBLEM - wiki.kourouklides.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.kourouklides.com' expires in 15 day(s) (Tue 04 Dec 2018 02:51:38 PM GMT +0000). [14:54:19] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpczP [14:54:20] [02miraheze/ssl] 07MirahezeSSLBot 031df69be - Bot: Update SSL cert for wiki.kourouklides.com [14:55:36] PROBLEM - wiki.ldmsys.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ldmsys.net' expires in 15 day(s) (Tue 04 Dec 2018 02:52:45 PM GMT +0000). [14:55:47] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpczy [14:55:48] [02miraheze/ssl] 07MirahezeSSLBot 03a4dff6e - Bot: Update SSL cert for wiki.ldmsys.net [14:56:44] PROBLEM - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.worlduniversityandschool.org' expires in 15 day(s) (Tue 04 Dec 2018 02:53:14 PM GMT +0000). [14:56:55] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpczS [14:56:56] [02miraheze/ssl] 07MirahezeSSLBot 037434a1b - Bot: Update SSL cert for wiki.worlduniversityandschool.org [14:57:40] PROBLEM - wikipuk.cl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikipuk.cl' expires in 15 day(s) (Tue 04 Dec 2018 02:53:58 PM GMT +0000). [14:57:50] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpczd [14:57:51] [02miraheze/ssl] 07MirahezeSSLBot 035f2d3dd - Bot: Update SSL cert for wikipuk.cl [15:01:02] RECOVERY - pwiki.arkcls.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwiki.arkcls.com' will expire on Sat 16 Feb 2019 01:53:10 PM GMT +0000. [15:01:16] RECOVERY - aman.info.tm - LetsEncrypt on sslhost is OK: OK - Certificate 'aman.info.tm' will expire on Sat 16 Feb 2019 01:51:30 PM GMT +0000. [15:01:24] RECOVERY - wiki.lbcomms.co.za - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.lbcomms.co.za' will expire on Sat 16 Feb 2019 01:53:29 PM GMT +0000. [15:01:36] RECOVERY - wiki.ldmsys.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ldmsys.net' will expire on Sat 16 Feb 2019 01:55:40 PM GMT +0000. [15:01:40] RECOVERY - wikipuk.cl - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipuk.cl' will expire on Sat 16 Feb 2019 01:57:45 PM GMT +0000. [15:02:08] RECOVERY - wiki.kourouklides.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.kourouklides.com' will expire on Sat 16 Feb 2019 01:54:13 PM GMT +0000. [15:02:42] RECOVERY - nenawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nenawiki.org' will expire on Sat 16 Feb 2019 01:52:47 PM GMT +0000. [15:02:44] RECOVERY - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worlduniversityandschool.org' will expire on Sat 16 Feb 2019 01:56:49 PM GMT +0000. [15:28:40] PROBLEM - www.dariawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.dariawiki.org' expires in 15 day(s) (Tue 04 Dec 2018 03:26:23 PM GMT +0000). [15:28:51] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpc2a [15:28:53] [02miraheze/ssl] 07MirahezeSSLBot 03589779e - Bot: Update SSL cert for www.dariawiki.org [15:29:26] PROBLEM - www.zenbuddhism.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.zenbuddhism.info' expires in 15 day(s) (Tue 04 Dec 2018 03:25:38 PM GMT +0000). [15:29:38] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpc2w [15:29:40] [02miraheze/ssl] 07MirahezeSSLBot 03a492ce8 - Bot: Update SSL cert for www.zenbuddhism.info [15:30:08] PROBLEM - wiki.valentinaproject.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.valentinaproject.org' expires in 15 day(s) (Tue 04 Dec 2018 03:27:45 PM GMT +0000). [15:30:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpc2r [15:30:26] [02miraheze/ssl] 07MirahezeSSLBot 03a7613b9 - Bot: Update SSL cert for wiki.valentinaproject.org [15:32:40] RECOVERY - www.dariawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.dariawiki.org' will expire on Sat 16 Feb 2019 02:28:45 PM GMT +0000. [15:41:27] RECOVERY - www.zenbuddhism.info - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zenbuddhism.info' will expire on Sat 16 Feb 2019 02:29:33 PM GMT +0000. [15:42:09] RECOVERY - wiki.valentinaproject.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.valentinaproject.org' will expire on Sat 16 Feb 2019 02:30:19 PM GMT +0000. [16:46:50] [02miraheze/landing] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpcwW [16:46:52] [02miraheze/landing] 07MacFan4000 038dc46b5 - Add Favicon and apple touch icon [17:46:30] Hello Guest89473! If you have any questions feel free to ask and someone should answer soon. [19:44:10] Hello [19:51:26] ping Reception123 [19:55:24] Wiki-1776: Wiki1776 hi [20:36:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/fpc1c [20:37:00] [02miraheze/puppet] 07paladox 034ecb53e - Stop forwarding mail to paladox (rather create a account) [20:37:02] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbiAS [20:37:03] [02puppet] 07paladox opened pull request 03#894: Stop forwarding mail to paladox (rather create a account) - 13https://git.io/fpc1C [22:33:35] PROBLEM - db4 Current Load on db4 is CRITICAL: CRITICAL - load average: 21.65, 11.37, 5.96 [22:33:43] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [22:33:55] PROBLEM - db4 SSH on db4 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:34:05] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [22:34:35] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb, 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [22:34:49] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb [22:35:37] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [22:35:49] RECOVERY - db4 SSH on db4 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u4 (protocol 2.0) [22:36:05] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy [22:36:33] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [22:36:51] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [22:37:25] PROBLEM - db4 Current Load on db4 is WARNING: WARNING - load average: 4.00, 7.65, 5.68 [22:39:19] RECOVERY - db4 Current Load on db4 is OK: OK - load average: 3.81, 6.38, 5.45 [23:03:17] Hello Voidwalker__! If you have any questions feel free to ask and someone should answer soon. [23:14:31] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb, 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [23:14:35] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 107.191.126.23/cpweb, 2604:180:0:33b::2/cpweb, 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb, 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [23:15:08] PROBLEM - db4 Current Load on db4 is CRITICAL: CRITICAL - load average: 8.31, 6.19, 4.84 [23:16:06] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 3 backends are down. mw1 mw2 mw3 [23:16:50] PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw1 [23:17:08] PROBLEM - db4 Current Load on db4 is WARNING: WARNING - load average: 7.21, 6.44, 5.10 [23:17:20] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 2 backends are down. mw2 mw3 [23:19:08] RECOVERY - db4 Current Load on db4 is OK: OK - load average: 5.96, 6.32, 5.23 [23:19:35] that's... not... ok [23:20:32] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [23:20:38] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [23:20:50] RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy [23:20:57] Voidwalker indeed [23:21:07] some how db4 had a spike in cpu and load. [23:21:13] i/o wait was 200+ [23:21:20] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy [23:22:04] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy [23:25:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fpcQo [23:25:12] [02miraheze/services] 07MirahezeSSLBot 03fb40f26 - BOT: Updating services config for wikis [23:50:17] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=americangirldollswiki --report=1 --files americangirlwikiacom-20181102-history.xml on mw1 [23:50:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master