[00:02:47] <cfd005>	 Doesn't work any more.
[00:03:23] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.67, 21.43, 14.51
[00:03:24] <cfd005>	 The reference tooltip doesn't work again.
[00:04:01] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.55, 25.59, 17.77
[00:05:22] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 11.13, 17.42, 13.87
[00:05:57] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.91, 22.78, 17.65
[00:07:56] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.79, 19.29, 17.00
[00:09:56] <paladox>	 cfd005 ok, re enable Popups extension in Special:ManageWiki/extensions
[00:10:02] <paladox>	 that should get the tooltip to work
[00:10:10] <paladox>	 but not exactly how you expected it to look
[00:11:12] <cfd005>	 ok. I see it.
[00:13:06] <cfd005>	 Is it possible for my wiki to use the Popups version exactly the same as en.wikipedia.org?
[00:16:33] <paladox>	 i guess so, but it doesn't seem to work when i tried (worked first time, then failed a bit afterwards). Worked when in the private tab
[00:18:16] <cfd005>	 I have seen a Page Preview option under Preference\Appearance. But I don't it any more.
[00:19:22] <cfd005>	 -> I don't see it any more.
[00:25:00] <icinga-miraheze>	 PROBLEM - wiki.autocountsoft.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.autocountsoft.com All nameservers failed to answer the query.
[00:25:11] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU5tc
[00:25:12] <Not>	 [02miraheze/services] 07MirahezeSSLBot 03ed2e15e - BOT: Updating services config for wikis
[00:31:07] <cfd005>	 paladox Now I can see the other version of Reference Tooltips work even I turned off the Citoid and VisualEditor extensions and turned off Reference Tooltips under Preference/Gadgets. So wired.
[00:31:53] <icinga-miraheze>	 RECOVERY - wiki.autocountsoft.com - reverse DNS on sslhost is OK: rDNS OK - wiki.autocountsoft.com reverse DNS resolves to cp7.miraheze.org
[00:32:57] <cfd005>	 -> So weired.
[00:34:32] <paladox>	 yeh
[00:40:11] <cfd005>	 I think the Reference Tooltips gadget under Preference/Gadgets is not actually working. If it can work, it should look the same as I can see on en.wikipedia.org
[01:22:00] <paladox>	 !log upgrade phabricator on phab1
[01:22:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:25:16] <icinga-miraheze>	 PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 177s
[01:27:16] <icinga-miraheze>	 RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 1s
[01:35:12] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU5Ou
[01:35:14] <Not>	 [02miraheze/services] 07MirahezeSSLBot 0351bb613 - BOT: Updating services config for wikis
[02:06:57] <cfd005>	 paladox Can you simply delete my wiki cfd.miraheze.org and reset it? I don't have any content in it yet. But I kept trying different settings and messed up. I hope I can start from scratch. 
[02:07:53] <paladox>	 It's really late here (3am), so i cannot reset it right now. Could you file a task on phabricator.miraheze.org please? Just so we don't forget to it.
[02:08:43] <cfd005>	 Thank you very much for you help. 
[02:09:40] <cfd005>	 I really need the en.wikipedia.org style reference tips.
[02:09:53] <cfd005>	 -> reference tooltips
[02:11:15] <cfd005>	 I am new to miraheze. I will give it a try on phabricator.miraheze.org Thanks again.
[05:19:34] <icinga-miraheze>	 PROBLEM - dreamsit.com.br - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dreamsit.com.br' expires in 15 day(s) (Tue 20 Oct 2020 05:17:32 GMT +0000).
[05:26:18] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU50h
[05:26:19] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 038d9ff08 - Bot: Update SSL cert for dreamsit.com.br
[05:33:00] <icinga-miraheze>	 RECOVERY - dreamsit.com.br - LetsEncrypt on sslhost is OK: OK - Certificate 'dreamsit.com.br' will expire on Sat 02 Jan 2021 04:26:10 GMT +0000.
[05:49:08] <icinga-miraheze>	 PROBLEM - commons.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - commons.gyaanipedia.co.in All nameservers failed to answer the query.
[05:56:03] <icinga-miraheze>	 RECOVERY - commons.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - commons.gyaanipedia.co.in reverse DNS resolves to cp7.miraheze.org
[06:09:15] <icinga-miraheze>	 PROBLEM - wiki.valentinaproject.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.valentinaproject.org' expires in 15 day(s) (Tue 20 Oct 2020 06:03:41 GMT +0000).
[06:09:30] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JU5g5
[06:09:32] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 03cc5c673 - Bot: Update SSL cert for wiki.valentinaproject.org
[06:22:40] <icinga-miraheze>	 RECOVERY - wiki.valentinaproject.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.valentinaproject.org' will expire on Sat 02 Jan 2021 05:09:23 GMT +0000.
[06:46:23] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.43, 20.51, 19.01
[06:48:19] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.05, 18.61, 18.48
[08:22:32] <icinga-miraheze>	 PROBLEM - gu.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - gu.gyaanipedia.co.in All nameservers failed to answer the query.
[08:24:06] <icinga-miraheze>	 PROBLEM - meta.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - meta.gyaanipedia.co.in All nameservers failed to answer the query.
[08:28:12] <icinga-miraheze>	 PROBLEM - fa.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - fa.gyaanipedia.co.in All nameservers failed to answer the query.
[08:33:55] <icinga-miraheze>	 PROBLEM - commons.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - commons.gyaanipedia.co.in All nameservers failed to answer the query.
[08:37:36] <icinga-miraheze>	 PROBLEM - ml.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - ml.gyaanipedia.co.in All nameservers failed to answer the query.
[08:37:48] <icinga-miraheze>	 RECOVERY - meta.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - meta.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[08:40:55] <icinga-miraheze>	 RECOVERY - commons.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - commons.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[08:43:29] <icinga-miraheze>	 RECOVERY - gu.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - gu.gyaanipedia.co.in reverse DNS resolves to cp7.miraheze.org
[08:48:25] <icinga-miraheze>	 PROBLEM - hi.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - hi.gyaanipedia.co.in All nameservers failed to answer the query.
[08:52:14] <icinga-miraheze>	 PROBLEM - hif.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - hif.gyaanipedia.co.in All nameservers failed to answer the query.
[08:55:17] <icinga-miraheze>	 RECOVERY - hi.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - hi.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[08:57:14] <icinga-miraheze>	 PROBLEM - mr.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mr.gyaanipedia.co.in All nameservers failed to answer the query.
[08:59:14] <icinga-miraheze>	 RECOVERY - hif.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - hif.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[09:09:24] <icinga-miraheze>	 PROBLEM - gu.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - gu.gyaanipedia.co.in All nameservers failed to answer the query.
[09:10:47] <icinga-miraheze>	 RECOVERY - mr.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - mr.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[09:12:07] <icinga-miraheze>	 RECOVERY - ml.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - ml.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[09:15:37] <icinga-miraheze>	 RECOVERY - fa.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - fa.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[09:16:25] <icinga-miraheze>	 RECOVERY - gu.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - gu.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[09:16:45] <icinga-miraheze>	 PROBLEM - en.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.gyaanipedia.co.in All nameservers failed to answer the query.
[09:22:21] <icinga-miraheze>	 PROBLEM - mg.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mg.gyaanipedia.co.in All nameservers failed to answer the query.
[09:29:11] <icinga-miraheze>	 RECOVERY - mg.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - mg.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[09:30:39] <icinga-miraheze>	 RECOVERY - en.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - en.gyaanipedia.co.in reverse DNS resolves to cp7.miraheze.org
[11:02:11] <Reception123>	 !log reception@jobrunner2:/srv/mediawiki/w/maintenance$ sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --report=1 --wiki tuscriaturaswiki /home/reception/Wikipedia-20201004104840.xml
[11:02:15] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:00:33] <MH-Discord>	 <Avengium (Ángel)> Hi. Can i request the flood user group for 1 hour? i want to translate more pages
[12:02:48] <avengium>	 Reception123 , text me when the user group is done, so i know i can start
[12:04:51] <MH-Discord>	 <Reception123> @Avengium (Ángel) done
[12:06:03] <avengium>	 thanks
[12:09:44] <Reception123>	 you're welcome :)
[12:55:42] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 48%
[12:56:01] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 48%
[12:57:39] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 33%
[13:02:16] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.83, 20.02, 16.07
[13:04:11] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.79, 19.05, 16.15
[13:11:39] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 41%
[13:21:41] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 30%
[13:25:40] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 47%
[13:27:39] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 38%
[13:31:41] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 43%
[13:39:40] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 27%
[13:45:40] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 47%
[13:49:39] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 39%
[13:54:23] <paladox>	 !log dropped cfdwiki and recreated
[13:54:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:55:40] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 43%
[14:00:51] <Not>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JUdkS
[14:00:52] <Not>	 [02miraheze/puppet] 07paladox 0335fbaeb - varnish: Ignore 429 in nginx error check
[14:00:54] <Not>	 [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS
[14:00:55] <Not>	 [02puppet] 07paladox opened pull request 03#1504: varnish: Ignore 429 in nginx error check - 13https://git.io/JUdk9
[14:01:39] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 36%
[14:05:04] <icinga-miraheze>	 PROBLEM - tep.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[14:07:39] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 45%
[14:11:39] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 39%
[14:11:56] <icinga-miraheze>	 RECOVERY - tep.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tep.wiki' will expire on Wed 25 Nov 2020 16:21:04 GMT +0000.
[14:15:39] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 40%
[14:17:39] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 31%
[14:29:25] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 53%
[14:31:23] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 13%
[14:55:11] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUdYW
[14:55:13] <Not>	 [02miraheze/services] 07MirahezeSSLBot 0334e733e - BOT: Updating services config for wikis
[15:15:39] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 48%
[15:17:39] <cfd005>	 paladox Thank you for reset my cfd.miraheze.org
[15:17:39] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 32%
[15:17:51] <cfd005>	 This is a brand new installation. I followed exactly the instructions as you described on Phabricator. But I still don't see the reference tooltips show up.
[15:29:40] <icinga-miraheze>	 PROBLEM - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is WARNING: WARNING - NGINX Error Rate is 44%
[15:31:40] <icinga-miraheze>	 RECOVERY - cp9 HTTP 4xx/5xx ERROR Rate on cp9 is OK: OK - NGINX Error Rate is 33%
[15:35:01] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.12, 20.35, 16.64
[15:36:57] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.12, 18.04, 16.25
[15:41:57] <Not>	 [02puppet] 07paladox closed pull request 03#1504: varnish: Ignore 429 in nginx error check - 13https://git.io/JUdk9
[15:41:59] <Not>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUdGF
[15:42:00] <Not>	 [02miraheze/puppet] 07paladox 035b804db - varnish: Ignore 429 in nginx error check (#1504)
[15:42:02] <Not>	 [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS
[15:42:03] <Not>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1
[15:53:00] <icinga-miraheze>	 RECOVERY - graylog1 Puppet on graylog1 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures
[17:36:02] <MH-Discord>	 <Avengium (Ángel)> I think I want to translate a little more. Could some admin give me the flooder group?
[17:36:40] <MH-Discord>	 <RhinosF1> One sec
[17:36:55] <MH-Discord>	 <Avengium (Ángel)> For 3 hours, just to be sure
[17:37:29] <MH-Discord>	 <Avengium (Ángel)> Maybe 1 hour only is a small amount
[17:37:54] <MH-Discord>	 <RhinosF1> Given for 3 hours
[17:37:59] <MH-Discord>	 <RhinosF1> Ping me when you're done
[17:38:04] <MH-Discord>	 <RhinosF1> (Or any admin)
[17:38:21] <MH-Discord>	 <Avengium (Ángel)> Why? To deactivate the group?
[17:38:40] <MH-Discord>	 <RhinosF1> Yes
[17:38:56] <MH-Discord>	 <RhinosF1> If it's more than like half an hour before it expires
[18:20:58] <SPF|Cloud>	 !log disable puppet on test2 for syslog-ng work
[18:21:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:21:31] <icinga-miraheze>	 PROBLEM - test2 MediaWiki Rendering on test2 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 423 bytes in 0.158 second response time
[18:22:20] <SPF|Cloud>	 paladox: ^ since you're logged in
[18:22:39] <paladox>	 ok
[18:22:44] <icinga-miraheze>	 PROBLEM - test2 Puppet on test2 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 5 minutes ago with 1 failures
[18:27:10] <SPF|Cloud>	 paladox: well, test2 just replaced syslog-ng with rsyslog again
[18:27:18] <paladox>	 oh
[18:27:18] <SPF|Cloud>	 that has happened a few times now
[18:27:29] <SPF|Cloud>	 any idea why puppet does that?
[18:27:32] <icinga-miraheze>	 RECOVERY - test2 MediaWiki Rendering on test2 is OK: HTTP OK: HTTP/1.1 200 OK - 17208 bytes in 0.961 second response time
[18:28:18] <paladox>	 nope.
[18:28:44] <Zppix>	 puppet doesnt like change
[18:28:45] <Zppix>	 xD
[18:29:19] <SPF|Cloud>	 https://github.com/miraheze/puppet/blob/master/modules/base/manifests/syslog.pp
[18:29:19] <MirahezeBot>	 [ puppet/syslog.pp at master · miraheze/puppet · GitHub ] - github.com
[18:30:07] <SPF|Cloud>	 since https://github.com/miraheze/puppet/blob/master/hieradata/hosts/test2.yaml#L14 is present, test2 should get syslog-ng, not rsyslog
[18:30:08] <MirahezeBot>	 [ puppet/test2.yaml at master · miraheze/puppet · GitHub ] - github.com
[18:31:52] <Zppix>	 SPF|Cloud:  could it be https://github.com/miraheze/puppet/blob/master/modules/base/manifests/syslog.pp#L3 
[18:31:52] <MirahezeBot>	 [ puppet/syslog.pp at master · miraheze/puppet · GitHub ] - github.com
[18:32:06] <SPF|Cloud>	 that's the default
[18:32:09] <paladox>	 No, since what SPF|Cloud set should be overriding that
[18:32:12] <Zppix>	 or maybe its because puppet2 is disabled?
[18:32:16] <SPF|Cloud>	 the file in hieradata takes precedence
[18:32:22] <icinga-miraheze>	 PROBLEM - cp9 Current Load on cp9 is WARNING: WARNING - load average: 1.98, 1.71, 0.99
[18:33:01] <SPF|Cloud>	 the issue is puppet installing rsyslog instead of syslog-ng, that doesn't happen when puppet is disabled, since puppet is not running in that case
[18:33:03] <icinga-miraheze>	 PROBLEM - zh.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - zh.gyaanipedia.co.in All nameservers failed to answer the query.
[18:33:07] <icinga-miraheze>	 PROBLEM - hi.gyaanipedia.co.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - hi.gyaanipedia.co.in All nameservers failed to answer the query.
[18:33:15] <Zppix>	 ill look into the rDNS
[18:33:38] <Zppix>	 LGTM, must just be a blip
[18:34:18] <Zppix>	 SPF|Cloud:  did we get our main ssl cert renewed?
[18:34:21] <icinga-miraheze>	 RECOVERY - cp9 Current Load on cp9 is OK: OK - load average: 0.83, 1.40, 0.96
[18:34:22] <SPF|Cloud>	 yes
[18:34:34] <SPF|Cloud>	 only the database servers need to be updated at some point
[18:35:15] <Zppix>	 That would be important
[18:36:44] <icinga-miraheze>	 RECOVERY - puppet2 Puppet on puppet2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[18:39:58] <icinga-miraheze>	 RECOVERY - zh.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - zh.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[18:39:58] <icinga-miraheze>	 RECOVERY - hi.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - hi.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[18:47:30] <Not>	 [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JUdVg
[18:47:31] <Not>	 [02miraheze/ssl] 07Pix1234 032e5e6ce - add wiki.wikipariksha.com per T6275
[18:58:55] <Not>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUdwG
[18:58:56] <Not>	 [02miraheze/puppet] 07Southparkfan 034a7e6be - base::syslog: do not use mutual authentication, only verify graylog's certificate
[19:17:04] <Not>	 [02dns] 07Pix1234 opened pull request 03#176: add DNS for T6275 - 13https://git.io/JUdrH
[19:20:16] <Not>	 [02dns] 07paladox closed pull request 03#176: add DNS for T6275 - 13https://git.io/JUdrH
[19:20:18] <Not>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JUdok
[19:20:19] <Not>	 [02miraheze/dns] 07Pix1234 039252ed3 - add DNS for T6275 (#176)
[19:23:06] <icinga-miraheze>	 RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[19:28:18] <Not>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUdoQ
[19:28:20] <Not>	 [02miraheze/puppet] 07Southparkfan 0313c0a1b - syslog-ng: add disk buffer If graylog is down for any reason, syslog-ng will queue up to 1G of logs to /var/tmp. When graylog comes back online, syslog-ng will automatically clear the queue.
[19:29:05] <icinga-miraheze>	 PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[19:31:05] <icinga-miraheze>	 PROBLEM - test2 Puppet on test2 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 5 minutes ago with 1 failures
[19:31:12] <Not>	 [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03master [+1/-1/±1] 13https://git.io/JUdop
[19:31:14] <Not>	 [02miraheze/ssl] 07Pix1234 03ad2ceb8 - switch wiki.wikipariksha.com with root domain per T6275
[19:33:20] <Not>	 [02dns] 07Pix1234 opened pull request 03#177: switch to root domain - 13https://git.io/JUdKI
[19:33:48] <Not>	 [02dns] 07paladox closed pull request 03#177: switch to root domain - 13https://git.io/JUdKI
[19:33:49] <Not>	 [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUdKm
[19:33:51] <Not>	 [02miraheze/dns] 07Pix1234 031f79aea - switch to root domain (#177)
[19:43:05] <icinga-miraheze>	 PROBLEM - wikipariksha.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wikipariksha.com reverse DNS resolves to 180.136.102.34.bc.googleusercontent.com
[19:43:21] <Not>	 [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUd6e
[19:43:22] <Not>	 [02miraheze/ssl] 07Pix1234 03d6ef18a - remove newline from EOF
[19:44:14] <Zppix>	 icinga-miraheze:  lies
[20:36:13] <MH-Discord>	 <RhinosF1> Did greylog just die @southparkfan
[20:36:23] <SPF|Cloud>	 works for me
[20:38:34] <MH-Discord>	 <RhinosF1> Fetching index sets list failed: cannot GET https://graylog.miraheze.org/api/system/indices/index_sets?stats=false (400)
[20:39:25] <SPF|Cloud>	 seems more like wrong permissions
[20:39:45] <SPF|Cloud>	 or the lack of actually, because the error seems to be correct
[20:40:18] <MH-Discord>	 <RhinosF1> Hmm
[20:41:06] <MH-Discord>	 <RhinosF1> was looking at the nginx error stream when it happened
[21:00:07] <SPF|Cloud>	 Rhinos: https://graylog.miraheze.org/streams/5f7a378746640840f1f0ef37/search?q=&rangetype=relative&streams=5f7a378746640840f1f0ef37&relative=300
[21:00:08] <MirahezeBot>	 [ Graylog Web Interface ] - graylog.miraheze.org
[21:03:16] <MH-Discord>	 <RhinosF1> Endless loading
[21:03:56] <MH-Discord>	 <RhinosF1> I'll try on my pc in the morning
[21:57:29] <icinga-miraheze>	 RECOVERY - wikipariksha.com - reverse DNS on sslhost is OK: rDNS OK - wikipariksha.com reverse DNS resolves to cp6.miraheze.org
[23:30:19] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JUdbT
[23:30:21] <Not>	 [02miraheze/services] 07MirahezeSSLBot 0320a7a47 - BOT: Updating services config for wikis