[00:02:56] <icinga-miraheze>	 PROBLEM - Puppet on misc3 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:02:58] <icinga-miraheze>	 PROBLEM - Puppet on db4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:00] <icinga-miraheze>	 PROBLEM - Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:18] <AmandaCatherine>	 Whoa ^
[00:03:44] <icinga-miraheze>	 PROBLEM - Puppet on lizardfs2 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:46] <icinga-miraheze>	 PROBLEM - Puppet on test1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:03:56] <icinga-miraheze>	 PROBLEM - Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:04:14] <icinga-miraheze>	 PROBLEM - Puppet on mw1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:04:40] <AmandaCatherine>	 Uhh.. has icinga-miraheze gone crazy?
[00:05:55] <paladox>	 nope
[00:06:50] <Wiki-1776>	 hi
[00:07:29] <AmandaCatherine>	 Well, we have a lot of critical issues
[00:08:24] <paladox>	 yep
[00:08:27] <paladox>	 it's puppet1
[00:08:28] <paladox>	 gc
[00:08:36] <paladox>	 garbadge collection
[00:10:55] <icinga-miraheze>	 RECOVERY - Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures  
[00:11:45] <icinga-miraheze>	 RECOVERY - Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures  
[00:11:55] <icinga-miraheze>	 RECOVERY - Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:12:55] <icinga-miraheze>	 RECOVERY - Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:12:57] <icinga-miraheze>	 RECOVERY - Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:13:34] <AmandaCatherine>	 Well, that’s better
[00:13:55] <icinga-miraheze>	 RECOVERY - Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:14:15] <icinga-miraheze>	 RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:14:55] <icinga-miraheze>	 RECOVERY - Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:17:45] <icinga-miraheze>	 RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[00:25:51] <AmandaCatherine>	 Ok, I’m being told to shelter in place (severe thunderstorms)
[00:26:07] <AmandaCatherine>	 I won’t be around over the weekend very much
[00:26:26] <AmandaCatherine>	 So, for the most part, see everyone on Monday
[00:27:33] <AmandaCatherine>	 !night
[00:27:34] <wm-bot5>	 Good night, sweet dreams and dream of the miraheze servers without errors!
[00:27:51] <AmandaCatherine>	 How about we add “and dream that the storms don’t cause damage” onto that
[00:48:19] <ZppixBot>	 Hello Vithit! If you have any questions feel free to ask and someone should answer soon.
[00:50:01] <Vithit>	 Hi.
[01:19:45] <Not-683e>	 [02mw-config] 07Wiki1776 opened pull request 03#2313: enable namespaces on centralwiki, destinoswiki, ucroniawiki, mexicopediawiki, apunteswiki, repositoriowiki per T3417 - 13https://git.io/fNge4
[01:21:43] <Not-683e>	 [02mw-config] 07paladox closed pull request 03#2313: enable namespaces on centralwiki, destinoswiki, ucroniawiki, mexicopediawiki, apunteswiki, repositoriowiki per T3417 - 13https://git.io/fNge4
[01:21:45] <Not-683e>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgeu
[01:21:46] <Not-683e>	 [02miraheze/mw-config] 07Wiki1776 035bd6737 - enable namespaces per T3417 (#2313)
[01:41:03] <Wiki-1776>	 paladox: 
[01:41:51] <paladox>	 hi?
[01:45:56] <Not-683e>	 [02services] 07Wiki1776 opened pull request 03#150: add centralwiki, destinoswiki, ucroniawiki, mexicopediawiki, apuntesw… - 13https://git.io/fNgvT
[01:45:57] <Not-683e>	 [02mw-config] 07Wiki1776 opened pull request 03#2314: other configurations on centralwiki, destinoswiki, ucroniawiki, mexic… - 13https://git.io/fNgvk
[01:46:00] <Wiki-1776>	 Do you have time to enable visual editor in centralwiki, destinoswiki, ucroniawiki, mexicopediawiki, apunteswiki, repositoriowiki?
[01:46:30] <Wiki-1776>	 I'd like to have it enabled right now.
[01:46:31] <Not-683e>	 [02services] 07paladox closed pull request 03#150: add centralwiki, destinoswiki, ucroniawiki, mexicopediawiki, apuntesw… - 13https://git.io/fNgvT
[01:46:32] <Not-683e>	 [02miraheze/services] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgvt
[01:46:34] <Not-683e>	 [02miraheze/services] 07Wiki1776 037f1acd9 - add centralwiki, destinoswiki, ucroniawiki, mexicopediawiki, apunteswiki, repositoriowiki on services (#150)
[01:46:34] <paladox>	 yep
[01:47:28] <Wiki-1776>	 (to check if there are any mistakes or if something is missing)
[01:48:45] <paladox>	 done
[01:49:06] <Wiki-1776>	 thanks, thanks, paladox 
[01:49:13] <paladox>	 your welcome :)
[01:49:38] * Wiki-1776 He gives her cookies and soda paladox
[01:49:45] <paladox>	 :)
[02:27:58] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+14/-4/±194] 13https://git.io/fNgfO
[02:27:59] <Not-683e>	 [02miraheze/puppet] 07paladox 0318cab16 - Update icinga2 module
[02:30:52] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-1/±0] 13https://git.io/fNgfG
[02:30:53] <Not-683e>	 [02miraheze/puppet] 07paladox 0384e4094 - Delete test.txt
[02:47:05] <Wiki-1776>	 https://meta.miraheze.org/w/index.php?title=User_talk:Wiki1776&diff=prev&oldid=56077 bug in CWNotify? xd 
[02:47:06] <ZppixBot>	 Title: [ Difference between revisions of "User talk:Wiki1776" - Miraheze Meta ] - meta.miraheze.org
[02:47:59] <Voidwalker>	 I thought that was impossible :/
[03:05:06] <PuppyKun>	 Voids script borked.
[03:20:31] <Voidwalker>	 meh, I'll take a closer look at it tomorrow
[03:55:45] <icinga-miraheze>	 PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5728  
[04:27:27] <Wiki-1776>	 hello
[04:28:24] <revi>	 probably of your interest: https://atlas.ripe.net/measurements/15418556/#!probes
[04:28:25] <ZppixBot>	 Title: [ Ping measurement to reviwiki.info - RIPE Atlas — RIPE Network Coordination Centre ] - atlas.ripe.net
[06:16:04] <Not-683e>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgk5
[06:16:05] <Not-683e>	 [02miraheze/mw-config] 07Reception123 0367cc47d - rm sitenotice up for a day, can be removed now
[06:22:31] <Reception123>	 revi: oh, I've always been looking for a site like that to measure ping from different countries. Thanks! :)
[06:55:25] <revi>	 running test there requires some sort of running HW for tests (so you are running tests for others) or donate IIRC
[06:55:38] <revi>	 I just run hardware for test
[07:37:09] <Reception123>	 oh I see
[07:42:58] <Reception123>	 !log reception@mw1:/srv/mediawiki/w/maintenance$ sudo -u www-data php dumpBackup.php --wiki allthetropeswiki --full > /home/reception/allthetropeswiki27072018.xml
[07:43:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[08:11:45] <Not-683e>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgtq
[08:11:47] <Not-683e>	 [02miraheze/mw-config] 07Reception123 03e38c509 - rm globalblock-exempt from weatherwiki Has not been discussed, globalblock exempt is granted via IPBE, not by assigning userrights on wikis.
[08:36:29] <Not-683e>	 [02mw-config] 07Reception123 closed pull request 03#2314: other configurations on centralwiki, destinoswiki, ucroniawiki, mexic… - 13https://git.io/fNgvk
[08:36:31] <Not-683e>	 [02miraheze/mw-config] 07Reception123 pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/fNgt9
[08:36:32] <Not-683e>	 [02miraheze/mw-config] 07Wiki1776 03d673297 - other configurations on centralwiki, destinoswiki, ucroniawiki, mexicopediawiki, apunteswiki, repositoriowiki
[08:36:34] <Not-683e>	 [02miraheze/mw-config] 07Reception123 0375cc66e - Merge pull request #2314 from Wiki1776/patch-81 other configurations on centralwiki, destinoswiki, ucroniawiki, mexic…
[08:46:15] <Not-683e>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgtx
[08:46:16] <Not-683e>	 [02miraheze/mw-config] 07Reception123 03954fe88 - AddThis to wfload
[09:34:05] <icinga-miraheze>	 PROBLEM - Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 2 minutes ago with 5 failures. Failed resources (up to 3 shown): Exec[ufw-allow-tcp-from-any-to-any-port-80],Exec[ufw-allow-tcp-from-any-to-any-port-443],Exec[ufw-allow-tcp-from-185.52.1.75-to-any-port-81],Exec[ufw-allow-tcp-from-185.52.2.113-to-any-port-81]  
[11:20:32] <Reception123>	 !log > DELETE FROM cw_wikis WHERE wiki_dbname = 'unidoswiki'; and > DELETE FROM cw_wikis WHERE wiki_dbname = 'tallerwiki'; T3409 T3410
[11:20:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[11:23:37] <Reception123>	 !log /srv/mediawiki/w/extensions/CreateWiki/maintenance/removeDeletedWikis.php --wiki testwiki on mw1
[11:23:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[11:24:42] <Not-683e>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg3x
[11:24:43] <Not-683e>	 [02miraheze/mw-config] 07Reception123 038b0d126 - correctly terminate comment
[12:51:45] <icinga-miraheze>	 RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[13:14:55] <icinga-miraheze>	 PROBLEM - Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]  
[13:16:15] <icinga-miraheze>	 PROBLEM - Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]  
[13:17:45] <icinga-miraheze>	 PROBLEM - Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]  
[13:52:55] <icinga-miraheze>	 RECOVERY - Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures  
[13:54:16] <icinga-miraheze>	 RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[13:54:56] <icinga-miraheze>	 RECOVERY - Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[13:55:46] <icinga-miraheze>	 RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures  
[15:07:37] <Not-683e>	 [02mw-config] 07Wiki1776 opened pull request 03#2315: add NS_FILE  of repositoriowiki on $wgContentNamespaces - 13https://git.io/fNgl3
[15:12:59] <Not-683e>	 [02mw-config] 07paladox closed pull request 03#2315: add NS_FILE  of repositoriowiki on $wgContentNamespaces - 13https://git.io/fNgl3
[15:13:00] <Not-683e>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNglb
[15:13:02] <Not-683e>	 [02miraheze/mw-config] 07Wiki1776 0314d80ee - NS_FILE of repositoriowiki add $wgContentNamespaces (#2315)
[16:06:57] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgBl
[16:06:58] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox 03e9a7261 - Add addTracker to MatomoAnalyticsHooks Fixes T3420
[16:08:19] <Not-683e>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fNgBE
[16:08:21] <Not-683e>	 [02miraheze/mediawiki] 07paladox 038ecf02b - Update MatomoAnalytics
[16:13:43] <Reception123>	 revi: hi, do you know how we could prevent https://phabricator.miraheze.org/T3420?
[16:13:44] <ZppixBot>	 Title: [ ⚓ T3420 Add aggregated website ID for Matomo/Piwik ] - phabricator.miraheze.org
[16:13:57] <Reception123>	 Herald adds "Import" because I wrote "important" in the task
[16:16:18] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgRv
[16:16:19] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox 03176ce32 - Update MatomoAnalyticsHooks.php
[16:17:31] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgRJ
[16:17:32] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox 0325b5067 - Update MatomoAnalyticsHooks.php
[16:18:01] <Not-683e>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fNgRU
[16:18:02] <Not-683e>	 [02miraheze/mediawiki] 07paladox 038838078 - Update MatomoAnalytics
[16:35:05] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg0U
[16:35:07] <Not-683e>	 [02miraheze/puppet] 07paladox 03d4e44dc - Update icinga2.pp
[16:35:44] <Not-683e>	 [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://git.io/vbiAS
[16:35:46] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/fNg0T
[16:35:48] <Not-683e>	 [02miraheze/puppet] 07paladox 0380cd8cc - Add icinga2 to test1
[16:35:48] <Not-683e>	 [02puppet] 07paladox opened pull request 03#784: Add icinga2 to test1 - 13https://git.io/fNg0k
[16:37:09] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/fNg0L
[16:37:10] <Not-683e>	 [02miraheze/puppet] 07paladox 03572e3cc - Update test1.yaml
[16:37:12] <Not-683e>	 [02puppet] 07paladox synchronize pull request 03#784: Add icinga2 to test1 - 13https://git.io/fNg0k
[16:38:07] <Not-683e>	 [02puppet] 07paladox closed pull request 03#784: Add icinga2 to test1 - 13https://git.io/fNg0k
[16:38:09] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fNg03
[16:38:10] <Not-683e>	 [02miraheze/puppet] 07paladox 03229975d - Add icinga2 to test1 (#784) * Add icinga2 to test1 * Update test1.yaml
[16:38:12] <Not-683e>	 [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://git.io/vbiAS
[16:38:13] <Not-683e>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4
[16:39:12] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg0Z
[16:39:14] <Not-683e>	 [02miraheze/puppet] 07paladox 030ebb398 - Update test1.yaml
[16:41:46] <icinga-miraheze>	 PROBLEM - Puppet on test1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[16:42:10] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg0a
[16:42:11] <Not-683e>	 [02miraheze/puppet] 07paladox 036a47340 - icinga2: fix config
[16:42:42] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg0w
[16:42:43] <Not-683e>	 [02miraheze/puppet] 07paladox 036440cb3 - icinga2: fix config part 2
[16:51:45] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fNg0j
[16:51:46] <Not-683e>	 [02miraheze/puppet] 07paladox 037988530 - icinga2: fix config part 3
[16:53:10] <Not-683e>	 [02MatomoAnalytics] 07paladox created branch 03paladox-patch-1 - 13https://git.io/fN4LT
[16:53:12] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNgEf
[16:53:13] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox 03192c7b0 - Update MatomoAnalyticsHooks.php
[16:53:15] <Not-683e>	 [02MatomoAnalytics] 07paladox opened pull request 03#4: Update MatomoAnalyticsHooks.php - 13https://git.io/fNgEJ
[16:53:33] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNgET
[16:53:35] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox 03beb7836 - Update extension.json
[16:53:36] <Not-683e>	 [02MatomoAnalytics] 07paladox synchronize pull request 03#4: Update MatomoAnalyticsHooks.php - 13https://git.io/fNgEJ
[16:54:56] <travis-ci>	 miraheze/MatomoAnalytics/paladox-patch-1/beb7836 - paladox The build passed. https://travis-ci.org/miraheze/MatomoAnalytics/builds/409328081
[16:58:55] <Not-683e>	 [02MatomoAnalytics] 07paladox synchronize pull request 03#4: Update MatomoAnalyticsHooks.php - 13https://git.io/fNgEJ
[16:58:57] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNgEO
[16:58:58] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox 0349a26b5 - Update MatomoAnalyticsHooks.php
[16:59:18] <Not-683e>	 [02MatomoAnalytics] 07paladox synchronize pull request 03#4: Update MatomoAnalyticsHooks.php - 13https://git.io/fNgEJ
[16:59:19] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNgEG
[16:59:21] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox 0363c9f4b - Update extension.json
[17:02:09] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fNgE4
[17:02:11] <Not-683e>	 [02miraheze/puppet] 07paladox 03a224df2 - icinga2: fix config
[17:04:11] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgEr
[17:04:12] <Not-683e>	 [02miraheze/puppet] 07paladox 0336e6a90 - Remove swift password
[17:04:26] <Not-683e>	 [02MatomoAnalytics] 07paladox closed pull request 03#4: Update MatomoAnalyticsHooks.php - 13https://git.io/fNgEJ
[17:04:27] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fNgE6
[17:04:29] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox 03d6b178d - Update MatomoAnalyticsHooks.php (#4) * Update MatomoAnalyticsHooks.php * Update extension.json * Update MatomoAnalyticsHooks.php * Update extension.json
[17:04:50] <Not-683e>	 [02MatomoAnalytics] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/fN4LT
[17:04:52] <Not-683e>	 [02miraheze/MatomoAnalytics] 07paladox deleted branch 03paladox-patch-1
[17:05:52] <Not-683e>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgEM
[17:05:53] <Not-683e>	 [02miraheze/mw-config] 07paladox 0324bd752 - Set wgMatomoAnalyticsGlobalID to default to 1
[17:06:01] <Not-683e>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_31 [+0/-0/±1] 13https://git.io/fNgEy
[17:06:02] <Not-683e>	 [02miraheze/mediawiki] 07paladox 0379af3a8 - Update MatomoAnalytics
[17:06:41] <Not-683e>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[17:06:42] <Not-683e>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/fNgEH
[17:06:44] <Not-683e>	 [02miraheze/mw-config] 07paladox 03eae44df - Remove FileBackend.php
[17:06:45] <Not-683e>	 [02mw-config] 07paladox opened pull request 03#2316: Remove FileBackend.php - 13https://git.io/fNgEQ
[17:07:00] <Not-683e>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/fNgE5
[17:07:02] <Not-683e>	 [02miraheze/mw-config] 07paladox 034a8d58f - Delete FileBackend.php
[17:07:03] <Not-683e>	 [02mw-config] 07paladox synchronize pull request 03#2316: Remove FileBackend.php - 13https://git.io/fNgEQ
[17:07:08] <Not-683e>	 [02mw-config] 07paladox closed pull request 03#2316: Remove FileBackend.php - 13https://git.io/fNgEQ
[17:07:09] <Not-683e>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/fNgEd
[17:07:11] <Not-683e>	 [02miraheze/mw-config] 07paladox 03b1ec5a3 - Remove FileBackend.php (#2316) * Remove FileBackend.php * Delete FileBackend.php
[17:07:13] <Not-683e>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[17:07:15] <Not-683e>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[17:08:28] <travis-ci>	 miraheze/mw-config/paladox-patch-1/4a8d58f - paladox The build was broken. https://travis-ci.org/miraheze/mw-config/builds/409330903
[17:17:05] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/fNguT
[17:17:06] <Not-683e>	 [02miraheze/puppet] 07paladox 0316a87a1 - Fix config
[17:17:08] <Not-683e>	 [02miraheze/puppet] 07paladox 036d921e9 - Merge branch 'master' of github.com:miraheze/puppet
[17:21:04] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgut
[17:21:05] <Not-683e>	 [02miraheze/puppet] 07paladox 034bde850 - Update init.pp
[17:22:17] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgum
[17:22:18] <Not-683e>	 [02miraheze/puppet] 07paladox 03999ac9e - Update php7_2.pp
[17:46:33] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgu9
[17:46:34] <Not-683e>	 [02miraheze/puppet] 07paladox 033e6f6de - Fix config
[17:55:08] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgux
[17:55:09] <Not-683e>	 [02miraheze/puppet] 07paladox 030a788f4 - Fix icinga2 class
[17:57:05] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgzU
[17:57:06] <Not-683e>	 [02miraheze/puppet] 07paladox 03ea61564 - Update icinga2.pp
[17:58:40] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgzI
[17:58:41] <Not-683e>	 [02miraheze/puppet] 07paladox 03b14a66c - Update mediawiki.pp
[18:03:59] <Wiki-1776>	 Reception123: estás?
[18:13:14] <icinga-miraheze>	 PROBLEM - Check correctness of the icinga configuration on misc1 is CRITICAL: Icinga configuration contains errors  
[18:15:40] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fNgzV
[18:15:41] <Not-683e>	 [02miraheze/puppet] 07paladox 03869fb3e - Install package icinga2-ido-mysql
[18:15:58] <paladox>	 uh
[18:16:57] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgzo
[18:16:59] <Not-683e>	 [02miraheze/puppet] 07paladox 03368d9ff - fix
[18:17:38] <paladox>	 !log reboot cp2 to regain ram
[18:17:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[18:19:45] <icinga-miraheze>	 RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[18:21:34] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgzH
[18:21:35] <Not-683e>	 [02miraheze/puppet] 07paladox 036d7ac1a - Update test1.yaml
[18:27:43] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNggJ
[18:27:44] <Not-683e>	 [02miraheze/puppet] 07paladox 031b8c61a - Update hostgroups.cfg
[18:29:33] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNggq
[18:29:35] <Not-683e>	 [02miraheze/puppet] 07paladox 039e7906c - Update hostgroups.cfg
[18:30:23] <SPF|Cloud>	 paladox: can't you depool cp2 and restart varnish instead?
[18:30:35] <SPF|Cloud>	 Or was there something else using so much ram?
[18:30:43] <paladox>	 SPF|Cloud oh, right. Sorry. Though it is happening daily it seems now
[18:30:44] <paladox>	 like cp4
[18:30:58] <paladox>	 *like cp4 did
[18:32:11] <icinga-miraheze>	 RECOVERY - Check correctness of the icinga configuration on misc1 is OK: Icinga configuration is correct  
[18:32:19] <paladox>	 um did mw3 go down?
[18:32:45] <paladox>	 recovered
[18:32:53] <Reception123>	 paladox: down? I pinged it and it's fine
[18:33:06] <paladox>	 Reception123 it was depooled from cp2 and cp5
[18:33:10] <paladox>	 but has recovered now.
[18:33:12] <Reception123>	 oh
[18:35:39] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNggc
[18:35:40] <Not-683e>	 [02miraheze/puppet] 07paladox 031e9bf33 - Update web.pp
[18:39:03] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNggz
[18:39:05] <Not-683e>	 [02miraheze/puppet] 07paladox 03b019089 - Update icinga2.conf
[18:45:59] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNggH
[18:46:00] <Not-683e>	 [02miraheze/puppet] 07paladox 03d3da4d9 - Make SPF a admin
[19:00:16] <icinga2-miraheze>	 hi
[19:00:34] <icinga2-miraheze>	 PROBLEM - test1 HTTP on test1 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 319 bytes in 0.003 second response time   
[19:01:05] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg2G
[19:01:06] <Not-683e>	 [02miraheze/puppet] 07paladox 0340446b8 - Update irc.py
[19:02:48] <icinga2-miraheze>	 PROBLEM - test1 HTTP on test1 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 319 bytes in 0.003 second response time   
[19:03:30] <icinga2-miraheze>	 CUSTOM - test1 HTTP on test1 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 319 bytes in 0.003 second response time  paladox test
[19:03:34] <icinga2-miraheze>	 PROBLEM - test1 HTTP on test1 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 319 bytes in 0.003 second response time   
[19:03:37] <paladox>	 works
[19:03:55] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg2W
[19:03:57] <Not-683e>	 [02miraheze/puppet] 07paladox 0385841aa - Update irc-host-notification.sh
[19:04:04] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg2l
[19:04:06] <Not-683e>	 [02miraheze/puppet] 07paladox 036e23971 - Update irc-service-notification.sh
[19:04:44] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg2B
[19:04:45] <Not-683e>	 [02miraheze/puppet] 07paladox 0365069a3 - Update site.pp
[19:05:06] <icinga2-miraheze>	 CUSTOM - test1 HTTP on test1 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 319 bytes in 0.003 second response time  paladox test
[19:05:52] <icinga2-miraheze>	 PROBLEM - test1 HTTP on test1 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 319 bytes in 0.001 second response time   
[19:22:49] <icinga2-miraheze>	 PROBLEM - db4 MySQL on db4 is CRITICAL: Access denied for user 'icinga'@'185.52.2.243' (using password: NO)  
[19:22:53] <icinga2-miraheze>	 PROBLEM - bacula1 Bacula Lizardfs1 Lizardfs Chunkserver1 on bacula1 is CRITICAL: NRPE: Command 'check_bacula_lizardfs_lizardfs_chunkserver1' not defined  
[19:22:55] <icinga2-miraheze>	 PROBLEM - bacula1 Bacula Static Lizardfs2 on bacula1 is CRITICAL: CRITICAL: no terminated jobs  
[19:22:57] <icinga2-miraheze>	 PROBLEM - ping4 on cp5 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 268.21 ms  
[19:23:05] <icinga2-miraheze>	 PROBLEM - misc1 Auth DNS on misc1 is CRITICAL: DNS CRITICAL - expected '-s' but got '81.4.109.133'  
[19:23:07] <icinga2-miraheze>	 PROBLEM - misc3 Mathoid on misc3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[19:23:10] <paladox>	 uh
[19:23:15] <icinga2-miraheze>	 PROBLEM - misc3 Electron on misc3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[19:23:31] <icinga2-miraheze>	 PROBLEM - ns1 Auth DNS on ns1 is CRITICAL: DNS CRITICAL - expected '-s' but got '81.4.109.133'  
[19:26:11] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg2S
[19:26:13] <Not-683e>	 [02miraheze/puppet] 07paladox 03ae089cc - Update director.pp
[19:33:46] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg2A
[19:33:47] <Not-683e>	 [02miraheze/puppet] 07paladox 03b0c7d0f - Fix dns command check
[19:35:21] <icinga2-miraheze>	 PROBLEM - test1 Puppet on test1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 4 minutes ago with 0 failures  
[19:35:23] <icinga2-miraheze>	 RECOVERY - bacula1 Bacula Lizardfs1 Lizardfs Chunkserver1 on bacula1 is OK: OK: Incr, 1 files, 78.78KB, 2018-07-22 01:02:00 (6.8 days ago)  
[19:35:55] <icinga2-miraheze>	 RECOVERY - misc1 Auth DNS on misc1 is OK: DNS OK: 0.024 seconds response time. miraheze.org returns 81.4.109.133  
[19:36:21] <icinga2-miraheze>	 RECOVERY - ns1 Auth DNS on ns1 is OK: DNS OK: 0.217 seconds response time. miraheze.org returns 81.4.109.133  
[19:36:27] <icinga2-miraheze>	 RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures  
[19:36:33] <paladox>	 woo
[20:24:42] <icinga2-miraheze>	 PROBLEM - db4 Disk Space on db4 is WARNING: DISK WARNING - free space: / 76918 MB (20% inode=94%);  
[20:24:50] <icinga-miraheze>	 PROBLEM - Disk Space on db4 is WARNING: DISK WARNING - free space: / 76918 MB (20% inode=94%):  
[20:44:10] <paladox>	 !log PURGE BINARY LOGS BEFORE '2018-07-28 21:43'; on db4
[20:44:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[20:44:43] <icinga2-miraheze>	 RECOVERY - db4 Disk Space on db4 is OK: DISK OK - free space: / 101395 MB (27% inode=94%);  
[20:44:51] <icinga-miraheze>	 RECOVERY - Disk Space on db4 is OK: DISK OK - free space: / 101395 MB (27% inode=94%):  
[20:47:05] <icinga2-miraheze>	 PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.45 ms  
[20:47:11] <icinga2-miraheze>	 PROBLEM - ping4 on cp2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 122.76 ms  
[20:48:40] <paladox>	 uh
[20:49:05] <icinga2-miraheze>	 RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 98.43 ms  
[20:49:09] <icinga2-miraheze>	 PROBLEM - ping4 on bacula1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 93.21 ms  
[20:49:11] <icinga2-miraheze>	 RECOVERY - ping4 on cp2 is OK: PING OK - Packet loss = 0%, RTA = 98.26 ms  
[20:51:13] <icinga2-miraheze>	 RECOVERY - ping4 on bacula1 is OK: PING OK - Packet loss = 0%, RTA = 93.12 ms  
[20:54:07] <icinga2-miraheze>	 PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.89, 1.88, 0.97  
[20:56:03] <icinga2-miraheze>	 RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.54, 1.38, 0.89  
[21:00:27] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+1/-0/±0] 13https://git.io/fNgw5
[21:00:28] <Not-683e>	 [02miraheze/puppet] 07paladox 03f62cdd6 - Add check_icinga_config for icinga2
[21:00:30] <Not-683e>	 [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://git.io/vbiAS
[21:00:31] <Not-683e>	 [02puppet] 07paladox opened pull request 03#785: Add check_icinga_config for icinga2 - 13https://git.io/fNgwd
[21:01:55] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/fNgwA
[21:01:56] <Not-683e>	 [02miraheze/puppet] 07paladox 035bc9954 - Update server.pp
[21:01:58] <Not-683e>	 [02puppet] 07paladox synchronize pull request 03#785: Add check_icinga_config for icinga2 - 13https://git.io/fNgwd
[21:02:12] <Not-683e>	 [02puppet] 07paladox closed pull request 03#785: Add check_icinga_config for icinga2 - 13https://git.io/fNgwd
[21:02:14] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/fNgwx
[21:02:15] <Not-683e>	 [02miraheze/puppet] 07paladox 037083f72 - Add check_icinga_config for icinga2 (#785) * Add check_icinga_config for icinga2 * Update server.pp
[21:06:55] <Not-683e>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4
[21:06:56] <Not-683e>	 [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://git.io/vbiAS
[21:07:04] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNgrq
[21:07:06] <Not-683e>	 [02miraheze/puppet] 07paladox 039938dcf - Update check_icinga_config
[21:16:15] <paladox>	 um
[21:16:21] <paladox>	 meta is down.
[22:00:13] <icinga-miraheze>	 PROBLEM - Varnish Backends on cp5 is CRITICAL: 1 backends are down.  mw2  
[22:00:35] <icinga-miraheze>	 PROBLEM - www.radviser.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:01:08] <icinga2-miraheze>	 RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[22:02:32] <icinga2-miraheze>	 PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 2 backends are down.  mw1 mw2  
[22:06:11] <icinga2-miraheze>	 PROBLEM - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:06:21] <icinga2-miraheze>	 PROBLEM - lodge.jsnydr.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:07:47] <icinga2-miraheze>	 PROBLEM - espiral.org - Gandi on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:09:16] <icinga-miraheze>	 PROBLEM - Disk Space on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.  
[22:09:40] <icinga-miraheze>	 PROBLEM - orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:09:51] <icinga2-miraheze>	 RECOVERY - lodge.jsnydr.com - LetsEncrypt on sslhost is OK: OK - Certificate 'lodge.jsnydr.com' will expire on Fri 31 Aug 2018 10:07:43 PM GMT +0000.  
[22:09:56] <icinga-miraheze>	 RECOVERY - Disk Space on bacula1 is OK: DISK OK - free space: / 204873 MB (42% inode=99%):  
[22:10:01] <icinga2-miraheze>	 RECOVERY - cp5 Varnish Backends on cp5 is OK: All 3 backends are healthy  
[22:10:29] <icinga2-miraheze>	 RECOVERY - espiral.org - Gandi on sslhost is OK: OK - Certificate 'espiral.org' will expire on Fri 23 Aug 2019 11:59:59 PM GMT +0000.  
[22:11:26] <icinga-miraheze>	 RECOVERY - bebaskanpengetahuan.org - LetsEncrypt on sslhost is OK: OK - Certificate bebaskanpengetahuan.org will expire on Sat 20 Oct 2018 01:05:40 PM GMT +0000.  
[22:11:28] <icinga-miraheze>	 RECOVERY - orain.org - LetsEncrypt on sslhost is OK: OK - Certificate orain.org will expire on Sun 19 Aug 2018 02:42:04 PM GMT +0000.  
[22:17:00] <icinga-miraheze>	 PROBLEM - Disk Space on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.  
[22:17:53] <icinga2-miraheze>	 PROBLEM - www.radviser.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:18:35] <icinga2-miraheze>	 PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 2 backends are down.  mw1 mw2  
[22:21:52] <icinga2-miraheze>	 RECOVERY - www.radviser.org - LetsEncrypt on sslhost is OK: OK - Certificate 'radviser.org' will expire on Fri 12 Oct 2018 12:11:50 PM GMT +0000.  
[22:22:36] <icinga2-miraheze>	 RECOVERY - cp5 Varnish Backends on cp5 is OK: All 3 backends are healthy  
[22:28:27] <icinga-miraheze>	 PROBLEM - wiki.taotac.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:30:27] <icinga-miraheze>	 PROBLEM - saf.songcontests.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:30:47] <icinga2-miraheze>	 RECOVERY - cp5 Varnish Backends on cp5 is OK: All 3 backends are healthy  
[22:31:06] <icinga-miraheze>	 PROBLEM - wiki.consentcraft.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:31:13] <icinga-miraheze>	 RECOVERY - wiki.taotac.org - LetsEncrypt on sslhost is OK: OK - Certificate wiki.taotac.org will expire on Tue 02 Oct 2018 08:33:57 AM GMT +0000.  
[22:31:37] <icinga-miraheze>	 RECOVERY - saf.songcontests.eu - LetsEncrypt on sslhost is OK: OK - Certificate saf.songcontests.eu will expire on Tue 11 Sep 2018 04:06:47 AM GMT +0000.  
[22:32:55] <icinga2-miraheze>	 HTTP CRITICAL - Unable to open TCP socket  
[22:33:13] <icinga-miraheze>	 PROBLEM - Bacula - Private Git on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.  
[22:34:54] <icinga-miraheze>	 RECOVERY - Bacula - Private Git on bacula1 is OK: OK: Full, 1387 files, 1.492MB, 2018-07-22 00:05:00 (6.9 days ago)  
[22:35:57] <icinga2-miraheze>	 PROBLEM - test1 HTTP on test1 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 319 bytes in 0.002 second response time   
[22:36:18] <icinga-miraheze>	 RECOVERY - wiki.consentcraft.uk - LetsEncrypt on sslhost is OK: OK - Certificate wiki.consentcraft.uk will expire on Thu 25 Oct 2018 01:36:36 PM GMT +0000.  
[22:36:59] <icinga2-miraheze>	 PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]  
[22:37:07] <icinga2-miraheze>	 CUSTOM - cp5 Varnish Backends on cp5 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. paladox test
[22:37:27] <paladox>	 \o/
[22:38:53] <icinga2-miraheze>	 PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 1 backends are down.  mw1  
[22:52:57] <icinga-miraheze>	 PROBLEM - wiki.dobots.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds  
[22:53:10] <icinga-miraheze>	 RECOVERY - saf.songcontests.eu - LetsEncrypt on sslhost is OK: OK - Certificate saf.songcontests.eu will expire on Tue 11 Sep 2018 04:06:47 AM GMT +0000.  
[22:53:12] <icinga-miraheze>	 PROBLEM - Varnish Backends on cp5 is CRITICAL: 2 backends are down.  mw1 mw2  
[22:53:18] <icinga-miraheze>	 RECOVERY - wiki.taotac.org - LetsEncrypt on sslhost is OK: OK - Certificate wiki.taotac.org will expire on Tue 02 Oct 2018 08:33:57 AM GMT +0000.  
[22:53:30] <icinga-miraheze>	 RECOVERY - miraheze.com - LetsEncrypt on sslhost is OK: OK - Certificate miraheze.com will expire on Fri 31 Aug 2018 04:53:48 PM GMT +0000.  
[22:53:34] <icinga-miraheze>	 RECOVERY - wiki.dobots.nl - LetsEncrypt on sslhost is OK: OK - Certificate wiki.dobots.nl will expire on Thu 11 Oct 2018 06:56:30 PM GMT +0000.  
[22:55:20] <icinga-miraheze>	 RECOVERY - Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures  
[23:00:22] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg6p
[23:00:24] <Not-683e>	 [02miraheze/puppet] 07paladox 030ad5b1c - Update groups.conf
[23:01:01] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNg6j
[23:01:02] <Not-683e>	 [02miraheze/puppet] 07paladox 03de8ae41 - Update users.conf
[23:03:33] <icinga2-miraheze>	 adox test
[23:04:07] <icinga2-miraheze>	 RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[23:05:01] <icinga-miraheze>	 RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[23:10:46] <icinga2-miraheze>	 CUSTOM - bacula1 Bacula Phabricator Static on bacula1 is CRITICAL: CRITICAL: no terminated jobs paladox test
[23:10:50] <icinga2-miraheze>	 PROBLEM - bacula1 Bacula Phabricator Static on bacula1 is CRITICAL: CRITICAL: no terminated jobs  
[23:11:14] <icinga2-miraheze>	 CUSTOM - bacula1 Bacula Phabricator Static on bacula1 is CRITICAL: CRITICAL: no terminated jobs paladox test
[23:11:20] <icinga2-miraheze>	 PROBLEM - bacula1 Bacula Phabricator Static on bacula1 is CRITICAL: CRITICAL: no terminated jobs