[00:03:03] <icinga-miraheze>	 PROBLEM - Puppet on bacula1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[00:11:04] <icinga-miraheze>	 RECOVERY - Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures  
[00:19:42] <icinga-miraheze>	 PROBLEM - Current Load on test1 is CRITICAL: CRITICAL - load average: 3.28, 1.52, 0.69  
[00:19:52] <icinga-miraheze>	 PROBLEM - Current Load on misc4 is CRITICAL: CRITICAL - load average: 5.23, 3.57, 2.01  
[00:20:01] <paladox>	 known
[00:21:53] <icinga-miraheze>	 RECOVERY - Current Load on misc4 is OK: OK - load average: 2.82, 3.26, 2.09  
[00:35:43] <icinga-miraheze>	 PROBLEM - Current Load on test1 is WARNING: WARNING - load average: 0.30, 1.63, 1.89  
[00:37:41] <icinga-miraheze>	 RECOVERY - Current Load on test1 is OK: OK - load average: 0.16, 1.13, 1.67  
[00:53:32] <icinga-miraheze>	 RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[01:43:31] <icinga-miraheze>	 PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 5611  
[02:54:52] <icinga-miraheze>	 PROBLEM - HTTP 4xx/5xx ERROR Rate on cp4 is WARNING: WARNING - NGINX Error Rate is 44%  
[02:55:22] <icinga-miraheze>	 PROBLEM - Varnish Backends on cp2 is CRITICAL: 1 backends are down.  mw1  
[02:55:32] <icinga-miraheze>	 PROBLEM - Varnish Backends on cp5 is CRITICAL: 1 backends are down.  mw1  
[02:55:42] <icinga-miraheze>	 PROBLEM - Varnish Backends on cp4 is CRITICAL: 1 backends are down.  mw1  
[02:56:52] <icinga-miraheze>	 RECOVERY - HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 9%  
[02:57:22] <icinga-miraheze>	 RECOVERY - Varnish Backends on cp2 is OK: All 3 backends are healthy  
[02:57:32] <icinga-miraheze>	 RECOVERY - Varnish Backends on cp5 is OK: All 3 backends are healthy  
[02:57:42] <icinga-miraheze>	 RECOVERY - Varnish Backends on cp4 is OK: All 3 backends are healthy  
[03:47:33] <icinga-miraheze>	 RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[14:19:06] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNstM
[14:19:08] <Not-683e>	 [02miraheze/puppet] 07paladox 039cfd45a - Update object-server.conf.erb
[14:19:29] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNsty
[14:19:30] <Not-683e>	 [02miraheze/puppet] 07paladox 03bc17a4d - Update container-server.conf.erb
[14:25:37] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNsqW
[14:25:38] <Not-683e>	 [02miraheze/puppet] 07paladox 03a86c875 - Update account-server.conf.erb
[14:26:22] <JohnLewis>	 half of puppet is just one line swift changes now I swear
[14:31:49] <paladox>	 JohnLewis yeh, i want to remove swift.
[15:13:32] <icinga-miraheze>	 PROBLEM - JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 2715  
[18:01:18] <Wiki-1776>	 Hello
[18:09:33] <icinga-miraheze>	 RECOVERY - JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs  
[21:14:34] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+11/-0/±3] 13https://git.io/fNsdK
[21:14:36] <Not-683e>	 [02miraheze/puppet] 07paladox 03af6aced - Initial import of lizardfs module Bug: T3361
[21:14:37] <Not-683e>	 [02miraheze/puppet] 07paladox 03c3a1d44 - Merge branch 'master' of github.com:miraheze/puppet
[21:18:04] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNsFJ
[21:18:05] <Not-683e>	 [02miraheze/puppet] 07paladox 0302ae7d3 - lizardfs: update ips in config.yaml
[21:18:46] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/fNsFq
[21:18:48] <Not-683e>	 [02miraheze/puppet] 07paladox 03575e449 - Revert "lizardfs: update ips in config.yaml" This reverts commit 02ae7d31cae6aac3f5f35d3845677555762267af.
[21:18:49] <Not-683e>	 [02miraheze/puppet] 07paladox 03db6d334 - lizardfs: update ips in config.yaml
[21:25:03] <paladox>	 JohnLewis ^^
[21:25:40] <JohnLewis>	 k
[22:10:02] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+2/-0/±3] 13https://git.io/fNspi
[22:10:04] <Not-683e>	 [02miraheze/puppet] 07paladox 03ea9aae3 - lizardfs: Add firewall rules and role::lizardfs
[22:10:14] <paladox>	 JohnLewis ^^!
[22:11:25] <JohnLewis>	 kk
[22:41:49] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fNGef
[22:41:51] <Not-683e>	 [02miraheze/puppet] 07paladox 03e64dbf3 - Add lizardfs master and web to misc4
[22:42:44] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNGet
[22:42:45] <Not-683e>	 [02miraheze/puppet] 07paladox 03abd19d2 - Update proxy-server.conf.erb
[22:44:38] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNGec
[22:44:39] <Not-683e>	 [02miraheze/puppet] 07paladox 03304f692 - lizardfs: Fix master.pp
[22:44:53] <icinga-miraheze>	 PROBLEM - Puppet on misc4 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[22:46:53] <icinga-miraheze>	 RECOVERY - Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[22:47:50] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fNGeK
[22:47:51] <Not-683e>	 [02miraheze/puppet] 07paladox 036390ab0 - Lizardfs: update exports
[22:56:16] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fNGvG
[22:56:17] <Not-683e>	 [02miraheze/puppet] 07paladox 03f890d9b - Lizardfs: Add storage to swift1 and swift2
[22:58:21] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNGvE
[22:58:22] <Not-683e>	 [02miraheze/puppet] 07paladox 0368cc831 - Fix syntax in site.pp
[23:07:17] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNGfG
[23:07:19] <Not-683e>	 [02miraheze/puppet] 07paladox 03ec97737 - mediawiki: add lizardfs::client to mount paths
[23:07:23] <paladox>	 JohnLewis ^^!
[23:08:30] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNGfl
[23:08:31] <Not-683e>	 [02miraheze/puppet] 07paladox 034727219 - lizardfs: fix file define name
[23:10:22] <icinga-miraheze>	 PROBLEM - Puppet on mw1 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues  
[23:15:13] <icinga-miraheze>	 PROBLEM - Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[/mnt/mediawiki-trash]  
[23:16:03] <icinga-miraheze>	 PROBLEM - Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[/mnt/mediawiki-trash]  
[23:16:38] <Not-683e>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fNGJt
[23:16:40] <Not-683e>	 [02miraheze/puppet] 07paladox 03f064f7c - Use root to create mounts
[23:20:21] <icinga-miraheze>	 RECOVERY - Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures  
[23:23:11] <icinga-miraheze>	 RECOVERY - Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures  
[23:24:01] <icinga-miraheze>	 RECOVERY - Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures  
[23:42:32] <icinga-miraheze>	 PROBLEM - Varnish Backends on cp5 is CRITICAL: 1 backends are down.  mw2  
[23:42:43] <icinga-miraheze>	 PROBLEM - Varnish Backends on cp4 is CRITICAL: 1 backends are down.  mw2  
[23:43:23] <icinga-miraheze>	 RECOVERY - Puppet on test1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures  
[23:44:33] <icinga-miraheze>	 RECOVERY - Varnish Backends on cp5 is OK: All 3 backends are healthy  
[23:44:43] <icinga-miraheze>	 RECOVERY - Varnish Backends on cp4 is OK: All 3 backends are healthy