[00:17:59] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 577 [00:31:53] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [02:47:58] Hello antus! If you have any questions feel free to ask and someone should answer soon. [02:53:34] PROBLEM - bacula1 Current Load on bacula1 is CRITICAL: CRITICAL - load average: 2.51, 1.59, 0.80 [02:55:35] RECOVERY - bacula1 Current Load on bacula1 is OK: OK - load average: 1.56, 1.54, 0.89 [03:24:25] PROBLEM - db4 Disk Space on db4 is CRITICAL: DISK CRITICAL - free space: / 40296 MB (10% inode=95%); [03:54:29] RECOVERY - bacula1 Disk Space on bacula1 is OK: DISK OK - free space: / 101946 MB (21% inode=99%); [04:02:29] PROBLEM - bacula1 Disk Space on bacula1 is WARNING: DISK WARNING - free space: / 98857 MB (20% inode=99%); [06:52:29] RECOVERY - bacula1 Disk Space on bacula1 is OK: DISK OK - free space: / 101818 MB (21% inode=99%); [07:06:29] PROBLEM - bacula1 Disk Space on bacula1 is WARNING: DISK WARNING - free space: / 99320 MB (20% inode=99%); [07:50:56] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is WARNING: WARNING - NGINX Error Rate is 41% [07:52:55] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 29% [08:20:44] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is WARNING: WARNING - NGINX Error Rate is 40% [08:22:43] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 32% [08:24:48] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[lizardfs-master] [08:32:47] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:14:29] RECOVERY - bacula1 Disk Space on bacula1 is OK: DISK OK - free space: / 101810 MB (21% inode=99%); [11:26:29] PROBLEM - bacula1 Disk Space on bacula1 is WARNING: DISK WARNING - free space: / 99496 MB (20% inode=99%); [11:30:32] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is WARNING: WARNING - NGINX Error Rate is 48% [11:34:30] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 28% [11:52:23] PROBLEM - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is WARNING: WARNING - NGINX Error Rate is 42% [11:54:22] RECOVERY - cp2 HTTP 4xx/5xx ERROR Rate on cp2 is OK: OK - NGINX Error Rate is 38% [14:55:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhS2a [14:55:11] [02miraheze/services] 07MirahezeSSLBot 03b2ae541 - BOT: Updating services config for wikis [15:17:08] [02MirahezeMagic] 07paladox commented on pull request 03#65: Update populateWikibaseSitesTable.php - 13https://git.io/fhS2d [15:17:13] [02MirahezeMagic] 07paladox closed pull request 03#65: Update populateWikibaseSitesTable.php - 13https://git.io/fhyim [15:17:14] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhS2F [15:17:16] [02miraheze/MirahezeMagic] 07paladox 03ac2cc89 - Update populateWikibaseSitesTable.php (#65) * Update populateWikibaseSitesTable.php * Update populateWikibaseSitesTable.php * Update populateWikibaseSitesTable.php * Update populateWikibaseSitesTable.php [15:17:17] [02MirahezeMagic] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/fQRGX [15:17:19] [02miraheze/MirahezeMagic] 07paladox deleted branch 03paladox-patch-2 [15:18:05] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fhS2b [15:18:06] [02miraheze/mediawiki] 07paladox 039ffc08e - Update MM [15:28:30] RECOVERY - bacula1 Disk Space on bacula1 is OK: DISK OK - free space: / 101489 MB (21% inode=99%); [15:36:29] PROBLEM - bacula1 Disk Space on bacula1 is WARNING: DISK WARNING - free space: / 99627 MB (20% inode=99%); [16:21:03] Hello Marshallazora! If you have any questions feel free to ask and someone should answer soon. [16:25:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhSaQ [16:25:11] [02miraheze/services] 07MirahezeSSLBot 036cbbbcc - BOT: Updating services config for wikis [18:01:43] * Wiki1776 saluda al canal [19:46:29] PROBLEM - bacula1 Disk Space on bacula1 is CRITICAL: DISK CRITICAL - free space: / 52302 MB (10% inode=99%); [22:41:50] [02miraheze/RottenLinks] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±6] 13https://git.io/fhSXH [22:41:51] [02miraheze/RottenLinks] 07JohnFLewis 033368d14 - push 1.0.5 [22:57:56] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [22:58:13] Looking for help using iFrame widget. Driving me nutty. [23:00:08] do you think you could put all the details you have on a task in phabricator.miraheze.org? [23:18:13] Yes. will do. [23:33:45] [02miraheze/RottenLinks] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±6] 13https://git.io/fhS13 [23:33:47] [02miraheze/RottenLinks] 07JohnFLewis 03250e1bc - push 1.0.5 [23:36:25] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fhS1n [23:36:26] [02miraheze/mediawiki] 07JohnFLewis 035c09ea4 - update RottenLinks [23:48:45] [02miraheze/mw-config] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhS18 [23:48:47] [02miraheze/mw-config] 07JohnFLewis 03424ff1f - enable CW's Echo notifs [23:50:20] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fhS14 [23:50:21] [02miraheze/CreateWiki] 07JohnFLewis 0375d467c - disable conditional for notifs, both are controlled [23:50:54] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fhS1B [23:50:56] [02miraheze/mediawiki] 07JohnFLewis 03a5d0429 - update CW [23:53:15] miraheze/CreateWiki/master/75d467c - John Lewis The build was broken. https://travis-ci.com/miraheze/CreateWiki/builds/99569669 [23:54:46] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhS1u [23:54:47] [02miraheze/CreateWiki] 07JohnFLewis 0360a49f7 - finish brace rm [23:55:20] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fhS1g [23:55:22] [02miraheze/mediawiki] 07JohnFLewis 03d69d368 - update CW [23:56:09] miraheze/CreateWiki/master/60a49f7 - John Lewis The build was fixed. https://travis-ci.com/miraheze/CreateWiki/builds/99569808