[00:01:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03new-cert [+5/-3/±11] 13https://git.io/fhxoR [00:01:04] [02miraheze/puppet] 07paladox 033808b0b - Redesgn the certificate infrastructure What this upgrade includes: * New name * Updated a script to use python * Updated the code format of python to look more professional. * Remove nagiosre as no longer needed. * Being able to scale by using mw*. [00:03:58] [02miraheze/puppet] 07paladox pushed 031 commit to 03new-cert [+5/-3/±11] 13https://git.io/fhxoz [00:04:00] [02miraheze/puppet] 07paladox 0311bdc46 - Redesgn the certificate infrastructure What this upgrade includes: * New name * Updated a script to use python * Updated the code format of python to look more professional. * Remove nagiosre as no longer needed. * Being able to scale by using mw*. [00:10:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhxow [00:10:04] [02miraheze/ssl] 07root 03c5fcf28 - Bot: Update SSL cert for www.wikimicrofinanza.it [00:12:21] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 7 minutes ago with 0 failures [00:12:41] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhxor [00:12:43] [02miraheze/ssl] 07root 03deee509 - Bot: Update SSL cert for www.wikimicrofinanza.it [00:12:47] \o/ [00:13:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03new-cert [+5/-3/±11] 13https://git.io/fhxoK [00:13:38] [02miraheze/puppet] 07paladox 03760786d - Redesgn the certificate infrastructure What this upgrade includes: * New name * Updated a script to use python * Updated the code format of python to look more professional. * Remove nagiosre as no longer needed. * Being able to scale by using mw*. [00:14:20] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:15:03] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [00:20:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03new-cert [+5/-3/±11] 13https://git.io/fhxo1 [00:20:28] [02miraheze/puppet] 07paladox 03aac0072 - Redesgn the certificate infrastructure What this upgrade includes: * New name * Updated a script to use python * Updated the code format of python to look more professional. * Remove nagiosre as no longer needed. * Being able to scale by using mw*. [00:22:34] PROBLEM - wiki.hackdown.me - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [00:29:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03new-cert [+5/-3/±11] 13https://git.io/fhxoA [00:29:23] [02miraheze/puppet] 07paladox 0329ba00e - Redesgn the certificate infrastructure What this upgrade includes: * New name * Updated a script to use python * Updated the code format of python to look more professional. * Remove nagiosre as no longer needed. * Being able to scale by using mw*. [00:30:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03new-cert [+5/-3/±11] 13https://git.io/fhxop [00:30:51] [02miraheze/puppet] 07paladox 03419c255 - Redesgn the certificate infrastructure What this upgrade includes: * New name * Updated a script to use python * Updated the code format of python to look more professional. * Remove nagiosre as no longer needed. * Being able to scale by using mw*. [00:32:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03new-cert [+5/-3/±11] 13https://git.io/fhxKf [00:32:39] [02miraheze/puppet] 07paladox 0355ce908 - Redesgn the certificate infrastructure What this upgrade includes: * New name * Updated a script to use python * Updated the code format of python to look more professional. * Remove nagiosre as no longer needed. * Being able to scale by using mw*. [00:33:42] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhxKT [00:33:44] [02miraheze/ssl] 07MirahezeSSLBot 03315129c - Bot: Update SSL cert for www.wikimicrofinanza.it [00:33:50] there we go [00:35:22] PROBLEM - bacula1 Disk Space on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:35:25] !log re enable puppet on all hosts [00:35:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:35:38] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:35:40] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:35:50] RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:52] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:36:02] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:36:07] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:36:10] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:36:12] RECOVERY - lizardfs1 Puppet on lizardfs1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:36:37] PROBLEM - bacula1 Bacula Private Git on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:37:00] RECOVERY - lizardfs2 Puppet on lizardfs2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:37:09] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:37:09] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:37:13] PROBLEM - db4 Disk Space on db4 is WARNING: DISK WARNING - free space: / 44227 MB (12% inode=96%); [00:37:17] PROBLEM - bacula1 Disk Space on bacula1 is WARNING: DISK WARNING - free space: / 86888 MB (18% inode=99%); [00:37:35] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures [00:38:04] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures [00:38:33] PROBLEM - bacula1 Bacula Private Git on bacula1 is WARNING: WARNING: Full, 2896 files, 4.422MB, 2019-02-24 03:58:00 (1.3 weeks ago) [00:40:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03new-cert [+5/-3/±11] 13https://git.io/fhxKY [00:40:53] [02miraheze/puppet] 07paladox 03d1d2362 - Redesgn the certificate infrastructure What this upgrade includes: * New name * Updated a script to use python * Updated the code format of python to look more professional. * Remove nagiosre as no longer needed. * Being able to scale by using mw*. [00:51:29] RECOVERY - mw3 Ssl Renewal Service on mw3 is OK: TCP OK - 0.001 second response time on 81.4.121.113 port 5000 [00:51:44] RECOVERY - mw2 Ssl Renewal Service on mw2 is OK: TCP OK - 0.000 second response time on 185.52.2.113 port 5000 [01:10:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+5/-3/±11] 13https://git.io/fhxK1 [01:11:22] [02puppet] 07paladox deleted branch 03icinga2-upgrade - 13https://git.io/vbiAS [01:11:24] [02miraheze/puppet] 07paladox deleted branch 03icinga2-upgrade [01:11:25] [02puppet] 07paladox deleted branch 03new-cert - 13https://git.io/vbiAS [01:11:27] [02miraheze/puppet] 07paladox deleted branch 03new-cert [01:33:57] RECOVERY - wiki.hackdown.me - LetsEncrypt on sslhost is OK: OK - Certificate '*.hackdown.me' will expire on Wed 08 May 2019 12:20:01 AM GMT +0000. [02:17:25] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:19:23] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 07 May 2019 10:15:37 PM GMT +0000. [02:31:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhx6K [02:31:21] [02miraheze/puppet] 07paladox 0372456d7 - Update default.vcl [03:24:09] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 820 [03:39:15] PROBLEM - wiki.hackdown.me - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.hackdown.me and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [03:46:09] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [04:31:40] RECOVERY - wiki.hackdown.me - LetsEncrypt on sslhost is OK: OK - Certificate '*.hackdown.org' will expire on Mon 03 Jun 2019 01:54:06 AM GMT +0000. [04:53:56] PROBLEM - wiki.hackdown.me - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:55:55] RECOVERY - wiki.hackdown.me - LetsEncrypt on sslhost is OK: OK - Certificate '*.hackdown.org' will expire on Mon 03 Jun 2019 01:54:06 AM GMT +0000. [12:18:09] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±6] 13https://git.io/fhxH0 [12:18:11] [02miraheze/ManageWiki] 07JohnFLewis 03bbb9f73 - remove global object variables [14:55:13] PROBLEM - db4 Disk Space on db4 is CRITICAL: DISK CRITICAL - free space: / 40296 MB (10% inode=96%); [14:57:44] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 953 [15:29:00] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [15:29:25] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [15:29:34] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 172.104.111.8/cpweb, 2400:8902::f03c:91ff:fe07:444e/cpweb [15:31:25] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy [15:31:34] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [16:12:51] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 434 [16:18:42] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [16:56:49] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:58:52] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 07 May 2019 10:15:37 PM GMT +0000. [17:09:13] * Hispano76 saluda [17:11:31] hi [17:16:57] Voidwalker hi :) [17:17:20] :) [17:45:31] hmm opinions on https://meta.miraheze.org/wiki/Special:RequestWikiQueue/7480 [17:45:32] Title: [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org [17:54:03] Voidwalker: My name is it in it :P [17:54:09] Though I don't know, seems kind of vague to me [18:49:01] [02mw-config] 07The-Voidwalker opened pull request 03#2643: configure wgRCLinkDays for T4144 - 13https://git.io/fhxpG [18:50:35] [02mw-config] 07JohnFLewis commented on pull request 03#2643: configure wgRCLinkDays for T4144 - 13https://git.io/fhxpc [19:51:29] Hi! Here is the list of currently open high priority tasks on Phabricator [19:51:36] No updates for 11 days - https://phabricator.miraheze.org/T4128 - Fix SSH not working after reboot for various servers - authored by Southparkfan, assigned to None [19:51:43] No updates for 3 days - https://phabricator.miraheze.org/T4024 - Install elasticsearch - authored by Southparkfan, assigned to Southparkfan [20:11:22] PROBLEM - mw1 Ssl Renewal Service on mw1 is CRITICAL: connect to address 185.52.1.75 and port 5000: Connection refused [20:11:39] [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+3/-5/±12] 13https://git.io/fhxjT [20:11:40] PROBLEM - mw1 Puppet on mw1 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 9 minutes ago with 0 failures [20:11:41] [02miraheze/puppet] 07paladox 03c2f18ca - Revert "Update default.vcl" This reverts commit 72456d7e56cd23d4d004fb4203953139cd1a4149. [20:11:42] [02miraheze/puppet] 07paladox 0349b67fa - Revert "Redesgn the certificate infrastructure" This reverts commit d1d2362a631c9365060e4704781c09cd927a522d. [20:13:06] PROBLEM - mw2 Ssl Renewal Service on mw2 is CRITICAL: connect to address 185.52.2.113 and port 5000: Connection refused [20:13:29] PROBLEM - mw2 Puppet on mw2 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 1 minute ago with 0 failures [20:13:45] PROBLEM - mw3 Puppet on mw3 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 1 minute ago with 0 failures [20:14:08] PROBLEM - mw3 Ssl Renewal Service on mw3 is CRITICAL: connect to address 81.4.121.113 and port 5000: Connection refused [20:15:04] That should ideally not be saying “reason not specified” [20:15:40] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [20:17:22] RECOVERY - mw1 Ssl Renewal Service on mw1 is OK: TCP OK - 0.001 second response time on 185.52.1.75 port 5000 [20:17:29] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [20:17:45] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [20:27:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhxjE [20:27:44] [02miraheze/puppet] 07paladox 035193731 - Add --no-use-key option to ssl-certificate [20:31:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhxja [20:31:22] [02miraheze/puppet] 07paladox 03002fa3a - Update ssl-certificate.py [20:34:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhxjr [20:34:09] [02miraheze/puppet] 07paladox 0346da766 - Update ssl-certificate.py [20:47:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhxjH [20:47:16] [02miraheze/puppet] 07paladox 03e45193c - Update ssl-certificate.py [20:52:01] Hello CreativeC! If you have any questions feel free to ask and someone should answer soon. [20:56:52] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpeU [20:56:53] [02miraheze/ssl] 07paladox 038c62c99 - Update antiguabarbudacalypso.com.crt [21:15:28] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpeP [21:15:30] [02miraheze/ssl] 07paladox 03540f366 - Update spiral.wiki.crt [21:19:29] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpeM [21:19:30] [02miraheze/ssl] 07paladox 03538b13f - Update permanentfuturelab.wiki.crt [21:24:40] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpe7 [21:24:41] [02miraheze/ssl] 07paladox 039aa9674 - Update publictestwiki.com.crt [21:24:55] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:25:08] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:25:19] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:25:21] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:25:36] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [21:28:26] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpve [21:28:28] [02miraheze/ssl] 07paladox 03a06ef92 - Update wiki.valentinaproject.org.crt [21:31:42] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:32:49] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [21:33:17] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:33:18] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:33:20] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [21:33:49] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:37:49] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Mon 03 Jun 2019 08:18:41 PM GMT +0000. [21:42:10] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpvG [21:42:11] [02miraheze/ssl] 07paladox 03e41572d - Update wiki.dwplive.com.crt [21:44:29] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpvW [21:44:31] [02miraheze/ssl] 07paladox 03638007c - Update wiki.grottocenter.org.crt [21:51:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpvo [21:51:55] [02miraheze/puppet] 07paladox 03eb4f516 - Update ssl-certificate.py [21:55:42] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpv1 [21:55:44] [02miraheze/ssl] 07paladox 0360546f0 - Update wisdomwiki.org.crt [21:59:09] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpv7 [21:59:10] [02miraheze/ssl] 07paladox 0397a9220 - Update wiki.make717.org.crt [22:00:47] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpv5 [22:00:48] [02miraheze/ssl] 07paladox 0345f8a47 - Update thelonsdalebattalion.co.uk.crt [22:02:48] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpvb [22:02:50] [02miraheze/ssl] 07paladox 033d33de4 - Update allthetropes.org.crt [22:07:45] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpfJ [22:07:46] [02miraheze/ssl] 07MacFan4000 033930be8 - Update www.zenbuddhism.info.crt [22:14:53] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [22:14:54] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [22:15:06] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [22:15:19] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [22:15:21] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [22:15:33] uh [22:15:48] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [22:16:17] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [22:16:51] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures [22:19:47] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpfG [22:19:49] [02miraheze/ssl] 07MacFan4000 031a734a1 - Update www.splat-teams.com.crt [22:24:55] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [22:26:51] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [22:32:20] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [22:32:49] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [22:33:18] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:33:20] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures [22:33:27] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:34:18] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [23:20:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpJo [23:20:14] [02miraheze/services] 07MirahezeSSLBot 038379cc9 - BOT: Updating services config for wikis [23:28:15] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpJ9 [23:28:16] [02miraheze/dns] 07paladox 03476c5d1 - Update miraheze.org [23:32:51] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpJd [23:32:52] [02miraheze/ssl] 07paladox 031927368 - Update m.miraheze.org.crt [23:34:10] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpJN [23:34:12] [02miraheze/mw-config] 07paladox 03cce9310 - Update Sitenotice.php [23:36:16] PROBLEM - cp5 Puppet on cp5 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [23:37:16] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpJp [23:37:17] [02miraheze/mw-config] 07paladox 0319b171f - Update Sitenotice.php [23:39:12] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpJh [23:39:13] [02miraheze/mw-config] 07paladox 0301d9427 - Update Sitenotice.php [23:42:18] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [23:42:56] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [23:43:05] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [23:44:23] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpUv [23:44:24] [02miraheze/ssl] 07paladox 03a744aec - Update www.zenbuddhism.info.crt [23:44:54] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [23:45:19] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [23:45:21] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[nginx-syntax] [23:46:21] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [23:46:56] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:47:08] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:48:27] [02mw-config] 07The-Voidwalker opened pull request 03#2644: require captcha on wikiforum - 13https://git.io/fhpUk [23:50:57] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpUL [23:50:58] [02miraheze/ssl] 07paladox 0332d9162 - Update aman.info.tm.crt [23:51:02] [02mw-config] 07paladox closed pull request 03#2644: require captcha on wikiforum - 13https://git.io/fhpUk [23:51:03] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhpUt [23:51:05] [02miraheze/mw-config] 07The-Voidwalker 0382984e5 - require captcha on wikiforum (#2644) reduce spam in the forums [23:52:49] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [23:53:18] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:53:20] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [23:54:18] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures