[01:33:25] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:35:25] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 07 May 2019 10:15:37 PM GMT +0000. [01:43:56] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:45:55] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Wed 15 May 2019 09:02:45 PM GMT +0000. [04:12:51] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhFKk [04:12:53] [02miraheze/ssl] 07MacFan4000 03d86e8c7 - Syntax [04:15:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhFKI [04:15:12] [02miraheze/services] 07MirahezeSSLBot 037c6b0c4 - BOT: Updating services config for wikis [04:29:26] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [04:32:40] JohnLewis: mind checking mw1? [04:32:43] Please [04:34:12] looks fine [04:35:19] Thanks! [07:02:10] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:04:14] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Wed 15 May 2019 09:02:45 PM GMT +0000. [11:11:40] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:13:41] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 07 May 2019 10:15:37 PM GMT +0000. [12:40:40] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:42:43] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 07 May 2019 10:15:37 PM GMT +0000. [14:13:52] hi [14:14:45] Hispano76: Hello [14:15:03] :) [14:15:36] Hispano76: How are you? [14:16:42] I'm fine Zppix [14:16:53] good [14:17:49] hi Hispano76 and Zppix :) [14:19:24] Reception123: Your title should be Miraheze Receptionist [14:20:16] hi Hispano76 Zppix :) [14:20:27] Reception123 [14:21:55] Zppix: lol [14:22:07] Zppix: maybe it already is :P [14:25:20] Reception123: are you able to ssh into ZppixBot real quick? [14:25:27] nevermind [14:26:05] Reception123: and lol [14:28:14] Zppix: why nevermind? [14:28:40] Reception123: see the bot channel [14:29:34] Zppix: it's the same message? [14:29:57] Reception123: yeah i changed my mind [14:30:06] Reception123: i need you to restart ZppixBot pls [14:30:32] ok [17:05:46] [02RottenLinks] 07eduaddad opened pull request 03#15: Update pt-br.json - 13https://git.io/fhF5e [17:08:21] [02RottenLinks] 07paladox reviewed pull request 03#15 commit - 13https://git.io/fhF5T [17:08:36] [02RottenLinks] 07paladox synchronize pull request 03#15: Update pt-br.json - 13https://git.io/fhF5e [17:09:01] [02RottenLinks] 07paladox closed pull request 03#15: Update pt-br.json - 13https://git.io/fhF5e [17:09:03] [02miraheze/RottenLinks] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhF5k [17:09:04] [02miraheze/RottenLinks] 07eduaddad 03d7dea59 - Update pt-br.json (#15) * Update pt-br.json updated translation * Update pt-br.json [17:10:55] [02CustomHeader] 07eduaddad opened pull request 03#2: Create pt-br.json - 13https://git.io/fhF5q [17:12:13] [02CustomHeader] 07paladox closed pull request 03#2: Create pt-br.json - 13https://git.io/fhF5q [17:12:14] [02miraheze/CustomHeader] 07paladox pushed 032 commits to 03master [+2/-0/±0] 13https://git.io/fhF5Y [17:12:16] [02miraheze/CustomHeader] 07eduaddad 039eb7b40 - Create pt-br.json Brazilian Portuguese language [17:12:17] [02miraheze/CustomHeader] 07paladox 038032d55 - Merge pull request #2 from eduaddad/patch-1 Create pt-br.json [17:14:29] [02PDFEmbed] 07eduaddad opened pull request 03#1: Create pt-br.json - 13https://git.io/fhF5O [17:15:39] [02PDFEmbed] 07paladox closed pull request 03#1: Create pt-br.json - 13https://git.io/fhF5O [17:15:40] [02miraheze/PDFEmbed] 07paladox pushed 032 commits to 03master [+2/-0/±0] 13https://git.io/fhF53 [17:15:42] [02miraheze/PDFEmbed] 07eduaddad 03b42731c - Create pt-br.json Brazilian Portuguese language [17:15:43] [02miraheze/PDFEmbed] 07paladox 03a20e13f - Merge pull request #1 from eduaddad/patch-1 Create pt-br.json [21:31:55] !log install vpncloud package on test1 [21:31:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:42:45] !log enable TUN/TAP on test1, may require reboot [21:42:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:45:46] PROBLEM - test1 Current Load on test1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [21:45:54] PROBLEM - test1 SSH on test1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:46:06] PROBLEM - test1 Puppet on test1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [21:46:19] PROBLEM - test1 HTTPS on test1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:48:25] PROBLEM - test1 Disk Space on test1 is CRITICAL: connect to address 185.52.2.243 port 5666: Connection refusedconnect to host 185.52.2.243 port 5666: Connection refused [21:48:25] PROBLEM - test1 php-fpm on test1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [21:51:41] RECOVERY - test1 SSH on test1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u5 (protocol 2.0) [21:59:58] !log disable TUN/TAP on test1, seems to break stuff [22:00:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:03:34] PROBLEM - test1 SSH on test1 is CRITICAL: connect to address 185.52.2.243 and port 22: Connection refused [22:05:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhFNP [22:05:12] [02miraheze/services] 07MirahezeSSLBot 0375a653a - BOT: Updating services config for wikis [22:09:26] RECOVERY - test1 SSH on test1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u5 (protocol 2.0) [22:11:38] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 29 minutes ago with 0 failures [22:11:46] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.20, 0.05, 0.01 [22:12:00] RECOVERY - test1 Disk Space on test1 is OK: DISK OK - free space: / 12286 MB (29% inode=98%); [22:12:07] RECOVERY - test1 php-fpm on test1 is OK: PROCS OK: 2 processes with command name 'php-fpm7.3' [22:12:19] !log shutdown bacula1 [22:12:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:13:34] PROBLEM - bacula1 Bacula Private Git on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:13:50] RECOVERY - test1 HTTPS on test1 is OK: HTTP OK: HTTP/1.1 200 OK - 22921 bytes in 0.010 second response time [22:15:00] PROBLEM - bacula1 Current Load on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [22:15:15] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [22:15:32] PROBLEM - bacula1 SSH on bacula1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:17:21] PROBLEM - Host bacula1 is DOWN: PING CRITICAL - Packet loss = 100% [22:17:29] [02miraheze/dns] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhFNd [22:17:30] [02miraheze/dns] 07Southparkfan 0380796ca - depool cp5 [22:19:44] RECOVERY - Host bacula1 is UP: PING WARNING - Packet loss = 82%, RTA = 97.56 ms [22:19:45] PROBLEM - bacula1 Bacula Daemon on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:19:45] PROBLEM - bacula1 Bacula Databases db4 on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:19:45] PROBLEM - bacula1 Bacula Phabricator Static on bacula1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:25:52] !log aaaaaand give tun/tap yet another try [22:25:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:28:06] PROBLEM - test1 Puppet on test1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [22:28:10] PROBLEM - test1 Current Load on test1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [22:28:19] PROBLEM - test1 HTTPS on test1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:28:24] PROBLEM - test1 Disk Space on test1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [22:28:31] PROBLEM - test1 php-fpm on test1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [22:29:54] PROBLEM - test1 SSH on test1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:33:45] RECOVERY - test1 SSH on test1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u5 (protocol 2.0) [22:43:02] !log reimage bacula1 with 64-bit stretch image [22:43:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:49:11] PROBLEM - Host bacula1 is DOWN: PING CRITICAL - Packet loss = 100% [22:51:28] PROBLEM - cp5 Varnish Backends on cp5 is CRITICAL: 1 backends are down. mw2 [22:53:28] RECOVERY - cp5 Varnish Backends on cp5 is OK: All 5 backends are healthy [23:13:05] RECOVERY - Host bacula1 is UP: PING OK - Packet loss = 0%, RTA = 97.27 ms [23:14:07] RECOVERY - bacula1 SSH on bacula1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u5 (protocol 2.0) [23:24:01] PROBLEM - bacula1 SSH on bacula1 is CRITICAL: connect to address 172.245.38.205 and port 22: Connection refused [23:34:25] PROBLEM - wiki.thunis.eu - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.thunis.eu' expires in 15 day(s) (Sun 10 Mar 2019 11:30:55 PM GMT +0000). [23:34:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fhFAD [23:34:41] [02miraheze/ssl] 07MirahezeSSLBot 03036e3e5 - Bot: Update SSL cert for wiki.thunis.eu [23:41:11] PROBLEM - Host bacula1 is DOWN: PING CRITICAL - Packet loss = 100% [23:42:25] RECOVERY - wiki.thunis.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thunis.eu' will expire on Thu 23 May 2019 10:34:33 PM GMT +0000. [23:43:11] RECOVERY - Host bacula1 is UP: PING OK - Packet loss = 0%, RTA = 97.21 ms [23:43:38] RECOVERY - bacula1 SSH on bacula1 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u5 (protocol 2.0) [23:52:18] !log puppetserver ca revoke --certname bacula1.miraheze.org on puppet1 [23:52:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:52:45] !log puppetserver ca clean --certname bacula1.miraheze.org on puppet1 [23:52:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:56:19] !log puppetserver ca sign --certname bacula1.miraheze.org on puppet1 [23:56:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:59:46] PROBLEM - bacula1 Puppet on bacula1 is UNKNOWN: NRPE: Unable to read output