[00:02:29] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2680 MB (11% inode=93%); [00:02:35] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.50, 21.78, 17.67 [00:06:33] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.34, 20.06, 17.92 [00:34:28] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2648 MB (10% inode=93%); [01:48:35] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.91, 18.63, 16.54 [01:50:38] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.11, 18.23, 16.62 [06:09:50] RECOVERY - rdb2 APT on rdb2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:11:11] RECOVERY - gluster1 APT on gluster1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:11:23] RECOVERY - mail1 APT on mail1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:13:19] RECOVERY - db12 APT on db12 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [06:20:00] RECOVERY - puppet2 APT on puppet2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:31:33] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.32, 20.23, 17.01 [06:33:31] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.18, 19.62, 17.13 [06:35:27] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.21, 18.04, 16.83 [06:39:32] RECOVERY - cp6 APT on cp6 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:42:38] PROBLEM - erikapedia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.erikapedia.com' expires in 15 day(s) (Wed 02 Sep 2020 06:38:59 GMT +0000). [06:42:49] RECOVERY - ldap1 APT on ldap1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:45:08] RECOVERY - ns2 APT on ns2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:46:45] PROBLEM - www.erikapedia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.erikapedia.com' expires in 15 day(s) (Wed 02 Sep 2020 06:38:59 GMT +0000). [06:50:05] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJFlb [06:50:06] [02miraheze/ssl] 07MirahezeSSLBot 03723e166 - Bot: Update SSL cert for www.erikapedia.com [06:53:37] RECOVERY - ns1 APT on ns1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:53:44] RECOVERY - db13 APT on db13 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [07:07:17] RECOVERY - www.erikapedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.erikapedia.com' will expire on Sun 15 Nov 2020 05:49:57 GMT +0000. [07:10:18] RECOVERY - erikapedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.erikapedia.com' will expire on Sun 15 Nov 2020 05:49:57 GMT +0000. [07:34:41] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 0.92, 2.08, 1.20 [07:36:39] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.02, 0.97, 0.94 [07:54:10] PROBLEM - puppet2 Current Load on puppet2 is WARNING: WARNING - load average: 7.01, 4.94, 3.81 [07:56:09] RECOVERY - puppet2 Current Load on puppet2 is OK: OK - load average: 1.36, 3.62, 3.47 [08:50:29] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 131s [10:15:34] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [10:16:17] PROBLEM - ns1 APT on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [10:16:47] PROBLEM - ns1 SSH on ns1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:17:04] SPF|Cloud, paladox, Reception|away: can someone check ^ [10:17:13] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [10:17:13] PROBLEM - ns1 Current Load on ns1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [10:17:32] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 14 minutes ago with 0 failures [10:18:11] RECOVERY - ns1 APT on ns1 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [10:18:41] RECOVERY - ns1 SSH on ns1 is OK: SSH OK - OpenSSH_7.9p1 Debian-10+deb10u2 (protocol 2.0) [10:19:09] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [10:30:58] RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.30, 0.56, 1.66 [11:13:02] PROBLEM - www.hinduwiki.online - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.hinduwiki.online' expires in 15 day(s) (Wed 02 Sep 2020 11:08:54 GMT +0000). [11:16:03] PROBLEM - innersphere.tk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'innersphere.tk' expires in 15 day(s) (Wed 02 Sep 2020 11:10:28 GMT +0000). [11:18:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJFKT [11:18:28] [02miraheze/ssl] 07MirahezeSSLBot 03cb14fc2 - Bot: Update SSL cert for www.hinduwiki.online [11:19:00] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJFKk [11:19:02] [02miraheze/ssl] 07MirahezeSSLBot 03270383a - Bot: Update SSL cert for innersphere.tk [11:26:36] RECOVERY - www.hinduwiki.online - LetsEncrypt on sslhost is OK: OK - Certificate 'www.hinduwiki.online' will expire on Sun 15 Nov 2020 10:18:15 GMT +0000. [11:29:21] RECOVERY - innersphere.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'innersphere.tk' will expire on Sun 15 Nov 2020 10:18:53 GMT +0000. [11:54:29] PROBLEM - cp3 Disk Space on cp3 is CRITICAL: DISK CRITICAL - free space: / 1443 MB (5% inode=93%); [12:24:34] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 38.78, 24.53, 17.61 [12:25:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJFPD [12:25:14] [02miraheze/services] 07MirahezeSSLBot 032b81c9b - BOT: Updating services config for wikis [12:50:43] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [13:04:34] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.51, 19.71, 23.57 [13:16:33] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.64, 16.27, 20.11 [15:23:31] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 10.06, 5.99, 4.33 [15:25:31] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 4.38, 5.48, 4.36 [16:34:39] Hello @sysadmins wiki without CD can be moved from dbname1 to dbname2 per request on phab only? :) [16:35:46] without CD? [16:36:08] And I won't be able to today, but I can take a look tomorrow [16:40:23] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJFxo [16:40:24] [02miraheze/services] 07MirahezeSSLBot 03295a1e9 - BOT: Updating services config for wikis [16:41:24] PROBLEM - gluster2 Disk Space on gluster2 is WARNING: DISK WARNING - free space: / 36708 MB (10% inode=77%); [16:42:50] @MrJaroslavik to change dbname's they should file a phab task [16:49:13] Okay, Thanks. [16:50:20] Reception|Away CD= custom domain and no request at this time, only for info ;). [16:50:50] Oh [16:51:01] And yes what Zppix said [17:23:14] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJFhI [17:23:15] [02miraheze/CreateWiki] 07translatewiki 03a0e9583 - Localisation updates from https://translatewiki.net. [17:23:16] [ Main page - translatewiki.net ] - translatewiki.net [17:23:17] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJFhL [17:23:18] [02miraheze/ManageWiki] 07translatewiki 03373d143 - Localisation updates from https://translatewiki.net. [17:23:19] [ Main page - translatewiki.net ] - translatewiki.net [18:14:39] PROBLEM - puppet2 Current Load on puppet2 is CRITICAL: CRITICAL - load average: 8.05, 5.44, 4.10 [18:16:36] RECOVERY - puppet2 Current Load on puppet2 is OK: OK - load average: 1.65, 4.02, 3.75 [18:29:48] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.83, 21.06, 18.94 [18:30:29] PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 152s [18:31:45] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.19, 19.19, 18.53 [18:32:29] RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 3s [19:05:18] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.87, 5.90, 4.95 [19:07:13] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 3.32, 4.86, 4.68 [19:15:11] PROBLEM - puppet2 Current Load on puppet2 is WARNING: WARNING - load average: 6.90, 5.44, 4.24 [19:17:09] RECOVERY - puppet2 Current Load on puppet2 is OK: OK - load average: 1.00, 3.69, 3.74 [20:02:45] PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 10.10, 7.20, 5.06 [20:02:46] PROBLEM - kn.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for kn.gyaanipedia.co.in could not be found [20:02:46] PROBLEM - permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for permanentfuturelab.wiki could not be found [20:02:48] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb [20:02:57] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb, 2607:5300:205:200::2ac4/cpweb [20:03:22] PROBLEM - cp3 Stunnel Http for mw4 on cp3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 0.508 second response time [20:03:29] PROBLEM - cp6 Stunnel Http for mw4 on cp6 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:03:29] PROBLEM - cp9 Stunnel Http for mw5 on cp9 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:03:38] PROBLEM - cp6 Stunnel Http for mw5 on cp6 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:03:49] PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 9.00, 7.79, 5.50 [20:03:50] PROBLEM - cp9 Stunnel Http for mw4 on cp9 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:04:14] PROBLEM - mw5 MediaWiki Rendering on mw5 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:04:26] PROBLEM - cp7 Stunnel Http for mw5 on cp7 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:04:26] PROBLEM - cp7 Stunnel Http for mw4 on cp7 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:04:46] PROBLEM - mw4 MediaWiki Rendering on mw4 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:05:02] PROBLEM - cp3 Stunnel Http for mw5 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [20:05:22] RECOVERY - cp3 Stunnel Http for mw4 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15653 bytes in 3.968 second response time [20:05:26] RECOVERY - cp6 Stunnel Http for mw4 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15653 bytes in 0.310 second response time [20:05:27] RECOVERY - cp9 Stunnel Http for mw5 on cp9 is OK: HTTP OK: HTTP/1.1 200 OK - 15653 bytes in 0.359 second response time [20:05:33] RECOVERY - cp6 Stunnel Http for mw5 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15653 bytes in 0.019 second response time [20:05:49] RECOVERY - cp9 Stunnel Http for mw4 on cp9 is OK: HTTP OK: HTTP/1.1 200 OK - 15653 bytes in 0.324 second response time [20:06:14] RECOVERY - mw5 MediaWiki Rendering on mw5 is OK: HTTP OK: HTTP/1.1 200 OK - 17160 bytes in 0.163 second response time [20:06:24] RECOVERY - cp7 Stunnel Http for mw5 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15653 bytes in 0.007 second response time [20:06:25] RECOVERY - cp7 Stunnel Http for mw4 on cp7 is OK: HTTP OK: HTTP/1.1 200 OK - 15653 bytes in 0.008 second response time [20:06:37] PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 5.00, 7.27, 5.67 [20:06:42] RECOVERY - mw4 MediaWiki Rendering on mw4 is OK: HTTP OK: HTTP/1.1 200 OK - 17160 bytes in 0.165 second response time [20:06:43] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [20:06:51] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [20:06:57] RECOVERY - cp3 Stunnel Http for mw5 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15653 bytes in 0.749 second response time [20:07:17] PROBLEM - www.erikapedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.erikapedia.com could not be found [20:07:19] PROBLEM - oecumene.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for oecumene.org could not be found [20:07:25] PROBLEM - wiki.wikidadds.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.wikidadds.org could not be found [20:07:37] PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 4.05, 7.38, 6.01 [20:08:33] RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 2.53, 5.75, 5.31 [20:09:31] RECOVERY - permanentfuturelab.wiki - reverse DNS on sslhost is OK: rDNS OK - permanentfuturelab.wiki reverse DNS resolves to cp7.miraheze.org [20:09:32] RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 2.24, 5.63, 5.53 [20:09:33] RECOVERY - kn.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - kn.gyaanipedia.co.in reverse DNS resolves to cp7.miraheze.org [20:14:09] RECOVERY - wiki.wikidadds.org - reverse DNS on sslhost is OK: rDNS OK - wiki.wikidadds.org reverse DNS resolves to cp7.miraheze.org [20:14:15] RECOVERY - www.erikapedia.com - reverse DNS on sslhost is OK: rDNS OK - www.erikapedia.com reverse DNS resolves to cp7.miraheze.org [20:14:17] RECOVERY - oecumene.org - reverse DNS on sslhost is OK: rDNS OK - oecumene.org reverse DNS resolves to cp6.miraheze.org [20:40:28] RhinosF1 on? [20:43:32] @MrJaroslavik (OFF) Is this regarding the IP editor that requested permissions on TestWiki? [20:43:54] Lock pls, only logged in [20:43:59] I've protected the page for "editing" to logged-in users only. No need to edit logged out. [20:44:04] ✅ Done. [20:44:30] Ok [20:46:11] GN [20:52:16] > GN @MrJaroslavik (OFF) What's GN stand for? Good now? Just checking my acronym understanding. [20:53:06] I know GN only as Good Night (yes, here 😆) [20:53:35] > I know GN only as Good Night (yes, here 😆) @MrJaroslavik (OFF) Ah, okay. Thanks! Have a nice sleep then! 🙂 [21:05:26] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.83, 19.58, 17.35 [21:07:24] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.15, 17.55, 16.87 [21:16:32] hhi [21:44:23] hi @hispano76 :) [22:05:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JJbLK [22:05:14] [02miraheze/services] 07MirahezeSSLBot 0301b0bba - BOT: Updating services config for wikis [22:06:26] Hello Bugambilia! If you have any questions, feel free to ask and someone should answer soon. [22:06:38] Test [22:06:55] .kickban Bugambilia LTA [22:07:10] .ban *!*@199.8.201.* [22:07:15] .op