[04:41:01] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 5060 MB (20% inode=95%); [06:27:01] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 5440 MB (22% inode=95%); [12:52:12] paladox: another issue with special pages not updating. https://phabricator.miraheze.org/T4299 [12:52:13] Title: [ ⚓ T4299 Update wiki statistics ] - phabricator.miraheze.org [13:10:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjO4H [13:10:13] [02miraheze/services] 07MirahezeSSLBot 03f2009b4 - BOT: Updating services config for wikis [14:54:06] PROBLEM - wiki.tensorflow.community - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Cannot make SSL connection. [15:42:13] * Hispano76 saluda [16:47:30] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±2] 13https://git.io/fjOE8 [16:47:31] [02miraheze/mediawiki] 07paladox 03874a83c - Update ApprovedRevs to the master branch Yaron maintains this extension which means it supports older mw version too. Needed to fix some bugs. [16:50:46] !log running lc on mw* [16:50:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [17:02:23] PROBLEM - db4 Current Load on db4 is CRITICAL: CRITICAL - load average: 13.95, 8.36, 5.29 [17:04:22] PROBLEM - db4 Current Load on db4 is WARNING: WARNING - load average: 5.06, 7.21, 5.27 [17:06:22] RECOVERY - db4 Current Load on db4 is OK: OK - load average: 3.83, 6.10, 5.11 [17:25:01] !log install 'sysbench' on cp4 [17:25:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [17:25:59] !log restarted php-fpm and nginx on misc2 [17:26:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [17:30:00] !log remove sysbench package from cp4 (+db4, I also benchmarked db4) [17:30:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:55:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjO2R [20:55:12] [02miraheze/services] 07MirahezeSSLBot 034dfa602 - BOT: Updating services config for wikis [21:16:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-6/±3] 13https://git.io/fjO2X [21:16:49] [02miraheze/puppet] 07paladox 037baba58 - Rip out old dumps infrastructure This has been replaced by our new infrastructure. Bug: T4158 Change-Id: Ic0905cf82fe36b1849b404e49ecfe2bca845f42f [21:19:18] !log upgrading puppetdb to 6.3.1 on puppet1 [21:19:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:49:23] !log installing trafficserver on cp4 to test (from https://apt.wikimedia.org/wikimedia/pool/main/t/trafficserver/trafficserver_8.0.3-1wm1_amd64.deb) [22:49:24] Title: [ 404 Not Found ] - apt.wikimedia.org [22:49:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:52:38] !log noting that i also "apt-get install libc++1 libc++abi1 libhwloc5 libluajit-5.1-2 libtcl8.6 libunwind8 libnuma1 libluajit-5.1-common libhwloc5 -t stretch-backports" required by trafficserver [22:52:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:53:19] paladox: don't test in prod ;) [22:53:30] ok [22:53:38] * paladox moves it to test1 then [22:54:09] !log apt-get --purge remove trafficserver on cp4 (installing trafficserver on test1 instead). [22:54:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:55:08] also why WMF apt? [22:55:34] JohnLewis it was the only one with apache traffic server vers 8 :) [22:55:44] okay, why 8 over 7? [22:55:58] policy is always use upstream unless absolutely necessary [22:56:06] ok [22:56:22] buster uses 8 [22:57:20] but we're stretch, which is upstream [22:57:59] wait [22:58:02] we need 8 actually [22:58:41] JohnLewis why the change of heart? :) [22:58:56] because if you read the changelogs, TLS 1.3 is only supported in 8 [22:59:11] yup [22:59:13] i saw that [23:01:28] JohnLewis can i run puppet on test1 quickly? [23:01:33] yeah? [23:01:35] Will anything be overwritten if i do? [23:01:37] thanks! [23:13:59] PROBLEM - test1 Puppet on test1 is WARNING: WARNING: Puppet is currently disabled, message: John, last run 6 minutes ago with 1 failures [23:16:00] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 18 seconds ago with 5 failures. Failed resources (up to 3 shown): Package[php7.3-cli],Package[php7.3-fpm],Package[php7.3-dev],Package[php-mailparse] [23:19:58] PROBLEM - test1 Puppet on test1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 17 seconds ago with 1 failures [23:32:57] !log stopping nginx on test1 [23:33:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [23:36:21] PROBLEM - test1 HTTPS on test1 is CRITICAL: connect to address 185.52.2.243 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [23:38:32] 😐 [23:39:25] that's ok (that's a test server), nothing in prod will be affected. [23:44:28] After so long.. [23:45:46] hm? [23:46:56] Nothing, it's been a long time since I've entered Discord. Lewis