[00:01:00] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 46.82, 28.73, 25.21 [00:01:03] PROBLEM - gluster2 Current Load on gluster2 is CRITICAL: CRITICAL - load average: 7.18, 5.70, 5.32 [00:03:51] PROBLEM - ping6 on glustermigrtemp1 is CRITICAL: CRITICAL - Destination Unreachable (fe80::f816:3eff:fe19:bc66) [00:03:54] RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [00:05:22] RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:06:00] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:06:51] RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:07:17] RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:11:01] PROBLEM - gluster2 Current Load on gluster2 is WARNING: WARNING - load average: 4.93, 5.91, 5.73 [00:14:55] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 14.83, 20.10, 23.95 [00:17:04] RECOVERY - gluster2 Current Load on gluster2 is OK: OK - load average: 3.13, 4.17, 5.06 [00:22:49] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.21, 14.51, 19.65 [00:24:04] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/Jt0ul [00:24:06] [02miraheze/mw-config] 07Universal-Omega 031047752 - Disable file uploads [00:24:07] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3 [00:24:09] [02mw-config] 07Universal-Omega opened pull request 03#3697: Disable file uploads - 13https://git.io/Jt0u8 [00:25:10] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/Jt0uR [00:25:11] miraheze/mw-config - Universal-Omega the build passed. [00:25:12] [02miraheze/mw-config] 07Universal-Omega 030cb0e3b - Update ManageWikiSettings.php [00:25:13] [02mw-config] 07Universal-Omega synchronize pull request 03#3697: Disable file uploads - 13https://git.io/Jt0u8 [00:26:23] miraheze/mw-config - Universal-Omega the build passed. [00:28:20] PROBLEM - glustermigrtemp1 Puppet on glustermigrtemp1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:30:05] [02mw-config] 07Universal-Omega closed pull request 03#3697: Disable file uploads - 13https://git.io/Jt0u8 [00:30:06] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jt0u6 [00:30:08] [02miraheze/mw-config] 07Universal-Omega 03700c2c5 - Disable file uploads (#3697) * Disable file uploads * Update ManageWikiSettings.php [00:31:11] miraheze/mw-config - Universal-Omega the build passed. [00:33:24] RECOVERY - jobrunner4 Check Gluster Clients on jobrunner4 is OK: PROCS OK: 2 processes with args '/usr/sbin/glusterfs' [00:34:46] !log update mw_settings set s_settings = REPLACE(s_settings,'wgEnableUploads', 'wmgEnableUploads'); [00:34:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:37:25] PROBLEM - jobrunner4 Check Gluster Clients on jobrunner4 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [00:37:52] !log sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/w/cache/databases.json /home/paladox/resetWikiCaches.php on Jobrunner1 [00:37:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:44:22] [02miraheze/dns] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0zQ [00:44:23] [02miraheze/dns] 07Southparkfan 03ce78772 - experiment: depool cp7 [00:53:52] !log disable puppet on glustermigrtemp1 [00:53:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:55:47] [02mw-config] 07dmehus opened pull request 03#3698: Add sitenotice regarding gluster migration - 13https://git.io/Jt0gs [00:56:19] !log switched on gluster read-only mode [00:56:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:56:54] miraheze/mw-config - dmehus the build has errored. [01:00:35] [02mw-config] 07Universal-Omega assigned pull request 03#3698: Add sitenotice regarding gluster migration - 13https://git.io/Jt0gs [01:00:47] !log install rsync on gluster2 [01:00:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:01:10] PROBLEM - mon1 Current Load on mon1 is CRITICAL: CRITICAL - load average: 4.47, 3.20, 2.74 [01:02:43] [02mw-config] 07dmehus synchronize pull request 03#3698: Add sitenotice regarding gluster migration - 13https://git.io/Jt0gs [01:03:10] RECOVERY - mon1 Current Load on mon1 is OK: OK - load average: 2.28, 2.82, 2.66 [01:03:26] RECOVERY - jobrunner4 Check Gluster Clients on jobrunner4 is OK: PROCS OK: 2 processes with args '/usr/sbin/glusterfs' [01:03:45] miraheze/mw-config - dmehus the build has errored. [01:04:33] RECOVERY - jobrunner3 Check Gluster Clients on jobrunner3 is OK: PROCS OK: 2 processes with args '/usr/sbin/glusterfs' [01:06:10] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.59, 21.27, 18.79 [01:06:41] [02mw-config] 07dmehus synchronize pull request 03#3698: Add sitenotice regarding gluster migration - 13https://git.io/Jt0gs [01:07:17] [02mw-config] 07Universal-Omega reviewed pull request 03#3698 commit - 13https://git.io/Jt0gA [01:07:24] PROBLEM - jobrunner4 Check Gluster Clients on jobrunner4 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [01:07:48] miraheze/mw-config - dmehus the build has errored. [01:08:11] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.65, 19.00, 18.27 [01:08:11] [02mw-config] 07dmehus synchronize pull request 03#3698: Add sitenotice regarding gluster migration - 13https://git.io/Jt0gs [01:08:33] PROBLEM - jobrunner3 Check Gluster Clients on jobrunner3 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [01:08:56] [02mw-config] 07dmehus reviewed pull request 03#3698 commit - 13https://git.io/Jt0gh [01:09:08] miraheze/mw-config - dmehus the build passed. [01:09:48] [02mw-config] 07Universal-Omega closed pull request 03#3698: Add sitenotice regarding gluster migration - 13https://git.io/Jt0gs [01:09:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt02v [01:09:51] [02miraheze/mw-config] 07dmehus 03c98da21 - Add sitenotice regarding gluster migration (#3698) * Add sitenotice regarding gluster migration * Trying to fix this * Adding sitenotice about gluster migration Credit @Universal_Omega * Adding sitenotice re: gluster migration Credit to @Universal_Omega [01:09:54] [02miraheze/dns] 07Southparkfan pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/Jt02J [01:09:56] [02miraheze/dns] 07Southparkfan 031329794 - Revert "experiment: depool cp7" This reverts commit ce78772f0b88d29dc21d7a16a8427a94d0a730e2. [01:09:57] [02miraheze/dns] 07Southparkfan 03a4ed2b2 - Depool cp6 [01:10:50] miraheze/mw-config - Universal-Omega the build passed. [01:21:16] PROBLEM - aman.awiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for aman.awiki.org could not be found [01:21:20] PROBLEM - nonciclopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for nonciclopedia.org could not be found [01:21:21] PROBLEM - wiki.villagecollaborative.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.villagecollaborative.net could not be found [01:21:25] PROBLEM - wiki.jafaron.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.jafaron.net could not be found [01:21:27] PROBLEM - sportsanalytics.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sportsanalytics.wiki could not be found [01:21:28] PROBLEM - test1.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for test1.miraheze.org could not be found [01:25:12] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 31.81, 22.40, 19.39 [01:26:00] PROBLEM - gluster2 Current Load on gluster2 is CRITICAL: CRITICAL - load average: 6.54, 5.45, 4.21 [01:27:59] PROBLEM - gluster2 Current Load on gluster2 is WARNING: WARNING - load average: 5.42, 5.57, 4.42 [01:28:04] RECOVERY - wiki.villagecollaborative.net - reverse DNS on sslhost is OK: rDNS OK - wiki.villagecollaborative.net reverse DNS resolves to cp7.miraheze.org [01:28:14] RECOVERY - wiki.jafaron.net - reverse DNS on sslhost is OK: rDNS OK - wiki.jafaron.net reverse DNS resolves to cp7.miraheze.org [01:28:14] RECOVERY - sportsanalytics.wiki - reverse DNS on sslhost is OK: rDNS OK - sportsanalytics.wiki reverse DNS resolves to cp7.miraheze.org [01:28:15] RECOVERY - test1.miraheze.org - reverse DNS on sslhost is OK: rDNS OK - test1.miraheze.org reverse DNS resolves to cp7.miraheze.org [01:28:16] RECOVERY - aman.awiki.org - reverse DNS on sslhost is OK: rDNS OK - aman.awiki.org reverse DNS resolves to cp7.miraheze.org [01:28:18] RECOVERY - nonciclopedia.org - reverse DNS on sslhost is OK: rDNS OK - nonciclopedia.org reverse DNS resolves to cp7.miraheze.org [01:31:57] RECOVERY - gluster2 Current Load on gluster2 is OK: OK - load average: 2.96, 4.34, 4.20 [01:32:40] PROBLEM - cloud1 Puppet on cloud1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 28 minutes ago with 0 failures [01:35:07] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.07, 22.39, 21.90 [01:39:05] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.45, 17.96, 20.18 [01:40:40] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0af [01:40:41] [02miraheze/mw-config] 07Universal-Omega 039b6e97c - Minor updates to sitenotice [01:40:56] PROBLEM - test2 Puppet on test2 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 4 minutes ago with 2 failures [01:41:44] miraheze/mw-config - Universal-Omega the build passed. [01:44:19] PROBLEM - test2 Check Gluster Clients on test2 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [01:44:33] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0am [01:44:34] [02miraheze/mw-config] 07Universal-Omega 0355da61b - Minor update to sitenotice [01:45:31] PROBLEM - gluster2 Disk Space on gluster2 is WARNING: DISK WARNING - free space: / 32613 MB (6% inode=81%); [01:45:44] miraheze/mw-config - Universal-Omega the build passed. [01:48:25] PROBLEM - gluster3 Gluster Disk Space on gluster3 is WARNING: DISK WARNING - free space: /mnt/mediawiki-static 33627 MB (6% inode=81%); [01:50:57] PROBLEM - gluster1 SSH on gluster1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:51:11] PROBLEM - ping6 on gluster1 is CRITICAL: CRITICAL - Destination Unreachable (2001:41d0:800:105a::2) [01:51:32] PROBLEM - gluster1 Current Load on gluster1 is CRITICAL: connect to address 51.77.107.209 port 5666: Connection refusedconnect to host 51.77.107.209 port 5666: Connection refused [01:52:25] PROBLEM - gluster3 Gluster Disk Space on gluster3 is CRITICAL: DISK CRITICAL - free space: /mnt/mediawiki-static 73424 MB (5% inode=81%); [01:53:02] RECOVERY - gluster1 SSH on gluster1 is OK: SSH OK - OpenSSH_7.9p1 Debian-10+deb10u2 (protocol 2.0) [01:53:13] RECOVERY - ping6 on gluster1 is OK: PING OK - Packet loss = 0%, RTA = 4.11 ms [01:53:30] RECOVERY - gluster1 Current Load on gluster1 is OK: OK - load average: 1.24, 0.66, 0.26 [01:58:19] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0aw [01:58:21] [02miraheze/mw-config] 07Universal-Omega 0308356ec - minor change to sitenotice [01:58:39] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0aP [01:58:41] [02miraheze/mw-config] 07Universal-Omega 03b92fa32 - minor fix on sitenotice [01:59:23] miraheze/mw-config - Universal-Omega the build passed. [01:59:43] miraheze/mw-config - Universal-Omega the build passed. [02:02:18] [02mw-config] 07dmehus opened pull request 03#3699: Correct grammar, improve phrasing, and add detail - 13https://git.io/Jt0aD [02:02:56] [02mw-config] 07dmehus commented on pull request 03#3699: Correct grammar, improve phrasing, and add detail - 13https://git.io/Jt0aS [02:03:20] miraheze/mw-config - dmehus the build passed. [02:03:24] RECOVERY - jobrunner4 Check Gluster Clients on jobrunner4 is OK: PROCS OK: 2 processes with args '/usr/sbin/glusterfs' [02:03:32] [02mw-config] 07Universal-Omega closed pull request 03#3699: Correct grammar, improve phrasing, and add detail - 13https://git.io/Jt0aD [02:03:34] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0a9 [02:03:35] [02miraheze/mw-config] 07dmehus 03228ae3c - Update Sitenotice.php (#3699) Removes redundant phrasing, improves grammar, and adds clarity and detail (i.e., "new, upgraded infrastructure") so customers see benefits. [02:04:33] miraheze/mw-config - Universal-Omega the build passed. [02:05:05] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0aF [02:05:07] [02miraheze/mw-config] 07Universal-Omega 03b013052 - Minor grammatical fixes to sitenotice [02:06:08] miraheze/mw-config - Universal-Omega the build passed. [02:07:24] PROBLEM - jobrunner4 Check Gluster Clients on jobrunner4 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [02:10:26] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0Ve [02:10:28] [02miraheze/mw-config] 07Universal-Omega 03b304fa7 - Add note to $wgEnableUploads [02:11:30] miraheze/mw-config - Universal-Omega the build passed. [02:28:13] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jt0V8 [02:28:15] [02miraheze/ManageWiki] 07paladox 03366c41d - Add missing $options [02:28:16] [02ManageWiki] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vpSns [02:28:18] [02ManageWiki] 07paladox opened pull request 03#236: Add missing $options - 13https://git.io/Jt0V4 [02:28:48] [02ManageWiki] 07paladox closed pull request 03#236: Add missing $options - 13https://git.io/Jt0V4 [02:28:49] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0VB [02:28:51] [02miraheze/ManageWiki] 07paladox 032549b8a - Add missing $options (#236) [02:28:52] [02ManageWiki] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vpSns [02:28:54] [02miraheze/ManageWiki] 07paladox deleted branch 03paladox-patch-1 [02:29:17] miraheze/ManageWiki - paladox the build passed. [02:29:50] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/Jt0VE [02:29:52] miraheze/ManageWiki - paladox the build passed. [02:29:52] [02miraheze/mediawiki] 07paladox 030f0d28c - Update ManageWiki [02:32:52] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 1 minute ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config],Exec[git_pull_MediaWiki core] [02:35:24] RECOVERY - jobrunner4 Check Gluster Clients on jobrunner4 is OK: PROCS OK: 2 processes with args '/usr/sbin/glusterfs' [02:36:33] RECOVERY - jobrunner3 Check Gluster Clients on jobrunner3 is OK: PROCS OK: 2 processes with args '/usr/sbin/glusterfs' [02:38:19] RECOVERY - test2 Check Gluster Clients on test2 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [02:39:24] PROBLEM - jobrunner4 Check Gluster Clients on jobrunner4 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [02:40:33] PROBLEM - jobrunner3 Check Gluster Clients on jobrunner3 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [02:43:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0w0 [02:43:15] [02miraheze/puppet] 07paladox 037038929 - gluster: Add jobrunner3 and 4 to firewall [02:44:52] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [02:46:34] RECOVERY - jobrunner3 Check Gluster Clients on jobrunner3 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [02:47:24] RECOVERY - jobrunner4 Check Gluster Clients on jobrunner4 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [02:49:22] PROBLEM - jobrunner4 MediaWiki Rendering on jobrunner4 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:49:29] PROBLEM - jobrunner3 MediaWiki Rendering on jobrunner3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:32:55] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [03:33:30] RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures [04:01:24] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0ob [04:01:25] [02miraheze/mw-config] 07Universal-Omega 03d5ed4e6 - remove old description for wgEnableUploads. Will be re-added when re-enabled [04:02:21] miraheze/mw-config - Universal-Omega the build passed. [04:08:26] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0KI [04:08:27] [02miraheze/mw-config] 07Universal-Omega 032731f28 - minor fix to sitenotice [04:09:31] miraheze/mw-config - Universal-Omega the build passed. [04:32:41] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0K7 [04:32:43] [02miraheze/mw-config] 07Universal-Omega 03013cc22 - minor fix in help message [04:33:47] miraheze/mw-config - Universal-Omega the build passed. [05:54:46] back [05:55:15] Hello [05:55:40] Hi [06:02:26] RECOVERY - mw5 APT on mw5 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:04:34] Hello Firestar70! If you have any questions, feel free to ask and someone should answer soon. [06:04:35] RECOVERY - mw10 APT on mw10 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:05:42] bruh that's me [06:07:05] RECOVERY - services1 APT on services1 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:08:52] Hello Firestar92! If you have any questions, feel free to ask and someone should answer soon. [06:08:52] RECOVERY - services4 APT on services4 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:09:59] RECOVERY - mw6 APT on mw6 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:11:06] RECOVERY - mon2 APT on mon2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:15:24] RECOVERY - jobrunner4 APT on jobrunner4 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:18:31] RECOVERY - jobrunner3 APT on jobrunner3 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:18:31] RECOVERY - mw7 APT on mw7 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:22:57] RECOVERY - mw4 APT on mw4 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:25:40] RECOVERY - mw11 APT on mw11 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:26:47] RECOVERY - jobrunner2 APT on jobrunner2 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:27:06] zzzzzz [06:29:19] RECOVERY - services2 APT on services2 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:30:47] RECOVERY - cp6 APT on cp6 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:35:55] RECOVERY - cloud5 APT on cloud5 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:35:56] RECOVERY - cloud3 APT on cloud3 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [06:36:02] RECOVERY - cloud5 APT on cloud5 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:36:16] RECOVERY - cp11 APT on cp11 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:37:11] RECOVERY - cloud3 APT on cloud3 is OK: APT OK: 79 packages available for upgrade (0 critical updates). [06:41:24] RECOVERY - test2 APT on test2 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:41:30] RECOVERY - cloud1 APT on cloud1 is OK: APT OK: 97 packages available for upgrade (0 critical updates). [06:44:03] RECOVERY - mon1 APT on mon1 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:46:17] RECOVERY - cloud2 APT on cloud2 is OK: APT OK: 98 packages available for upgrade (0 critical updates). [06:46:58] CptViraj Welcome! [06:47:40] Hi, Thanks. [06:48:21] Do you own any wikis? [06:48:54] You may wish to join the Discord server [06:49:13] https://discord.gg/Bb8Pbyqc2f [06:49:13] [ Miraheze ] - discord.gg [06:52:02] RECOVERY - cp12 APT on cp12 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:52:13] RECOVERY - cp12 APT on cp12 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:53:21] RECOVERY - jobrunner1 APT on jobrunner1 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:54:08] RECOVERY - cloud4 APT on cloud4 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:54:45] RECOVERY - cloud4 APT on cloud4 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:59:49] RECOVERY - cp3 APT on cp3 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:59:49] RECOVERY - mail1 APT on mail1 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:59:49] RECOVERY - cp7 APT on cp7 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [08:22:05] [02phabricator-extensions] 07Reception123 closed pull request 03#9: Use tabs not spaces - 13https://git.io/Jt0L9 [08:22:06] [02miraheze/phabricator-extensions] 07Reception123 pushed 031 commit to 03master [+0/-0/±5] 13https://git.io/Jt09q [08:22:08] [02miraheze/phabricator-extensions] 07Universal-Omega 038dad4fb - Use tabs not spaces (#9) * Fix tabbing * Fix tabbing * fix formatting * Fix tabbing * Fix tabbing * Fix tabbing * Fix spacing * Fix formatting * fix spacing * fix spacing [08:22:09] [02miraheze/phabricator-extensions] 07Reception123 pushed 031 commit to 03master [+0/-0/±5] 13https://git.io/Jt09q [08:22:11] [02miraheze/phabricator-extensions] 07Universal-Omega 038dad4fb - Use tabs not spaces (#9) * Fix tabbing * Fix tabbing * fix formatting * Fix tabbing * Fix tabbing * Fix tabbing * Fix spacing * Fix formatting * fix spacing * fix spacing [08:23:05] miraheze/phabricator-extensions - Reception123 the build passed. [09:30:19] [02miraheze/DataDump] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/Jt059 [09:30:21] [02miraheze/DataDump] 07paladox 03ef34c6d - Add new DataDumpDisableGenerate config [09:30:22] [02DataDump] 07paladox created branch 03paladox-patch-2 - 13https://git.io/fhhKV [09:30:24] [02DataDump] 07paladox opened pull request 03#19: Add new DataDumpDisableGenerate config - 13https://git.io/Jt05Q [09:31:30] miraheze/DataDump - paladox the build passed. [09:31:58] [02DataDump] 07paladox synchronize pull request 03#19: Add new DataDumpDisableGenerate config - 13https://git.io/Jt05Q [09:31:59] [02miraheze/DataDump] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/Jt05F [09:32:01] [02miraheze/DataDump] 07paladox 0390895cd - Update DataDumpPager.php [09:32:38] [02miraheze/DataDump] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/Jt05x [09:32:39] [02miraheze/DataDump] 07paladox 03a703350 - Update en.json [09:32:41] [02DataDump] 07paladox synchronize pull request 03#19: Add new DataDumpDisableGenerate config - 13https://git.io/Jt05Q [09:33:09] miraheze/DataDump - paladox the build passed. [09:33:21] [02miraheze/DataDump] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/Jt05h [09:33:22] [02miraheze/DataDump] 07paladox 03a0233e2 - Update extension.json [09:33:24] [02DataDump] 07paladox synchronize pull request 03#19: Add new DataDumpDisableGenerate config - 13https://git.io/Jt05Q [09:33:54] miraheze/DataDump - paladox the build passed. [09:34:15] [02DataDump] 07paladox closed pull request 03#19: Add new DataDumpDisableGenerate config - 13https://git.io/Jt05Q [09:34:17] [02miraheze/DataDump] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/Jt0dv [09:34:18] [02miraheze/DataDump] 07paladox 03eedc30e - Add new DataDumpDisableGenerate config (#19) * Add new DataDumpDisableGenerate config * Update DataDumpPager.php * Update en.json * Update extension.json [09:34:20] [02DataDump] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/fhhKV [09:34:20] miraheze/DataDump - paladox the build passed. [09:34:21] [02miraheze/DataDump] 07paladox deleted branch 03paladox-patch-2 [09:35:14] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/Jt0dk [09:35:16] [02miraheze/mediawiki] 07paladox 03bde7d6a - Update DataDump [09:35:20] miraheze/DataDump - paladox the build passed. [09:35:59] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0dt [09:36:00] [02miraheze/mw-config] 07paladox 03f21fefa - Set wgDataDumpDisableGenerate to true [09:37:03] miraheze/mw-config - paladox the build passed. [10:01:57] [02mw-config] 07RhinosF1 commented on commit 03f21fefa3458b30fb20f37f87ce96f5eceb4fc2dc - 13https://git.io/Jt0FK [10:04:56] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.03, 20.39, 16.52 [10:05:46] PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 3.36, 6.28, 4.21 [10:06:55] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.75, 17.91, 16.05 [10:07:46] RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.41, 4.53, 3.81 [10:10:52] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [10:28:53] [02miraheze/mw-config] 07paladox pushed 035 commits to 03master [+0/-0/±6] 13https://git.io/Jt0NV [10:28:55] [02miraheze/mw-config] 07paladox 035ee6f86 - Revert "Set wgDataDumpDisableGenerate to true" This reverts commit f21fefa3458b30fb20f37f87ce96f5eceb4fc2dc. [10:28:56] [02miraheze/mw-config] 07paladox 03a0e71de - Revert "minor fix in help message" This reverts commit 013cc22bb5eff88da5319f6170c60669e39eca35. [10:28:58] [02miraheze/mw-config] 07paladox 034a14e8b - Revert "remove old description for wgEnableUploads. Will be re-added when re-enabled" This reverts commit d5ed4e629ed8d61c45c65fc7f29ef2f06d12260a. [10:28:59] [02miraheze/mw-config] ... and 2 more commits. [10:29:59] miraheze/mw-config - paladox the build passed. [10:30:09] !log MariaDB [mhglobal]> update mw_settings set s_settings = REPLACE(s_settings,'wmgEnableUploads', 'wgEnableUploads'); [10:30:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:30:35] !log sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/w/cache/databases.json /home/paladox/resetWikiCaches.php on jobrunner1 [10:30:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:34:52] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures [10:58:35] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jt0xX [10:58:36] [02miraheze/mw-config] 07paladox 03343db2f - Update Sitenotice.php [10:59:36] miraheze/mw-config - paladox the build passed. [12:08:38] PROBLEM - wiki.triplescripts.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.triplescripts.org could not be found [12:08:41] PROBLEM - wiki.scrungecraft.gg - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.scrungecraft.gg could not be found [12:08:41] PROBLEM - wiki.openhatch.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.openhatch.org could not be found [12:08:47] PROBLEM - ndg.nenawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ndg.nenawiki.org could not be found [12:08:49] PROBLEM - wiki.nowchess.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nowchess.org could not be found [12:08:51] PROBLEM - wikilukas.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikilukas.tk could not be found [12:08:54] PROBLEM - www.opendatascot.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.opendatascot.org could not be found [12:08:55] PROBLEM - poserdazfreebies.orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for poserdazfreebies.orain.org could not be found [12:08:55] PROBLEM - wiki.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.miraheze.org could not be found [12:15:15] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtEeN [12:15:17] [02miraheze/services] 07MirahezeSSLBot 03bacdebd - BOT: Updating services config for wikis [12:15:27] RECOVERY - wiki.triplescripts.org - reverse DNS on sslhost is OK: rDNS OK - wiki.triplescripts.org reverse DNS resolves to cp7.miraheze.org [12:15:29] RECOVERY - wiki.nowchess.org - reverse DNS on sslhost is OK: rDNS OK - wiki.nowchess.org reverse DNS resolves to cp7.miraheze.org [12:15:31] RECOVERY - wiki.scrungecraft.gg - reverse DNS on sslhost is OK: rDNS OK - wiki.scrungecraft.gg reverse DNS resolves to cp7.miraheze.org [12:15:32] RECOVERY - wiki.openhatch.org - reverse DNS on sslhost is OK: rDNS OK - wiki.openhatch.org reverse DNS resolves to cp7.miraheze.org [12:15:34] RECOVERY - wikilukas.tk - reverse DNS on sslhost is OK: rDNS OK - wikilukas.tk reverse DNS resolves to cp7.miraheze.org [12:15:37] RECOVERY - www.opendatascot.org - reverse DNS on sslhost is OK: rDNS OK - www.opendatascot.org reverse DNS resolves to cp7.miraheze.org [12:15:40] RECOVERY - poserdazfreebies.orain.org - reverse DNS on sslhost is OK: rDNS OK - poserdazfreebies.orain.org reverse DNS resolves to cp7.miraheze.org [12:15:41] RECOVERY - wiki.miraheze.org - reverse DNS on sslhost is OK: rDNS OK - wiki.miraheze.org reverse DNS resolves to cp7.miraheze.org [12:15:47] RECOVERY - ndg.nenawiki.org - reverse DNS on sslhost is OK: rDNS OK - ndg.nenawiki.org reverse DNS resolves to cp7.miraheze.org [12:16:23] [02miraheze/dns] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtEvJ [12:16:24] [02miraheze/dns] 07Southparkfan 03f5ee1a9 - Revert "Depool cp6" This reverts commit a4ed2b21ae435273779963b3c3c38507565ff0fd. [13:00:19] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 33.47, 24.68, 18.76 [13:02:16] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.10, 22.04, 18.51 [13:04:14] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.06, 23.77, 19.57 [13:06:13] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.32, 21.97, 19.36 [13:10:13] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.87, 19.19, 18.88 [13:39:30] PROBLEM - wiki.globasa.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.globasa.net could not be found [13:39:32] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.lefrenchmelee.fr could not be found [13:39:38] PROBLEM - hi.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hi.gyaanipedia.com could not be found [13:39:38] PROBLEM - meta.nocyclo.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for meta.nocyclo.tk could not be found [13:46:20] RECOVERY - hi.gyaanipedia.com - reverse DNS on sslhost is OK: rDNS OK - hi.gyaanipedia.com reverse DNS resolves to cp7.miraheze.org [13:46:21] RECOVERY - meta.nocyclo.tk - reverse DNS on sslhost is OK: rDNS OK - meta.nocyclo.tk reverse DNS resolves to cp6.miraheze.org [13:46:27] RECOVERY - wiki.globasa.net - reverse DNS on sslhost is OK: rDNS OK - wiki.globasa.net reverse DNS resolves to cp6.miraheze.org [13:46:33] RECOVERY - wiki.lefrenchmelee.fr - reverse DNS on sslhost is OK: rDNS OK - wiki.lefrenchmelee.fr reverse DNS resolves to cp6.miraheze.org [14:15:14] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtELI [14:15:16] [02miraheze/services] 07MirahezeSSLBot 03abe1c3c - BOT: Updating services config for wikis [14:35:57] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.87, 20.11, 18.66 [14:37:55] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.02, 18.26, 18.16 [14:56:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JtEqy [14:56:57] [02miraheze/puppet] 07paladox 03d32f97a - Set ldap2 to use puppet3 [14:57:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JtEqS [14:57:13] [02miraheze/puppet] 07paladox 033ccb35e - Set test3 to use puppet3 [15:04:25] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtEmu [15:04:27] [02miraheze/puppet] 07paladox 03574c709 - Install ldap on ldap2 [15:04:36] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 32.51, 23.05, 19.84 [15:06:36] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.05, 21.04, 19.49 [15:08:34] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 18.16, 20.23, 19.38 [15:10:38] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtEmQ [15:10:39] [02miraheze/puppet] 07paladox 0394b1c11 - Install mediawiki onto test3 [15:20:24] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 27.34, 23.47, 20.70 [15:20:45] PROBLEM - test3 APT on test3 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [15:20:47] PROBLEM - ldap2 Puppet on ldap2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 15 minutes ago with 2 failures. Failed resources (up to 3 shown): Openldap_global_conf[TLSCertificate],Openldap_global_conf[TLSCACertificateFile] [15:20:49] PROBLEM - test3 php-fpm on test3 is CRITICAL: PROCS CRITICAL: 0 processes with command name 'php-fpm7.2' [15:20:50] PROBLEM - test3 Puppet on test3 is UNKNOWN: UNKNOWN: Failed to check. Reason is: no_summary_file [15:21:03] PROBLEM - ldap2 LDAP on ldap2 is CRITICAL: Could not bind to the LDAP server [15:21:06] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 0.009 second response time [15:21:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtEYr [15:21:37] [02miraheze/puppet] 07paladox 030e28326 - gluster: Add test3 to firewall [15:22:48] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 32 failures. Last run 43 seconds ago with 32 failures. Failed resources (up to 3 shown): Package[php7.2-common],Package[php7.2-opcache],Package[php7.2-cli],File[/etc/php/7.2/cli/conf.d] [15:24:23] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.98, 22.39, 20.90 [15:24:42] RECOVERY - test3 APT on test3 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [15:24:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtEYb [15:24:59] [02miraheze/puppet] 07paladox 038bc75b4 - Update test3.yaml [15:26:46] RECOVERY - test3 php-fpm on test3 is OK: PROCS OK: 27 processes with command name 'php-fpm7.3' [15:27:02] PROBLEM - test3 MediaWiki Rendering on test3 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 2500 bytes in 0.005 second response time [15:29:01] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 771 bytes in 0.454 second response time [15:30:20] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.13, 18.47, 19.79 [15:30:43] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [15:36:11] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.26, 20.96, 20.57 [15:41:15] PROBLEM - test3 Check Gluster Clients on test3 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [15:42:11] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.98, 18.23, 19.57 [15:43:53] Hello thepoliceman[m]! If you have any questions, feel free to ask and someone should answer soon. [15:43:56] Hello Miraheze staff members! Today is a great day, Groundhog day, so time for some singing!! Let's have fun together [15:43:59] Can't Stand Losing You - The Police [15:44:06] I called you so many times today [15:44:10] And I guess it's all true what your girlfriends say [15:44:11] That you don't ever want to see me again [15:44:17] And your brother's gonna kill me and he's six feet ten [15:44:22] I guess you'd call it cowardice [15:44:27] But I'm not prepared to go on like this [15:44:37] I can't, I can't, I can't stand losing x6 [15:44:43] I can't, I can't, I can't stand losing x6 [15:44:50] Hello Miraheze staff members! Today is a great day, Groundhog day, so time for some singing!! Let's have fun together [15:44:53] .op [15:44:53] Attempting to OP... [15:44:56] Hello Miraheze staff members! Today is a great day, Groundhog day, so time for some singing!! Let's have fun together [15:45:00] I see you've sent my letters back [15:45:03] And my LP records and they're all scratched [15:45:06] I can't see the point in another day [15:45:08] When nobody listens to a word I say [15:45:11] You can call it lack of confidence [15:45:14] But to carry on living doesn't make no sense [15:50:01] .deop [15:52:40] Hello thepolicenotdone! If you have any questions, feel free to ask and someone should answer soon. [15:52:55] .op [16:02:55] [02mw-config] 07TheAnimals99 opened pull request 03#3700: House of the Rising Sun The Animals, Eric Burdon House of the Rising … - 13https://git.io/JtEsy [16:03:10] [02mw-config] 07Universal-Omega closed pull request 03#3700: House of the Rising Sun The Animals, Eric Burdon House of the Rising … - 13https://git.io/JtEsy [16:03:16] [02mw-config] 07TheAnimals99 opened pull request 03#3701: There is a house in New Orleans They call the Rising Sun And it's bee… - 13https://git.io/JtEsQ [16:03:37] [02mw-config] 07TheAnimals99 opened pull request 03#3702: There is a house in New Orleans They call the Rising Sun And it's bee… - 13https://git.io/JtEsF [16:03:45] [02mw-config] 07Universal-Omega closed pull request 03#3701: There is a house in New Orleans They call the Rising Sun And it's bee… - 13https://git.io/JtEsQ [16:04:06] miraheze/mw-config - TheAnimals99 the build passed. [16:04:07] [02mw-config] 07TheAnimals99 opened pull request 03#3703: There is a house in New Orleans They call the Rising Sun And it's bee… - 13https://git.io/JtEsb [16:04:26] miraheze/mw-config - TheAnimals99 the build passed. [16:04:34] [02mw-config] 07Universal-Omega closed pull request 03#3703: There is a house in New Orleans They call the Rising Sun And it's bee… - 13https://git.io/JtEsb [16:04:41] miraheze/mw-config - TheAnimals99 the build passed. [16:04:52] [02mw-config] 07Universal-Omega closed pull request 03#3702: There is a house in New Orleans They call the Rising Sun And it's bee… - 13https://git.io/JtEsF [16:04:53] [02puppet] 07TheAnimals99 opened pull request 03#1620: COME ON SING WITH ME FOR GROUNDHOG DAY MIRAHEZE!!! COME ON SING WITH … - 13https://git.io/JtEsx [16:05:01] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 30.68, 22.78, 20.34 [16:05:16] miraheze/mw-config - TheAnimals99 the build passed. [16:05:23] [02puppet] 07TheAnimals99 opened pull request 03#1621: There is a house in New Orleans They call the Rising Sun And it's bee… - 13https://git.io/JtEsh [16:05:57] [02puppet] 07paladox closed pull request 03#1620: COME ON SING WITH ME FOR GROUNDHOG DAY MIRAHEZE!!! COME ON SING WITH … - 13https://git.io/JtEsx [16:06:33] !log enabled advanced moderation on Github mw-config to block new users with a 24 hours expiration. [16:06:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:06:59] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 19.50, 21.15, 20.03 [16:10:55] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.00, 22.50, 20.72 [16:12:55] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.34, 21.41, 20.50 [16:16:50] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 19.10, 20.16, 20.21 [16:18:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JtEGj [16:18:59] [02miraheze/puppet] 07paladox 036e79233 - Install mediawiki on mw 8 and 9 [16:20:47] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.39, 22.27, 21.08 [16:20:48] PROBLEM - mw9 php-fpm on mw9 is CRITICAL: PROCS CRITICAL: 0 processes with command name 'php-fpm7.3' [16:20:53] PROBLEM - mw9 Check Gluster Clients on mw9 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [16:20:55] PROBLEM - mw9 MediaWiki Rendering on mw9 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:21:53] PROBLEM - mw9 Puppet on mw9 is UNKNOWN: UNKNOWN: Failed to check. Reason is: no_summary_file [16:22:06] PROBLEM - mw9 HTTPS on mw9 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:22:44] PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 30.40, 23.87, 21.72 [16:22:45] RECOVERY - mw9 php-fpm on mw9 is OK: PROCS OK: 3 processes with command name 'php-fpm7.3' [16:22:48] PROBLEM - mw8 Check Gluster Clients on mw8 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [16:22:51] PROBLEM - mw8 HTTPS on mw8 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:12] PROBLEM - mw8 MediaWiki Rendering on mw8 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:24:43] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 16.87, 20.94, 20.91 [16:27:15] Universal_Omega: What do you mean, testing? [16:28:39] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.72, 19.44, 20.39 [16:28:45] Universal_Omega: What.....do......you.....mean......TESTING! [16:29:21] Don't need to discuss this here @blackwidowmovie0 [16:29:32] .op [16:29:40] Universal_Omega: DM me [16:29:46] Discord or IRC works [16:29:51] I did on Discord [16:29:53] ok [16:30:24] @blackwidowmovie0 Please remember to check your DMs on all platforms before asking someone to DM you. Thanks! [16:30:34]