[00:01:40] <MacFanBot>	 [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/cb224a10e8173d343f4ee433ab4013726ec6cc42
[00:01:40] <MacFanBot>	 02statichelp/03main 07WikiTideBot 03cb224a1 Bot: Auto-update Tech namespace pages 2025-11-08 00:01:34
[00:06:20] <icinga-miraheze>	 [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?from=1762556750000&orgId=1&to=1762560380039
[00:08:01] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 12.76, 14.76, 11.80
[00:09:56] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 6.39, 11.68, 11.02
[00:13:26] <icinga-miraheze>	 RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 67910MiB (14% inode=99%);
[00:13:46] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.44, 8.29, 9.77
[00:14:50] <icinga-miraheze>	 RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 67938MiB (14% inode=99%);
[00:14:56] <icinga-miraheze>	 RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 68986MiB (15% inode=99%);
[00:21:20] <icinga-miraheze>	 [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?from=1762557410000&orgId=1&to=1762561010000
[00:23:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 18.17, 13.15, 10.59
[00:31:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 6.56, 11.76, 11.77
[00:34:35] <MacFanBot>	 [02ssl] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/19c4f542e2aedfab1c56e1f094b583761e019b92
[00:34:35] <MacFanBot>	 02ssl/03main 07Skye 0319c4f54 Update redirect for blindspacewiki
[00:35:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 15.71, 12.69, 11.94
[00:39:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.91, 11.43, 11.75
[00:45:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.80, 7.58, 9.89
[01:00:57] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is CRITICAL: LOAD CRITICAL - total load average: 26.54, 22.32, 18.90
[01:02:54] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 19.55, 21.07, 18.85
[01:08:51] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.38, 21.14, 18.98
[01:10:41] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 19.49, 19.85, 19.20
[01:10:48] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 14.82, 18.52, 18.27
[01:16:20] <icinga-miraheze>	 [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?from=1762560950000&orgId=1&to=1762564580037
[01:21:20] <icinga-miraheze>	 [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?from=1762560950000&orgId=1&to=1762564670000
[01:22:52] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 22.69, 19.05, 16.82
[01:24:52] <icinga-miraheze>	 RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 10.70, 16.30, 16.13
[01:37:57] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.40, 20.79, 18.51
[01:39:57] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 15.90, 18.73, 18.03
[02:03:20] <icinga-miraheze>	 [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?from=1762563770000&orgId=1&to=1762567400040
[02:08:20] <icinga-miraheze>	 [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?from=1762563770000&orgId=1&to=1762567670000
[02:34:49] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 21.40, 14.28, 10.53
[02:36:44] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 8.16, 11.83, 10.09
[02:38:39] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 7.11, 10.11, 9.64
[02:48:16] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 11.66, 11.65, 10.30
[02:54:01] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 15.22, 14.31, 11.74
[02:55:56] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 8.07, 11.76, 11.10
[02:59:47] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.69, 8.64, 9.97
[04:19:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 13.40, 11.17, 8.50
[04:21:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 4.40, 8.57, 7.87
[04:29:34] <MirahezeRelay>	 <pskyechology> https://gif.fxtwitter.com/tweet_video/Gyz103BXgAAbd7D.gif
[04:40:19] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 11.94, 10.37, 8.77
[04:42:14] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 8.22, 9.77, 8.75
[04:42:32] <icinga-miraheze>	 PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.33, 9.25, 7.04
[04:44:32] <icinga-miraheze>	 RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 7.37, 8.51, 7.04
[04:45:02] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.41, 19.76, 14.79
[04:47:02] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 10.39, 16.59, 14.27
[04:48:00] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 8.07, 10.52, 9.61
[04:49:55] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 7.21, 9.51, 9.34
[05:25:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.94, 10.39, 9.08
[05:27:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 17.10, 11.60, 9.58
[05:29:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 9.58, 10.89, 9.59
[05:35:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 6.95, 9.86, 9.73
[05:39:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.83, 10.79, 10.45
[05:39:57] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 21.73, 19.23, 16.51
[05:41:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 6.17, 9.02, 9.83
[05:41:57] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 15.96, 17.87, 16.34
[05:59:44] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 20.17, 12.15, 9.85
[06:03:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.00, 10.27, 9.78
[06:05:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.52, 8.51, 9.19
[06:17:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 24.88, 15.16, 10.94
[06:25:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 5.00, 11.80, 11.53
[06:27:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 12.18, 12.29, 11.74
[06:29:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 9.21, 11.24, 11.42
[06:35:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 6.12, 8.51, 10.12
[07:25:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 19.85, 12.08, 9.16
[07:29:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.49, 10.55, 9.26
[07:31:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 9.79, 10.09, 9.22
[08:21:12] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 31.83, 17.38, 12.48
[08:26:57] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 5.54, 11.68, 11.54
[08:28:52] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 28.20, 16.68, 13.27
[08:40:22] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 6.70, 9.87, 11.59
[08:42:17] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 31.60, 14.25, 12.77
[08:46:07] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 5.86, 10.65, 11.75
[08:53:48] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 12.61, 12.27, 11.81
[08:55:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.69, 10.49, 11.21
[08:59:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 4.20, 7.45, 9.83
[09:55:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 8.70, 10.88, 8.28
[09:59:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 6.99, 9.34, 8.30
[10:09:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 6.01, 10.43, 9.49
[10:11:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 4.65, 8.58, 8.94
[10:35:25] <MacFanBot>	 [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/37e1cc5fc0af9f491ae3ec61de1cfe8d68411846
[10:35:25] <MacFanBot>	 02ssl/03main 07WikiTideBot 0337e1cc5 Bot: Auto-update domain lists
[10:54:50] <icinga-miraheze>	 PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49762MiB (10% inode=99%);
[11:15:26] <icinga-miraheze>	 PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49850MiB (10% inode=99%);
[11:31:55] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 8.01, 10.82, 9.60
[11:33:50] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 6.60, 9.22, 9.15
[11:36:56] <icinga-miraheze>	 PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49896MiB (10% inode=99%);
[11:55:56] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 15.80, 13.71, 10.89
[11:57:51] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.73, 11.32, 10.34
[11:59:46] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.69, 9.20, 9.67
[12:26:04] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 13.53, 10.78, 9.21
[12:27:59] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 8.37, 9.99, 9.12
[15:02:39] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 21.18, 17.71, 13.17
[15:04:39] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 15.95, 16.76, 13.37
[15:26:47] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 8.85, 11.03, 9.07
[15:27:09] <MacFanBot>	 [02puppet] 07Honoka55 opened pull request #4593: CSP: add testingcf.jsdelivr.net (07miraheze:03main...07PGW-MH:03main) 13https://github.com/miraheze/puppet/pull/4593
[15:27:19] <MacFanBot>	 [02puppet] 07coderabbitai[bot] commented on pull request #4593: <details> […] 13https://github.com/miraheze/puppet/pull/4593#issuecomment-3506639391
[15:28:42] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 14.75, 12.83, 9.95
[15:34:27] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 3.99, 9.39, 9.72
[15:35:19] <MacFanBot>	 [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/b9d643773fbfc1ad66a4be18f99a88aeda86a44e
[15:35:19] <MacFanBot>	 02ssl/03main 07WikiTideBot 03b9d6437 Bot: Auto-update domain lists
[15:42:10] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 4.74, 9.89, 10.27
[15:42:39] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.09, 20.79, 18.26
[15:44:05] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 6.59, 9.03, 9.92
[15:44:39] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 19.04, 19.95, 18.26
[16:00:24] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 10.18, 11.13, 9.97
[16:02:19] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 7.68, 9.68, 9.56
[16:06:11] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 14.83, 13.15, 11.02
[16:07:57] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 20.48, 19.57, 18.00
[16:08:06] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.22, 10.76, 10.39
[16:09:57] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 18.33, 18.98, 17.96
[16:10:01] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.10, 8.84, 9.72
[16:17:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 16.09, 12.76, 10.57
[16:25:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 5.67, 10.77, 11.18
[16:29:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 4.40, 7.17, 9.59
[16:52:10] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 14.01, 8.55, 7.64
[16:54:05] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.47, 7.20, 7.25
[17:15:21] <MacFanBot>	 [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/6c9690343ab632606133f19b13217e776c178a08
[17:15:21] <MacFanBot>	 02ssl/03main 07WikiTideBot 036c96903 Bot: Auto-update domain lists
[17:18:05] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 22.49, 18.77, 16.30
[17:20:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.62, 18.74, 15.54
[17:21:08] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.20, 19.93, 16.82
[17:21:28] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 21.12, 18.17, 14.78
[17:22:24] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 21.59, 20.06, 17.12
[17:22:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 16.70, 18.48, 15.88
[17:23:28] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 14.44, 16.42, 14.55
[17:23:57] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 14.59, 19.55, 17.71
[17:24:24] <icinga-miraheze>	 RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 17.52, 18.79, 17.00
[17:25:02] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 14.62, 18.19, 16.91
[17:39:39] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 20.51, 19.37, 18.13
[17:40:24] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 19.24, 20.58, 19.27
[17:40:38] <icinga-miraheze>	 PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 22.48, 20.61, 18.39
[17:41:36] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 18.80, 18.50, 17.92
[17:42:24] <icinga-miraheze>	 RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 20.31, 20.25, 19.29
[17:42:38] <icinga-miraheze>	 RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 17.64, 19.37, 18.20
[17:44:38] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.43, 21.34, 19.58
[17:46:24] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 22.40, 21.42, 20.00
[17:46:45] <icinga-miraheze>	 PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 23.02, 19.07, 16.31
[17:47:25] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.83, 20.77, 19.04
[17:48:32] <icinga-miraheze>	 PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 21.93, 20.80, 18.17
[17:49:50] <MirahezeLSBot>	 !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php CreateWiki:SetContainersAccess --wiki=snxyzmetawiki (END - exit=0)
[17:50:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:50:24] <Skye>	 uhoh
[17:50:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.81, 20.93, 18.24
[17:50:32] <icinga-miraheze>	 RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 19.40, 20.31, 18.32
[17:50:32] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.43, 21.29, 19.04
[17:50:45] <icinga-miraheze>	 RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 19.17, 20.28, 17.51
[17:54:35] <icinga-miraheze>	 PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 22.91, 20.52, 19.10
[17:56:21] <icinga-miraheze>	 PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 22.52, 19.99, 18.03
[17:56:24] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is CRITICAL: LOAD CRITICAL - total load average: 24.75, 23.64, 21.83
[17:57:24] <icinga-miraheze>	 PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 21.55, 21.26, 19.44
[17:57:28] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 23.16, 20.26, 17.49
[17:58:21] <icinga-miraheze>	 RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 17.00, 19.01, 17.93
[17:58:24] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 23.20, 23.49, 22.00
[17:58:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 16.52, 19.44, 18.85
[17:58:34] <icinga-miraheze>	 RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 19.16, 19.94, 19.22
[17:58:45] <icinga-miraheze>	 PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 22.91, 21.46, 19.05
[17:59:28] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 16.11, 18.50, 17.18
[18:00:50] <icinga-miraheze>	 [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?from=1762621220000&orgId=1&to=1762624850039
[18:01:05] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.85, 23.46, 21.61
[18:03:02] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.53, 23.49, 21.85
[18:03:11] <icinga-miraheze>	 RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 18.48, 20.27, 19.59
[18:06:45] <icinga-miraheze>	 RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 17.39, 19.45, 19.25
[18:08:21] <icinga-miraheze>	 PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 20.01, 20.54, 19.04
[18:08:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 20.62, 20.30, 19.39
[18:10:16] <icinga-miraheze>	 RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 17.73, 19.47, 20.16
[18:10:21] <icinga-miraheze>	 RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 15.51, 18.94, 18.66
[18:10:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 17.58, 19.60, 19.27
[18:10:31] <icinga-miraheze>	 PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 23.68, 21.77, 20.16
[18:12:30] <icinga-miraheze>	 RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 17.15, 20.10, 19.75
[18:14:11] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 22.66, 21.07, 20.68
[18:20:45] <icinga-miraheze>	 PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 20.70, 19.82, 19.04
[18:20:58] <MirahezeRelay>	 <pskyechology, replying to paladox> what was the hack? this happened again with snxyzmetawiki after a rename and reset combo
[18:22:24] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 8.68, 10.44, 8.20
[18:22:45] <icinga-miraheze>	 RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 16.03, 18.74, 18.77
[18:23:38] <icinga-miraheze>	 PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 20.88, 20.16, 18.23
[18:24:19] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.14, 8.61, 7.80
[18:25:38] <icinga-miraheze>	 RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 18.20, 18.79, 17.93
[18:26:45] <icinga-miraheze>	 PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 20.66, 19.62, 19.09
[18:28:10] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 5.28, 11.23, 9.53
[18:28:45] <icinga-miraheze>	 RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 16.15, 17.99, 18.54
[18:30:05] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 4.65, 9.08, 8.94
[18:30:39] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.04, 22.05, 21.83
[18:31:57] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 16.30, 18.47, 20.13
[18:32:39] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.91, 22.37, 21.98
[18:33:56] <icinga-miraheze>	 RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 16.93, 19.26, 20.26
[18:34:24] <icinga-miraheze>	 RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 15.40, 18.36, 20.28
[18:35:57] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.32, 20.79, 20.66
[18:38:47] <icinga-miraheze>	 PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push
[18:39:52] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.60, 20.81, 20.45
[18:40:23] <icinga-miraheze>	 PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 23.24, 19.62, 18.44
[18:40:39] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 14.30, 17.94, 20.16
[18:41:51] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is CRITICAL: LOAD CRITICAL - total load average: 24.02, 21.93, 20.90
[18:41:57] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 16.70, 19.09, 20.07
[18:42:23] <icinga-miraheze>	 RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 17.11, 18.57, 18.21
[18:43:49] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.31, 22.32, 21.17
[18:46:47] <icinga-miraheze>	 RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push
[18:49:45] <icinga-miraheze>	 RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 19.66, 19.58, 20.29
[18:53:40] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 21.49, 20.36, 20.40
[18:55:38] <icinga-miraheze>	 RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 18.01, 19.69, 20.17
[19:02:39] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.04, 21.11, 20.00
[19:07:27] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.48, 20.37, 19.79
[19:09:26] <icinga-miraheze>	 RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 18.19, 19.95, 19.75
[19:10:43] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 23.47, 20.64, 19.01
[19:11:15] <icinga-miraheze>	 PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 22.74, 20.18, 18.86
[19:12:37] <icinga-miraheze>	 RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 14.16, 18.41, 18.42
[19:13:15] <icinga-miraheze>	 RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 20.00, 19.51, 18.74
[19:18:24] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 23.42, 21.13, 19.54
[19:18:39] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 18.45, 19.68, 20.19
[19:24:24] <icinga-miraheze>	 RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 16.55, 19.51, 19.49
[19:24:39] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.19, 21.40, 20.70
[19:27:33] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 21.39, 18.16, 15.66
[19:28:24] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 21.11, 20.84, 20.11
[19:28:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 21.55, 19.81, 17.57
[19:29:31] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 15.60, 16.95, 15.51
[19:31:34] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 20.89, 20.56, 19.49
[19:34:00] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 19.63, 20.55, 20.18
[19:34:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 16.86, 19.56, 18.34
[19:35:38] <icinga-miraheze>	 PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 21.77, 20.64, 18.32
[19:35:59] <icinga-miraheze>	 RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 19.41, 20.22, 20.11
[19:37:38] <icinga-miraheze>	 RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 18.48, 19.94, 18.35
[19:38:08] <icinga-miraheze>	 PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 22.03, 19.86, 18.48
[19:39:54] <icinga-miraheze>	 PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 22.22, 21.11, 20.49
[19:40:45] <icinga-miraheze>	 PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 22.55, 21.06, 18.86
[19:41:38] <icinga-miraheze>	 PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 22.83, 20.98, 19.07
[19:41:43] <icinga-miraheze>	 PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 22.31, 19.26, 16.66
[19:41:44] <icinga-miraheze>	 PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 22.93, 18.77, 15.84
[19:42:21] <icinga-miraheze>	 PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 22.08, 19.77, 17.74
[19:42:22] <icinga-miraheze>	 PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 22.44, 19.45, 16.31
[19:42:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.05, 20.65, 19.18
[19:42:32] <icinga-miraheze>	 PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 22.23, 20.46, 18.15
[19:43:28] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 21.09, 19.67, 17.61
[19:43:44] <icinga-miraheze>	 RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 20.35, 19.39, 16.44
[19:44:21] <icinga-miraheze>	 RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 17.67, 19.13, 17.78
[19:44:22] <icinga-miraheze>	 RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 18.32, 18.66, 16.39
[19:44:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 19.01, 20.20, 19.21
[19:45:28] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 16.42, 18.48, 17.43
[19:45:43] <icinga-miraheze>	 RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 19.59, 20.39, 17.77
[19:48:22] <icinga-miraheze>	 PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 22.46, 20.51, 17.65
[19:48:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.20, 21.14, 19.81
[19:49:38] <icinga-miraheze>	 RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 16.99, 19.41, 19.32
[19:50:06] <icinga-miraheze>	 RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 16.31, 19.47, 19.59
[19:50:22] <icinga-miraheze>	 RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 15.43, 19.10, 17.52
[19:50:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 17.00, 19.71, 19.45
[19:50:32] <icinga-miraheze>	 RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 18.35, 19.68, 18.84
[19:52:45] <icinga-miraheze>	 RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 15.19, 19.27, 19.61
[19:54:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.51, 20.72, 19.86
[20:00:24] <icinga-miraheze>	 RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 15.91, 19.16, 20.38
[20:00:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 14.14, 19.14, 19.71
[20:00:46] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 15.90, 18.80, 20.19
[20:04:37] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.05, 20.92, 20.72
[20:11:00] <icinga-miraheze>	 PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 23.04, 20.37, 19.36
[20:12:24] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 16.47, 19.02, 20.17
[20:13:00] <icinga-miraheze>	 RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 15.08, 18.22, 18.71
[20:13:27] <icinga-miraheze>	 RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 14.72, 18.36, 19.90
[20:14:45] <icinga-miraheze>	 PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 23.35, 20.35, 18.90
[20:16:45] <icinga-miraheze>	 RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 17.80, 19.62, 18.84
[20:17:46] <MirahezeRelay>	 <bartomelow> what servers do you guys think are the ones that always has some type of problem
[20:18:24] <icinga-miraheze>	 PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 20.45, 19.74, 19.38
[20:18:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.15, 19.33, 18.74
[20:18:39] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 19.11, 19.39, 20.35
[20:20:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 17.98, 18.64, 18.56
[20:24:24] <icinga-miraheze>	 RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 18.28, 19.28, 19.30
[20:26:30] <icinga-miraheze>	 PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.49, 20.36, 19.25
[20:26:47] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 6.69, 11.24, 9.30
[20:28:42] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.46, 9.40, 8.86
[20:30:30] <icinga-miraheze>	 RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 14.03, 18.10, 18.69
[20:42:09] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 12.81, 11.38, 9.49
[20:44:04] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.39, 9.13, 8.89
[20:53:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 11.13, 12.36, 10.47
[20:57:43] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 6.82, 10.06, 9.98
[21:04:28] <MirahezeLSBot>	 !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php MirahezeMagic:GenerateMirahezeSitemap --wiki=iliadwiki (END - exit=0)
[21:04:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:10:50] <icinga-miraheze>	 [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?from=1762621220000&orgId=1&to=1762636070000
[21:12:50] <icinga-miraheze>	 PROBLEM - cp201 Disk Space on cp201 is CRITICAL: DISK CRITICAL - free space: / 27138MiB (5% inode=99%);
[21:45:09] <MirahezeRelay>	 <pskyechology> is it just me or is graylog kinda cooked
[21:46:09] <MirahezeRelay>	 <zppix, replying to pskyechology> Where we are going, we dont need logs 😛
[21:47:26] <icinga-miraheze>	 PROBLEM - cp171 Disk Space on cp171 is CRITICAL: DISK CRITICAL - free space: / 27221MiB (5% inode=99%);
[21:48:09] <MirahezeRelay>	 <pskyechology, replying to zppix> uhhh yea we do
[21:48:21] <MirahezeRelay>	 <zppix, replying to pskyechology> Fine smh
[21:52:56] <icinga-miraheze>	 PROBLEM - cp191 Disk Space on cp191 is CRITICAL: DISK CRITICAL - free space: / 27228MiB (5% inode=99%);
[21:56:36] <MirahezeRelay>	 <pskyechology> something is very wrong
[22:13:26] <icinga-miraheze>	 RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 66768MiB (14% inode=99%);
[22:14:56] <icinga-miraheze>	 RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 67166MiB (14% inode=99%);
[22:25:17] <MacFanBot>	 [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/54e377e3006ef089501461b7cdeb7a2875d81fb0
[22:25:17] <MacFanBot>	 02ssl/03main 07WikiTideBot 0354e377e Bot: Auto-update domain lists