[00:00:57] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/5109dc0395d0396faab0b24fc64b0b1fd3314236 [00:00:57] 02statichelp/03main 07WikiTideBot 035109dc0 Bot: Auto-update Tech namespace pages 2026-03-04 00:00:55 [00:48:29] PROBLEM - mw173 MediaWiki Rendering on mw173 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:48:41] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw173 [00:48:44] PROBLEM - mw173 HTTPS on mw173 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:48:57] PROBLEM - mw173 Current Load on mw173 is CRITICAL: LOAD CRITICAL - total load average: 55.86, 28.50, 13.58 [00:49:28] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 1 backends are down. mw173 [00:50:23] RECOVERY - mw173 MediaWiki Rendering on mw173 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.168 second response time [00:50:41] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 31 backends are healthy [00:50:41] RECOVERY - mw173 HTTPS on mw173 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4308 bytes in 0.068 second response time [00:50:53] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 11.14, 20.36, 12.34 [00:51:28] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [01:08:16] wtf they doin to mw173 [01:29:22] [02ssl] 07emwe39 opened pull request #905: Redirect kaiserreich.miraheze.org to kaiserreich.wiki (07miraheze:03main...07emwe39:03patch-1) 13https://github.com/miraheze/ssl/pull/905 [01:31:32] [02ssl] 07pskyechology approved pull request #905: Thank you! 13https://github.com/miraheze/ssl/pull/905#pullrequestreview-3886236819 [01:31:36] [02ssl] 07coderabbitai[bot] commented on pull request #905: No actionable comments were generated in the recent review. 🎉 […] 13https://github.com/miraheze/ssl/pull/905#issuecomment-3994667475 [01:31:41] [02ssl] 07pskyechology merged 07emwe39's pull request #905: Redirect kaiserreich.miraheze.org to kaiserreich.wiki (07miraheze:03main...07emwe39:03patch-1) 13https://github.com/miraheze/ssl/pull/905 [01:31:41] [02ssl] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/383ba9a896019884452181b616d2d7c4d97b89f8 [01:31:42] 02ssl/03main 07~mw~ 03383ba9a Redirect kaiserreich.miraheze.org to kaiserreich.wiki (#905)… [06:34:56] !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php CreateWiki:SetContainersAccess --wiki=zeroerawiki (END - exit=0) [06:34:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:00:22] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/2bc17adaec6a1f4cf21b5881f41c11cd09c03ebf [07:00:22] 02ssl/03main 07WikiTideBot 032bc17ad Bot: Auto-update domain lists [07:13:09] PROBLEM - swiftproxy171 Check unit status of swift-container-stats_mw-media on swiftproxy171 is CRITICAL: CRITICAL: Status of the systemd unit swift-container-stats_mw-media [07:21:07] RECOVERY - swiftproxy171 Check unit status of swift-container-stats_mw-media on swiftproxy171 is OK: OK: Status of the systemd unit swift-container-stats_mw-media [11:05:29] [Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772618690000&orgId=1&to=1772622329115 [11:10:29] [Grafana] RESOLVED: DatasourceError https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772618690000&orgId=1&to=1772622350000 [14:00:34] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/708a4e41e54f7e71e9f348e578e133dde2e72815 [14:00:35] 02ssl/03main 07WikiTideBot 03708a4e4 Bot: Auto-update domain lists [17:04:01] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [17:11:29] [Grafana] FIRING: An unusually high number of threats are being reported by CloudFlare! https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772640660000&orgId=1&to=1772644289031[Grafana] FIRING: A MediaWiki pool is sick according to CloudFlare https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772640660000&orgId=1&to=1772644289031[Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time p [17:11:29] s://grafana.wikitide.net/d/GtxbP1Xnk?from=1772640650000&orgId=1&to=1772644289031 [17:16:29] [Grafana] FIRING: An unusually high number of threats are being reported by CloudFlare! https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772640660000&orgId=1&to=1772644589032[Grafana] FIRING: A MediaWiki pool is sick according to CloudFlare https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772640660000&orgId=1&to=1772644589032[Grafana] RESOLVED: DatasourceError https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772640650000&orgId=1&to=1772644310 [17:32:01] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [17:42:51] PROBLEM - llm191 Puppet on llm191 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[openwebui] [17:51:29] [Grafana] RESOLVED: DatasourceError https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772640660000&orgId=1&to=1772646660000[Grafana] RESOLVED: DatasourceError https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772640660000&orgId=1&to=1772646660000 [17:59:07] [02TSPortal] 07renovate[bot] created 03renovate/github-actions (+1 new commit) 13https://github.com/miraheze/TSPortal/commit/c947d9278289 [17:59:07] 02TSPortal/03renovate/github-actions 07renovate[bot] 03c947d92 Update shivammathur/setup-php digest to 650d05d [18:10:51] RECOVERY - llm191 Puppet on llm191 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [18:45:50] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 11.50, 8.97, 4.28 [18:47:50] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 2.76, 6.47, 3.93 [18:48:39] PROBLEM - mon181 Puppet on mon181 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 13 minutes ago with 0 failures [18:49:34] PROBLEM - mon181 HTTPS on mon181 is WARNING: HTTP WARNING: HTTP/2 401 - 162 bytes in 0.008 second response time [18:50:14] PROBLEM - mon181 grafana.wikitide.net HTTPS on mon181 is WARNING: HTTP WARNING: HTTP/1.1 401 Unauthorized - 367 bytes in 0.011 second response time [18:53:03] !log created a hack in puppet folder on puppet181 [18:53:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:54:39] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:00:22] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/fbbd876862e4a3d2e0ad24085dbd9564b2df8dd8 [19:00:22] 02ssl/03main 07WikiTideBot 03fbbd876 Bot: Auto-update domain lists [19:34:28] [02TSPortal] 07Universal-Omega merged pull request #61: Improvements/fixes to investigation events (03main...03investigation-events) 13https://github.com/miraheze/TSPortal/pull/61 [19:34:28] [02TSPortal] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/TSPortal/commit/d83d58f86387c92d524dc587ea5b31cefeb1cd4a [19:34:30] 02TSPortal/03main 07CosmicAlpha 03d83d58f Improvements/fixes to investigation events… [19:34:32] [02TSPortal] 07Universal-Omega 04deleted 03investigation-events at 03625213c 13https://api.github.com/repos/miraheze/TSPortal/commit/625213c [19:35:07] [02TSPortal] 07renovate[bot] 04force-pushed 03renovate/github-actions from 03c947d92 to 036a4a7f4 13https://api.github.com/repos/miraheze/TSPortal/commits/renovate/github-actions [19:35:07] 02TSPortal/03renovate/github-actions 07renovate[bot] 036a4a7f4 Update shivammathur/setup-php digest to 650d05d [19:35:14] [02TSPortal] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/TSPortal/commit/d32e47c7a895f7a8c37a07304f6117ef069ec38a [19:35:14] 02TSPortal/03main 07CosmicAlpha 03d32e47c Bump version [19:42:39] [02TSPortal] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/TSPortal/commit/6dd9a68ce2488c06815a775554486c44590b746f [19:42:39] 02TSPortal/03main 07CosmicAlpha 036dd9a68 Start Version 30 in CHANGELOG [20:06:17] [02TSPortal] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/TSPortal/commit/0cee33cba476259eb34b20b631a0ecdc7f7664af [20:06:17] 02TSPortal/03main 07CosmicAlpha 030cee33c Merge commit from fork [20:07:13] [02TSPortal] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/TSPortal/commit/37f162c637e129c111fa513e3f9c60bccf32b6cb [20:07:13] 02TSPortal/03main 07CosmicAlpha 0337f162c Add CHANGELOG entry [20:08:39] [02TSPortal] 07Universal-Omega released Version 30 13https://github.com/miraheze/TSPortal/releases/tag/v30 [20:08:40] [02TSPortal] 07Universal-Omega tagged 03v30 at 03main 13https://github.com/miraheze/TSPortal/compare/v30 [20:13:15] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/cb9dffade4c476c98150a2a2c99f997a2bd7ec20 [20:13:15] 02puppet/03main 07CosmicAlpha 03cb9dffa Update TSPortal to v30 [21:35:26] [02TSPortal] 07renovate[bot] 04force-pushed 03renovate/github-actions from 036a4a7f4 to 03383a3a2 13https://api.github.com/repos/miraheze/TSPortal/commits/renovate/github-actions [21:35:26] 02TSPortal/03renovate/github-actions 07renovate[bot] 03383a3a2 Update shivammathur/setup-php digest to 650d05d [21:45:12] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php MirahezeMagic:GenerateMirahezeSitemap --wiki=superstarracerswiki (END - exit=0) [21:45:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:12:55] [02CreateWiki] 07dependabot[bot] created 03dependabot/npm_and_yarn/svgo-4.0.1 (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/da226493ba21 [22:12:55] 02CreateWiki/03dependabot/npm_and_yarn/svgo-4.0.1 07dependabot[bot] 03da22649 Bump svgo from 4.0.0 to 4.0.1… [22:12:56] [02CreateWiki] 07dependabot[bot] opened pull request #810: Bump svgo from 4.0.0 to 4.0.1 (03main...03dependabot/npm_and_yarn/svgo-4.0.1) 13https://github.com/miraheze/CreateWiki/pull/810 [22:12:56] [02CreateWiki] 07dependabot[bot] added the label 'dependencies' to pull request #810 (Bump svgo from 4.0.0 to 4.0.1) 13https://github.com/miraheze/CreateWiki/pull/810 [22:12:58] [02CreateWiki] 07dependabot[bot] added the label 'dependencies' to pull request #810 (Bump svgo from 4.0.0 to 4.0.1) 13https://github.com/miraheze/CreateWiki/pull/810 [22:13:00] [02CreateWiki] 07dependabot[bot] added the label 'javascript' to pull request #810 (Bump svgo from 4.0.0 to 4.0.1) 13https://github.com/miraheze/CreateWiki/pull/810 [22:13:02] [02CreateWiki] 07dependabot[bot] added the label 'javascript' to pull request #810 (Bump svgo from 4.0.0 to 4.0.1) 13https://github.com/miraheze/CreateWiki/pull/810 [22:21:53] miraheze/CreateWiki - dependabot[bot] the build passed. [23:00:41] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/b68fdac2eccb036642be4162b264912f2dd992fc [23:00:41] 02ssl/03main 07WikiTideBot 03b68fdac Bot: Auto-update domain lists [23:12:41] [02landing] 07dependabot[bot] created 03dependabot/npm_and_yarn/svgo-4.0.1 (+1 new commit) 13https://github.com/miraheze/landing/commit/1aa6d3bc7a7c [23:12:41] 02landing/03dependabot/npm_and_yarn/svgo-4.0.1 07dependabot[bot] 031aa6d3b Bump svgo from 4.0.0 to 4.0.1… [23:12:42] [02landing] 07dependabot[bot] added the label 'javascript' to pull request #192 (Bump svgo from 4.0.0 to 4.0.1) 13https://github.com/miraheze/landing/pull/192 [23:12:44] [02landing] 07dependabot[bot] added the label 'dependencies' to pull request #192 (Bump svgo from 4.0.0 to 4.0.1) 13https://github.com/miraheze/landing/pull/192 [23:12:46] [02landing] 07dependabot[bot] added the label 'dependencies' to pull request #192 (Bump svgo from 4.0.0 to 4.0.1) 13https://github.com/miraheze/landing/pull/192 [23:12:48] [02landing] 07dependabot[bot] opened pull request #192: Bump svgo from 4.0.0 to 4.0.1 (03main...03dependabot/npm_and_yarn/svgo-4.0.1) 13https://github.com/miraheze/landing/pull/192 [23:12:50] [02landing] 07dependabot[bot] added the label 'javascript' to pull request #192 (Bump svgo from 4.0.0 to 4.0.1) 13https://github.com/miraheze/landing/pull/192 [23:13:18] [02landing] 07renovate[bot] created 03renovate/npm-svgo-vulnerability (+1 new commit) 13https://github.com/miraheze/landing/commit/a651d1673bcc [23:13:18] 02landing/03renovate/npm-svgo-vulnerability 07renovate[bot] 03a651d16 Update dependency svgo to v4.0.1 [SECURITY] [23:13:38] miraheze/landing - dependabot[bot] the build passed. [23:17:53] [02CreateWiki] 07Universal-Omega merged 07dependabot[bot]'s pull request #810: Bump svgo from 4.0.0 to 4.0.1 (03main...03dependabot/npm_and_yarn/svgo-4.0.1) 13https://github.com/miraheze/CreateWiki/pull/810 [23:17:53] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/2a59fec9b88aea58c356d6496a12dbd7cefa19e7 [23:17:54] 02CreateWiki/03main 07dependabot[bot] 032a59fec Bump svgo from 4.0.0 to 4.0.1 (#810)… [23:17:56] [02CreateWiki] 07Universal-Omega 04deleted 03dependabot/npm_and_yarn/svgo-4.0.1 at 03da22649 13https://api.github.com/repos/miraheze/CreateWiki/commit/da22649 [23:20:11] [02landing] 07renovate[bot] pushed 1 new commit to 03main 13https://github.com/miraheze/landing/commit/a651d1673bcc005de71922dbe4e842ec99acf284 [23:20:11] 02landing/03main 07renovate[bot] 03a651d16 Update dependency svgo to v4.0.1 [SECURITY] [23:20:12] [02landing] 07renovate[bot] 04deleted 03renovate/npm-svgo-vulnerability at 03a651d16 13https://api.github.com/repos/miraheze/landing/commit/a651d16 [23:20:32] [02landing] 07Universal-Omega commented on pull request #192: @dependabot rebase 13https://github.com/miraheze/landing/pull/192#issuecomment-4000921940 [23:21:12] [02landing] 07dependabot[bot] commented on pull request #192: Looks like svgo is up-to-date now, so this is no longer needed. 13https://github.com/miraheze/landing/pull/192#issuecomment-4000924417 [23:21:13] [02landing] 07dependabot[bot] closed pull request #192: Bump svgo from 4.0.0 to 4.0.1 (03main...03dependabot/npm_and_yarn/svgo-4.0.1) 13https://github.com/miraheze/landing/pull/192 [23:21:14] [02landing] 07dependabot[bot] 04deleted 03dependabot/npm_and_yarn/svgo-4.0.1 at 031aa6d3b 13https://api.github.com/repos/miraheze/landing/commit/1aa6d3b [23:21:33] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php MirahezeMagic:GenerateMirahezeSitemap --wiki=superblox64wiki (END - exit=0) [23:22:08] !log [petramagna@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php MirahezeMagic:GenerateMirahezeSitemap --wiki=ablocksjourneywiki (END - exit=0) [23:22:11] miraheze/landing - renovate[bot] the build passed. [23:27:20] miraheze/CreateWiki - Universal-Omega the build passed. [23:55:29] [Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1772664890000&orgId=1&to=1772668529211