[00:00:22] RECOVERY - matomo151 Check unit status of matomo-archiver-1 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-1 [00:01:01] RECOVERY - matomo151 Check unit status of matomo-archiver-2 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-2 [00:01:21] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/7e9d69d1d0727f3f6810b5bef0338d5e90246dc1 [00:01:21] 02statichelp/03main 07WikiTideBot 037e9d69d Bot: Auto-update Tech namespace pages 2025-10-17 00:01:18 [00:03:07] RECOVERY - matomo151 Check unit status of matomo-archiver-3 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-3 [00:04:50] PROBLEM - cp171 Disk Space on cp171 is CRITICAL: DISK CRITICAL - free space: / 26938MiB (5% inode=99%); [00:06:38] [02mw-config] 07NotAracham opened pull request #6145: Adding IWD entry for Wiki.gg (07miraheze:03main...07NotAracham:03WikiGG_IWD) 13https://github.com/miraheze/mw-config/pull/6145 [00:07:58] miraheze/mw-config - NotAracham the build passed. [00:10:50] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 60555MiB (13% inode=99%); [00:12:05] [02mw-config] 07pskyechology approved pull request #6145: looks good and matches wiki.gg url structure (incl. i18n variants) […] 13https://github.com/miraheze/mw-config/pull/6145#pullrequestreview-3347505895 [00:12:54] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 75250MiB (16% inode=99%); [00:13:27] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 74141MiB (16% inode=99%); [00:38:44] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [00:46:44] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [05:21:07] PROBLEM - matomo151 Check unit status of matomo-archiver-3 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-3 [05:54:00] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 8.89, 11.34, 8.01 [06:02:00] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 5.24, 8.84, 8.35 [08:03:07] RECOVERY - matomo151 Check unit status of matomo-archiver-3 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-3 [08:14:49] [02mw-config] 07SomeMWDev requested changes on pull request #6145 13https://github.com/miraheze/mw-config/pull/6145#pullrequestreview-3348786085 [08:14:50] [02mw-config] 07SomeMWDev left a file comment in pull request #6145 03aa69bb8: This comment needs to be updated 13https://github.com/miraheze/mw-config/pull/6145#discussion_r2438770008 [08:18:08] [02mw-config] 07pskyechology left a file comment in pull request #6145 03aa69bb8: or removed altogether 13https://github.com/miraheze/mw-config/pull/6145#discussion_r2438804472 [08:18:59] local girl yet to open her eyes since 2018 [08:38:50] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49863MiB (10% inode=99%); [10:25:27] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/514b23ab34be597578bdc9994deed876d57a3e61 [10:25:28] 02ssl/03main 07WikiTideBot 03514b23a Bot: Auto-update domain lists [11:16:00] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 11.02, 8.57, 5.37 [11:18:00] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 10.16, 9.10, 5.96 [15:43:43] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/c5a9c5904ca2 [15:43:43] 02puppet/03paladox-patch-3 07paladox 03c5a9c59 squid: add some http_access deny rules… [15:43:48] [02puppet] 07paladox opened pull request #4574: squid: add some http_access deny rules (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/4574 [15:44:00] [02puppet] 07coderabbitai[bot] commented on pull request #4574:
[…] 13https://github.com/miraheze/puppet/pull/4574#issuecomment-3416107149 [15:44:02] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/d94ac8847d2719cd266df886e859a0805101fd9d [15:44:04] [02puppet] 07paladox merged pull request #4574: squid: add some http_access deny rules (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/4574 [15:44:05] 02puppet/03main 07paladox 03d94ac88 squid: add some http_access deny rules (#4574)… [15:44:07] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 03c5a9c59 13https://api.github.com/repos/miraheze/puppet/commit/c5a9c59 [15:48:44] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [15:56:44] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [16:52:34] [02ssl] 07SomeMWDev created 03T14404 (+1 new commit) 13https://github.com/miraheze/ssl/commit/e8b59c76e346 [16:52:34] 02ssl/03T14404 07SomeRandomDeveloper 03e8b59c7 T14404: Add redirect for foolishmodwiki [16:52:58] [02ssl] 07SomeMWDev opened pull request #888: T14404: Add redirect for foolishmodwiki (03main...03T14404) 13https://github.com/miraheze/ssl/pull/888 [16:55:04] [02ssl] 07coderabbitai[bot] commented on pull request #888: Adds a new redirect configuration entry `foolishmodwiki` to redirects.yaml, mapping foolishmod.miraheze.org to foolish.wiki with Cloudflare SSL and strict HSTS settings. […] 13https://github.com/miraheze/ssl/pull/888#issuecomment-3416357654 [16:55:31] [02ssl] 07SomeMWDev merged pull request #888: T14404: Add redirect for foolishmodwiki (03main...03T14404) 13https://github.com/miraheze/ssl/pull/888 [16:55:31] [02ssl] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/48889bdd56f353a32f3d57e30a0ddbc2792875a4 [16:55:31] 02ssl/03main 07SomeRandomDeveloper 0348889bd T14404: Add redirect for foolishmodwiki (#888) [16:55:32] [02ssl] 07SomeMWDev 04deleted 03T14404 at 03e8b59c7 13https://api.github.com/repos/miraheze/ssl/commit/e8b59c7 [17:09:26] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49812MiB (10% inode=99%); [18:15:32] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49890MiB (10% inode=99%); [19:24:43] !log [somerandomdeveloper@test151] starting deploy of {'versions': ['1.44', '1.45'], 'upgrade_skins': 'Citizen'} to test151 [19:24:45] !log [somerandomdeveloper@test151] finished deploy of {'versions': ['1.44', '1.45'], 'upgrade_skins': 'Citizen'} to test151 - SUCCESS in 2s [19:24:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:40] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.44', 'upgrade_skins': 'Citizen'} to all [19:25:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:06] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.44', 'upgrade_skins': 'Citizen'} to all - SUCCESS in 25s [19:26:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:32] RECOVERY - mw161 Check unit status of php8.2-fpm_check_restart on mw161 is OK: OK: Status of the systemd unit php8.2-fpm_check_restart [22:36:41] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/a727a784818e [22:36:41] 02puppet/03paladox-patch-3 07paladox 03a727a78 dns: fix searching for fsslc.wtnet on puppet181… [22:36:45] [02puppet] 07paladox opened pull request #4575: dns: fix searching for fsslc.wtnet on puppet181 (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/4575 [22:36:56] [02puppet] 07coderabbitai[bot] commented on pull request #4575:
[…] 13https://github.com/miraheze/puppet/pull/4575#issuecomment-3417431614 [22:37:03] [02puppet] 07paladox merged pull request #4575: dns: fix searching for fsslc.wtnet on puppet181 (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/4575 [22:37:03] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/84597c54c5f5d6324b6ef3c0ad0ca89710df0277 [22:37:03] 02puppet/03main 07paladox 0384597c5 dns: fix searching for fsslc.wtnet on puppet181 (#4575)… [22:37:03] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 03a727a78 13https://api.github.com/repos/miraheze/puppet/commit/a727a78 [22:43:22] PROBLEM - llm191 Puppet on llm191 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[openwebui_pip_install] [22:48:13] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/57f5f2efdb8f [22:48:13] 02puppet/03paladox-patch-3 07paladox 0357f5f2e Fix DNS query local address format in bastion.yaml [22:48:17] [02puppet] 07paladox opened pull request #4576: Fix DNS query local address format in bastion.yaml (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/4576 [22:48:40] [02puppet] 07coderabbitai[bot] commented on pull request #4576:
[…] 13https://github.com/miraheze/puppet/pull/4576#issuecomment-3417445208 [22:50:28] [02puppet] 07paladox closed pull request #4576: Fix DNS query local address format in bastion.yaml (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/4576 [22:50:31] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 0357f5f2e 13https://api.github.com/repos/miraheze/puppet/commit/57f5f2e [22:56:17] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/8e84d664bcbc [22:56:17] 02puppet/03paladox-patch-3 07paladox 038e84d66 dns: Increase max-cache-entries from 500000 to 1000000… [22:56:23] [02puppet] 07paladox opened pull request #4577: dns: Increase max-cache-entries from 500000 to 1000000 (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/4577 [22:56:37] [02puppet] 07coderabbitai[bot] commented on pull request #4577:
[…] 13https://github.com/miraheze/puppet/pull/4577#issuecomment-3417454011 [22:56:42] [02puppet] 07paladox merged pull request #4577: dns: Increase max-cache-entries from 500000 to 1000000 (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/4577 [22:56:42] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/4d842e09d97c427e72fd7e3e17b5a772d91476b4 [22:56:43] 02puppet/03main 07paladox 034d842e0 dns: Increase max-cache-entries from 500000 to 1000000 (#4577)… [22:56:45] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 038e84d66 13https://api.github.com/repos/miraheze/puppet/commit/8e84d66 [23:01:01] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 17.06, 13.19, 8.15 [23:03:01] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 3.08, 9.16, 7.28 [23:11:42] RECOVERY - llm191 Puppet on llm191 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:41:44] PROBLEM - cp171 Disk Space on cp171 is CRITICAL: DISK CRITICAL - free space: / 27220MiB (5% inode=99%); [23:42:41] PROBLEM - mattermost1 Puppet on mattermost1 is WARNING: WARNING: Puppet last ran 1 hour ago