[00:04:45] PROBLEM - cp171 Disk Space on cp171 is CRITICAL: DISK CRITICAL - free space: / 26770MiB (5% inode=99%); [00:06:55] PROBLEM - cp191 Disk Space on cp191 is CRITICAL: DISK CRITICAL - free space: / 27205MiB (5% inode=99%); [00:08:45] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 55276MiB (12% inode=99%); [00:10:55] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 55719MiB (12% inode=99%); [00:44:21] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.79, 18.17, 12.05 [00:48:21] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 19.58, 20.37, 14.48 [00:52:21] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.16, 20.59, 15.97 [01:00:21] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.65, 23.20, 19.09 [01:12:21] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.62, 23.57, 21.85 [01:16:21] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.40, 24.07, 22.47 [01:20:21] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.65, 23.58, 22.70 [01:32:21] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 15.95, 18.05, 20.11 [04:05:19] !log [somerandomdeveloper@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:PopulateWikiSettings --setting=wgAlexaSiteVerificationKey --remove (END - exit=0) [04:46:58] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Package[python3-GitPython],Exec[git_clone_statichelp] [04:53:50] miraheze/puppet - Universal-Omega the build passed. [04:56:45] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49851MiB (10% inode=99%); [05:13:12] miraheze/puppet - Universal-Omega the build passed. [05:14:46] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49905MiB (10% inode=99%); [05:21:23] miraheze/puppet - Universal-Omega the build passed. [05:22:00] PROBLEM - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit update-static-tech-docs [05:22:03] miraheze/puppet - Universal-Omega the build passed. [05:23:56] RECOVERY - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is OK: OK: Status of the systemd unit update-static-tech-docs [05:25:09] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:27:49] PROBLEM - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit update-static-tech-docs [05:33:35] RECOVERY - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is OK: OK: Status of the systemd unit update-static-tech-docs [05:37:28] PROBLEM - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit update-static-tech-docs [05:43:28] miraheze/puppet - Universal-Omega the build passed. [05:45:10] RECOVERY - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is OK: OK: Status of the systemd unit update-static-tech-docs [05:47:34] miraheze/puppet - Universal-Omega the build passed. [05:49:25] miraheze/puppet - Universal-Omega the build passed. [08:06:53] [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1750230380000&orgId=1&to=1750234013357 [08:10:49] [02mw-config] 07Fluffy728 requested changes on pull request #5831: It’s still broken I think… 13https://github.com/miraheze/mw-config/pull/5831#pullrequestreview-2938195084 [08:11:53] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1750230500000&orgId=1&to=1750234100000 [08:12:05] [02mw-config] 07Fluffy728 approved pull request #5878 13https://github.com/miraheze/mw-config/pull/5878#pullrequestreview-2938198683 [08:55:18] !log [somerandomdeveloper@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:PopulateWikiSettings --setting=wgTabberNeueUseCodex --remove (START) [11:18:42] [02mw-config] 07asko1 opened pull request #5990: T13855: Add namespaces to $smwgNamespacesWithSemanticLinks for constantnoblewiki (07miraheze:03main...07asko1:03T13855) 13https://github.com/miraheze/mw-config/pull/5990 [11:21:34] miraheze/mw-config - asko1 the build passed. [11:21:41] [02mw-config] 07SomeMWDev approved pull request #5990 13https://github.com/miraheze/mw-config/pull/5990#pullrequestreview-2938814126 [11:21:57] [02mw-config] 07SomeMWDev merged 07asko1's pull request #5990: T13855: Add namespaces to $smwgNamespacesWithSemanticLinks for constantnoblewiki (07miraheze:03main...07asko1:03T13855) 13https://github.com/miraheze/mw-config/pull/5990 [11:21:57] [02mw-config] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/d60adfe9a96375ae7bbf4527c1e030f8b5360b20 [11:21:57] 02mw-config/03main 07Asko 03d60adfe T13855: Add namespaces to $smwgNamespacesWithSemanticLinks for constantnoblewiki (#5990)… [11:22:20] !log [somerandomdeveloper@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [11:22:47] miraheze/mw-config - SomeMWDev the build passed. [11:22:47] !log [somerandomdeveloper@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 26s [11:44:37] !log [somerandomdeveloper@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/cleanupTitles.php --wiki=balatromodswiki --dry-run (END - exit=0) [11:45:05] !log [somerandomdeveloper@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/cleanupTitles.php --wiki=balatromodswiki (END - exit=0) [13:29:19] [02mw-config] 07asko1 opened pull request #5991: Add $wgExtractsRemoveClasses to ManageWikiSettings (07miraheze:03main...07asko1:03T13859) 13https://github.com/miraheze/mw-config/pull/5991 [13:30:13] miraheze/mw-config - asko1 the build passed. [14:05:50] [02mw-config] 07SomeMWDev left a file comment in pull request #5991 037eb2d31: Since this can also contain classes and IDs, maybe "Selectors for elements" instead of "Elements"? 13https://github.com/miraheze/mw-config/pull/5991#discussion_r2154700280 [14:05:50] [02mw-config] 07SomeMWDev left a file comment in pull request #5991 037eb2d31: This doesn't need to be specified here, since 'from' is set to 'textextracts' already. […] 13https://github.com/miraheze/mw-config/pull/5991#discussion_r2154695124 [14:08:13] !log [somerandomdeveloper@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki:PopulateWikiSettings --setting=wgTabberNeueUseCodex --remove (END - exit=0) [14:17:19] miraheze/mw-config - asko1 the build passed. [14:18:10] [02mw-config] 07asko1 left a file comment in pull request #5991 039f40538: Missed that, thanks! Used the setting below as an example, which makes the same mistake. Could do with a cleanup. Fixed by 9f40538 13https://github.com/miraheze/mw-config/pull/5991#discussion_r2154734578 [14:21:28] [02mw-config] 07asko1 left a file comment in pull request #5991 039f40538: I agree, but fwiw, [Extension:TextExtracts](https://www.mediawiki.org/wiki/Extension:TextExtracts) refers to them as "an array of , .class, ., #" and in the FAQ section as "...other excluded **elements**". […] 13https://github.com/miraheze/mw-config/pull/5991#discussion_r2154742712 [14:22:14] [02mw-config] 07SomeMWDev left a file comment in pull request #5991 039f40538: The variable itself is called `$wgExtractsRemoveClasses`, which is a bit misleading as well... 13https://github.com/miraheze/mw-config/pull/5991#discussion_r2154744461 [14:24:14] !log [somerandomdeveloper@test151] starting deploy of {'config': True} to test151 [14:24:15] !log [somerandomdeveloper@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [14:39:48] [02mw-config] 07SomeMWDev merged 07asko1's pull request #5991: Add $wgExtractsRemoveClasses to ManageWikiSettings (07miraheze:03main...07asko1:03T13859) 13https://github.com/miraheze/mw-config/pull/5991 [14:39:48] [02mw-config] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/967c50e6bedbd5beaeba5157fdc7a84e84ed2828 [14:39:48] 02mw-config/03main 07Asko 03967c50e Add $wgExtractsRemoveClasses to ManageWikiSettings (#5991)… [14:39:59] !log [somerandomdeveloper@test151] starting deploy of {'pull': 'config', 'config': True} to test151 [14:40:01] !log [somerandomdeveloper@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 1s [14:40:36] !log [somerandomdeveloper@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [14:40:38] miraheze/mw-config - SomeMWDev the build passed. [14:41:02] !log [somerandomdeveloper@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 25s [14:42:25] @snowstacked merged and config deployed, try $wgExtractsRemoveClasses in managewiki now [14:44:13] omg YES [15:30:17] !log bounced logbot on bots171 [15:30:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:52:53] [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1750258340000&orgId=1&to=1750261973361 [15:57:53] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1750258640000&orgId=1&to=1750262240000 [16:35:21] [02pywikibot-config] 07Universal-Omega created 03periodic_jobs (+1 new commit) 13https://github.com/miraheze/pywikibot-config/commit/5feaecdf335b [16:35:21] 02pywikibot-config/03periodic_jobs 07CosmicAlpha 035feaecd Rename timers to periodic_jobs… [16:35:26] [02pywikibot-config] 07Universal-Omega opened pull request #6: Rename timers to periodic_jobs (03main...03periodic_jobs) 13https://github.com/miraheze/pywikibot-config/pull/6 [16:35:31] [02pywikibot-config] 07coderabbitai[bot] commented on pull request #6:
[…] 13https://github.com/miraheze/pywikibot-config/pull/6#issuecomment-2984949551 [16:36:09] miraheze/pywikibot-config - Universal-Omega the build has errored. [16:36:10] miraheze/pywikibot-config - Universal-Omega the build has errored. [17:05:13] [02pywikibot-config] 07Universal-Omega pushed 1 new commit to 03periodic_jobs 13https://github.com/miraheze/pywikibot-config/commit/4e96d8cb2ccced0bab8fc2ee9b6dc4c9a370a80c [17:05:13] 02pywikibot-config/03periodic_jobs 07CosmicAlpha 034e96d8c Update [17:05:53] miraheze/pywikibot-config - Universal-Omega the build has errored. [17:05:59] miraheze/pywikibot-config - Universal-Omega the build has errored. [17:07:31] [02pywikibot-config] 07Universal-Omega pushed 1 new commit to 03periodic_jobs 13https://github.com/miraheze/pywikibot-config/commit/ef32d4a14a7f4f61698d884f71b5360e4399fb59 [17:07:31] 02pywikibot-config/03periodic_jobs 07CosmicAlpha 03ef32d4a Update [17:08:11] miraheze/pywikibot-config - Universal-Omega the build has errored. [17:10:30] [02pywikibot-config] 07Universal-Omega pushed 1 new commit to 03periodic_jobs 13https://github.com/miraheze/pywikibot-config/commit/6ef7450c091831a81e24ac49093a475a407728eb [17:10:30] 02pywikibot-config/03periodic_jobs 07CosmicAlpha 036ef7450 Update [17:11:12] miraheze/pywikibot-config - Universal-Omega the build has errored. [17:11:39] [02pywikibot-config] 07Universal-Omega pushed 1 new commit to 03periodic_jobs 13https://github.com/miraheze/pywikibot-config/commit/bd4a4c7bbf1d5af5cf08021702a392dd8db200e3 [17:11:39] 02pywikibot-config/03periodic_jobs 07CosmicAlpha 03bd4a4c7 Update [17:30:32] [02pywikibot-config] 07Universal-Omega pushed 1 new commit to 03periodic_jobs 13https://github.com/miraheze/pywikibot-config/commit/12b94c7c6d62bb893b44584fce3cb8efadb5a216 [17:30:32] 02pywikibot-config/03periodic_jobs 07CosmicAlpha 0312b94c7 Update README [17:34:28] [02mediawiki-repos] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mediawiki-repos/commit/470f8a1e2463c0404f3343a40ec33c04af13eb1b [17:34:28] 02mediawiki-repos/03main 07CosmicAlpha 03470f8a1 Use sys.exit [17:39:09] [02pywikibot-config] 07Universal-Omega pushed 1 new commit to 03periodic_jobs 13https://github.com/miraheze/pywikibot-config/commit/250f101e754999cf28e94c64101b9b80f504d20f [17:39:09] 02pywikibot-config/03periodic_jobs 07CosmicAlpha 03250f101 Use sys.exit [17:43:01] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/71f3bba72d703f84c09d91160bde49cd3c5a86ce [17:43:01] 02puppet/03main 07CosmicAlpha 0371f3bba adminlogbot: use sys.exit [17:44:54] miraheze/puppet - Universal-Omega the build passed. [20:01:13] [02mw-config] 07SomeMWDev created 03cleanup-requirements (+1 new commit) 13https://github.com/miraheze/mw-config/commit/8ea324572e69 [20:01:13] 02mw-config/03cleanup-requirements 07SomeRandomDeveloper 038ea3245 Clean up redundant settings requirements… [20:03:03] !log [somerandomdeveloper@test151] starting deploy of {'config': True} to test151 [20:03:04] !log [somerandomdeveloper@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [20:03:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:12] [02mw-config] 07SomeMWDev drafted pull request #5992: Clean up redundant settings requirements (03main...03cleanup-requirements) 13https://github.com/miraheze/mw-config/pull/5992 [20:20:41] [02mw-config] 07github-actions[bot] pushed 1 new commit to 03cleanup-requirements 13https://github.com/miraheze/mw-config/commit/6b93324edfd321218ad57eeeb25fee2c3ce80055 [20:20:42] 02mw-config/03cleanup-requirements 07github-actions 036b93324 CI: lint code to MediaWiki standards… [20:21:12] miraheze/mw-config - SomeMWDev the build passed. [22:40:01] [02mw-config] 07asko1 opened pull request #5993: T13868: Change Semantic MediaWiki footer icon for universalunionwiki (07miraheze:03main...07asko1:03T13868) 13https://github.com/miraheze/mw-config/pull/5993 [22:40:50] miraheze/mw-config - asko1 the build passed. [22:48:32] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 23.27, 20.30, 14.71 [22:50:32] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 10.94, 16.77, 14.11 [22:53:04] miraheze/mw-config - asko1 the build passed. [22:56:46] [02dns] 07Universal-Omega created 03cp201-dns (+1 new commit) 13https://github.com/miraheze/dns/commit/8affebcff7f3 [22:56:46] 02dns/03cp201-dns 07CosmicAlpha 038affebc Add cp201 to dns [22:56:51] [02dns] 07Universal-Omega opened pull request #692: Add cp201 to dns (03main...03cp201-dns) 13https://github.com/miraheze/dns/pull/692 [22:57:45] [02dns] 07Universal-Omega pushed 1 new commit to 03cp201-dns 13https://github.com/miraheze/dns/commit/9d4d9132c091d140b02c5ee9430cd0e784c0e00a [22:57:45] 02dns/03cp201-dns 07CosmicAlpha 039d4d913 Add [22:58:33] miraheze/dns - Universal-Omega the build passed. [22:59:41] miraheze/dns - Universal-Omega the build passed. [23:06:53] [02dns] 07Universal-Omega merged pull request #692: Add cp201 to dns (03main...03cp201-dns) 13https://github.com/miraheze/dns/pull/692 [23:06:53] [02dns] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/dns/commit/fd2f905218382ac17c58e168569e158445a42088 [23:06:54] 02dns/03main 07CosmicAlpha 03fd2f905 Add cp201 to dns [23:06:56] [02dns] 07Universal-Omega 04deleted 03cp201-dns at 039d4d913 13https://api.github.com/repos/miraheze/dns/commit/9d4d913 [23:07:49] miraheze/dns - Universal-Omega the build passed. [23:16:32] [02python-functions] 07dependabot[bot] created 03dependabot/pip/dot-github/pytest-8.4.1 (+1 new commit) 13https://github.com/miraheze/python-functions/commit/83254eaf6732 [23:16:32] 02python-functions/03dependabot/pip/dot-github/pytest-8.4.1 07dependabot[bot] 0383254ea build(deps): bump pytest from 8.4.0 to 8.4.1 in /.github… [23:16:33] [02python-functions] 07dependabot[bot] added the label 'dependencies' to pull request #152 (build(deps): bump pytest from 8.4.0 to 8.4.1 in /.github) 13https://github.com/miraheze/python-functions/pull/152 [23:16:33] [02python-functions] 07dependabot[bot] added the label 'python' to pull request #152 (build(deps): bump pytest from 8.4.0 to 8.4.1 in /.github) 13https://github.com/miraheze/python-functions/pull/152 [23:16:35] [02python-functions] 07dependabot[bot] opened pull request #152: build(deps): bump pytest from 8.4.0 to 8.4.1 in /.github (03main...03dependabot/pip/dot-github/pytest-8.4.1) 13https://github.com/miraheze/python-functions/pull/152 [23:16:37] [02python-functions] 07dependabot[bot] added the label 'dependencies' to pull request #152 (build(deps): bump pytest from 8.4.0 to 8.4.1 in /.github) 13https://github.com/miraheze/python-functions/pull/152 [23:16:39] [02python-functions] 07dependabot[bot] added the label 'python' to pull request #152 (build(deps): bump pytest from 8.4.0 to 8.4.1 in /.github) 13https://github.com/miraheze/python-functions/pull/152 [23:16:41] [02python-functions] 07coderabbitai[bot] commented on pull request #152: --- […] 13https://github.com/miraheze/python-functions/pull/152#issuecomment-2986007596 [23:20:36] miraheze/python-functions - dependabot[bot] the build passed. [23:23:16] [02python-functions] 07github-merge-queue[bot] created 03gh-readonly-queue/main/pr-152-67e1858c754017df9212ea69aa427b553ae7054f (+1 new commit) 13https://github.com/miraheze/python-functions/commit/308b63692828 [23:23:16] 02python-functions/03gh-readonly-queue/main/pr-152-67e1858c754017df9212ea69aa427b553ae7054f 07dependabot[bot] 03308b636 build(deps): bump pytest from 8.4.0 to 8.4.1 in /.github (#152)… [23:26:42] [02python-functions] 07github-merge-queue[bot] merged 03gh-readonly-queue/main/pr-152-67e1858c754017df9212ea69aa427b553ae7054f into 03main 13https://github.com/miraheze/python-functions/compare/67e1858c7540...308b63692828 [23:26:43] [02python-functions] 07github-merge-queue[bot] 04deleted 03gh-readonly-queue/main/pr-152-67e1858c754017df9212ea69aa427b553ae7054f at 03308b636 13https://api.github.com/repos/miraheze/python-functions/commit/308b636 [23:26:45] [02python-functions] 07github-actions[bot] merged 07dependabot[bot]'s pull request #152: build(deps): bump pytest from 8.4.0 to 8.4.1 in /.github (03main...03dependabot/pip/dot-github/pytest-8.4.1) 13https://github.com/miraheze/python-functions/pull/152 [23:26:47] [02python-functions] 07github-actions[bot] 04deleted 03dependabot/pip/dot-github/pytest-8.4.1 at 0383254ea 13https://api.github.com/repos/miraheze/python-functions/commit/83254ea [23:30:41] miraheze/python-functions - github-merge-queue[bot] the build passed.