[00:02:52] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.06, 20.13, 14.86 [00:03:42] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.45, 1.87, 1.41 [00:04:51] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.54, 20.00, 15.45 [00:05:42] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.04, 1.54, 1.35 [00:06:49] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.46, 17.90, 15.22 [01:34:53] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.79, 1.32, 1.02 [01:36:54] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.68, 1.08, 0.97 [04:25:12] RECOVERY - bacula2 Bacula Static on bacula2 is OK: OK: Full, 10219941 files, 1.220TB, 2021-05-07 04:23:00 (2.2 minutes ago) [05:04:23] PROBLEM - wiki.mineland.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mineland.eu could not be found [05:10:51] [02mw-config] 07Reception123 closed pull request 03#3874: remove webhook sitenotice - 13https://git.io/J3iOt [05:10:52] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J3M7N [05:10:54] [02miraheze/mw-config] 07Reception123 03e8ea787 - remove webhook sitenotice (#3874) [05:10:55] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-1 [05:10:57] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://git.io/vbvb3 [05:10:58] [02mw-config] 07Reception123 synchronize pull request 03#3845: Merge 'master' into REL1_36 - 13https://git.io/JOKA0 [05:11:04] RECOVERY - wiki.mineland.eu - reverse DNS on sslhost is OK: rDNS OK - wiki.mineland.eu reverse DNS resolves to cp11.miraheze.org [05:11:51] miraheze/mw-config - Reception123 the build passed. [05:12:37] !log DELETED and DROPPED creepypastawiki (merge) [05:12:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:14:27] !log renamed horrorstorieswiki to creepypastawiki [05:14:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:19:24] !log reception@jobrunner3:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki ronrobloxwiki --username-prefix="wikia:ronroblox" /home/reception/ronroblox167_pages_full.xml [05:19:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:33:49] !log renamed cnvnwiki to trocwiki [05:33:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J3Mh1 [05:55:13] [02miraheze/services] 07MirahezeSSLBot 03d9f4d3e - BOT: Updating services config for wikis [08:43:22] [02MirahezeMagic] 07Universal-Omega opened pull request 03#254: Use !User::isRegistered() instead of User::isAnon() - 13https://git.io/J3Dz1 [08:44:29] miraheze/MirahezeMagic - Universal-Omega the build passed. [08:58:35] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J3DaB [08:58:36] [02miraheze/ManageWiki] 07translatewiki 03b05ac18 - Localisation updates from https://translatewiki.net. [08:58:37] [ Main page - translatewiki.net ] - translatewiki.net [08:58:38] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J3DaR [08:58:39] [02miraheze/DataDump] 07translatewiki 030a7b0b3 - Localisation updates from https://translatewiki.net. [08:58:40] [ Main page - translatewiki.net ] - translatewiki.net [08:58:41] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/J3Da0 [08:58:42] [02miraheze/MirahezeMagic] 07translatewiki 03a40dcdb - Localisation updates from https://translatewiki.net. [08:58:43] [ Main page - translatewiki.net ] - translatewiki.net [08:59:35] miraheze/DataDump - translatewiki the build passed. [08:59:42] miraheze/MirahezeMagic - translatewiki the build passed. [08:59:51] miraheze/ManageWiki - translatewiki the build passed. [09:31:51] [02puppet] 07Universal-Omega opened pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3DiT [09:42:14] [02puppet] 07Universal-Omega synchronize pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3DiT [09:45:25] [02puppet] 07Universal-Omega synchronize pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3DiT [09:47:44] [02puppet] 07Universal-Omega synchronize pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3DiT [10:44:41] [02puppet] 07JohnFLewis commented on pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3DF9 [10:47:59] [02puppet] 07JohnFLewis edited a comment on pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3DF9 [12:18:23] [02mw-config] 07R4356th opened pull request 03#3877: Add Wikidata as an import source for snapdatawiki - 13https://git.io/J3yY8 [12:19:25] miraheze/mw-config - R4356th the build passed. [12:30:33] PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 8.63, 5.55, 2.97 [12:40:35] PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 0.38, 3.23, 3.47 [12:42:35] RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.67, 2.38, 3.13 [13:08:58] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://git.io/J3y4V [13:08:59] [02miraheze/puppet] 07Reception123 0397e1dc5 - composer require phpspreadsheet for datatransfer T7186 [13:09:01] [02puppet] 07Reception123 created branch 03Reception123-patch-1 - 13https://git.io/vbiAS [13:10:16] [02puppet] 07Reception123 opened pull request 03#1751: composer require phpspreadsheet for datatransfer T7186 - 13https://git.io/J3y49 [13:23:00] [02mediawiki] 07dependabot[bot] opened pull request 03#1605: Bump grunt from 1.1.0 to 1.3.0 - 13https://git.io/J3yE9 [13:23:02] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/grunt-1.3.0 [+0/-0/±2] 13https://git.io/J3yEH [13:23:03] [02miraheze/mediawiki] 07dependabot[bot] 035bd258c - Bump grunt from 1.1.0 to 1.3.0 [13:23:04] [02mediawiki] 07dependabot[bot] labeled pull request 03#1605: Bump grunt from 1.1.0 to 1.3.0 - 13https://git.io/J3yE9 [13:23:06] [02mediawiki] 07dependabot[bot] labeled pull request 03#1605: Bump grunt from 1.1.0 to 1.3.0 - 13https://git.io/J3yE9 [13:23:08] [02mediawiki] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/grunt-1.3.0 - 13https://git.io/vbL5b [13:49:34] [02mediawiki] 07R4356th opened pull request 03#1606: Switch to branch 'stable' for SnapProjectEmbed - 13https://git.io/J3ywW [13:50:19] [02mediawiki] 07R4356th commented on pull request 03#1528: Switch to 'stable' branch for SnapProjectEmbed - 13https://git.io/J3ywz [13:54:40] [02mediawiki] 07R4356th synchronize pull request 03#1528: Switch to 'stable' branch for SnapProjectEmbed - 13https://git.io/J3GLw [14:13:13] [02mediawiki] 07dependabot[bot] opened pull request 03#1607: Bump underscore from 1.12.0 to 1.13.1 - 13https://git.io/J3y65 [14:13:15] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/underscore-1.13.1 [+0/-0/±1] 13https://git.io/J3y6d [14:13:16] [02miraheze/mediawiki] 07dependabot[bot] 03f1ee78b - Bump underscore from 1.12.0 to 1.13.1 [14:13:18] [02mediawiki] 07dependabot[bot] labeled pull request 03#1607: Bump underscore from 1.12.0 to 1.13.1 - 13https://git.io/J3y65 [14:13:19] [02mediawiki] 07dependabot[bot] labeled pull request 03#1607: Bump underscore from 1.12.0 to 1.13.1 - 13https://git.io/J3y65 [14:13:21] [02mediawiki] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/underscore-1.13.1 - 13https://git.io/vbL5b [14:42:33] [02puppet] 07dmehus commented on pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3y9G [14:43:12] [02puppet] 07dmehus edited a comment on pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3y9G [14:50:08] [02puppet] 07Reception123 commented on pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3yQR [14:54:43] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://git.io/J3y7R [14:54:44] [02miraheze/puppet] 07Reception123 038ad124f - make requestwiki AI job memory 1750M [14:54:46] [02puppet] 07Reception123 created branch 03Reception123-patch-2 - 13https://git.io/vbiAS [14:54:47] [02puppet] 07Reception123 opened pull request 03#1752: make requestwiki AI job memory 1750M - 13https://git.io/J3y70 [15:00:30] PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 4.77, 3.89, 2.31 [15:02:29] RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 1.03, 2.77, 2.09 [15:05:52] PROBLEM - www.wikilukas.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.wikilukas.tk could not be found [15:12:47] RECOVERY - www.wikilukas.tk - reverse DNS on sslhost is OK: rDNS OK - www.wikilukas.tk reverse DNS resolves to cp10.miraheze.org [15:14:48] [02puppet] 07dmehus commented on pull request 03#1752: make requestwiki AI job memory 1750M - 13https://git.io/J3ybh [16:07:12] [02puppet] 07Universal-Omega closed pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3DiT [16:09:46] [02puppet] 07Universal-Omega commented on pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3SL0 [16:13:27] [02puppet] 07JohnFLewis commented on pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3Stc [16:17:26] [02puppet] 07Universal-Omega commented on pull request 03#1750: Only allow system administrators to use logbot - 13https://git.io/J3Sqt [16:37:48] @R4536th: 99.99% of feature requests will be low pri [16:54:41] !remindme help [16:55:04] That's the wrong syntax? [16:58:59] .remind [16:59:14] No .in / .at [16:59:19] You can use .help [17:00:56] .help [17:00:56] SPF|Cloud: I've published a list of my commands at: https://sopel.mirahezebots.org/help_prod.html [17:01:24] .in 1d Domain names [17:01:24] SPF|Cloud: Okay, will remind at 2021-05-08 - 17:01:24UTC [17:01:29] Excellent [17:01:42] Thank you :-) [17:01:51] Np :) [17:04:31] PROBLEM - archive.stellurgists.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for archive.stellurgists.wiki could not be found [17:04:33] PROBLEM - vise.dayid.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vise.dayid.org could not be found [17:04:56] That code is mostly older than Miraheze [17:11:28] RECOVERY - archive.stellurgists.wiki - reverse DNS on sslhost is OK: rDNS OK - archive.stellurgists.wiki reverse DNS resolves to cp11.miraheze.org [17:11:30] RECOVERY - vise.dayid.org - reverse DNS on sslhost is OK: rDNS OK - vise.dayid.org reverse DNS resolves to cp11.miraheze.org [17:27:36] https://phabricator.miraheze.org/T6471#144193 Flagging for Miraheze devs: asking for the list of extensions from API is really slow on Miraheze wikis, I assume due to ManageWiki. [17:27:37] [ ⚓ T6471 Wiki-Bot ] - phabricator.miraheze.org [17:30:07] It probably needs profiling to see why [17:30:54] https://meta.miraheze.org/wiki/Tech:MediaWiki_appserver#Profiling [17:30:55] [ Tech:MediaWiki appserver - Miraheze Meta ] - meta.miraheze.org [17:31:00] If someone wants too [17:44:33] Reception123: ^ [17:57:18] PROBLEM - wiki.consid.vn - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.consid.vn reverse DNS resolves to ns-hold.vnnic.vn [18:12:20] @Lev: https://phabricator.miraheze.org/T6471#144195 [18:12:21] [ ⚓ T6471 Wiki-Bot ] - phabricator.miraheze.org [18:13:31] SPF|Cloud: that's from your profiling docs but where do we go from there [18:17:55] RhinosF1: do you know how to read profiles? [18:18:26] SPF|Cloud: nope [18:18:39] 95.63% 8820.098 108 - MediaWiki\Shell\Command::execute [18:19:08] out of the 9200ms it took to generate a response, 96% is spent in code execution [18:19:22] so yep, that's the culprit [18:19:44] 92.71% 8550.627 107 - GitInfo::getHeadCommitDate [18:19:44] 92.17% 8501.164 107 - section.execute-GitInfo->getHeadCommitDate [18:21:09] https://github.com/wikimedia/mediawiki/blob/REL1_35/includes/GitInfo.php#L230 [18:21:10] [ mediawiki/GitInfo.php at REL1_35 · wikimedia/mediawiki · GitHub ] - github.com [18:21:15] you'll need to look here [18:24:58] wait, this reminds me of something... https://phabricator.wikimedia.org/T131003 [18:24:59] [ ⚓ T131003 GitInfo never creates JSON files for caching ] - phabricator.wikimedia.org [18:26:32] afk [18:41:46] SPF|Cloud: ack, guess needs task [18:48:16] That is doing it for all extensions though [18:48:27] Uncached it's gonna be a disaster [19:37:55] Oh that's good to know. I can remove the extensions part from my requests since I don't really need it anymore. [19:38:52] @MarkusRost: at least it means no rush [19:38:59] But it's still a valid bug we've found now [19:39:49] Yeah, that definitely sounds like something that should be cached 😅 [20:15:40] There isn't a dump API endpoint, right? [21:38:01] DataDump? I've seen a mention somewhere about creating it [21:45:39] Wiki-Bot update is live, it's no longer querying the list of extensions [21:47:45] @MarkusRost, oh strange. I didn't know Wiki-Bot interacted with our list of extensions? [21:47:59] See phab [21:48:03] And scrollback [21:48:15] oh [21:49:07] It queried the list of extensions of a wiki using the api when setting up the bot because it was checking if some extensions Wiki-Bot uses are enabled on the wiki [21:49:14] .task T6471 [21:49:16] https://phabricator.miraheze.org/T6471 - section.execute-GitInfo->getHeadCommitDate is very slow, authored by BlackWidowMovie0000Editor, assigned to None, Priority: Normal, Status: Open [21:49:26] @RhinosF1, that one? [21:49:30] yes [21:49:46] ack, okay yeah [21:50:01] !wiki phab:T6471#144224 [21:50:05] Open: section.execute-GitInfo->getHeadCommitDate is very slow https://phabricator.miraheze.org/T6471#144224 [21:50:05] [ ⚓ T6471 section.execute-GitInfo->getHeadCommitDate is very slow ] - phabricator.miraheze.org [21:50:39] It still needs fixing as a function [21:50:48] ah [21:50:49] Because that's just silly that it's not cached [21:51:28] I'm glad this issue finally got tracked down to a source 😅 [21:52:32] I'm always glad when we find root causes for mysterious issues [21:52:50] * RhinosF1 is also glad when he can sleep so see you in the morning :) [21:53:39] Have a good night [21:59:13] [02mw-config] 07Universal-Omega opened pull request 03#3878: No longer manually set wmgUseExtension in LocalSettings - 13https://git.io/J39sH [22:00:17] miraheze/mw-config - Universal-Omega the build passed. [22:25:29] [02mw-config] 07Universal-Omega synchronize pull request 03#3878: No longer manually set wmgUseExtension in LocalSettings - 13https://git.io/J39sH [22:26:52] miraheze/mw-config - Universal-Omega the build passed. [22:28:16] [02mw-config] 07Universal-Omega synchronize pull request 03#3878: No longer manually set wmgUseExtension in LocalSettings - 13https://git.io/J39sH [22:28:43] [02mw-config] 07Universal-Omega edited pull request 03#3878: No longer manually set wmgUseExtension in LocalSettings - 13https://git.io/J39sH [22:29:14] miraheze/mw-config - Universal-Omega the build passed. [23:28:40] [02mw-config] 07Universal-Omega synchronize pull request 03#3878: No longer manually set wmgUseExtension in LocalSettings - 13https://git.io/J39sH [23:29:42] miraheze/mw-config - Universal-Omega the build passed.