[00:05:47] RECOVERY - test3 Current Load on test3 is OK: OK - load average: 0.53, 3.29, 2.50 [00:13:05] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [00:21:53] PROBLEM - test3 Current Load on test3 is CRITICAL: CRITICAL - load average: 9.46, 4.56, 2.66 [00:25:29] RECOVERY - cp10 Puppet on cp10 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:25:36] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JO9A8 [00:25:37] [02miraheze/dns] 07paladox 03c3a350d - Revert "Depool cp10" [00:26:19] PROBLEM - cp10 HTTP 4xx/5xx ERROR Rate on cp10 is WARNING: WARNING - NGINX Error Rate is 45% [00:27:54] RECOVERY - test3 Current Load on test3 is OK: OK - load average: 0.29, 3.35, 3.01 [00:28:19] RECOVERY - cp10 HTTP 4xx/5xx ERROR Rate on cp10 is OK: OK - NGINX Error Rate is 37% [01:38:49] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.21, 6.84, 6.41 [01:40:47] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.96, 6.56, 6.36 [03:13:07] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp10.miraheze.org [04:22:45] PROBLEM - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 247s [04:24:03] PROBLEM - dbbackup2 Current Load on dbbackup2 is WARNING: WARNING - load average: 3.70, 2.74, 1.52 [04:26:03] PROBLEM - dbbackup2 Current Load on dbbackup2 is CRITICAL: CRITICAL - load average: 5.73, 3.80, 2.06 [04:28:02] PROBLEM - dbbackup2 Current Load on dbbackup2 is WARNING: WARNING - load average: 3.96, 3.87, 2.30 [04:42:00] RECOVERY - dbbackup2 Current Load on dbbackup2 is OK: OK - load average: 2.55, 3.19, 2.90 [05:10:05] PROBLEM - dbbackup2 Current Load on dbbackup2 is WARNING: WARNING - load average: 3.68, 3.46, 3.22 [05:12:05] RECOVERY - dbbackup2 Current Load on dbbackup2 is OK: OK - load average: 3.16, 3.40, 3.23 [05:14:54] [02mw-config] 07Universal-Omega edited a comment on pull request 03#3846: add more file formats to wgFileExtensions - 13https://git.io/JOPi1 [05:28:04] PROBLEM - dbbackup2 Current Load on dbbackup2 is WARNING: WARNING - load average: 3.58, 3.31, 3.17 [05:32:04] RECOVERY - dbbackup2 Current Load on dbbackup2 is OK: OK - load average: 2.30, 2.96, 3.08 [06:17:05] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [06:21:40] RECOVERY - cloud3 APT on cloud3 is OK: APT OK: 110 packages available for upgrade (0 critical updates). [06:42:22] RECOVERY - cloud4 APT on cloud4 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [06:55:10] RECOVERY - cloud5 APT on cloud5 is OK: APT OK: 64 packages available for upgrade (0 critical updates). [07:34:43] RECOVERY - dbbackup2 Check MariaDB Replication c3 on dbbackup2 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s [09:17:05] RECOVERY - wiki.mlpwiki.net - reverse DNS on sslhost is OK: rDNS OK - wiki.mlpwiki.net reverse DNS resolves to cp10.miraheze.org [10:09:24] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [10:26:28] PROBLEM - mw9 Puppet on mw9 is WARNING: WARNING: Puppet is currently disabled, message: Reception123 - upgrade, last run 22 minutes ago with 0 failures [10:27:17] PROBLEM - mw8 Puppet on mw8 is WARNING: WARNING: Puppet is currently disabled, message: Reception123 - upgrade, last run 23 minutes ago with 0 failures [10:27:23] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [10:27:39] PROBLEM - mw10 Puppet on mw10 is WARNING: WARNING: Puppet is currently disabled, message: Reception123 - upgrade, last run 23 minutes ago with 0 failures [10:27:54] PROBLEM - mw11 Puppet on mw11 is WARNING: WARNING: Puppet is currently disabled, message: Reception123 - upgrade, last run 24 minutes ago with 0 failures [10:28:25] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JOQ5z [10:28:27] [02miraheze/mediawiki] 07Reception123 039bd70a9 - Update Cosmos [10:30:51] !log depool mw11 [10:30:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:31:52] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv && sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php [10:31:52] /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw11 [10:31:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:33:23] PROBLEM - cp12 Varnish Backends on cp12 is CRITICAL: 1 backends are down. mw11 [10:33:55] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:33:58] PROBLEM - mw11 MediaWiki Rendering on mw11 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 18509 bytes in 0.211 second response time [10:34:02] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw11 [10:34:12] PROBLEM - cp10 Varnish Backends on cp10 is CRITICAL: 1 backends are down. mw11 [10:34:52] PROBLEM - cp11 Varnish Backends on cp11 is CRITICAL: 1 backends are down. mw11 [10:35:57] RECOVERY - mw11 MediaWiki Rendering on mw11 is OK: HTTP OK: HTTP/1.1 200 OK - 20729 bytes in 0.189 second response time [10:36:49] !log repool mw11 ; depool mw10 [10:36:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:37:03] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv && sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php [10:37:03] /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw10 [10:37:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:37:23] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [10:37:45] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [10:37:54] PROBLEM - jobrunner3 MediaWiki Rendering on jobrunner3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 18515 bytes in 0.304 second response time [10:38:53] PROBLEM - jobrunner4 MediaWiki Rendering on jobrunner4 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 18515 bytes in 0.244 second response time [10:40:57] RECOVERY - jobrunner4 MediaWiki Rendering on jobrunner4 is OK: HTTP OK: HTTP/1.1 200 OK - 20742 bytes in 4.007 second response time [10:41:54] RECOVERY - jobrunner3 MediaWiki Rendering on jobrunner3 is OK: HTTP OK: HTTP/1.1 200 OK - 20741 bytes in 0.464 second response time [10:42:05] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 7 backends are healthy [10:42:07] !log repool mw10 ; depool mw9 [10:42:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:42:30] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv && sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php [10:42:30] /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw9 [10:42:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:44:26] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:46:03] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw9 [10:46:44] !log repool mw9 ; depool mw8 [10:46:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:46:52] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv && sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php [10:46:53] /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw8 [10:46:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:47:14] Reception123: you do realise half of that hasn't logged [10:47:16] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [10:47:50] urgh yeah, too much [10:47:54] I'll fix it on the page [10:52:10] !log repool mw8 [10:52:12] RECOVERY - cp10 Varnish Backends on cp10 is OK: All 7 backends are healthy [10:52:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:52:51] RECOVERY - cp11 Varnish Backends on cp11 is OK: All 7 backends are healthy [10:53:22] RECOVERY - cp12 Varnish Backends on cp12 is OK: All 7 backends are healthy [10:54:02] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 7 backends are healthy [10:55:01] !log same on jbr* [10:55:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:05:13] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 18510 bytes in 0.419 second response time [11:35:24] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:55:23] ha, I estimated a full backup of db11 would take 50 minutes, but it's more like 20 hours [11:55:57] on the other hand, I estimated a full backup would be 50 GB, but in reality it's more like 14 GB [11:56:03] that's nice :) [11:56:25] heh, so one good thing and one less good thing [11:59:13] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20731 bytes in 0.438 second response time [11:59:49] definitely [12:05:49] !log disable puppet on mw* [12:05:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:06:07] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±2] 13https://git.io/JO7TV [12:06:08] [02miraheze/mediawiki] 07Reception123 035daa223 - Switch ScratchBlocks fork (T7156) [12:07:55] PROBLEM - mw11 Puppet on mw11 is WARNING: WARNING: Puppet is currently disabled, message: Reception123 - fork, last run 4 minutes ago with 0 failures [12:08:24] PROBLEM - mw9 Puppet on mw9 is WARNING: WARNING: Puppet is currently disabled, message: Reception123 - fork, last run 4 minutes ago with 0 failures [12:09:17] PROBLEM - mw8 Puppet on mw8 is WARNING: WARNING: Puppet is currently disabled, message: Reception123 - fork, last run 5 minutes ago with 0 failures [12:09:35] PROBLEM - mw10 Puppet on mw10 is WARNING: WARNING: Puppet is currently disabled, message: Reception123 - fork, last run 5 minutes ago with 0 failures [12:17:16] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [12:19:09] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv on mw* [12:19:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:14] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git pull ; sudo -u www-data git submodule sync ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -t on mw*/jbr* [12:20:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:22] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:21:35] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [12:21:41] !log sudo puppet agent -tv && sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw*/jbr* [12:21:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:21:54] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:24:34] PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 12.72, 5.31, 2.42 [12:25:41] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.33, 3.80, 2.06 [12:27:40] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.20, 4.26, 2.44 [12:28:31] [02mw-config] 07Reception123 commented on pull request 03#3854: Remove wmgUseYandexTranslate - 13https://git.io/JO7qs [12:29:40] RECOVERY - gluster4 Current Load on gluster4 is OK: OK - load average: 1.49, 3.13, 2.25 [12:32:18] PROBLEM - cp11 Current Load on cp11 is WARNING: WARNING - load average: 0.40, 3.69, 3.17 [12:34:19] RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 0.30, 2.56, 2.82 [13:19:30] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JO7ch [13:19:32] [02miraheze/ssl] 07Reception123 03912b62d - add wiki.rpointer.ml cert [13:25:05] !log reception@jobrunner3:~$ sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/w/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php validator --disable [13:25:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:33:13] [02mw-config] 07R4356th commented on pull request 03#3854: Remove wmgUseYandexTranslate - 13https://git.io/JO7l9 [13:35:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JO78J [13:35:12] [02miraheze/services] 07MirahezeSSLBot 03a5d85f9 - BOT: Updating services config for wikis [13:39:34] [02mw-config] 07Reception123 closed pull request 03#3850: Remove Validator - 13https://git.io/JOP5Q [13:39:36] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JO78j [13:39:37] [02miraheze/mw-config] 07Universal-Omega 03b56e306 - Remove Validator (#3850) [13:39:39] [02mw-config] 07Reception123 synchronize pull request 03#3845: Merge 'master' into REL1_36 - 13https://git.io/JOKA0 [13:40:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JO74U [13:40:12] [02miraheze/services] 07MirahezeSSLBot 03dedb0ce - BOT: Updating services config for wikis [13:40:41] miraheze/mw-config - Reception123 the build passed. [13:40:42] miraheze/mw-config - Reception123 the build passed. [13:41:20] !log running bash ./wikibackups.sh /home/reception/publicwikis.txt /srv/mediawiki/w/maintenance/dumpBackup.php (wikibackups) [13:41:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:42:30] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-1/±1] 13https://git.io/JO742 [13:42:31] [02miraheze/mediawiki] 07Reception123 03aa7e369 - Remove Validator (T7156) [13:44:21] [02mw-config] 07RhinosF1 commented on pull request 03#3854: Remove wmgUseYandexTranslate - 13https://git.io/JO747 [13:50:53] .op [13:50:53] Attempting to OP... [13:51:01] (See global notice) [13:51:30] Oh that's old [13:51:34] .deop [13:51:34] Attempting to OP... [14:06:41] [02miraheze/puppet] 07paladox pushed 039 commits to 03patch-1 [+14/-0/±23] 13https://git.io/JO7Em [14:06:42] [02miraheze/puppet] 07paladox 0314711c2 - Merge branch 'master' into patch-1 [14:06:44] [02puppet] 07paladox synchronize pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [14:09:08] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 4 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config],Exec[git_pull_MediaWiki core] [14:10:25] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [14:10:25] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [14:10:49] Reception123: ^ [14:11:23] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [14:11:44] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [14:15:47] [02puppet] 07paladox closed pull request 03#1726: Introduce trafficserver module - 13https://git.io/JYonQ [14:15:48] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+43/-0/±4] 13https://git.io/JO7uF [14:15:50] [02miraheze/puppet] 07paladox 03ad42516 - Introduce trafficserver module (#1726) [14:15:51] [02puppet] 07paladox deleted branch 03patch-1 - 13https://git.io/vbiAS [14:15:53] [02miraheze/puppet] 07paladox deleted branch 03patch-1 [14:15:58] [02puppet] 07paladox commented on pull request 03#1726: Introduce trafficserver module - 13https://git.io/JO7uA [14:36:37] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:37:37] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:37:44] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:37:51] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:42:45] Seems to have fixed itself [15:09:18] I need the content from the closed FANDOM version of atrociousgameplaywiki to be imported. Since it's closed, compliance doesn't seem to matter, so just use the prefix "imported" without any link. https://phabricator.miraheze.org/T7189 [15:09:19] [ ⚓ T7189 Import FANDOM version XML on atrociousgameplaywiki ] - phabricator.miraheze.org [15:10:09] @MarioMario456 I'll have a look to see if it does indeed have the FANDOM version. [15:10:28] @MarioMario456: no attribution, no import. [15:11:15] Couldn't find it. It's nowhere to be found. [15:11:43] > @MarioMario456: no attribution, no import. [15:11:43] ^ :thistbh: [15:12:14] Was it something I said to MarioMario456? [15:12:23] no [15:12:26] Oh. [15:12:48] Then we both typed at the exact same time. [15:14:19] I commented [15:14:36] The FANDOM version was closed and it got permanently deleted [15:14:53] Then what's the point of asking for an importation if it's deleted? [15:15:28] It contains the full page history and (possibly) some more pages that didn't get imported [15:15:52] :thinking: [15:16:03] You can still link to it [15:16:21] Or wikia in general seen as it's a shared login system [15:16:38] Since it's deleted, link to Wayback Machine instead of FANDOM [15:16:59] That might work if someone sets an Interwiki up [15:17:00] Or link the user pages to FANDOM Community Central [15:17:12] Yeah that's also attribution [15:17:22] But we need to attribute every revision [15:18:26] http://web.archive.org/web/20190825181747/https://atrocious-gameplay.fandom.com/wiki/Atrocious_Gameplay_Wiki [15:18:26] [ Atrocious Gameplay Wiki | FANDOM powered by Wikia ] - web.archive.org [15:19:31] For example, if user "Foo123" edited on the FANDOM version, it becomes "wikia:atrocious-gameplay>Foo123" and it links to their FANDOM Community Central user page [15:20:38] Note in on the task [15:21:00] And we'll find the Interwiki for community central [15:22:28] > http://web.archive.org/web/20190825181747/https://atrocious-gameplay.fandom.com/wiki/Atrocious_Gameplay_Wiki [15:22:28] That's actually a good suggestion, we could add an interwiki prefix, potentially, for `http://web.archive.org/web/20190825181747/https://atrocious-gameplay.fandom.com/wiki/$1`, and then we'd link to an actual version of the wiki [15:24:37] or just use `wikia:community`, though technically that's less than ideal as it wouldn't say which wiki the imports were from; only the user pages. Best would probably be to use `wikia:community` and have local wiki editors add an edit summary to every imported page [15:33:18] Wikia:community would be fine [15:33:23] Archive.org sort of works [15:35:19] Yeah, Internet Archive is generally fine, the only issue is if it missed archiving a contributor's user page in that archive run [15:37:36] Yeah [15:39:31] * dmehus wishes `importDump.php` had an `--edit-summary=""` parameter :) [15:40:53] yeah, after all Special:Import does allow for a "comment" [15:50:38] @Doug You can disregard my question on the #general channel as I've already figured out what the issue was. [15:51:46] DarkMatterMan4500, okay, thanks :) [15:52:28] I found that I didn't replace the Caption with the Quote in the infobox. [15:52:40] And therefore, I fixed it on my own. [16:01:23] oh, cool 👍 [16:25:26] [02puppet] 07Reception123 closed pull request 03#1744: Remove composer for Validator - 13https://git.io/JOP5S [16:25:27] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JO7dv [16:25:29] [02miraheze/puppet] 07Universal-Omega 03d0f42a0 - Remove composer for Validator (#1744) [16:53:25] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-3 [+0/-0/±3] 13https://git.io/JO7As [16:53:27] [02miraheze/mw-config] 07Reception123 03d178e80 - ScratchBlocks -> ScratchBlocks4 [16:53:28] [02mw-config] 07Reception123 created branch 03Reception123-patch-3 - 13https://git.io/vbvb3 [16:53:30] [02mw-config] 07Reception123 opened pull request 03#3855: ScratchBlocks -> ScratchBlocks4 - 13https://git.io/JO7AG [16:54:33] miraheze/mw-config - Reception123 the build passed. [17:06:44] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-3 [+0/-0/±1] 13https://git.io/JO7xb [17:06:45] [02miraheze/mw-config] 07Reception123 0321c4d5b - single quote [17:06:47] [02mw-config] 07Reception123 synchronize pull request 03#3855: ScratchBlocks -> ScratchBlocks4 - 13https://git.io/JO7AG [17:07:35] [02mw-config] 07Universal-Omega synchronize pull request 03#3852: Convert AutoCreatePage to ExtensionRegistry - 13https://git.io/JOSQk [17:07:47] miraheze/mw-config - Reception123 the build passed. [17:08:30] miraheze/mw-config - Universal-Omega the build passed. [17:16:19] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.85, 6.77, 6.41 [17:18:19] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.29, 6.62, 6.40 [17:21:53] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 324 bytes in 0.008 second response time [17:22:06] paladox: you? ^ [17:22:19] Or Reception123 ^ [17:22:34] me [17:22:43] RhinosF1: ScratchBlocks apparently needs a different name in wfLoad [17:22:48] Don't blow prod up [17:22:56] that's why I'm using test3 :) [17:23:06] Reception123: cool [17:23:12] Maybe downtime icinga [17:23:23] it shouldn't be too long [17:23:46] RhinosF1: will have to depool again though because the submodule switch will be rough [17:24:56] Heh [17:26:05] as set-url won't work because it has to be a completely new name [17:31:31] Notice: /Stage[main]/Mediawiki/Git::Clone[MediaWiki core]/Exec[git_pull_MediaWiki core]/returns: error: insufficient permission for adding an object to repository database /srv/mediawiki/w/.git/modules/skins/Metrolook/objects [17:31:35] RhinosF1: ^ hmm this annoying error is back on test3 [17:31:42] I don't know how I fixed it last time [17:31:52] but it's not impressed by cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update [17:32:32] I think maybe I messed around with /.git/modules/skins/Metrolook/objects [17:34:19] chown + chmod [17:35:32] yeah, that's what I tried just now, probably what I did last time [17:35:36] but I don't get how that happens [17:35:49] * Reception123 is running puppet [17:36:58] Reception123, do you have to log in SAL when you manually run Puppet? if so, are you going to use the new server logging facility? :P [17:37:44] no, running puppet has never been logged :) [17:37:49] and certainly not on test3 [17:38:09] Reception123, oh cool, I didn't know that [17:39:11] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [17:39:18] dmehus: disabling puppet is logged though [17:39:22] !log disabled puppet on mw* [17:39:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:39:27] Reception123, ah [17:39:39] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+1/-1/±1] 13https://git.io/JO5fY [17:39:40] [02miraheze/mediawiki] 07Reception123 0305fa5e3 - change ScratchBlocks name to mw-ScratchBlocks4 [17:40:02] [02mw-config] 07Reception123 closed pull request 03#3855: ScratchBlocks -> ScratchBlocks4 - 13https://git.io/JO7AG [17:40:03] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JO5fn [17:40:04] * Reception123 hopes this works [17:40:05] [02miraheze/mw-config] 07Reception123 0309396eb - ScratchBlocks -> ScratchBlocks4 (#3855) [17:40:06] [02mw-config] 07Reception123 synchronize pull request 03#3845: Merge 'master' into REL1_36 - 13https://git.io/JOKA0 [17:41:09] miraheze/mw-config - Reception123 the build passed. [17:41:39] PROBLEM - mw11 Puppet on mw11 is WARNING: WARNING: Puppet is currently disabled, message: Reception123, last run 7 minutes ago with 0 failures [17:41:43] PROBLEM - mw9 Puppet on mw9 is WARNING: WARNING: Puppet is currently disabled, message: Reception123, last run 7 minutes ago with 0 failures [17:41:52] PROBLEM - mw8 Puppet on mw8 is WARNING: WARNING: Puppet is currently disabled, message: Reception123, last run 7 minutes ago with 0 failures [17:42:13] PROBLEM - mw10 Puppet on mw10 is WARNING: WARNING: Puppet is currently disabled, message: Reception123, last run 8 minutes ago with 0 failures [17:47:07] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:51:54] RhinosF1: do you have access? I had to delete /extensions because there were some conflicts but now composer is mad [17:52:19] and all extension dirs are empty [17:55:02] Reception123: just deleted w [17:55:07] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [17:55:07] And no I don't have access [17:55:10] Delete* [17:55:19] I thought about that but wouldn't composer still be mad? [17:55:51] Composer install [17:55:53] PROBLEM - test3 MediaWiki Rendering on test3 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 261 bytes in 0.041 second response time [17:55:59] Like paladox said [17:56:04] In w [17:56:15] After running puppet once [17:57:51] I'll try that then [17:57:52] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 MediaWiki configuration Error - 1297 bytes in 0.033 second response time [18:01:51] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 1260 bytes in 0.303 second response time [18:02:01] That sounds good [18:07:40] RhinosF1: nope, 404 [18:07:48] there's nothing in /srv/mediawiki/w/cache [18:07:54] PROBLEM - test3 MediaWiki Rendering on test3 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 2502 bytes in 0.024 second response time [18:08:01] Eh [18:08:04] It went ok [18:08:41] Reception123: try sudo -u www-data composer install again [18:09:10] tried that too and it hates it even more [18:09:13] reception@test3:/srv/mediawiki/w/cache$ sudo -u www-data composer install [18:09:13] sudo: composer: command not found [18:09:38] ./usr/bin/composer then maybe Reception123 [18:09:59] Reception123, have you tried out the logging from your ssh session? [18:10:11] still doesn't like [18:10:15] Ooh no [18:10:25] dmehus: not sure what you mean [18:10:28] php composer.phar install --no-dev [18:10:31] In w [18:10:34] Reception123: ^ [18:10:42] Actually looking at puppet would have helped me [18:10:47] dmehus: no [18:10:48] with MirahezeLSBot, so you don't have to log to SAL by typing on IRC anymore [18:10:53] test3 hates us today [18:10:53] Could not open input file: composer.phar [18:11:10] dmehus: well I won't log anything since it's test3 [18:11:15] oh true [18:11:20] yeah don't have to log stuff there [18:11:24] Try in CreateWiki folder Reception123 [18:11:30] other than maybe dropping test3wiki [18:11:55] https://www.irccloud.com/pastebin/txtE55EC/ [18:11:56] [ Snippet | IRCCloud ] - www.irccloud.com [18:12:02] dmehus: that won't help heh, that's not the issue [18:12:24] Okay I'm confused [18:12:33] paladox: how fix create wiki cache [18:12:41] Reception123: You need to install the composer phar file from composers website. And place composer.phar in /w directory. That was what paladox told me last time. And also will need `sudo -u www-data php /srv/mediawiki/w/maint*/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki` at some point. [18:12:46] Bar removing it from w folder [18:13:17] * RhinosF1 thinks removing create wiki cache from w would be better in future [18:13:21] What version of composer [18:13:32] Whatever works on test3! [18:13:46] I was just thinking that actually, of copying composer.phar [18:14:27] Reception123: make sure composer v1 not v2 though I think. [18:15:30] got it [18:15:38] copied it from a mw server [18:15:51] /home/reception/.composer/cache/repo/https- [18:16:13] it's trying to use your home dir [18:16:16] run it as root [18:16:18] https://phabricator.miraheze.org/T7192 [18:16:19] [ ⚓ T7192 Don't store CW cache in w folder ] - phabricator.miraheze.org [18:16:21] then chrown it as www-data [18:16:25] oh, ok [18:17:51] RhinosF1: that can be done by changing a config [18:17:53] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 771 bytes in 0.339 second response time [18:18:15] paladox: yep, just needs doing [18:19:36] finally fixed! [18:19:40] thanks for helping paladox : [18:19:52] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20764 bytes in 0.400 second response time [18:20:32] Yey! [18:20:35] now for the fun time of depooling mw* again [18:23:43] !log depool mw8 [18:23:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:23:48] PROBLEM - wiki.mlpwiki.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mlpwiki.net reverse DNS resolves to 192-185-16-85.unifiedlayer.com [18:25:33] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv on mw8 [18:25:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:25:39] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw8 [18:25:43] !log repool mw8 ; depool mw9 [18:25:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:25:51] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [18:25:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:26:13] PROBLEM - cp10 Varnish Backends on cp10 is CRITICAL: 1 backends are down. mw9 [18:26:36] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw9 [18:27:34] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv on mw9 [18:27:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:39] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw9 [18:27:43] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [18:27:43] !log repool mw9 ; depool mw10 [18:27:44] PROBLEM - cp12 Varnish Backends on cp12 is CRITICAL: 1 backends are down. mw9 [18:27:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:13] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:28:58] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv on mw10 [18:29:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:03] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw10 [18:29:07] !log repool mw10 ; depool mw11 [18:29:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:37] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:30:47] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.76, 6.95, 5.55 [18:31:10] !log cd /srv/mediawiki/w/extensions && sudo -u www-data git reset --hard origin/REL1_35 && sudo -u www-data git pull ; sudo -u www-data git submodule update && sudo puppet agent --enable && sudo puppet agent -tv on mw11 [18:31:14] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw11 [18:31:16] !log repool mw11 [18:31:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:31:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:31:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:31:59] PROBLEM - cp11 Varnish Backends on cp11 is CRITICAL: 1 backends are down. mw11 [18:32:48] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.98, 7.82, 6.01 [18:36:36] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 7 backends are healthy [18:37:45] RECOVERY - cp12 Varnish Backends on cp12 is OK: All 7 backends are healthy [18:37:58] RECOVERY - cp11 Varnish Backends on cp11 is OK: All 7 backends are healthy [18:38:13] RECOVERY - cp10 Varnish Backends on cp10 is OK: All 7 backends are healthy [18:38:46] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.24, 7.43, 6.71 [18:38:46] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.22, 7.05, 6.49 [18:40:45] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.22, 6.03, 6.29 [18:40:46] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.66, 6.27, 6.27 [19:21:09] [02puppet] 07Universal-Omega opened pull request 03#1747: Add scratchblocks.github.io to CSP whitelist - 13https://git.io/JO5Ga [19:21:33] ^ paladox could you please sign off, it's for the ScratchBlocks extension [19:21:51] it's fine [19:21:55] thanks [19:22:09] [02puppet] 07Reception123 commented on pull request 03#1747: Add scratchblocks.github.io to CSP whitelist - 13https://git.io/JO5GD [19:22:12] [02puppet] 07Reception123 closed pull request 03#1747: Add scratchblocks.github.io to CSP whitelist - 13https://git.io/JO5Ga [19:22:13] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JO5GS [19:22:15] [02miraheze/puppet] 07Universal-Omega 032920088 - Add scratchblocks.github.io to CSP whitelist (#1747) [20:35:24] PROBLEM - mw8 Check Gluster Clients on mw8 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [20:35:26] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.60, 7.12, 5.05 [20:35:31] PROBLEM - mw9 Check Gluster Clients on mw9 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [20:35:36] paladox: ^ [20:35:43]