[00:02:54] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 39.42, 25.89, 17.45
[00:03:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.95, 21.99, 19.58
[00:04:50] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 17.09, 22.06, 17.04
[00:04:50] <icinga-miraheze>	 PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 3.43, 2.93, 1.75
[00:06:46] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 27.53, 23.67, 18.15
[00:06:50] <icinga-miraheze>	 PROBLEM - graylog1 Current Load on graylog1 is CRITICAL: CRITICAL - load average: 5.47, 3.93, 2.27
[00:07:18] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-3485-revert-3482-Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/Jkd2R
[00:07:19] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03c93eb2c - fix
[00:07:21] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3487: Translate requires UniversalLanguageSelector - 13https://git.io/JkdzY
[00:07:40] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3487: Translate requires UniversalLanguageSelector - 13https://git.io/JkdzY
[00:07:42] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jkd20
[00:07:43] <Not>	 [02miraheze/mw-config] 07Universal-Omega 034fdc741 - Translate requires UniversalLanguageSelector (#3487) * Revert "Revert "Translate requires UniversalLanguageSelector (#3482)" (#3485)" This reverts commit 1ca53a88e49704abb284ec3c6f13dcebc0478096. * fix
[00:07:45] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03revert-3485-revert-3482-Universal-Omega-patch-4 - 13https://git.io/vbvb3
[00:07:46] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-3485-revert-3482-Universal-Omega-patch-4
[00:07:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.26, 22.08, 20.00
[00:08:22] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3480: Migrate UrlShortener to ManageWikiExtensions (T6505) - 13https://git.io/JkdcG
[00:08:23] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/Jkd2a
[00:08:25] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03cae3072 - Migrate UrlShortener to ManageWikiExtensions (T6505) (#3480) * Migrate UrlShortener to ManageWikiExtensions * rename variable * add UrlShortener
[00:08:26] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3
[00:08:28] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3
[00:08:42] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.21, 21.82, 18.12
[00:09:55] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.41, 20.54, 19.70
[00:10:50] <icinga-miraheze>	 PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 2.90, 3.60, 2.54
[00:11:58] <Not>	 [02mw-config] 07paladox closed pull request 03#3488: Move DataDump configs to LS - 13https://git.io/Jkdzp
[00:12:00] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jkd2d
[00:12:01] <Not>	 [02miraheze/mw-config] 07paladox 03f8866db - Move DataDump configs to LS (#3488) * Move DataDump configs to LS * Update LocalExtensions.php
[00:12:03] <Not>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[00:12:04] <Not>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[00:12:08] <travis-ci>	 miraheze/mw-config/revert-3483-Universal-Omega-patch-4/f72b50e - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746349958
[00:13:19] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/Jkd2h
[00:13:21] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03b2771cd - VisualEditor requires templatedata
[00:13:22] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3
[00:13:28] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#3489: VisualEditor requires TemplateData - 13https://git.io/Jkd2j
[00:13:56] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.87, 21.87, 20.35
[00:14:50] <icinga-miraheze>	 RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 2.00, 2.97, 2.57
[00:15:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.73, 20.62, 20.08
[00:18:27] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.63, 19.32, 18.91
[00:19:17] <Not>	 [02landing] 07Aftabuzzaman commented on pull request 03#41: Update translations.php - 13https://git.io/JkdaP
[00:21:08] <Not>	 [02landing] 07Aftabuzzaman closed pull request 03#48: Bangla/বাংলা (bn) translation - 13https://git.io/JkdUB
[00:22:26] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.00, 21.76, 19.85
[00:22:29] <Not>	 [02landing] 07Aftabuzzaman commented on pull request 03#48: Bangla/বাংলা (bn) translation - 13https://git.io/JkdVv
[00:25:56] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.05, 19.63, 20.21
[00:26:28] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.89, 20.34, 19.86
[00:26:47] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3489: VisualEditor requires TemplateData - 13https://git.io/Jkd2j
[00:26:49] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkdVu
[00:26:50] <Not>	 [02miraheze/mw-config] 07Universal-Omega 033b98a23 - VisualEditor requires templatedata (#3489)
[00:26:52] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3
[00:26:53] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4
[00:27:00] <Universal_Omega>	 !log sudo -u www-data /usr/local/bin/foreachwikiindblist /home/universalomega/visualeditor.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php templatedata on Jobrunner1
[00:27:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:29:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.80, 20.12, 20.51
[00:32:27] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 23.21, 20.45, 19.79
[00:33:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.82, 18.52, 19.93
[00:34:27] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.09, 19.37, 19.55
[00:36:01] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JkdwW
[00:36:02] <Not>	 [02miraheze/mw-config] 07Universal-Omega 031b6ed60 - Remove wfLoadExt for TemplateData under VisualEditor
[00:36:04] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3
[00:36:05] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#3490: Remove wfLoadExt for TemplateData under VisualEditor - 13https://git.io/Jkdw4
[00:36:29] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3490: Remove wfLoadExt for TemplateData under VisualEditor - 13https://git.io/Jkdw4
[00:36:30] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jkdw0
[00:36:32] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03cc3f742 - Remove wfLoadExt for TemplateData under VisualEditor (#3490)
[00:36:33] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3
[00:36:35] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3
[00:37:33] <travis-ci>	 miraheze/mw-config/revert-3482-Universal-Omega-patch-4/5412d59 - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746350452
[00:38:05] <Not>	 [02landing] 07Aftabuzzaman commented on pull request 03#42: Update index.php - 13https://git.io/Jkdw6
[00:46:18] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JkdrB
[00:46:19] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03c523964 - Remove uneeded donateboxinsidebar
[00:46:21] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3
[00:46:22] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3-1 [+0/-0/±1] 13https://git.io/JkdrR
[00:46:24] <Not>	 [02miraheze/mw-config] 07Universal-Omega 037020c88 - Remove uneeded donateboxinsidebar
[00:46:25] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3-1 - 13https://git.io/vbvb3
[00:46:36] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#3491: Remove uneeded donateboxinsidebar - 13https://git.io/Jkdrz
[00:46:58] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3-1
[00:47:00] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3-1 - 13https://git.io/vbvb3
[00:47:43] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JkdrK
[00:47:45] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03ef6a95e - Remove DonateBoxInSidebar
[00:47:46] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3491: Remove uneeded donateboxinsidebar - 13https://git.io/Jkdrz
[00:48:25] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JkdrM
[00:48:27] <Not>	 [02miraheze/mw-config] 07Universal-Omega 039241e68 - Remove DonateBoxInSidebar
[00:48:28] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3491: Remove uneeded donateboxinsidebar - 13https://git.io/Jkdrz
[00:51:41] <Not>	 [02mw-config] 07Universal-Omega edited pull request 03#3491: Remove uneeded donateboxinsidebar - 13https://git.io/Jkdrz
[00:53:48] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/Jkdot
[00:53:49] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03e231370 - remove unused and outdated CirrusSearch section
[00:53:51] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3
[00:53:56] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#3492: remove unused and outdated CirrusSearch section - 13https://git.io/Jkdoq
[00:58:35] <Not>	 [02landing] 07Aftabuzzaman commented on pull request 03#41: Update translations.php - 13https://git.io/JkdoV
[00:59:17] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/Jkdo6
[00:59:19] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03b9c4615 - remove Elastica and CirrusSearch
[00:59:20] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3492: remove unused and outdated CirrusSearch section - 13https://git.io/Jkdoq
[01:00:14] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/Jkdoy
[01:00:16] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03d0656d2 - remove CirrusSearch
[01:00:17] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3492: remove unused and outdated CirrusSearch section - 13https://git.io/Jkdoq
[01:01:05] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3492: remove unused and outdated CirrusSearch section - 13https://git.io/Jkdoq
[01:01:07] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JkdoN
[01:01:08] <Not>	 [02miraheze/mw-config] 07Universal-Omega 0309494bd - remove unused and outdated CirrusSearch section (#3492) * remove unused and outdated CirrusSearch section * remove Elastica and CirrusSearch * remove CirrusSearch
[01:01:10] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3
[01:01:11] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4
[01:02:33] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3491: Remove uneeded donateboxinsidebar - 13https://git.io/Jkdrz
[01:02:35] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JkdKe
[01:02:36] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03da0c60d - Remove uneeded donateboxinsidebar (#3491) * Remove uneeded donateboxinsidebar * Remove DonateBoxInSidebar * Remove DonateBoxInSidebar
[01:02:38] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3
[01:02:40] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3
[01:02:46] <travis-ci>	 miraheze/mw-config/revert-3484-revert-3483-Universal-Omega-patch-4/e06a66c - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746351242
[01:05:06] <icinga-miraheze>	 PROBLEM - pastport.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pastport.org' expires in 15 day(s) (Mon 14 Dec 2020 00:58:30 GMT +0000).
[01:10:27] <Not>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-3/±2] 13https://git.io/JkdK7
[01:10:28] <Not>	 [02miraheze/mediawiki] 07Universal-Omega 03b25da2b - Removed DonateBoxInSidebar, Elastica, and CirrusSearch
[01:10:30] <Not>	 [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[01:12:16] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jkd6J
[01:12:17] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 034a00bea - Bot: Update SSL cert for pastport.org
[01:12:22] <Not>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jkd6U
[01:12:24] <Not>	 [02miraheze/mediawiki] 07Universal-Omega 030f8dbff - Rebase CreateWiki
[01:13:49] <Not>	 [02mediawiki] 07Universal-Omega opened pull request 03#608: Removed DonateBoxInSidebar, Elastica, and CirrusSearch - 13https://git.io/Jkd6G
[01:15:01] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/Jkd68
[01:15:03] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03eeb8ce8 - DataDump to global extension
[01:15:05] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3
[01:15:08] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#3493: DataDump to global extension - 13https://git.io/Jkd64
[01:15:41] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/Jkd60
[01:15:43] <Not>	 [02miraheze/mw-config] 07Universal-Omega 032796bf5 - datadump to global
[01:15:45] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3493: DataDump to global extension - 13https://git.io/Jkd64
[01:16:17] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/Jkd6u
[01:16:19] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03361af10 - Add DataDump
[01:16:20] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3493: DataDump to global extension - 13https://git.io/Jkd64
[01:25:57] <icinga-miraheze>	 RECOVERY - pastport.org - LetsEncrypt on sslhost is OK: OK - Certificate 'pastport.org' will expire on Fri 26 Feb 2021 00:12:09 GMT +0000.
[01:26:05] <travis-ci>	 miraheze/mw-config/paladox-patch-1/0b47036 - paladox The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746352453
[01:26:47] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3493: DataDump to global extension - 13https://git.io/Jkd64
[01:26:49] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JkdiA
[01:26:50] <Not>	 [02miraheze/mw-config] 07Universal-Omega 0359624fc - DataDump to global extension (#3493) * DataDump to global extension * datadump to global * Add DataDump
[01:26:52] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3
[01:26:53] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3
[01:27:47] <Not>	 [02mediawiki] 07Universal-Omega closed pull request 03#608: Removed DonateBoxInSidebar, Elastica, and CirrusSearch - 13https://git.io/Jkd6G
[01:27:49] <Not>	 [02miraheze/mediawiki] 07Universal-Omega pushed 033 commits to 03REL1_35 [+0/-6/±4] 13https://git.io/JkdPT
[01:27:50] <Not>	 [02miraheze/mediawiki] 07Universal-Omega 0395aed78 - Merge pull request #608 from miraheze/Universal-Omega-patch-1 Removed DonateBoxInSidebar, Elastica, and CirrusSearch
[01:27:52] <Not>	 [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[01:27:53] <Not>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[01:36:03] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.61, 20.50, 19.42
[01:37:57] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.00, 19.72, 19.32
[01:40:00] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:40:22] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:40:44] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:40:54] <icinga-miraheze>	 PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:45:39] <travis-ci>	 miraheze/mw-config/revert-3485-revert-3482-Universal-Omega-patch-4/c93eb2c - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746354185
[01:46:23] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures
[01:46:43] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures
[01:46:52] <icinga-miraheze>	 RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[01:48:08] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:02:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.49, 20.84, 20.08
[02:04:48] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 20.15, 20.30, 19.94
[02:15:16] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkdSl
[02:15:18] <Not>	 [02miraheze/mw-config] 07Universal-Omega 0300f2532 - add wfLoadSkin back
[02:15:19] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3478: Migrate Minerva skin to ManageWikiExtensions - 13https://git.io/JkMgg
[02:16:16] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkdSE
[02:16:18] <Not>	 [02miraheze/mw-config] 07Universal-Omega 0306b9369 - temp comment out required val
[02:16:19] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3478: Migrate Minerva skin to ManageWikiExtensions - 13https://git.io/JkMgg
[02:16:41] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3478: Migrate Minerva skin to ManageWikiExtensions - 13https://git.io/JkMgg
[02:16:42] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JkdSV
[02:16:44] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03a573b8a - Migrate Minerva skin to ManageWikiExtensions (#3478) * Migrate Minerva skin to MWE * add vars * add * add wfLoadSkin back * temp comment out required val
[02:16:45] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[02:16:47] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2
[02:19:40] <travis-ci>	 miraheze/mw-config/Universal-Omega-patch-3-1/7020c88 - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746358711
[02:34:25] <travis-ci>	 miraheze/mw-config/Universal-Omega-patch-4/d0656d2 - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746360234
[02:34:26] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JkdHw
[02:34:28] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03f7bf366 - extensions-skins text to skins
[02:34:29] <Not>	 [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX
[02:34:31] <Not>	 [02MirahezeMagic] 07Universal-Omega opened pull request 03#155: extensions-skins text to skins - 13https://git.io/JkdHr
[02:35:16] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JkdHi
[02:35:17] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03db0ac5e - change
[02:35:19] <Not>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#155: extensions-skins text to skins - 13https://git.io/JkdHr
[02:37:10] <Not>	 [02MirahezeMagic] 07dmehus opened pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkdHj
[02:42:10] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkdQD
[02:42:11] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03d817223 - remove wfLoadext for Minerva
[02:42:13] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[02:42:14] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#3494: remove wfLoadext for Minerva - 13https://git.io/JkdQS
[02:42:54] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkdQb
[02:42:55] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03247545f - MF require Minerva
[02:42:57] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3494: remove wfLoadext for Minerva - 13https://git.io/JkdQS
[02:47:12] <travis-ci>	 miraheze/mw-config/Universal-Omega-patch-3/361af10 - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746361471
[02:49:19] <Not>	 [02landing] 07Aftabuzzaman opened pull request 03#49: add Bengali (বাংলা) - 13https://git.io/Jkd5m
[02:50:12] <Not>	 [02landing] 07Aftabuzzaman commented on pull request 03#41: Update translations.php - 13https://git.io/Jkd55
[02:50:28] <Not>	 [02landing] 07Aftabuzzaman edited a comment on pull request 03#41: Update translations.php - 13https://git.io/Jkd55
[02:52:45] <Not>	 [02landing] 07Universal-Omega synchronize pull request 03#41: Update translations.php - 13https://git.io/JU0df
[02:54:10] <Not>	 [02landing] 07Universal-Omega closed pull request 03#41: Update translations.php - 13https://git.io/JU0df
[02:54:11] <Not>	 [02miraheze/landing] 07Universal-Omega pushed 035 commits to 03master [+0/-0/±6] 13https://git.io/Jkddi
[02:54:12] <Not>	 [02miraheze/landing] 07ahmsaqib 03f9e9697 - Update translations.php Bengali translation completed Name of the language - Bengali Code- bn Area - Bangladesh / India Translator- A H M Saqib Miraheze Username - ahmsaqib
[02:54:14] <Not>	 [02miraheze/landing] 07ahmsaqib 03f10c439 - Merge branch 'master' into patch-1
[02:54:16] <Not>	 [02miraheze/landing] 07ahmsaqib 031cd1587 - Update translations.php
[02:54:17] <Not>	 [02miraheze/landing] ... and 2 more commits.
[02:54:49] <Not>	 [02landing] 07Universal-Omega closed pull request 03#49: add Bengali (বাংলা) - 13https://git.io/Jkd5m
[02:54:50] <Not>	 [02miraheze/landing] 07Universal-Omega pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/JkddN
[02:54:52] <Not>	 [02miraheze/landing] 07Aftabuzzaman 0389f5e09 - add Bengali (বাংলা)
[02:54:53] <Not>	 [02miraheze/landing] 07Universal-Omega 03ccc3230 - Merge pull request #49 from Aftabuzzaman/patch-3 add Bengali (বাংলা)
[02:55:11] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkdFc
[02:55:13] <Not>	 [02miraheze/services] 07MirahezeSSLBot 031138b5c - BOT: Updating services config for wikis
[02:58:04] <Not>	 [02landing] 07Aftabuzzaman opened pull request 03#50: add Bengali (বাংলা) - 13https://git.io/JkdFx
[02:58:38] <Not>	 [02landing] 07Universal-Omega closed pull request 03#50: add Bengali (বাংলা) - 13https://git.io/JkdFx
[02:58:40] <Not>	 [02miraheze/landing] 07Universal-Omega pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/JkdbY
[02:58:41] <Not>	 [02miraheze/landing] 07Aftabuzzaman 03df526a8 - add Bengali (বাংলা)
[02:58:43] <Not>	 [02miraheze/landing] 07Universal-Omega 0378c8d97 - Merge pull request #50 from Aftabuzzaman/patch-4 add Bengali (বাংলা)
[03:03:29] <Universal_Omega>	 !log sudo -u www-data /usr/local/bin/foreachwikiindblist /home/universalomega/mobilefrontend.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php minervaneue on Jobrunner1
[03:03:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[03:03:57] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3494: remove wfLoadext for Minerva - 13https://git.io/JkdQS
[03:03:58] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jkdbh
[03:04:00] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03a7cf2db - remove wfLoadext for Minerva (#3494) * remove wfLoadext for Minerva * MF require Minerva
[03:04:01] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2
[03:04:03] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[03:05:03] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.66, 20.97, 18.44
[03:05:07] <Not>	 [02landing] 07Aftabuzzaman commented on pull request 03#41: Update translations.php - 13https://git.io/JkdNt
[03:06:26] <Not>	 [02landing] 07Universal-Omega commented on pull request 03#41: Update translations.php - 13https://git.io/JkdNW
[03:06:57] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.21, 19.14, 18.06
[03:12:14] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkdAJ
[03:12:16] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03de22153 - remove "(Skin)" from skins, since they are in a skin tab
[03:12:17] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[03:12:19] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#3495: remove "(Skin)" from skins, since they are in a skin tab - 13https://git.io/JkdAU
[03:14:10] <Not>	 [02landing] 07Aftabuzzaman opened pull request 03#51: fixing bn mistake - 13https://git.io/JkdAZ
[03:14:24] <travis-ci>	 miraheze/MirahezeMagic/Universal-Omega-patch-1/db0ac5e - Universal Omega The build passed. https://travis-ci.org/miraheze/MirahezeMagic/builds/746369178
[03:14:38] <Not>	 [02landing] 07Aftabuzzaman commented on pull request 03#41: Update translations.php - 13https://git.io/JkdAC
[03:15:20] <Not>	 [02landing] 07Universal-Omega closed pull request 03#51: fixing bn mistake - 13https://git.io/JkdAZ
[03:15:22] <Not>	 [02miraheze/landing] 07Universal-Omega pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/JkdAB
[03:15:23] <Not>	 [02miraheze/landing] 07Aftabuzzaman 031d55c8f - fixing bn mistake
[03:15:25] <Not>	 [02miraheze/landing] 07Universal-Omega 03315d4cd - Merge pull request #51 from Aftabuzzaman/patch-5 fixing bn mistake
[03:17:10] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkdA6
[03:17:12] <Not>	 [02miraheze/mw-config] 07Universal-Omega 038a2ec32 - Remove unneeded comments since there are conflicts in MWE
[03:17:36] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3495: remove "(Skin)" from skins, since they are in a skin tab - 13https://git.io/JkdAU
[03:17:37] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkdAM
[03:17:39] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03cc7e9c4 - remove "(Skin)" from skins, since they are in a skin tab (#3495)
[03:17:40] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[03:17:42] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2
[03:23:00] <Not>	 [02MirahezeMagic] 07Universal-Omega closed pull request 03#155: extensions-skins text to skins - 13https://git.io/JkdHr
[03:23:02] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 033 commits to 03master [+0/-0/±4] 13https://git.io/JkdxW
[03:23:03] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega 030f7ac33 - Merge pull request #155 from miraheze/Universal-Omega-patch-1 extensions-skins text to skins
[03:23:05] <Not>	 [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fQRGX
[03:23:06] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[03:36:23] <Not>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±2] 13https://git.io/Jkdh3
[03:36:25] <Not>	 [02miraheze/mediawiki] 07Universal-Omega 032f41d11 - Update MirahezeMagic and Cosmos
[03:36:26] <Not>	 [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[03:37:45] <Not>	 [02mediawiki] 07Universal-Omega opened pull request 03#609: Update MirahezeMagic and Cosmos - 13https://git.io/JkdhW
[03:38:32] <Not>	 [02mediawiki] 07Universal-Omega closed pull request 03#609: Update MirahezeMagic and Cosmos - 13https://git.io/JkdhW
[03:38:33] <Not>	 [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-0/±4] 13https://git.io/Jkdh4
[03:38:35] <Not>	 [02miraheze/mediawiki] 07Universal-Omega 03b540e31 - Merge pull request #609 from miraheze/Universal-Omega-patch-1 Update MirahezeMagic and Cosmos
[03:38:48] <Not>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[03:38:50] <Not>	 [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[03:43:21] <travis-ci>	 miraheze/mw-config/Universal-Omega-patch-2/de22153 - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746372477
[03:50:19] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[03:50:24] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[03:50:45] <travis-ci>	 miraheze/landing/master/315d4cd - Universal Omega The build passed. https://travis-ci.org/miraheze/landing/builds/746372775
[03:54:19] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[03:54:24] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[03:56:34] <Universal_Omega>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* and jobrunner*
[03:56:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[03:56:55] <travis-ci>	 miraheze/mw-config/master/cc7e9c4 - Universal Omega The build passed. https://travis-ci.org/miraheze/mw-config/builds/746372951
[03:59:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.26, 21.26, 18.35
[04:04:28] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 21.63, 20.13, 16.25
[04:06:26] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 19.24, 19.78, 16.58
[04:07:56] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.09, 23.59, 21.28
[04:09:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.91, 24.23, 21.75
[04:10:51] <icinga-miraheze>	 PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 3.42, 3.38, 2.42
[04:12:29] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 23.72, 22.02, 18.52
[04:13:39] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 6.53, 6.99, 5.59
[04:14:31] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 33.98, 25.78, 20.28
[04:14:50] <icinga-miraheze>	 RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 1.60, 3.03, 2.55
[04:15:39] <icinga-miraheze>	 RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 5.30, 6.45, 5.56
[04:15:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.45, 22.38, 22.00
[04:16:28] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 16.11, 22.36, 19.72
[04:17:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.05, 25.70, 23.24
[04:18:26] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 10.15, 18.06, 18.47
[04:19:57] <icinga-miraheze>	 PROBLEM - pol.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pol.wiki' expires in 15 day(s) (Mon 14 Dec 2020 04:16:26 GMT +0000).
[04:23:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.84, 22.40, 22.50
[04:26:21] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkFIJ
[04:26:23] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 03d15f181 - Bot: Update SSL cert for pol.wiki
[04:29:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.23, 17.23, 20.19
[04:33:38] <icinga-miraheze>	 RECOVERY - pol.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'pol.wiki' will expire on Fri 26 Feb 2021 03:26:13 GMT +0000.
[04:53:33] <musikanimal>	 Hi, it looks like Minerva disappeared?
[05:02:17] <musikanimal>	 Universal_Omega: is this a known issue?
[05:07:16] <musikanimal>	 It was undeoloyed, apparently
[05:11:35] <musikanimal>	 https://phabricator.miraheze.org/T6512
[05:11:36] <MirahezeBot>	 [ ⚓ T6512 MinervaNeue skin disappeared ] - phabricator.miraheze.org
[05:17:07] <Not>	 [02MirahezeMagic] 07dmehus commented on pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkFOP
[05:18:29] <Universal_Omega>	 @musikanimal: minerva was moved to ManageWikiExtensions
[05:20:05] <musikanimal>	 I tried re-enabling through ManageWiki, no dice :( 
[05:20:19] <musikanimal>	 03:03 Universal_Omega: sudo -u www-data /usr/local/bin/foreachwikiindblist /home/universalomega/mobilefrontend.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php minervaneue on Jobrunner1
[05:20:24] <Not>	 [02MirahezeMagic] 07Universal-Omega commented on pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkF3Y
[05:20:33] <musikanimal>	 that looks suspect
[05:21:27] <Universal_Omega>	 That just enables it on all wikis which mobilefrontend was enabled. 
[05:22:57] <Universal_Omega>	 @musikanimal: Oh,whoops , fixing now... I forgot to add the wfloadextension decleration
[05:23:29] <musikanimal>	 You  sure it didn't disable it? I don't see Minerva at https://meta.miraheze.org/wiki/Special:Version
[05:23:31] <MirahezeBot>	 [ Version - Miraheze Meta ] - meta.miraheze.org
[05:23:41] <musikanimal>	 Oh okay :)
[05:24:02] <Universal_Omega>	 The script did not, I forgot to add it the load deceleration. Sorry about that.
[05:24:41] <musikanimal>	 It happens
[05:24:42] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JkF3V
[05:24:44] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03ce299bf - add MinervaNeue
[05:24:45] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[05:24:47] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#3496: add MinervaNeue - 13https://git.io/JkF3w
[05:24:54] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3496: add MinervaNeue - 13https://git.io/JkF3w
[05:24:56] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkF3r
[05:24:57] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03dbf7556 - add MinervaNeue (#3496)
[05:25:17] <Not>	 [02MirahezeMagic] 07dmehus commented on pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkF3P
[05:25:21] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[05:25:22] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2
[05:25:42] <Universal_Omega>	 @musikanimal: Thanks for reporting that
[05:26:21] <musikanimal>	 Thanks for the prompt support!
[05:27:00] <travis-ci>	 miraheze/mw-config/Universal-Omega-patch-2/ce299bf - Universal Omega The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746383773
[05:27:17] <Universal_Omega>	 @musikanimal: No problem
[05:28:27] <Not>	 [02MirahezeMagic] 07Universal-Omega commented on pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkFs3
[05:30:27] <Not>	 [02MirahezeMagic] 07Universal-Omega reviewed pull request 03#156 commit - 13https://git.io/JkFsW
[05:31:40] <dmehus>	 @Universal_Omega Can you see this thread on [[community noticeboard]] (https://meta.miraheze.org/w/index.php?diff=147257&oldid=147178&rcid=556405&diffmode=source)? Seems like it's possibly related to the MinervaNeue skin issue you were discussing with @musikanimal
[05:31:43] <MirahezeBot>	 [ Difference between revisions of "Community noticeboard" - Miraheze Meta ] - meta.miraheze.org
[05:32:05] <dmehus>	 It may not be, but you might be able to assist them as it is a more technical question related to skins and that's your area.
[05:32:10] <Universal_Omega>	 @dmehus I already fixed that...looking now though.
[05:32:21] <dmehus>	 @Universal_Omega Okay, thanks. :)
[05:35:16] <Not>	 [02MirahezeMagic] 07dmehus reviewed pull request 03#156 commit - 13https://git.io/JkFGT
[05:36:06] <Not>	 [02MirahezeMagic] 07dmehus commented on pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkFGZ
[05:36:28] <Not>	 [02MirahezeMagic] 07Universal-Omega reviewed pull request 03#156 commit - 13https://git.io/JkFGl
[05:37:58] <Not>	 [02MirahezeMagic] 07Universal-Omega commented on pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkFGa
[05:38:54] <Not>	 [02MirahezeMagic] 07dmehus synchronize pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkdHj
[05:39:25] <dmehus>	 👍 @Univeral_Omega thanks, that was easy. I didn't know synchronization was automatic. :P
[05:39:47] <Universal_Omega>	 Yep, GH is awesome that way.
[05:40:02] <dmehus>	 Oh, cool. So can I edit that other qqq.json file in my same fork?
[05:40:07] <dmehus>	 and it'll add it to my PR?
[05:40:12] <Universal_Omega>	 yep
[05:40:14] <dmehus>	 ok
[05:40:17] <dmehus>	 let me try that
[05:41:50] <Not>	 [02MirahezeMagic] 07dmehus synchronize pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkdHj
[05:42:08] <dmehus>	 Okay, *looking now*
[05:42:34] <Universal_Omega>	 that's great!
[05:42:45] <musikanimal>	 Minerva looking good on my end now. Thanks!
[05:43:04] <Universal_Omega>	 No problem, glad it was fixed, and again sorry for the mistake.
[05:43:20] <Not>	 [02MirahezeMagic] 07Universal-Omega closed pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkdHj
[05:43:21] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 034 commits to 03master [+0/-0/±5] 13https://git.io/JkFZ3
[05:43:23] <Not>	 [02miraheze/MirahezeMagic] 07dmehus 033d1987e - Update miraheze-helpcenter message and add miraheze-faq message This GitHub PR accomplishes two things: (1) it revises the Miraheze Help Centre displayed sidebar text back to the U.S. English Miraheze Help Center per discussion with @Reception123 on Discord and (2) it adds a `miraheze-faq` interface message, per this `Meta:Administrators' noticeboard` request
[05:43:23] <Not>	 (https://meta.miraheze.org/w/index.php?title=Meta:Administrators'_noticeboard&diff=147171&oldid=147169&diffmode=source), so that it can be translated on translatewiki.net. Thanks
[05:43:24] <Not>	 [02miraheze/MirahezeMagic] 07dmehus 03f876955 - Alphabetize "miraheze-faq"
[05:43:25] <MirahezeBot>	 [ Difference between revisions of "Meta:Administrators' noticeboard" - Miraheze Meta ] - meta.miraheze.org
[05:43:26] <Not>	 [02miraheze/MirahezeMagic] 07dmehus 03109f3a4 - Adding miraheze-faq to list of defined MirahezeMagic custom interface messages
[05:43:27] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03cdb6f5b - Merge pull request #156 from dmehus/patch-1 Update miraheze-helpcenter message and add miraheze-faq message
[05:44:00] <Universal_Omega>	 @dmehus merged
[05:45:53] <musikanimal>	 Speaking of mobile, any plans to revisit https://phabricator.miraheze.org/T6362 ? Don't mean to sound pushy :) I'm definitely around to help too, though Jdlrobson is the real go-to. I think he can walk you through debugging steps, if needed
[05:45:55] <MirahezeBot>	 [ ⚓ T6362 Mobile.css / Mobile.js not loading since MW 1.35 upgrade ] - phabricator.miraheze.org
[05:46:40] <Not>	 [02MirahezeMagic] 07dmehus commented on pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkFZA
[05:47:53] <Not>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JkFnt
[05:47:55] <Not>	 [02miraheze/mediawiki] 07Universal-Omega 034320ffe - Updating MirahezeMagic
[05:47:56] <Not>	 [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[05:48:22] <Not>	 [02mediawiki] 07Universal-Omega opened pull request 03#610: Updating MirahezeMagic - 13https://git.io/JkFnY
[05:48:53] <Not>	 [02mediawiki] 07Universal-Omega closed pull request 03#610: Updating MirahezeMagic - 13https://git.io/JkFnY
[05:48:54] <Not>	 [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JkFn3
[05:48:55] <Not>	 [02miraheze/mediawiki] 07Universal-Omega 03c1d0d28 - Merge pull request #610 from miraheze/Universal-Omega-patch-1 Updating MirahezeMagic
[05:49:01] <Not>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[05:49:02] <Not>	 [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[05:49:46] <dmehus>	 @Universal_Omega Okay, great, thanks. 👍
[05:50:09] <Not>	 [02MirahezeMagic] 07Universal-Omega commented on pull request 03#156: Update miraheze-helpcenter message and add miraheze-faq message - 13https://git.io/JkFn0
[05:50:58] <Universal_Omega>	 @dmehus: You're welcome! I also updated MirahezeMagic, I'll run  RebuildLC once puppet runs successfully.
[05:55:13] <dmehus>	 @Universal_Omega Oh, okay, yeah I was wondering how come you created branch Universal-Omega-patch-1 as well, but I guess it wasn't really clear what was changed. Or is that how it works when someone with merge access merges a PR from someone that doesn't, it creates a separate branch? Like, for example, when paladox used to merge your PRs, did he create a branch in order to effect the merge from your fork?
[05:55:14] <dmehus>	 I guess that makes sense because my fork is in my own repository, so really it makes sense to merge them into a separate branch. Although, could you also push directly my fork to the master branch?
[05:56:15] <Universal_Omega>	 I did push to master branch.... I updated MirahezeMagic on the MediaWiki repo which is what that branch was from @dmehus 
[05:57:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.63, 20.85, 18.17
[05:59:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.98, 20.20, 18.29
[06:00:16] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[06:00:27] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[06:01:05] <icinga-miraheze>	 PROBLEM - jobrunner2 Puppet on jobrunner2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[06:03:02] <icinga-miraheze>	 RECOVERY - jobrunner2 Puppet on jobrunner2 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures
[06:04:16] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:04:28] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:12:23] <icinga-miraheze>	 RECOVERY - test2 MediaWiki Rendering on test2 is OK: HTTP OK: HTTP/1.1 200 OK - 19380 bytes in 1.313 second response time
[06:13:10] <Not>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkFlt
[06:13:12] <Not>	 [02miraheze/mw-config] 07Reception123 03608f33f - move two extensions to wfLoad
[06:22:09] <dmehus>	 @Universal_Omega Oh okay, thanks. LOL I guess GitHub branches and repos still confuse me a bit. :P
[07:13:04] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.29, 21.32, 19.05
[07:14:58] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.13, 19.43, 18.60
[07:37:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 32.11, 22.48, 19.45
[07:39:55] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.60, 21.29, 19.43
[07:41:56] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.81, 19.20, 18.90
[07:53:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.71, 21.61, 19.53
[07:57:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.84, 19.19, 19.12
[08:19:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.57, 21.95, 19.98
[08:31:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.32, 23.05, 21.32
[08:35:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.99, 22.27, 21.39
[08:39:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.52, 17.75, 19.86
[08:54:35] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.97, 20.94, 19.99
[08:58:22] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.29, 19.88, 19.85
[09:04:09] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.80, 23.03, 21.13
[09:04:25] <MirahezeBot>	 Hello helicopter! If you have any questions, feel free to ask and someone should answer soon.
[09:05:15] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 6.98, 9.10, 5.71
[09:05:56] <helicopter>	 Hi
[09:06:22] <helicopter>	 Anyone here to help
[09:07:13] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.27, 6.72, 5.23
[09:07:19] <helicopter>	 I have certain queries regarding 
[09:07:57] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.73, 18.66, 19.77
[09:15:01] <MH-Discord>	 <R4356th> Regarding what?
[09:18:30] <helicopter>	 Can I apply adsense for 
[09:18:40] <helicopter>	 The wiki
[09:19:41] <helicopter>	 I mean is it possible to use Adsense program in the used wiki
[09:20:13] <helicopter>	 In mirhaez
[09:22:51] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.96, 19.13, 15.82
[09:24:00] <MH-Discord>	 <R4356th> No, Miraheze does not allow wikis to have advertisements. It is a violation of the [[Content Policy]].
[09:24:01] <MH-Discord>	 <Wiki-Bot> https://meta.miraheze.org/wiki/Content_Policy
[09:24:01] <MirahezeBot>	 [ Content Policy - Miraheze Meta ] - meta.miraheze.org
[09:24:47] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 10.94, 15.97, 15.07
[09:27:19] <helicopter>	 Any other options to use it 
[09:29:06] <MH-Discord>	 <R4356th> What do you mean? You are not allowed to put advertisements in your wiki as I mentioned earlier.
[09:46:12] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.38, 20.00, 18.22
[09:48:05] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.51, 17.30, 17.46
[09:53:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.50, 21.39, 19.29
[09:55:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.27, 19.05, 18.66
[10:35:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 32.99, 24.49, 19.92
[10:37:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.90, 23.16, 19.98
[10:45:56] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.86, 19.06, 19.60
[11:11:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.99, 22.86, 20.53
[11:15:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.08, 20.03, 20.09
[11:33:17] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.68, 20.75, 19.94
[11:33:21] <MH-Discord>	 <RhinosF1> @System Administrators: Can someone see https://phabricator.miraheze.org/T6515
[11:33:21] <MirahezeBot>	 [ ⚓ T6515 Thumbnail generation seems to be broken ] - phabricator.miraheze.org
[11:33:40] <MH-Discord>	 <RhinosF1> JohnLewis: if you're online ^
[11:37:05] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.25, 22.84, 20.89
[11:38:58] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.59, 21.95, 20.78
[11:46:33] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.80, 19.49, 20.33
[12:00:22] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkbTm
[12:00:24] <Not>	 [02miraheze/services] 07MirahezeSSLBot 03dff1235 - BOT: Updating services config for wikis
[12:07:00] <Reception123>	 @RhinosF1 John isn't online and I really have no idea what to do with gluster, so we'll have to wait for Paladox
[12:07:41] <MH-Discord>	 <RhinosF1> @Reception123: okay, np
[12:08:06] <Reception123>	 @RhinosF1 yeah, I really wouldn't know where to start looking, and even if I did find it it would be very unlikely for me to know how to fix
[12:08:17] <Reception123>	 as gluster is quite complex
[12:08:21] <MH-Discord>	 <RhinosF1> Php logs would be the start
[12:08:26] <MH-Discord>	 <RhinosF1> Given its error 500s
[12:08:32] <MH-Discord>	 <RhinosF1> For static
[12:08:49] <MH-Discord>	 <RhinosF1> Or Apache logs
[12:09:01] <MH-Discord>	 <RhinosF1> Or nginx logs even
[12:09:08] <MH-Discord>	 <RhinosF1> isn't very awake
[12:16:24] <MH-Discord>	 <RhinosF1> @Reception123 ^
[12:18:17] <Reception123>	 I mean it doesn't tell us much at all
[12:18:29] <Reception123>	 2020/11/28 12:18:01 [error] <REDACTED> open() "/srv/mediawiki/w/CentralAuth/Denevs74" failed (2: No such file or directory), client: <REDACTED>, server: wiki.thunis.eu, request: "GET /w/CentralAuth/Denevs74 HTTP/1.1", host: "wiki.thunis.eu"
[12:18:37] <Reception123>	 ^ @RhinosF1
[12:19:18] <Reception123>	 don't know why it's saying that 
[12:19:41] <Reception123>	 though that's not even related to images
[12:25:51] <MH-Discord>	 <RhinosF1> Yeah that doesn't mean anything about static
[12:26:40] <MH-Discord>	 <RhinosF1> Look for things where host is static.miraheze.org @Reception123
[12:29:32] <MH-Discord>	 <Reception123> it's the same thing,  No such file or directory
[12:29:44] <MH-Discord>	 <RhinosF1> Hmm
[12:29:52] <MH-Discord>	 <RhinosF1> I was hoping something obvious
[12:40:06] <Not>	 [02CreateWiki] 07R4356th commented on pull request 03#174: Replace "Reason" with "Description" - 13https://git.io/JkbmC
[12:42:46] <MH-Discord>	 <RhinosF1> @Reception123: I found something
[12:46:51] <Not>	 [02CreateWiki] 07R4356th synchronize pull request 03#174: Replace "Reason" with "Description" - 13https://git.io/Jk5Qk
[12:47:10] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 7.94, 7.55, 4.56
[12:47:15] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.96, 23.41, 20.41
[12:49:13] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.29, 5.50, 4.16
[12:50:16] <Not>	 [02CreateWiki] 07R4356th synchronize pull request 03#174: Replace "Reason" with "Description" - 13https://git.io/Jk5Qk
[12:52:22] <RhinosF1>	 .op
[12:52:22] <MirahezeBot>	 Attempting to OP...
[12:53:38] <Not>	 [02CreateWiki] 07R4356th synchronize pull request 03#174: Replace "Reason" with "Description" - 13https://git.io/Jk5Qk
[12:54:22] <JohnLewis>	 !log remounted mediawiki-static on mw5
[12:54:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:54:29] <icinga-miraheze>	 RECOVERY - mw5 Check Gluster Clients on mw5 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs'
[12:54:58] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.19, 19.09, 19.60
[12:55:47] <Not>	 [02CreateWiki] 07R4356th commented on pull request 03#174: Replace "Reason" with "Description" - 13https://git.io/JkbOQ
[12:55:52] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures
[13:05:10] <Not>	 [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03revert-3486-revert-3484-revert-3483-Universal-Omega-patch-4 [+0/-0/±2] 13https://git.io/Jkbs4
[13:05:11] <Not>	 [02miraheze/mw-config] 07RhinosF1 03c2454f1 - Revert "Revert "Revert "TemplateWizard requires TemplateData (#3483)" (#3484)" (#3486)" This reverts commit fddda71d2371d1d6cc65253432b3588f8146a8e0.
[13:05:13] <Not>	 [02mw-config] 07RhinosF1 created branch 03revert-3486-revert-3484-revert-3483-Universal-Omega-patch-4 - 13https://git.io/vbvb3
[13:05:21] <Not>	 [02mw-config] 07RhinosF1 opened pull request 03#3497: Revert "TemplateWizard requires TemplateData" - 13https://git.io/JkbsB
[13:05:43] <RhinosF1>	 JohnLewis, Reception123: Can we merge ^
[13:06:38] <Not>	 [02mw-config] 07Reception123 closed pull request 03#3497: Revert "TemplateWizard requires TemplateData" - 13https://git.io/JkbsB
[13:06:40] <Not>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jkbs6
[13:06:41] <Not>	 [02miraheze/mw-config] 07RhinosF1 03af6d6b9 - Revert "Revert "Revert "TemplateWizard requires TemplateData (#3483)" (#3484)" (#3486)" (#3497) This reverts commit fddda71d2371d1d6cc65253432b3588f8146a8e0.
[13:06:51] <travis-ci>	 miraheze/mw-config/revert-3486-revert-3484-revert-3483-Universal-Omega-patch-4/c2454f1 - RhinosF1 The build passed. https://travis-ci.org/miraheze/mw-config/builds/746420433
[13:44:43] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.99, 20.63, 18.94
[13:46:37] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.33, 18.43, 18.35
[13:52:19] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 33.37, 24.41, 20.61
[13:56:07] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.22, 22.72, 20.96
[13:59:55] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 16.24, 19.37, 19.98
[14:03:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.81, 23.37, 21.52
[14:04:00] <icinga-miraheze>	 PROBLEM - archive.stellurgists.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for archive.stellurgists.wiki could not be found
[14:04:05] <icinga-miraheze>	 PROBLEM - commonswiki.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commonswiki.miraheze.org could not be found
[14:04:07] <icinga-miraheze>	 PROBLEM - www.baharna.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.baharna.org could not be found
[14:04:15] <icinga-miraheze>	 PROBLEM - factorio-mods.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for factorio-mods.tk could not be found
[14:05:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.91, 21.59, 21.10
[14:10:46] <icinga-miraheze>	 RECOVERY - archive.stellurgists.wiki - reverse DNS on sslhost is OK: rDNS OK - archive.stellurgists.wiki reverse DNS resolves to cp6.miraheze.org
[14:10:52] <icinga-miraheze>	 RECOVERY - commonswiki.miraheze.org - reverse DNS on sslhost is OK: rDNS OK - commonswiki.miraheze.org reverse DNS resolves to cp6.miraheze.org
[14:10:56] <icinga-miraheze>	 RECOVERY - www.baharna.org - reverse DNS on sslhost is OK: rDNS OK - www.baharna.org reverse DNS resolves to cp6.miraheze.org
[14:11:11] <icinga-miraheze>	 RECOVERY - factorio-mods.tk - reverse DNS on sslhost is OK: rDNS OK - factorio-mods.tk reverse DNS resolves to cp6.miraheze.org
[14:11:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.69, 22.45, 21.45
[14:12:42] <paladox>	 !log root@test2:/home/paladox# /usr/local/bin/foreachwikiindblist /home/paladox/templatewizard.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php templatedata
[14:12:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:13:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.85, 20.21, 20.76
[14:14:01] <Not>	 [02miraheze/mw-config] 07paladox deleted branch 03revert-3486-revert-3484-revert-3483-Universal-Omega-patch-4
[14:14:03] <Not>	 [02mw-config] 07paladox deleted branch 03revert-3486-revert-3484-revert-3483-Universal-Omega-patch-4 - 13https://git.io/vbvb3
[14:14:24] <Not>	 [02mw-config] 07R4356th opened pull request 03#3498: Patch 1 - 13https://git.io/Jkbuy
[14:15:18] <Not>	 [02mw-config] 07R4356th synchronize pull request 03#3498: Patch 1 - 13https://git.io/Jkbuy
[14:16:29] <Not>	 [02mw-config] 07R4356th synchronize pull request 03#3498: Patch 1 - 13https://git.io/Jkbuy
[14:17:34] <Not>	 [02mw-config] 07R4356th edited pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard - 13https://git.io/Jkbuy
[14:17:49] <paladox>	 !log root@test2:/srv/mediawiki/w/extensions/ManageWiki/maintenance# sudo -u www-data php toggleExtension.php --wiki cristianopediawiki Bootstrap --disable
[14:17:52] <Not>	 [02mw-config] 07R4356th edited pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkbuy
[14:17:53] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:17:54] <paladox>	 !log root@test2:/srv/mediawiki/w/extensions/ManageWiki/maintenance# sudo -u www-data php toggleExtension.php --wiki libraryofanamwiki Bootstrap --disable
[14:17:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:18:02] <paladox>	 !log root@test2:/srv/mediawiki/w/extensions/ManageWiki/maintenance# sudo -u www-data php toggleExtension.php --wiki trashepisodeswiki Bootstrap --disable
[14:18:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:18:06] <paladox>	 !log root@test2:/srv/mediawiki/w/extensions/ManageWiki/maintenance# sudo -u www-data php toggleExtension.php --wiki tualatinbasewiki Bootstrap --disable
[14:18:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:19:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.52, 17.88, 19.83
[14:22:22] <Not>	 [02mw-config] 07R4356th synchronize pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkbuy
[14:23:28] <Not>	 [02mw-config] 07R4356th edited pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkbuy
[14:24:24] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jkbgb
[14:24:25] <Not>	 [02miraheze/mw-config] 07paladox 031d087a1 - TemplateWizard requires TemplateData
[14:24:27] <Not>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[14:24:28] <Not>	 [02mw-config] 07paladox opened pull request 03#3499: TemplateWizard requires TemplateData - 13https://git.io/Jkbgx
[14:25:06] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/Jkb2T
[14:25:08] <Not>	 [02miraheze/mw-config] 07paladox 0358aba0e - Update LocalExtensions.php
[14:25:09] <Not>	 [02mw-config] 07paladox synchronize pull request 03#3499: TemplateWizard requires TemplateData - 13https://git.io/Jkbgx
[14:25:33] <Not>	 [02mw-config] 07paladox closed pull request 03#3499: TemplateWizard requires TemplateData - 13https://git.io/Jkbgx
[14:25:34] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jkb2Y
[14:25:36] <Not>	 [02miraheze/mw-config] 07paladox 034b39319 - TemplateWizard requires TemplateData (#3499) * TemplateWizard requires TemplateData * Update LocalExtensions.php
[14:25:37] <Not>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[14:25:39] <Not>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[14:26:45] <travis-ci>	 miraheze/mw-config/paladox-patch-1/58aba0e - paladox The build has errored. https://travis-ci.org/miraheze/mw-config/builds/746429180
[14:28:15] <Not>	 [02mw-config] 07paladox commented on pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkb2i
[14:28:36] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.95, 22.14, 20.82
[14:28:47] <Not>	 [02mw-config] 07paladox commented on pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkb2D
[14:29:46] <Not>	 [02mw-config] 07R4356th commented on pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkb2d
[14:29:47] <Not>	 [02mw-config] 07R4356th closed pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkbuy
[14:30:08] <Not>	 [02mw-config] 07R4356th edited a comment on pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkb2d
[14:30:17] <Not>	 [02mw-config] 07paladox commented on pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/Jkb2j
[14:30:29] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.90, 20.75, 20.44
[14:31:33] <Not>	 [02mw-config] 07R4356th commented on pull request 03#3498: Add TemplateData and WikiEditor as required for TemplateWizard (T6517) - 13https://git.io/JkbaL
[14:33:15] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.63, 17.10, 15.10
[14:34:42] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jkbao
[14:34:43] <Not>	 [02miraheze/mw-config] 07paladox 03a9faa88 - Revert "TemplateWizard requires TemplateData (#3499)" This reverts commit 4b39319fc983eab9a415c638cee2600f9fd90c4a. John says not to do this yet.
[14:35:11] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 11.99, 15.12, 14.61
[14:36:11] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.35, 20.15, 20.34
[14:38:21] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JkbVl
[14:38:23] <Not>	 [02miraheze/mw-config] 07paladox 03f59ac66 - Revert "Revert "TemplateWizard requires TemplateData (#3499)"" This reverts commit a9faa8812b2ee994bd3708c1913a3f0fef6b21a4.
[14:42:57] <paladox>	 !log upgrade graylog-server to 4.0.1
[14:42:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:43:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.16, 20.83, 20.55
[14:45:55] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.29, 18.66, 19.78
[14:53:44] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 23.30, 24.01, 19.52
[14:53:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.08, 23.75, 21.66
[14:54:14] <paladox>	 !log rebuild lc on mw[4567] and jobrunner[12]
[14:54:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:55:41] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.37, 21.82, 19.25
[14:56:00] <Not>	 [02landing] 07paladox closed pull request 03#42: Update index.php - 13https://git.io/JUEL2
[14:56:07] <Not>	 [02landing] 07paladox commented on pull request 03#42: Update index.php - 13https://git.io/JkbKW
[14:57:37] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 28.79, 25.10, 20.76
[15:03:26] <icinga-miraheze>	 PROBLEM - graylog1 Current Load on graylog1 is CRITICAL: CRITICAL - load average: 6.91, 4.64, 2.91
[15:03:42] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 10.54, 7.71, 5.29
[15:04:22] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 2607:5300:205:200::2ac4/cpweb
[15:04:51] <RhinosF1>	 paladox: ^
[15:05:36] <RhinosF1>	 Why things down?
[15:05:42] <paladox>	 Meta works for me. Guess this will resolve in a minute or 2.
[15:05:50] <RhinosF1>	 Okay
[15:05:55] <RhinosF1>	 Any reason it says down
[15:05:57] <paladox>	 It's probably hit the timeout.
[15:06:18] <icinga-miraheze>	 PROBLEM - wiki.teessidehackspace.org.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.teessidehackspace.org.uk could not be found
[15:06:19] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[15:06:20] <paladox>	 timeout as in the dns timeout we have
[15:06:24] <icinga-miraheze>	 PROBLEM - wiki.park-city.club - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.park-city.club could not be found
[15:06:25] <icinga-miraheze>	 PROBLEM - www.iceria.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.iceria.org could not be found
[15:06:25] <icinga-miraheze>	 PROBLEM - virus23.uk.to - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for virus23.uk.to could not be found
[15:06:26] <icinga-miraheze>	 PROBLEM - wiki.mineland.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mineland.eu could not be found
[15:06:26] <icinga-miraheze>	 PROBLEM - bharatwiki.online - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for bharatwiki.online could not be found
[15:06:26] <icinga-miraheze>	 PROBLEM - wiki.nowchess.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nowchess.org could not be found
[15:06:27] <icinga-miraheze>	 PROBLEM - wiki.xfbs.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.xfbs.net could not be found
[15:06:41] <icinga-miraheze>	 PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 7.01, 7.04, 5.31
[15:07:35] <RhinosF1>	 I'm gonna guess all them use our nameservers
[15:07:40] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 7.70, 7.82, 5.93
[15:08:42] <icinga-miraheze>	 PROBLEM - mw5 Current Load on mw5 is CRITICAL: CRITICAL - load average: 9.06, 7.47, 5.66
[15:10:51] <icinga-miraheze>	 PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 8.68, 7.13, 4.89
[15:11:41] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 8.50, 7.90, 6.37
[15:12:32] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.66, 6.53, 5.12
[15:12:47] <icinga-miraheze>	 RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 4.45, 6.12, 4.78
[15:13:05] <icinga-miraheze>	 RECOVERY - wiki.teessidehackspace.org.uk - reverse DNS on sslhost is OK: rDNS OK - wiki.teessidehackspace.org.uk reverse DNS resolves to cp6.miraheze.org
[15:13:19] <icinga-miraheze>	 RECOVERY - virus23.uk.to - reverse DNS on sslhost is OK: rDNS OK - virus23.uk.to reverse DNS resolves to cp6.miraheze.org
[15:13:19] <icinga-miraheze>	 RECOVERY - wiki.park-city.club - reverse DNS on sslhost is OK: rDNS OK - wiki.park-city.club reverse DNS resolves to cp7.miraheze.org
[15:13:20] <icinga-miraheze>	 RECOVERY - www.iceria.org - reverse DNS on sslhost is OK: rDNS OK - www.iceria.org reverse DNS resolves to cp6.miraheze.org
[15:13:21] <icinga-miraheze>	 RECOVERY - wiki.mineland.eu - reverse DNS on sslhost is OK: rDNS OK - wiki.mineland.eu reverse DNS resolves to cp6.miraheze.org
[15:13:21] <icinga-miraheze>	 RECOVERY - wiki.nowchess.org - reverse DNS on sslhost is OK: rDNS OK - wiki.nowchess.org reverse DNS resolves to cp6.miraheze.org
[15:13:21] <icinga-miraheze>	 RECOVERY - bharatwiki.online - reverse DNS on sslhost is OK: rDNS OK - bharatwiki.online reverse DNS resolves to cp7.miraheze.org
[15:13:25] <icinga-miraheze>	 RECOVERY - wiki.xfbs.net - reverse DNS on sslhost is OK: rDNS OK - wiki.xfbs.net reverse DNS resolves to cp6.miraheze.org
[15:14:29] <icinga-miraheze>	 RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 5.57, 6.19, 5.18
[15:17:40] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is WARNING: WARNING - load average: 5.84, 7.83, 6.92
[15:18:41] <icinga-miraheze>	 PROBLEM - mw5 Current Load on mw5 is WARNING: WARNING - load average: 4.77, 7.80, 7.11
[15:19:06] <icinga-miraheze>	 PROBLEM - graylog1 Current Load on graylog1 is WARNING: WARNING - load average: 0.77, 3.28, 3.76
[15:19:46] <Not>	 [02mediawiki] 07Pix1234 commented on pull request 03#600: Bump extensions/CommentStreams from `bff0e55` to `d82bb16` - 13https://git.io/JkbXz
[15:21:40] <icinga-miraheze>	 RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 5.35, 6.35, 6.49
[15:23:00] <icinga-miraheze>	 RECOVERY - graylog1 Current Load on graylog1 is OK: OK - load average: 1.65, 2.19, 3.19
[15:23:22] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.95, 6.62, 5.72
[15:24:40] <icinga-miraheze>	 RECOVERY - mw5 Current Load on mw5 is OK: OK - load average: 5.64, 6.48, 6.72
[15:25:20] <icinga-miraheze>	 RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 4.83, 6.00, 5.61
[15:30:56] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.28, 17.59, 23.46
[15:38:45] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.25, 14.54, 19.80
[15:44:42] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.35, 19.74, 20.28
[15:48:34] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.56, 17.36, 19.31
[15:57:56] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.43, 21.28, 23.95
[16:09:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.18, 21.74, 22.52
[16:13:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.10, 23.61, 23.14
[16:15:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.06, 25.24, 23.76
[16:19:55] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.80, 22.24, 22.95
[16:21:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.47, 23.30, 23.26
[16:25:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.78, 22.67, 23.17
[16:33:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.83, 24.56, 23.63
[16:35:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.58, 23.57, 23.39
[16:45:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.12, 23.19, 23.21
[16:47:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.43, 23.77, 23.44
[16:51:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.86, 24.29, 23.68
[17:18:53] <Not>	 [02mw-config] 07dmehus opened pull request 03#3500: Fix typo for Extension:UrlGetParameters in ManageWiki/extensions link - 13https://git.io/JkbhF
[17:25:16] <Not>	 [02mw-config] 07paladox closed pull request 03#3500: Fix typo for Extension:UrlGetParameters in ManageWiki/extensions link - 13https://git.io/JkbhF
[17:25:17] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkbjM
[17:25:18] <Not>	 [02miraheze/mw-config] 07dmehus 039daca60 - Fix typo for Extension:UrlGetParameters in ManageWiki/extensions link (#3500) No change to name in database table, so no DB update should be needed. Thanks
[17:29:37] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 24.12, 20.27, 16.74
[17:31:33] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.75, 20.75, 17.38
[17:33:30] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 17.40, 20.24, 17.63
[17:43:16] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 25.13, 20.41, 18.03
[17:43:47] <Universal_Omega>	 !log sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/w/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php urlshortener on Jobrunner1
[17:43:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:45:16] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.69, 18.43, 17.61
[17:47:23] <Universal_Omega>	 !log sudo -u www-data php /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php --wiki macfan4000wiki urlshortener --disable
[17:47:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:47:39] <Universal_Omega>	 sudo -u www-data php /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php --wiki schizoidnightmareswiki urlshortener --disable
[17:47:50] <Universal_Omega>	 !log sudo -u www-data php /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php --wiki schizoidnightmareswiki urlshortener --disable
[17:47:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:03:55] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.35, 20.06, 23.30
[18:13:35] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.58, 20.59, 17.67
[18:15:31] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 16.83, 18.88, 17.39
[18:21:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 36.21, 25.21, 23.36
[18:24:33] <MirahezeBot>	 https://phabricator.miraheze.org/T6431 - cp9 extremely latent for a number of users, authored by SCVSlalom, assigned to None, Priority: High, Status: Open
[18:30:01] <RhinosF1>	 JohnLewis: can an extra cp be approved?
[18:31:25] <MH-Discord>	 <Doug> 👍 from me to ^. hopes for a west coast cache proxy; is not fussed on whether Canada or the U.S.
[18:33:53] <JohnLewis>	 .It's not in the budget, so not by me as I don't know how much we've gone into the expansion pot
[18:35:11] * RhinosF1 looks at SPF|Cloud
[18:37:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 16.83, 22.63, 23.54
[18:41:56] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 36.68, 28.20, 25.31
[18:43:02] <MH-Discord>	 <Zppix> I dont see how we can afford a new CP
[18:59:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.50, 22.01, 23.87
[19:05:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.36, 23.77, 23.92
[19:13:48] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 14.93, 10.60, 6.27
[19:13:52] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 5 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb
[19:14:27] <icinga-miraheze>	 PROBLEM - gluster1 Current Load on gluster1 is WARNING: WARNING - load average: 7.94, 7.08, 5.45
[19:14:48] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:800:1056::2/cpweb
[19:16:29] <icinga-miraheze>	 PROBLEM - gluster1 Current Load on gluster1 is CRITICAL: CRITICAL - load average: 8.33, 7.62, 5.86
[19:18:04] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[19:18:23] <icinga-miraheze>	 PROBLEM - gluster1 Current Load on gluster1 is WARNING: WARNING - load average: 5.80, 7.09, 5.88
[19:18:42] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[19:20:21] <icinga-miraheze>	 RECOVERY - gluster1 Current Load on gluster1 is OK: OK - load average: 5.24, 6.33, 5.74
[19:22:04] <icinga-miraheze>	 PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 12.97, 8.33, 4.85
[19:23:16] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.55, 21.84, 18.12
[19:23:59] <icinga-miraheze>	 RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 2.94, 6.21, 4.49
[19:25:12] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 13.34, 18.27, 17.25
[19:27:56] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 2.68, 5.84, 7.68
[19:32:34] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.81, 6.18, 5.02
[19:33:01] <SPF|Cloud>	 hi
[19:33:04] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 26.78, 22.04, 19.12
[19:33:29] <icinga-miraheze>	 PROBLEM - jobrunner1 Current Load on jobrunner1 is CRITICAL: CRITICAL - load average: 6.22, 4.93, 3.54
[19:33:38] <icinga-miraheze>	 PROBLEM - jobrunner2 Current Load on jobrunner2 is CRITICAL: CRITICAL - load average: 6.68, 4.75, 3.27
[19:33:50] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.57, 4.46, 6.60
[19:34:24] <RhinosF1>	 SPF|Cloud: any thoughts on cp's?
[19:34:29] <RhinosF1>	 And hi
[19:34:33] <icinga-miraheze>	 RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 6.65, 6.17, 5.15
[19:34:34] <SPF|Cloud>	 reading the comments now
[19:34:39] <RhinosF1>	 Okay
[19:35:02] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 12.23, 18.37, 18.14
[19:35:35] <icinga-miraheze>	 PROBLEM - jobrunner2 Current Load on jobrunner2 is WARNING: WARNING - load average: 5.44, 4.93, 3.52
[19:37:32] <SPF|Cloud>	 when did the problem with cp9 start? earlier than Nov 11, I think?
[19:37:48] <RhinosF1>	 Earlier than that task was filed
[19:38:00] <SPF|Cloud>	 if you have an exact date for me
[19:38:14] <MH-Discord>	 <RhinosF1> @Doug ^
[19:39:25] <icinga-miraheze>	 PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 4.85, 5.40, 4.25
[19:42:29] <icinga-miraheze>	 PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 10.49, 7.44, 5.85
[19:42:35] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 8.48, 7.34, 6.08
[19:42:57] <SPF|Cloud>	 I see the message 'upstream prematurely closed connection while reading upstream' more frequently on cp9 than on cp7, but that's not a lack of cp9 resources (but a timeout issue), hence why I need more evidence to conclude cp9 is underpowered
[19:43:52] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 8.46, 6.00, 6.03
[19:44:27] <icinga-miraheze>	 PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.50, 7.39, 6.04
[19:44:33] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.19, 7.04, 6.12
[19:45:22] <icinga-miraheze>	 RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 4.73, 5.01, 4.44
[19:45:54] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 5.53, 5.45, 5.81
[19:46:26] <icinga-miraheze>	 PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 8.49, 7.73, 6.32
[19:47:27] <icinga-miraheze>	 RECOVERY - jobrunner2 Current Load on jobrunner2 is OK: OK - load average: 4.46, 5.04, 4.44
[19:48:06] <SPF|Cloud>	 !log restart varnishncsa on cp9
[19:48:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:48:29] <icinga-miraheze>	 RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 5.81, 6.50, 6.13
[19:49:49] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 15.16, 10.15, 7.53
[19:51:24] <dmehus>	 @SPF|Cloud I believe it around 11 November 2020, and while we have some okay periods, it's especially problematic right now, particularly. I'm getting page load times averaging 3000-10,000 ms, which is very high. Norm for me lately has been 1,000-2,0000. Even if we can't afford another cp, we do need another cp in North America, so perhaps we could take one of our least used cps elsewhere in Asia or Europe out of service. Potentially a west coast 
[19:51:24] <dmehus>	 NA cp could also serve east coast Asian reasonably well
[19:51:48] <dmehus>	 s/it around/it was around
[19:51:48] <MirahezeBot>	 dmehus meant to say: @SPF|Cloud I believe it was around 11 November 2020, and while we have some okay periods, it's especially problematic right now, particularly. I'm getting page load times averaging 3000-10,000 ms, which is very high. Norm for me lately has been 1,000-2,0000. Even if we can't afford another cp, we do need another cp in North America, so perhaps we could take one of our least used cps elsewhere in Asia or Europe out of serv
[19:52:17] <SPF|Cloud>	 grafana metrics do not show performance issues on cp9
[19:52:26] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 7.17, 6.83, 6.34
[19:53:01] <dmehus>	 @SPF|Cloud Well, that's odd. I do note from the Phabricator ticket John's rolling averages that suggested another cache proxy in North America could be useful/needed.
[19:53:18] <dmehus>	 Perhaps it's an issue with the mw servers then?
[19:53:20] <icinga-miraheze>	 PROBLEM - jobrunner1 Current Load on jobrunner1 is WARNING: WARNING - load average: 5.34, 5.08, 4.66
[19:53:37] <SPF|Cloud>	 I see cp9 is serving a lot of users, but metrics seem fine
[19:53:45] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 2.66, 7.48, 7.20
[19:54:19] <icinga-miraheze>	 PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 7.71, 7.91, 7.04
[19:54:24] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 9.72, 8.08, 6.88
[19:54:39] <dmehus>	 @SPF|Cloud Oh, okay. Well I just know that the page fetch times have been too long of late, so we do need to think about ways to correct that, whatever that may be.
[19:55:02] <SPF|Cloud>	 could be, although mediawiki (server) issues should impact other cache proxies as well
[19:55:18] <icinga-miraheze>	 RECOVERY - jobrunner1 Current Load on jobrunner1 is OK: OK - load average: 4.75, 4.93, 4.65
[19:55:43] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.11, 5.64, 6.55
[19:57:44] <dmehus>	 @SPF|Cloud Yeah it could be, though I'm 95% of the time or better served by cp9, I have, on occasion, between served by cp7 or cp8 (can't remember which), if that's helpful that it could be a mw server issue as well.
[19:58:12] <SPF|Cloud>	 latency from UK to cp9 was 78ms in July, is now 78ms as well, no network latency...
[19:58:18] <icinga-miraheze>	 RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 4.68, 6.70, 6.77
[19:58:22] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 6.35, 7.38, 6.87
[19:58:46] <SPF|Cloud>	 it is worrying though that simple .gif files are failing as well on cp9
[19:59:15] <dmehus>	 So maybe it's not so much a latency issue, but a server hardware issue, i.e., existing mw servers or cp servers needing additional resources (RAM perhaps)?
[19:59:30] <SPF|Cloud>	 could be anything, too many factors here
[19:59:35] <dmehus>	 yeah
[20:02:25] <SPF|Cloud>	 I said the latency was fine... PING OK - Packet loss = 0%, RTA = 85.93 ms
[20:02:27] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 8.81, 7.32, 6.90
[20:03:36] <SPF|Cloud>	 and that's 8 ms extra out of the nowhere? I know latency varies, unfortunately we have no monitoring on icmp...
[20:03:50] <SPF|Cloud>	 smokeping or similar could have been nice..
[20:03:53] <paladox>	 !log rm /srv/mediawiki/w/cache/badomainwiki.json on mw[4567] and jobrunner[12]
[20:04:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:04:25] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 8.00, 7.59, 7.06
[20:06:58] <icinga-miraheze>	 PROBLEM - test2 APT on test2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[20:06:59] <dmehus>	 @SPF|Cloud Would it help if I did a traceroute and DMed you the info?
[20:07:07] <SPF|Cloud>	 perhaps, go on
[20:07:12] <dmehus>	 okay
[20:08:43] <icinga-miraheze>	 PROBLEM - test2 Current Load on test2 is CRITICAL: CRITICAL - load average: 5.76, 3.57, 1.69
[20:08:57] <icinga-miraheze>	 RECOVERY - test2 APT on test2 is OK: APT OK: 14 packages available for upgrade (0 critical updates).
[20:09:29] <JohnLewis>	 paladox: why was deletion necessary?
[20:10:28] <paladox>	 JohnLewis because the wiki was throwing " Uncaught ExtensionDependencyError: TemplateWizard requires TemplateData to be installed.
[20:10:28] <paladox>	  in /srv/mediawiki/w/includes/registration/ExtensionRegistry.php:405". Even though it was enabled in MW, the cache wasn't updated, thus because TW was installed before, it was throwing (cache needed updating)
[20:10:43] <icinga-miraheze>	 RECOVERY - test2 Current Load on test2 is OK: OK - load average: 1.33, 2.67, 1.59
[20:10:56] <JohnLewis>	 ah, okay
[20:12:22] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is CRITICAL: CRITICAL - load average: 8.33, 7.31, 7.04
[20:14:05] <icinga-miraheze>	 PROBLEM - mw7 Current Load on mw7 is CRITICAL: CRITICAL - load average: 8.68, 8.20, 7.26
[20:14:23] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 6.59, 7.22, 7.06
[20:15:06] <Not>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/JkNCY
[20:15:07] <dmehus>	 @SPF|Cloud DMed.
[20:15:07] <Not>	 [02miraheze/puppet] 07paladox 038c74a0d - varnish: Remove static.miraheze.org directive, its already handled by *.miraheze.org
[20:15:09] <Not>	 [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://git.io/vbiAS
[20:15:11] <Not>	 [02puppet] 07paladox opened pull request 03#1526: varnish: Remove static.miraheze.org directive, its already handled by *.miraheze.org - 13https://git.io/JkNC3
[20:15:47] <Not>	 [02puppet] 07paladox closed pull request 03#1526: varnish: Remove static.miraheze.org directive, its already handled by *.miraheze.org - 13https://git.io/JkNC3
[20:15:49] <Not>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkNCC
[20:15:50] <Not>	 [02miraheze/puppet] 07paladox 039ee17d7 - varnish: Remove static.miraheze.org directive, its already handled by *.miraheze.org (#1526)
[20:15:52] <Not>	 [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://git.io/vbiAS
[20:15:53] <Not>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4
[20:16:02] <icinga-miraheze>	 PROBLEM - mw7 Current Load on mw7 is WARNING: WARNING - load average: 4.97, 7.01, 6.94
[20:18:00] <icinga-miraheze>	 RECOVERY - mw7 Current Load on mw7 is OK: OK - load average: 4.34, 6.16, 6.64
[20:24:06] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 18.65, 20.64, 18.51
[20:24:22] <icinga-miraheze>	 RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 6.50, 6.64, 6.80
[20:26:03] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 11.60, 17.29, 17.53
[20:39:54] <MirahezeBot>	 Hello helping! If you have any questions, feel free to ask and someone should answer soon.
[20:40:01] <helping>	 Hi there
[20:40:13] <helping>	 Anyone here to help the newbie
[20:40:32] <hispano76>	 hi
[20:41:00] <hispano76>	 ask your question and we will try to help you
[20:41:03] <RhinosF1>	 Hi
[20:41:07] <dmehus>	 hi @Helping, what is your question?
[20:41:13] <RhinosF1>	 .mh AQC
[20:41:13] <MirahezeBot>	 https://meta.miraheze.org/wiki/AQC
[20:41:15] <helping>	 Hi there, can you please tell me the procedure of setting a custom domain
[20:41:28] <dmehus>	 .mh Custom domains
[20:41:28] <MirahezeBot>	 https://Custom.miraheze.org/wiki/domains
[20:41:49] <dmehus>	 .mh Custom domains
[20:41:49] <MirahezeBot>	 https://Custom.miraheze.org/wiki/domains
[20:41:53] <dmehus>	 [[Custom domains]]
[20:41:55] <helping>	 I have already use the domain forwarding service
[20:41:58] <RhinosF1>	 .mh Custom_doamins
[20:41:58] <MirahezeBot>	 https://meta.miraheze.org/wiki/Custom_doamins
[20:42:04] <RhinosF1>	 helping: see ^
[20:42:08] <hispano76>	 :)
[20:42:12] * hispano76 greetings
[20:42:19] <helping>	 With my custom domain provider
[20:42:28] <dmehus>	 @RhinosF1 We should fix that `.mh` command to parse spaces as underscores :P
[20:42:35] <helping>	 I have already looked
[20:42:39] <RhinosF1>	 dmehus: it's <wiki> <page>
[20:42:53] <RhinosF1>	 .mh test page with a space
[20:42:54] <MirahezeBot>	 https://test.miraheze.org/wiki/page_with_a_space
[20:42:59] <RhinosF1>	 dmehus: see ^
[20:43:04] <dmehus>	 @RhinosF1 Ah, okay, I didn't see you enter the wiki first, though with your command
[20:43:13] <dmehus>	 you entered `.mh custom domains` same as me
[20:43:18] <RhinosF1>	 That's because I did an _
[20:43:40] <icinga-miraheze>	 PROBLEM - mw4 Current Load on mw4 is CRITICAL: CRITICAL - load average: 8.26, 6.02, 4.99
[20:43:42] <dmehus>	 @RhinosF1 that's what I am saying, we should have the bot convert the _ into a space
[20:43:42] <helping>	 But after forwarding also it is saying that sufiwiki.miraheze.org refused to connect
[20:43:55] <helping>	 Why this
[20:43:58] <helping>	 ?
[20:44:02] <dmehus>	 @Helping Well have you done the Phabricator task at Custom domains?
[20:44:12] <RhinosF1>	 helping: have you folllowed the custom domains page?
[20:44:14] <dmehus>	 There's a part that system administrators need to do.
[20:44:20] <RhinosF1>	 Adding a CNAME or DNS entry
[20:44:25] <dmehus>	 .mh Custom_domains
[20:44:26] <MirahezeBot>	 https://meta.miraheze.org/wiki/Custom_domains
[20:44:35] <RhinosF1>	 dmehus: it wouldn't error like that to my knowledge
[20:44:44] <RhinosF1>	 That sounds like it's not pointed at us
[20:44:49] <dmehus>	 yeah
[20:45:07] <RhinosF1>	 It should be an SSL error if it's pointed without a cert
[20:45:12] <helping>	 Can you please look at the page personally
[20:45:15] <dmehus>	 @Helping what's your domain so we can look at your zone file?
[20:45:28] <RhinosF1>	 helping: what is your custom domain?
[20:45:33] <RhinosF1>	 That you want
[20:45:39] <helping>	 wiki.qadrishattari.xyz
[20:45:39] <icinga-miraheze>	 RECOVERY - mw4 Current Load on mw4 is OK: OK - load average: 2.47, 4.62, 4.60
[20:45:41] <RhinosF1>	 And have you followed the instructions?
[20:45:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 14.63, 19.18, 23.33
[20:45:56] <dmehus>	 *looking*
[20:46:15] <dmehus>	 ```id 63014
[20:46:15] <dmehus>	 opcode QUERY
[20:46:15] <dmehus>	 rcode NOERROR
[20:46:15] <dmehus>	 flags QR RD RA
[20:46:15] <dmehus>	 ;QUESTION
[20:46:15] <dmehus>	 wiki.qadrishattari.xyz. IN A
[20:46:16] <dmehus>	 ;ANSWER
[20:46:17] <dmehus>	 wiki.qadrishattari.xyz. 21599 IN A 162.210.70.23
[20:46:17] <dmehus>	 ;AUTHORITY
[20:46:18] <dmehus>	 ;ADDITIONAL```
[20:46:22] <dmehus>	 Doesn't look like it's pointed to us
[20:46:39] <dmehus>	 So I recommend following the instructions exactly at...
[20:46:42] <RhinosF1>	 helping: please follow our instructions
[20:46:44] <dmehus>	 .mh Custom_domains
[20:46:44] <MirahezeBot>	 https://meta.miraheze.org/wiki/Custom_domains
[20:47:01] <RhinosF1>	 Whatever your provider's domain forwarding service does is not a CNAME or DNS change
[20:48:12] <helping>	 I have contacted my domain provider as I can't understand what is written in your articles
[20:48:18] <dmehus>	 Yeah, I mean you could redirect your domain to your Miraheze subdomain, if your DNS provider offers that service, but looking at your zone record, that doesn't look it's set up either, so I do recommend following the custom domains page
[20:48:31] <helping>	 So they guided me for domain forwarding
[20:48:32] <RhinosF1>	 helping: what is your provider?
[20:48:51] <helping>	 Vebonix
[20:48:58] <RhinosF1>	 .ip 162.210.70.23
[20:48:59] <MirahezeBot>	 [IP/Host Lookup] Hostname: 162.210.70-23.publicdomainregistry.com | Location: United States | ISP: AS394695 PUBLIC-DOMAIN-REGISTRY
[20:49:10] <dmehus>	 ```id 43051
[20:49:10] <dmehus>	 opcode QUERY
[20:49:11] <dmehus>	 rcode NOERROR
[20:49:11] <dmehus>	 flags QR RD RA
[20:49:11] <dmehus>	 ;QUESTION
[20:49:11] <dmehus>	 wiki.qadrishattari.xyz. IN NS
[20:49:11] <dmehus>	 ;ANSWER
[20:49:11] <dmehus>	 ;AUTHORITY
[20:49:12] <dmehus>	 qadrishattari.xyz. 1799 IN SOA ns4.vebonix.net. ashharjamalik.gmail.com. 2020112801 7200 7200 172800 38400
[20:49:13] <dmehus>	 ;ADDITIONAL```
[20:50:26] <helping>	 Basically, I am not getting what is written on that page of custom domain
[20:50:46] <helping>	 So
[20:51:06] <RhinosF1>	 helping: follow https://cp.vebonix.com/kb/node/636 to set a CNAME with the value mw-lb.miraheze.org
[20:51:07] <MirahezeBot>	 [ Managing DNS Resource Records | KnowledgeBase ] - cp.vebonix.com
[20:51:32] <RhinosF1>	 https://cp.vebonix.com/kb/servlet/KBServlet/faq471.html#mcname
[20:51:32] <MirahezeBot>	 [ Managing DNS Resource Records | KnowledgeBase ] - cp.vebonix.com
[20:52:29] <helping>	 So what I have to do for custom domain
[20:52:45] <RhinosF1>	 Yes
[20:52:55] <helping>	 Being properly set up
[20:53:00] <RhinosF1>	 Turn off domain forwarding. Whatever that does is wrong.
[20:53:14] <helping>	 Then
[20:53:40] <RhinosF1>	 helping: once you've done that. You'll have to wait ~1 day then ask us and we'll set an ssl certificate for you and point your wiki at it
[20:54:28] <dmehus>	 Yeah, you definitely can't have web/domain forwarding enabled on the same subdomain to which you'd like to get set up as a custom domain for your wiki.
[20:55:26] <helping>	 Being a newbie, I don't know where to ask
[20:55:37] <helping>	 Can you please guide me
[20:56:19] <RhinosF1>	 You haven't read the guide
[20:56:23] <helping>	 So what I have to do 
[20:56:25] <RhinosF1>	 As there's the link in there
[20:56:34] <helping>	 There are many
[20:56:51] <RhinosF1>	 https://phabricator.miraheze.org/maniphest/task/edit/form/14/
[20:56:51] <dmehus>	 ```•RhinosF1> Samuel helping: follow https://cp.vebonix.com/kb/node/636 to set a CNAME with the value mw-lb.miraheze.org
[20:56:51] <helping>	 Which link
[20:56:51] <dmehus>	 12:51 <•RhinosF1> Samuel https://cp.vebonix.com/kb/servlet/KBServlet/faq471.html#mcname
[20:56:51] <dmehus>	 12:52 <•RhinosF1> Samuel Yes
[20:56:51] <dmehus>	 12:53 <•RhinosF1> Samuel Turn off domain forwarding. Whatever that does is wrong.
[20:56:51] <dmehus>	 12:53 <•RhinosF1> Samuel helping: once you've done that. You'll have to wait ~1 day then ask us and we'll set an ssl certificate for you and point your wiki at it```
[20:56:51] <MirahezeBot>	 [ Managing DNS Resource Records | KnowledgeBase ] - cp.vebonix.com
[20:56:52] <MirahezeBot>	 [ Managing DNS Resource Records | KnowledgeBase ] - cp.vebonix.com
[20:56:53] <MirahezeBot>	 [ Login ] - phabricator.miraheze.org
[20:57:56] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.19, 23.23, 23.30
[20:58:21] <helping>	 I have just to ask only, anything else
[20:58:55] <RhinosF1>	 If you've pointed your domain at us as we instructed, then we'll be able to take it from there
[20:59:22] <RhinosF1>	 Set the CNAME as I've said first following https://cp.vebonix.com/kb/servlet/KBServlet/faq471.html#mcname
[20:59:22] <MirahezeBot>	 [ Managing DNS Resource Records | KnowledgeBase ] - cp.vebonix.com
[20:59:37] <RhinosF1>	 Or ask your provider to read https://meta.miraheze.org/wiki/Custom_domains
[20:59:38] <MirahezeBot>	 [ Custom domains - Miraheze Meta ] - meta.miraheze.org
[20:59:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.73, 21.79, 22.77
[21:02:27] <dmehus>	 @Helping Do you have any other subdomains on that domain? We could also just host DNS for your domain, too. That is one of the options at custom domains
[21:02:57] <helping>	 No
[21:03:21] <helping>	 I have just created that subdomain for miraheze
[21:04:12] <helping>	 What I have to write in the third option in that form regarding encryption
[21:04:34] <RhinosF1>	 We can just sort LE for you
[21:04:36] <RhinosF1>	 So say yes
[21:04:51] <RhinosF1>	 But have you set the CNAME?
[21:05:55] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.32, 23.13, 23.09
[21:07:44] <helping>	 I have contacted my domain provider, they told me to just do domain forwarding and nothing else, automatically your subdomain will be pointed to miraheze
[21:07:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.24, 21.98, 22.66
[21:08:47] <RhinosF1>	 helping: tell them it needs to either be pointed at our nameservers or a CNAME set to mw-lb.miraheze.org
[21:09:38] <MirahezeBot>	 Hello Femto! If you have any questions, feel free to ask and someone should answer soon.
[21:10:08] <RhinosF1>	 How can we help Femto
[21:10:36] <Femto>	 Hi, when I try to open my wiki I get a plain white screen. I don't think it's closed, and I can open any other wiki.
[21:11:16] <RhinosF1>	 Femto: which wiki
[21:11:25] <Femto>	 terrean.miraheze.org
[21:11:55] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.58, 24.20, 23.35
[21:12:26] <helping>	 What are your Dns records to ad there
[21:13:00] <RhinosF1>	 helping: it's in the document myself and dmehus have linked countless time
[21:13:02] <helping>	 Also received the email regarding my task that it had been stalled? Why?
[21:13:11] <RhinosF1>	 Because you have pointed it at us
[21:13:15] <RhinosF1>	 .mh custom_domain
[21:13:16] <MirahezeBot>	 https://meta.miraheze.org/wiki/custom_domain
[21:13:29] <RhinosF1>	 Tell your provider to follow the CNAME/nameservers part of that
[21:14:20] <paladox>	 !log rm /srv/mediawiki/w/cache/terreanwiki.json on mw[4567] and jobrunner[12]
[21:14:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:15:07] <RhinosF1>	 s/have/have not
[21:15:07] <MirahezeBot>	 RhinosF1 meant to say: Because you have not pointed it at us
[21:15:19] <RhinosF1>	 paladox: ty
[21:15:35] <RhinosF1>	 Femto: try now
[21:15:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.93, 22.12, 22.85
[21:16:08] <Femto>	 Okay, it works, thanks! Anything I need to do to avoid this problem?
[21:17:13] <RhinosF1>	 No, it was an issue with us
[21:17:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.40, 25.16, 23.85
[21:17:55] <Femto>	 okay!
[21:20:17] <Not>	 [02puppet] 07Universal-Omega opened pull request 03#1527: Remove non-*.miraheze.org domains from frame_whitelist - 13https://git.io/JkNRi
[21:21:42] <RhinosF1>	 paladox: ^
[21:22:02] <paladox>	 yeh, he pinged me
[21:24:32] <helping>	 Would i have to make a request again
[21:24:45] <helping>	 As it had been stalled
[21:25:01] <Not>	 [02puppet] 07Universal-Omega synchronize pull request 03#1527: Remove non-*.miraheze.org domains from frame_whitelist - 13https://git.io/JkNRi
[21:25:15] <Not>	 [02puppet] 07Universal-Omega synchronize pull request 03#1527: Remove non-*.miraheze.org domains from frame_whitelist - 13https://git.io/JkNRi
[21:25:29] <RhinosF1>	 helping: no, just comment on the task when the CNAME/nameservers are set
[21:25:32] <Not>	 [02puppet] 07Universal-Omega synchronize pull request 03#1527: Remove non-*.miraheze.org domains from frame_whitelist - 13https://git.io/JkNRi
[21:26:33] <Not>	 [02puppet] 07paladox closed pull request 03#1527: Remove non-*.miraheze.org domains from frame_whitelist - 13https://git.io/JkNRi
[21:26:35] <Not>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkN0m
[21:26:36] <Not>	 [02miraheze/puppet] 07Universal-Omega 03a863097 - Remove non-*.miraheze.org domains from frame_whitelist (#1527) * Remove non-*.miraheze.org domains from whitelist * add comment * fix * Update frame_whitelist.yaml
[21:29:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.37, 21.74, 23.52
[21:31:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.57, 23.19, 23.82
[21:35:17] <icinga-miraheze>	 PROBLEM - cp3 Stunnel Http for mw5 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[21:35:18] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb
[21:35:19] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 8 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.77.107.210/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:1056::2/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb, 2607:5300:205:200::2ac4/cpweb
[21:35:31] <RhinosF1>	 SPF|Cloud: ^
[21:35:40] <dmehus>	 and he just stepped out, I think
[21:35:43] <dmehus>	 maybe not though
[21:36:02] <RhinosF1>	 Or paladox JohnLewis ^
[21:36:02] <paladox>	 Nov 28 21:35:09 mw5 nginx-prometheus-exporter[2944]: 2020/11/28 21:35:09 Error getting stats: failed to get http://127.0.0.1:8090/server-status: Get "http://127.0.0.1:8090/server-status": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
[21:36:13] <icinga-miraheze>	 PROBLEM - cp6 Stunnel Http for mw5 on cp6 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[21:36:17] <icinga-miraheze>	 PROBLEM - gluster1 Current Load on gluster1 is CRITICAL: CRITICAL - load average: 8.80, 7.35, 5.48
[21:36:19] <dmehus>	 thanks @paladox
[21:37:14] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[21:37:16] <icinga-miraheze>	 RECOVERY - cp3 Stunnel Http for mw5 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15969 bytes in 0.957 second response time
[21:37:19] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[21:38:10] <icinga-miraheze>	 RECOVERY - cp6 Stunnel Http for mw5 on cp6 is OK: HTTP OK: HTTP/1.1 200 OK - 15969 bytes in 0.004 second response time
[21:38:11] <icinga-miraheze>	 PROBLEM - gluster1 Current Load on gluster1 is WARNING: WARNING - load average: 7.15, 7.12, 5.62
[21:38:25] <dmehus>	 @paladox, @JohnLewis, @SPF|Cloud ^ Seems to be recovered, but want to troubleshoot that later
[21:38:52] <RhinosF1>	 They're looking dmehus
[21:38:55] <dmehus>	 ok
[21:41:47] <paladox>	 !log root@gluster2:/home/paladox# gluster volume set mvol rebal-throttle aggressive
[21:42:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:44:05] <icinga-miraheze>	 PROBLEM - gluster1 Current Load on gluster1 is CRITICAL: CRITICAL - load average: 8.85, 8.38, 6.66
[21:45:39] <icinga-miraheze>	 PROBLEM - fr.gyaanipedia.co.in - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for fr.gyaanipedia.co.in could not be found
[21:45:46] <icinga-miraheze>	 PROBLEM - tl.awiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tl.awiki.org could not be found
[21:46:01] <icinga-miraheze>	 PROBLEM - gluster1 Current Load on gluster1 is WARNING: WARNING - load average: 7.02, 7.78, 6.64
[21:46:03] <paladox>	 !log root@gluster2:/home/paladox# gluster volume set mvol rebal-throttle lazy
[21:46:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:47:05] <Not>	 [02miraheze/WikiDiscover] 07Universal-Omega created branch 03Universal-Omega-patch-1 13https://git.io/JkNuI
[21:47:07] <Not>	 [02WikiDiscover] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vhUAp
[21:50:01] <icinga-miraheze>	 RECOVERY - gluster1 Current Load on gluster1 is OK: OK - load average: 5.09, 6.23, 6.27
[21:52:20] <icinga-miraheze>	 RECOVERY - fr.gyaanipedia.co.in - reverse DNS on sslhost is OK: rDNS OK - fr.gyaanipedia.co.in reverse DNS resolves to cp6.miraheze.org
[21:52:31] <icinga-miraheze>	 RECOVERY - tl.awiki.org - reverse DNS on sslhost is OK: rDNS OK - tl.awiki.org reverse DNS resolves to cp6.miraheze.org
[21:57:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.02, 22.20, 23.86
[22:00:38] <helping>	 I have just open my control panel
[22:00:55] <helping>	 Where I have to write mw-lb.miraheze.org";
[22:01:23] <helping>	 And what have to write in host name and value
[22:01:56] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.53, 23.54, 23.85
[22:03:07] <helping>	 Also whether I have to add both the records in cname
[22:03:20] <helping>	 Separately?
[22:03:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.13, 22.18, 23.31
[22:04:28] <RhinosF1>	 helping: there's only 1 record if it's a CNAME
[22:04:37] <RhinosF1>	 Host will be wiki for you
[22:04:53] <RhinosF1>	 Value is mw-lb.miraheze.org
[22:05:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.03, 22.71, 23.34
[22:06:53] <helping>	 But it is saying already present
[22:07:05] <helping>	 That's why i used manage
[22:07:13] <dmehus>	 Host = your existind wikisubdomain.miraheze.org and value = mw-lb.miraheze.org
[22:07:25] <dmehus>	 You may need to end mw-lb.miraheze.org in a .
[22:07:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.14, 22.95, 23.39
[22:10:35] <helping>	 The record is already present in A record 
[22:11:42] <helping>	 And it is pointing to 162.210.70.23
[22:12:05] <helping>	 So Shall I have to delete the record from A to 
[22:12:19] <helping>	 And add it to Cname
[22:12:23] <icinga-miraheze>	 PROBLEM - mw6 Current Load on mw6 is WARNING: WARNING - load average: 6.81, 5.53, 5.03
[22:12:43] <helping>	 Are you getting
[22:12:48] <helping>	 My point
[22:12:52] <helping>	 ?
[22:13:01] <MH-Discord>	 <Doug> @Helping yes that's right
[22:13:12] <MH-Discord>	 <Doug> Delete the A record and add the CNAME record
[22:13:18] <RhinosF1>	 Delete the A record
[22:13:24] <RhinosF1>	 Don't know why it exists
[22:13:42] <helping>	 With the same destination
[22:13:44] <MH-Discord>	 <Doug> @RhinosF1 Probably pre-existing configuration from domain parking
[22:13:48] <helping>	 Mentioned above
[22:13:56] <MH-Discord>	 <Doug> @helping yes
[22:14:00] <MH-Discord>	 <Doug> exactly
[22:14:22] <icinga-miraheze>	 RECOVERY - mw6 Current Load on mw6 is OK: OK - load average: 3.97, 5.00, 4.90
[22:16:07] <helping>	 Or I have to use ns1.miraheze.org.qadrishattari
[22:16:19] <helping>	 In value
[22:16:21] <dmehus>	 @Helping when you're done, take a screenshot of your domain's configuration and upload the screenshot using this link (https://imgur.com/upload) and paste the imgur url for us to view
[22:16:21] <MirahezeBot>	 [ Imgur: The magic of the Internet ] - imgur.com
[22:16:30] <dmehus>	 no not that
[22:16:38] <dmehus>	 use mw-lb.miraheze.org in `value`
[22:17:27] <helping>	 So I have to add a single cname record
[22:17:32] <dmehus>	 correct
[22:18:00] <dmehus>	 host will be `yourwikisubdomain.miraheze.org` and value will be `mw-lb.miraheze.org`
[22:18:36] <dmehus>	 It should then read:
[22:18:36] <dmehus>	 ```yourwikisubdomain.miraheze.org IN CNAME mw-lb.miraheze.org.``` when you're all done
[22:19:04] <dmehus>	 well there will likely be a TTL in there as well but you get the idea ;)
[22:19:55] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.23, 16.74, 19.94
[22:20:18] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkN2w
[22:20:19] <Not>	 [02miraheze/services] 07MirahezeSSLBot 032970069 - BOT: Updating services config for wikis
[22:22:29] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 2400:6180:0:d0::403:f001/cpweb, 51.89.160.142/cpweb, 2001:41d0:800:105a::10/cpweb, 2607:5300:205:200::2ac4/cpweb
[22:22:31] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 3 datacenters are down: 128.199.139.216/cpweb, 2001:41d0:800:105a::10/cpweb, 51.222.27.129/cpweb
[22:22:55] <dmehus>	 ^ @JohnLewis and @paladox
[22:23:06] <paladox>	 it'll recover
[22:23:26] <dmehus>	 yeah
[22:23:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.19, 22.08, 21.55
[22:24:25] <helping>	 So I have updated the c name
[22:24:27] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[22:24:28] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[22:24:42] <helping>	 And it is exactly looking like you told
[22:24:51] <helping>	 Kindly check
[22:25:08] <dmehus>	 okay let me check
[22:25:14] <dmehus>	 what's your wiki subdomain again?
[22:25:14] <helping>	 I can't upload the screen shot here
[22:25:30] <helping>	 wiki.qadrishattari.xyz
[22:25:51] <dmehus>	 ok
[22:25:53] <dmehus>	 checking
[22:27:51] <dmehus>	 @helping I'm not sure about your `value`. I'm showing...
[22:27:52] <dmehus>	 ```wiki.qadrishattari.xyz.	38400	IN	CNAME	mw-lb.miraheze.org.qadrishattari.xyz.```
[22:27:57] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 18.19, 21.90, 21.76
[22:28:19] <dmehus>	 Did you enter `qadrishattari.xyz` at the end of `mw-lb.miraheze.org?
[22:28:33] <helping>	 Kindly check
[22:28:44] <helping>	 I have updated it
[22:28:50] <helping>	 As per your guidance
[22:28:52] <dmehus>	 Okay, let me check again then.
[22:29:43] <dmehus>	 .tell @helping Looks like it's still the same, but it can take up to a day for DNS changes
[22:29:43] <MirahezeBot>	 dmehus: I'll pass that on when @helping is around.
[22:30:06] <dmehus>	 .tell @Helping Looks like it's still the same, but it can take up to a day for DNS changes
[22:30:06] <MirahezeBot>	 dmehus: I'll pass that on when @Helping is around.
[22:30:21] <dmehus>	 ^ in case they come back with an uppercase username :P
[22:30:57] <RhinosF1>	 dmehus: it looks fine to me
[22:32:29] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2400:6180:0:d0::403:f001/cpweb
[22:33:27] <helping>	 Is it okay
[22:33:30] <helping>	 ?
[22:33:45] <dmehus>	 @RhinosF1 Yeah it could just be the formatting of the Google Admin Toolbox dig tool I'm using. When I search by CNAME record, it seems fine.
[22:33:56] <dmehus>	 @helping yes it seems to be so now do the Phabricator task
[22:34:06] <dmehus>	 .mh Custom_domains
[22:34:06] <MirahezeBot>	 https://meta.miraheze.org/wiki/Custom_domains
[22:34:29] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[22:34:31] <dmehus>	 using this form https://phabricator.miraheze.org/maniphest/task/edit/form/14/
[22:34:32] <MirahezeBot>	 [ Login ] - phabricator.miraheze.org
[22:35:38] <helping>	 Now
[22:39:10] <dmehus>	 .tell @helping looks there's already a phab task for the custom domain so @Reception123 should see it tomorrow some time and process for you
[22:39:11] <MirahezeBot>	 dmehus: I'll pass that on when @helping is around.
[22:40:48] <RhinosF1>	 dmehus: @helping won't work
[22:42:34] <icinga-miraheze>	 PROBLEM - lama.madooa.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lama.madooa.org could not be found
[22:42:34] <icinga-miraheze>	 PROBLEM - www.bluevies.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.bluevies.org could not be found
[22:44:02] <helping>	 Regarding fabricator I have received the email regarding my ticket is open
[22:44:10] <RhinosF1>	 Yes
[22:44:17] <helping>	 Anything else I have to do
[22:44:23] <helping>	 ?
[22:44:30] <RhinosF1>	 Just wait now until probably Reception123 does the bit on our end
[22:45:33] <helping>	 I have also deleted that forwarding
[22:46:03] <helping>	 As you told
[22:47:04] <helping>	 Anything else which I have to do?
[22:47:20] <helping>	 Or shall i part this channel now
[22:47:41] <helping>	 Shall I wait here
[22:47:56] <helping>	 In this channel
[22:48:13] <helping>	 ?
[22:48:19] <RhinosF1>	 Either
[22:48:45] <RhinosF1>	 You can hang round here if your connection stays online
[22:49:09] <helping>	 Is it must to stay here,
[22:49:13] <helping>	 ?
[22:49:22] <helping>	 Because I am tired now
[22:49:30] <icinga-miraheze>	 RECOVERY - lama.madooa.org - reverse DNS on sslhost is OK: rDNS OK - lama.madooa.org reverse DNS resolves to cp7.miraheze.org
[22:49:31] <icinga-miraheze>	 RECOVERY - www.bluevies.org - reverse DNS on sslhost is OK: rDNS OK - www.bluevies.org reverse DNS resolves to cp6.miraheze.org
[22:49:41] <helping>	 I am here for so long
[22:50:51] <helping>	 Is it must to stay here?
[22:51:57] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.14, 19.31, 20.40
[22:52:29] <helping>	 How much time will it take for this custom domain setup?
[22:53:29] <helping>	 I mean when  will I be redirected to miraheze by typing wiki.qadrishattari.xyz
[22:53:39] <helping>	 ???
[22:53:54] <helping>	 Kindly reply
[22:55:11] <helping>	 How much time will it take for this custom domain setup?I mean when  will I be redirected to miraheze by typing wiki.qadrishattari.xyz???Kindly reply?
[22:55:19] <RhinosF1>	 helping: up to a few days
[22:55:34] <RhinosF1>	 And it's not a requirement to stay in here, no
[22:55:42] <helping>	 So I don't have to do anything now
[22:55:51] <RhinosF1>	 Nope
[22:55:59] <RhinosF1>	 You'll get an email when it's done
[22:56:02] <helping>	 Now you people will be doing
[22:56:10] <helping>	 Right?
[22:57:51] <dmehus>	 @RhinosF1 .tell doesn't work with non-registered nicknames, I gues?
[22:58:11] <RhinosF1>	 dmehus: it works with any nicknames
[22:58:15] <dmehus>	 oh
[22:58:20] <RhinosF1>	 It's the @ at the front that's the issue
[22:58:26] <dmehus>	 oh lol
[22:58:30] <RhinosF1>	 You're not on discord
[22:58:51] <dmehus>	 *is sure I've used an @ with messages to you, but maybe not*
[22:59:04] <dmehus>	 .tell RhinosF1 Test message
[22:59:04] <MirahezeBot>	 dmehus: I'll pass that on when RhinosF1 is around.
[22:59:29] <RhinosF1>	 Hi
[22:59:29] <MirahezeBot>	 RhinosF1: 2020-11-28 - 22:59:04GMT <dmehus> tell RhinosF1 Test message
[22:59:33] <dmehus>	 ah
[22:59:36] <dmehus>	 okay, thanks :)
[22:59:57] <RhinosF1>	 I asked dgw if we can make sopel shout at you if you do invalid nicks
[23:00:08] <dmehus>	 Oh, that'd be cool.
[23:00:15] <dmehus>	 Didn't realize that was a core feature.
[23:00:35] <RhinosF1>	 Yep seen is
[23:00:39] <dmehus>	 ah
[23:02:37] <RhinosF1>	 dmehus: https://github.com/sopel-irc/sopel/blob/master/sopel/modules/tell.py
[23:02:38] <MirahezeBot>	 [ sopel/tell.py at master · sopel-irc/sopel · GitHub ] - github.com
[23:03:56] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.10, 22.20, 21.25
[23:04:07] <icinga-miraheze>	 PROBLEM - ns1 Current Load on ns1 is CRITICAL: CRITICAL - load average: 0.58, 2.05, 1.21
[23:05:23] <dmehus>	 @RhinosF1 ack
[23:05:58] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.18, 19.49, 20.39
[23:06:06] <icinga-miraheze>	 RECOVERY - ns1 Current Load on ns1 is OK: OK - load average: 0.01, 0.95, 0.94
[23:09:54] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.51, 22.78, 21.61
[23:16:15] <Not>	 [02landing] 07Aftabuzzaman opened pull request 03#52: improving bn translation & fixing spelling mistake - 13https://git.io/JkNo6
[23:21:55] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 27.07, 23.79, 22.40
[23:22:30] <Not>	 [02landing] 07paladox closed pull request 03#52: improving bn translation & fixing spelling mistake - 13https://git.io/JkNo6
[23:22:31] <Not>	 [02miraheze/landing] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JkNKL
[23:22:33] <Not>	 [02miraheze/landing] 07Aftabuzzaman 03e7c1c49 - improving bn translation & fixing spelling mistake (#52)
[23:23:56] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.35, 23.90, 22.64
[23:37:54] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.89, 17.77, 19.95