[00:03:37] <icinga-miraheze>	 PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Puppet has 6 failures. Last run 3 minutes ago with 6 failures. Failed resources (up to 3 shown)
[00:05:46] <Not-80da>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#215: Use textarea type for reason and comment fields - 13https://git.io/J36M3
[00:05:58] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.03, 19.17, 14.69
[00:06:43] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[00:06:47] <Not-80da>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#215: Use textarea type for reason and comment fields - 13https://git.io/J36M3
[00:07:49] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[00:11:57] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.19, 18.67, 15.98
[00:23:33] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3865: Fix tabbing on the ManageWikiExtensions.php file - 13https://git.io/J3Ink
[00:25:45] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+1/-0/±1] 13https://git.io/JsYna
[00:25:46] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 0368ccfe5 - Install Monaco
[00:27:49] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[00:28:56] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JsYnh
[00:28:57] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 0368fb07e - Install Monaco
[00:31:04] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYcn
[00:31:05] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03346e45a - Update LocalExtensions.php
[00:31:07] <Not-80da>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[00:31:31] <Not-80da>	 [02mw-config] 07Universal-Omega opened pull request 03#3898: T7271: add Monaco skin - 13https://git.io/JsYcW
[00:31:36] <icinga-miraheze>	 RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:32:27] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYc0
[00:32:28] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[00:32:28] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 0309955c4 - Update LocalSettings.php
[00:32:30] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3898: T7271: add Monaco skin - 13https://git.io/JsYcW
[00:33:13] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYcw
[00:33:15] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03a060a2d - Update extension-list
[00:33:16] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3898: T7271: add Monaco skin - 13https://git.io/JsYcW
[00:33:33] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[00:34:15] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[00:34:33] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYcX
[00:34:34] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03bfc00f1 - Update ManageWikiExtensions.php
[00:34:36] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3898: T7271: add Monaco skin - 13https://git.io/JsYcW
[00:35:35] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[00:39:09] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[00:41:17] <icinga-miraheze>	 PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[00:41:20] <icinga-miraheze>	 PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[00:41:25] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[00:42:30] <icinga-miraheze>	 PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[00:43:51] <Crepusculum>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=metawiki --r "[[phab:T7305|Requested]]" /home/universalomega/metawikidel2.txt
[00:43:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:02:43] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsY8q
[01:02:45] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 0306bf648 - Update Monaco
[01:03:39] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3898: T7271: add Monaco skin - 13https://git.io/JsYcW
[01:03:40] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JsY8c
[01:03:42] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 033cf485d - T7271: add Monaco skin (#3898)
[01:03:46] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[01:03:47] <Not-80da>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[01:04:37] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[01:06:29] <icinga-miraheze>	 RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[01:07:17] <icinga-miraheze>	 RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[01:07:20] <icinga-miraheze>	 RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures
[01:09:41] <Crepusculum>	 !log  sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* / jbr* / test3
[01:09:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:18:20] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+1/-0/±1] 13https://git.io/JsY4y
[01:18:22] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 03c858d33 - Install UserPageEditProtection
[01:21:26] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JsYBT
[01:21:28] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 037689429 - Install UserPageEditProtection
[01:25:18] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1632: Bump extensions/DisplayTitle from `43a4a07` to `4e579b1` - 13https://git.io/J3Afe
[01:25:20] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsYRE
[01:25:21] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 030d0650a - Bump extensions/DisplayTitle from `43a4a07` to `4e579b1` (#1632)
[01:25:26] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/DisplayTitle-4e579b1
[01:25:27] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/DisplayTitle-4e579b1 - 13https://git.io/vbL5b
[01:27:22] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1656: Bump extensions/WikiForum from `4db12ac` to `29cbebb` - 13https://git.io/J3AJW
[01:27:23] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsYRx
[01:27:25] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 036616103 - Bump extensions/WikiForum from `4db12ac` to `29cbebb` (#1656)
[01:27:29] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/WikiForum-29cbebb
[01:27:31] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/WikiForum-29cbebb - 13https://git.io/vbL5b
[01:28:11] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1621: Bump extensions/SocialProfile from `1e4e3de` to `dca6e32` - 13https://git.io/J3AvJ
[01:28:12] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsY0J
[01:28:14] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 03dcc4ecf - Bump extensions/SocialProfile from `1e4e3de` to `dca6e32` (#1621)
[01:28:21] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/SocialProfile-dca6e32
[01:28:23] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/SocialProfile-dca6e32 - 13https://git.io/vbL5b
[01:29:14] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1629: Bump extensions/Wikibase from `292153f` to `0b76403` - 13https://git.io/J3Av1
[01:29:16] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsY0O
[01:29:17] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 034f0f89f - Bump extensions/Wikibase from `292153f` to `0b76403` (#1629)
[01:29:25] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/Wikibase-0b76403
[01:29:26] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/Wikibase-0b76403 - 13https://git.io/vbL5b
[01:30:47] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1642: Bump extensions/UniversalLanguageSelector from `f31b0c9` to `b556ff5` - 13https://git.io/J3AfK
[01:30:49] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsY0R
[01:30:50] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 03281d9c4 - Bump extensions/UniversalLanguageSelector from `f31b0c9` to `b556ff5` (#1642)
[01:30:56] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/UniversalLanguageSelector-b556ff5
[01:30:57] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/UniversalLanguageSelector-b556ff5 - 13https://git.io/vbL5b
[01:31:44] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1577: Bump extensions/IncidentReporting from `633ceae` to `85c5618` - 13https://git.io/J3oMc
[01:31:45] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsY0K
[01:31:47] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 0330580cc - Bump extensions/IncidentReporting from `633ceae` to `85c5618` (#1577)
[01:31:56] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/IncidentReporting-85c5618
[01:31:57] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/IncidentReporting-85c5618 - 13https://git.io/vbL5b
[01:35:58] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.96, 16.58, 13.46
[01:36:07] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1576: Bump extensions/FancyBoxThumbs from `5423283` to `272f8fb` - 13https://git.io/J3oMZ
[01:36:09] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsYEq
[01:36:10] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 03425ee3c - Bump extensions/FancyBoxThumbs from `5423283` to `272f8fb` (#1576)
[01:36:14] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/FancyBoxThumbs-272f8fb
[01:36:15] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/FancyBoxThumbs-272f8fb - 13https://git.io/vbL5b
[01:36:37] <Not-80da>	 [02mediawiki] 07Southparkfan commented on pull request 03#1574: Bump extensions/ApprovedRevs from `5668e4e` to `4c0b45e` - 13https://git.io/JsYE3
[01:36:39] <Not-80da>	 [02mediawiki] 07dependabot[bot] edited pull request 03#1574: Bump extensions/ApprovedRevs from `5668e4e` to `4c0b45e` - 13https://git.io/J3oMY
[01:37:12] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:37:23] <Not-80da>	 [02mediawiki] 07dependabot[bot] edited pull request 03#1574: Bump extensions/ApprovedRevs from `5668e4e` to `4c0b45e` - 13https://git.io/J3oMY
[01:37:25] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_35/extensions/ApprovedRevs-69f6dc7 [+0/-0/±1] 13https://git.io/JsYEc
[01:37:27] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 03e8c9d1b - Bump extensions/ApprovedRevs from `8aabb29` to `69f6dc7`
[01:37:28] <Not-80da>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_35/extensions/ApprovedRevs-69f6dc7 - 13https://git.io/vbL5b
[01:37:30] <Not-80da>	 [02mediawiki] 07dependabot[bot] opened pull request 03#1715: Bump extensions/ApprovedRevs from `8aabb29` to `69f6dc7` - 13https://git.io/JsYEC
[01:37:31] <Not-80da>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#1715: Bump extensions/ApprovedRevs from `8aabb29` to `69f6dc7` - 13https://git.io/JsYEC
[01:37:33] <Not-80da>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#1715: Bump extensions/ApprovedRevs from `8aabb29` to `69f6dc7` - 13https://git.io/JsYEC
[01:37:34] <Not-80da>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#1574: Bump extensions/ApprovedRevs from `5668e4e` to `4c0b45e` - 13https://git.io/JsYEW
[01:37:36] <Not-80da>	 [02mediawiki] 07dependabot[bot] closed pull request 03#1574: Bump extensions/ApprovedRevs from `5668e4e` to `4c0b45e` - 13https://git.io/J3oMY
[01:37:37] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/ApprovedRevs-4c0b45e
[01:37:39] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/ApprovedRevs-4c0b45e - 13https://git.io/vbL5b
[01:37:57] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.94, 17.18, 14.04
[01:38:02] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1715: Bump extensions/ApprovedRevs from `8aabb29` to `69f6dc7` - 13https://git.io/JsYEC
[01:38:04] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsYEB
[01:38:05] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 03118014b - Bump extensions/ApprovedRevs from `8aabb29` to `69f6dc7` (#1715)
[01:38:12] <Not-80da>	 [02mediawiki] 07Southparkfan closed pull request 03#1612: Bump extensions/WikiCategoryTagCloud from `eaa931b` to `20f3e7a` - 13https://git.io/J3Aeo
[01:38:13] <Not-80da>	 [02miraheze/mediawiki] 07Southparkfan pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsYEE
[01:38:15] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] 031883bd3 - Bump extensions/WikiCategoryTagCloud from `eaa931b` to `20f3e7a` (#1612)
[01:38:16] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/ApprovedRevs-69f6dc7
[01:38:18] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/ApprovedRevs-69f6dc7 - 13https://git.io/vbL5b
[01:38:19] <Not-80da>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/WikiCategoryTagCloud-20f3e7a - 13https://git.io/vbL5b
[01:38:21] <Not-80da>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_35/extensions/WikiCategoryTagCloud-20f3e7a
[01:38:44] <SPF|Cloud>	 git clone issues again?
[01:39:47] <icinga-miraheze>	 PROBLEM - jobrunner4 Puppet on jobrunner4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:40:21] <icinga-miraheze>	 PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:40:46] <icinga-miraheze>	 PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:41:17] <icinga-miraheze>	 PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:42:30] <icinga-miraheze>	 PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:42:34] <SPF|Cloud>	 ^ on it
[01:43:20] <icinga-miraheze>	 PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[01:51:29] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[01:52:19] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 2.53, 5.50, 3.19
[01:53:20] <icinga-miraheze>	 RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[01:54:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is WARNING: WARNING - load average: 0.36, 3.69, 2.81
[01:56:18] <icinga-miraheze>	 RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 0.34, 2.64, 2.53
[02:03:32] <icinga-miraheze>	 PROBLEM - ping6 on cp3 is WARNING: PING WARNING - Packet loss = 0%, RTA = 348.79 ms
[02:03:46] <icinga-miraheze>	 RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures
[02:04:17] <icinga-miraheze>	 RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:04:29] <icinga-miraheze>	 RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:04:46] <icinga-miraheze>	 RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures
[02:05:06] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[02:05:10] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:05:16] <icinga-miraheze>	 RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[02:05:36] <icinga-miraheze>	 PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 407.05 ms
[02:08:12] <Not-80da>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsY2Y
[02:08:14] <Not-80da>	 [02miraheze/puppet] 07Southparkfan 031b5b9a5 - db11: remove backup clusters
[02:13:45] <icinga-miraheze>	 RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 296.20 ms
[02:15:45] <SPF|Cloud>	 night
[02:19:34] <icinga-miraheze>	 RECOVERY - db11 Puppet on db11 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures
[02:26:01] <Crepusculum>	 Night SPF|Cloud 
[02:26:01] <icinga-miraheze>	 PROBLEM - ping6 on cp3 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 403.50 ms
[02:27:48] <Not-80da>	 [02WikiDiscover] 07Universal-Omega assigned pull request 03#45: [BUG FIX] T7221: show "Deleted" not "Open" for deleted wikis - 13https://git.io/J3Ylf
[02:27:58] <Not-80da>	 [02WikiDiscover] 07Universal-Omega assigned pull request 03#42: [BUG FIX] fix allowing {{WIKICREATIONDATE}} without parameters - 13https://git.io/JOuEl
[02:30:27] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 6.01, 7.43, 3.51
[02:34:28] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 0.22, 3.41, 2.74
[02:36:27] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.11, 2.35, 2.43
[02:37:06] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsYos
[02:37:07] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03c9b2641 - Re-ordee UrlShortener
[02:38:06] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[02:38:15] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYow
[02:38:17] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03f8d3d87 - Update LocalExtensions.php
[02:38:18] <Not-80da>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[02:39:05] <Not-80da>	 [02mw-config] 07Universal-Omega opened pull request 03#3899: T7275: Add UserPageEditProtection extension - 13https://git.io/JsYoD
[02:40:04] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYo5
[02:40:06] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[02:40:06] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 0363017f6 - Update LocalSettings.php
[02:40:08] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3899: T7275: Add UserPageEditProtection extension - 13https://git.io/JsYoD
[02:40:57] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYoh
[02:40:59] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03a0a3771 - Update extension-list
[02:41:00] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3899: T7275: Add UserPageEditProtection extension - 13https://git.io/JsYoD
[02:41:06] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[02:42:01] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[02:45:23] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYKw
[02:45:25] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03e2674e0 - Update ManageWikiExtensions.php
[02:45:26] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3899: T7275: Add UserPageEditProtection extension - 13https://git.io/JsYoD
[02:46:31] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[02:54:38] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[03:08:14] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[03:15:06] <icinga-miraheze>	 RECOVERY - ping6 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 245.80 ms
[03:18:38] <icinga-miraheze>	 PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.82, 1.78, 1.31
[03:20:39] <icinga-miraheze>	 RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.06, 1.47, 1.25
[03:23:47] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[03:37:25] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[03:37:34] <Crepusculum>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=trollpastawikiwiki --r "[[phab:T7308|Requested]]" /home/universalomega/trollpastawikiwiki-delete.txt
[03:37:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:07:13] <Not-80da>	 [02mw-config] 07Universal-Omega opened pull request 03#3900: merge 'master' into 'REL1_36' - 13https://git.io/JsY7H
[04:08:59] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2-1 13https://git.io/JsY5I
[04:09:00] <Not-80da>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2-1 - 13https://git.io/vbvb3
[04:09:02] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 0331 commits to 03Universal-Omega-patch-2-1 [+0/-0/±58] 13https://git.io/JsY5L
[04:09:03] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03c8deeeb - Merge branch 'REL1_36' into Universal-Omega-patch-2-1
[04:09:05] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3900: merge 'master' into 'REL1_36' - 13https://git.io/JsY7H
[04:09:40] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3900: merge 'master' into 'REL1_36' - 13https://git.io/JsY7H
[04:09:41] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±6] 13https://git.io/JsY53
[04:09:43] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03d23feb1 - merge 'master' into 'REL1_36' (#3900)
[04:09:44] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk
[04:09:47] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2-1
[04:09:49] <Not-80da>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2-1 - 13https://git.io/vbvb3
[04:10:09] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:10:49] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:19:30] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3899: T7275: Add UserPageEditProtection extension - 13https://git.io/JsYoD
[04:19:32] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JsYd6
[04:19:33] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03a4a1e8d - T7275: Add UserPageEditProtection extension (#3899)
[04:19:35] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[04:19:36] <Not-80da>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[04:20:07] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[04:20:34] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:33:42] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[04:35:22] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsYNb
[04:35:23] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 0331b71cb - T7282: set DPL3 allowUnlimitedResults to true for traceprojectwikiwiki
[04:36:26] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:40:11] <Not-80da>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsYAa
[04:40:13] <Not-80da>	 [02miraheze/services] 07MirahezeSSLBot 03d3ccb6a - BOT: Updating services config for wikis
[04:40:37] <Not-80da>	 [02CreateWiki] 07Universal-Omega closed pull request 03#215: Use textarea type for reason and comment fields - 13https://git.io/J36M3
[04:40:38] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±5] 13https://git.io/JsYAV
[04:40:40] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega 030cdfb7a - Use textarea type for reason and comment fields (#215)
[04:41:35] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[04:42:23] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[04:44:30] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsYxe
[04:44:32] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 030179e50 - Update CreateWiki
[04:44:33] <Not-80da>	 [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[04:44:58] <Not-80da>	 [02mediawiki] 07Universal-Omega opened pull request 03#1716: Update CreateWiki - 13https://git.io/JsYxJ
[04:46:56] <Not-80da>	 [02mediawiki] 07Universal-Omega closed pull request 03#1716: Update CreateWiki - 13https://git.io/JsYxJ
[04:46:58] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsYxZ
[04:46:59] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 039e29c82 - Update CreateWiki (#1716)
[04:47:01] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[04:47:02] <Not-80da>	 [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[04:57:17] <icinga-miraheze>	 PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[04:59:06] <Crepusculum>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* / jbr* / test3
[04:59:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:59:16] <icinga-miraheze>	 RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[05:02:29] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 30.68, 19.68, 15.44
[05:05:09] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 14 minutes ago with 0 failures
[05:06:15] <Not-80da>	 [02DataDump] 07Universal-Omega edited pull request 03#26: T6699: Use ?action="action"(&type="type")&dump="dump" - 13https://git.io/JsLJl
[05:06:51] <Not-80da>	 [02DataDump] 07Universal-Omega edited pull request 03#26: T6699: Use ?action URL parameter instead of subpages - 13https://git.io/JsLJl
[05:06:59] <Not-80da>	 [02DataDump] 07Universal-Omega edited pull request 03#26: T6699: Use `?action` URL parameter instead of subpages - 13https://git.io/JsLJl
[05:07:13] <Not-80da>	 [02DataDump] 07Universal-Omega closed pull request 03#26: T6699: Use `?action` URL parameter instead of subpages - 13https://git.io/JsLJl
[05:07:14] <Not-80da>	 [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JsYj2
[05:07:16] <Not-80da>	 [02miraheze/DataDump] 07Universal-Omega 03fb78cf0 - T6699: Use `?action` URL parameter instead of subpages (#26)
[05:08:07] <miraheze-github>	 miraheze/DataDump - Universal-Omega the build passed.
[05:08:18] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.39, 19.60, 17.22
[05:08:58] <Not-80da>	 [02miraheze/DataDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[05:09:00] <Not-80da>	 [02DataDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV
[05:10:05] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsYjb
[05:10:07] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 0377de33d - Update DataDump
[05:12:38] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsOe3
[05:12:39] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 03b81afe1 - Update RottenLinks
[05:15:11] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[05:25:09] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 8 minutes ago with 0 failures
[05:26:22] <Not-80da>	 [02WikiDiscover] 07Universal-Omega closed pull request 03#45: [BUG FIX] T7221: show "Deleted" not "Open" for deleted wikis - 13https://git.io/J3Ylf
[05:26:24] <Not-80da>	 [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsOJO
[05:26:25] <Not-80da>	 [02miraheze/WikiDiscover] 07Universal-Omega 038ae3099 - [BUG FIX] T7221: show "Deleted" not "Open" for deleted wikis (#45)
[05:27:19] <miraheze-github>	 miraheze/WikiDiscover - Universal-Omega the build passed.
[05:31:17] <Not-80da>	 [02WikiDiscover] 07Universal-Omega closed pull request 03#42: [BUG FIX] fix allowing {{WIKICREATIONDATE}} without parameters - 13https://git.io/JOuEl
[05:31:18] <Not-80da>	 [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsOUf
[05:31:20] <Not-80da>	 [02miraheze/WikiDiscover] 07Universal-Omega 032be49d8 - [BUG FIX] fix allowing {{WIKICREATIONDATE}} without parameters (#42)
[05:32:18] <miraheze-github>	 miraheze/WikiDiscover - Universal-Omega the build passed.
[05:41:22] <icinga-miraheze>	 PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[05:41:24] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JsOT1
[05:41:25] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 03b9248a1 - Update WikiDiscover
[05:57:12] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[06:03:34] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±1] 13https://git.io/JsOtg
[06:03:35] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 031c5bedc - Install GlobalWatchlist
[06:03:36] <Not-80da>	 [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[06:05:42] <Not-80da>	 [02mediawiki] 07Universal-Omega opened pull request 03#1717: Install GlobalWatchlist - 13https://git.io/JsOtp
[06:05:47] <Not-80da>	 [02mediawiki] 07Universal-Omega closed pull request 03#1717: Install GlobalWatchlist - 13https://git.io/JsOtp
[06:05:48] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+1/-0/±1] 13https://git.io/JsOth
[06:05:50] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 03ed5e229 - Install GlobalWatchlist (#1717)
[06:05:54] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[06:06:00] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[06:06:01] <Not-80da>	 [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b
[06:07:08] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[06:07:53] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JsOq4
[06:07:55] <Not-80da>	 [02miraheze/mediawiki] 07Universal-Omega 037cc5f8e - Install GlobalWatchlist
[06:10:33] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsOqQ
[06:10:35] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03acd31ed - T7167: add GlobalWatchlist extension
[06:10:36] <Not-80da>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[06:10:38] <Not-80da>	 [02mw-config] 07Universal-Omega opened pull request 03#3901: T7167: add GlobalWatchlist extension - 13https://git.io/JsOq5
[06:11:17] <icinga-miraheze>	 PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[06:11:37] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsOmJ
[06:11:39] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 039a63102 - Update LocalExtensions.php
[06:11:40] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3901: T7167: add GlobalWatchlist extension - 13https://git.io/JsOq5
[06:11:43] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[06:12:35] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsOmO
[06:12:36] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03dad9f83 - Update extension-list
[06:12:38] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[06:12:38] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3901: T7167: add GlobalWatchlist extension - 13https://git.io/JsOq5
[06:13:33] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[06:15:08] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 5 minutes ago with 0 failures
[06:19:30] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[06:20:19] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsOYM
[06:20:20] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 0352b3528 - Update LocalSettings.php
[06:20:22] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3901: T7167: add GlobalWatchlist extension - 13https://git.io/JsOq5
[06:21:22] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[06:22:46] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3901: T7167: add GlobalWatchlist extension - 13https://git.io/JsOq5
[06:22:48] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JsOOs
[06:22:49] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03bc705ce - T7167: add GlobalWatchlist extension (#3901)
[06:22:51] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[06:22:52] <Not-80da>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[06:23:47] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[06:27:16] <dmehus>	 !sre I'm getting persistent error 500s on `metawiki`
[06:27:22] <dmehus>	 Can't access the wiki at all
[06:28:00] <dmehus>	 It now seems to be resolved—weird, though, as I did have about 2 minutes of error 500s
[06:28:27] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.00, 3.45, 2.08
[06:29:22] <icinga-miraheze>	 RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:29:22] <icinga-miraheze>	 RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:30:28] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 1.10, 2.54, 1.91
[06:30:46] <Reception123>	 seems like it was related to the recent extension install and i18n being rebuilt
[06:31:45] <dmehus>	 Reception123, ah, that makes sense. Does that happen from time to time?
[06:31:45] <Crepusculum>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* / jbr* / test3
[06:31:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:33:10] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[06:35:05] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[06:35:09] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.08, 6.87, 5.10
[06:35:47] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.99, 6.65, 5.02
[06:37:06] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.50, 6.48, 5.19
[06:37:14] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config]
[06:37:47] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.13, 6.11, 5.02
[06:41:09] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:43:16] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsOZ8
[06:43:17] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03ca2c9d9 - Switch GlobalWatchlist to loginwiki
[06:43:19] <Not-80da>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[06:43:20] <Not-80da>	 [02mw-config] 07Universal-Omega opened pull request 03#3902: Switch GlobalWatchlist to loginwiki - 13https://git.io/JsOZB
[06:43:26] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3902: Switch GlobalWatchlist to loginwiki - 13https://git.io/JsOZB
[06:43:27] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsOZ0
[06:43:29] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03ebc8f7d - Switch GlobalWatchlist to loginwiki (#3902)
[06:43:30] <Not-80da>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[06:43:32] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[06:44:22] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[06:44:32] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[06:48:41] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[07:05:13] <Crepusculum>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=trollpastawikiwiki --r "[[phab:T7308|Requested]]" /home/universalomega/trollpastawikiwiki-delete2.txt on jbr4
[07:05:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:07:10] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config]
[07:11:08] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[07:16:38] <Crepusculum>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=trollpastawikiwiki --r "[[phab:T7308|Requested]]" /home/universalomega/trollpastawikiwiki-delete3.txt on jbr4
[07:16:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:17:49] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[07:18:05] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-3902-Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsO8F
[07:18:07] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03ac92c16 - Revert "Switch GlobalWatchlist to loginwiki (#3902)"
[07:18:08] <Not-80da>	 [02mw-config] 07Universal-Omega created branch 03revert-3902-Universal-Omega-patch-1 - 13https://git.io/vbvb3
[07:18:10] <Not-80da>	 [02mw-config] 07Universal-Omega opened pull request 03#3903: Revert "Switch GlobalWatchlist to loginwiki" - 13https://git.io/JsO8N
[07:18:13] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3903: Revert "Switch GlobalWatchlist to loginwiki" - 13https://git.io/JsO8N
[07:18:15] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsO8A
[07:18:16] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03ccef4b8 - Revert "Switch GlobalWatchlist to loginwiki (#3902)" (#3903)
[07:18:47] <Not-80da>	 [02mw-config] 07Universal-Omega deleted branch 03revert-3902-Universal-Omega-patch-1 - 13https://git.io/vbvb3
[07:18:49] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-3902-Universal-Omega-patch-1
[07:19:09] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[07:19:16] <miraheze-github_>	 miraheze/mw-config - Universal-Omega the build passed.
[07:27:17] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 2.42, 3.58, 2.27
[07:29:14] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 1.05, 2.66, 2.08
[07:31:25] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[07:31:48] <Crepusculum>	 !log sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=trollpastawikiwiki --r "[[phab:T7308|Requested]]" /home/universalomega/trollpastawikiwiki-delete4.txt on jbr4
[07:31:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:33:10] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.41, 3.69, 2.78
[07:35:06] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.72, 2.76, 2.55
[07:37:10] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config]
[07:48:14] <Not-80da>	 [02mw-config] 07Universal-Omega opened pull request 03#3904: merge branch 'master' into REL1_36 - 13https://git.io/JsOzR
[07:51:25] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 13https://git.io/JsOgT
[07:51:26] <Not-80da>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[07:51:28] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 0332 commits to 03Universal-Omega-patch-1 [+0/-0/±64] 13https://git.io/JsOgk
[07:51:29] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 0391382ed - Merge branch 'REL1_36' into Universal-Omega-patch-1
[07:51:31] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3904: merge branch 'master' into REL1_36 - 13https://git.io/JsOzR
[07:52:33] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[07:52:53] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsOgu
[07:52:54] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03ee828c4 - Update LocalExtensions.php
[07:52:56] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3904: merge branch 'master' into REL1_36 - 13https://git.io/JsOzR
[07:53:18] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3904: merge branch 'master' into REL1_36 - 13https://git.io/JsOzR
[07:53:19] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±5] 13https://git.io/JsOgo
[07:53:21] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03241eb6c - merge branch 'master' into REL1_36 (#3904)
[07:53:22] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk
[07:53:24] <Not-80da>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[07:53:25] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[07:53:47] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[07:53:56] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[07:54:15] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 0368 commits to 03REL1_36 [+0/-0/±95] 13https://git.io/JsOg5
[07:54:17] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 038339df3 - Merge branch 'master' into REL1_36
[07:54:18] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk
[07:55:16] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[07:55:51] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsO2G
[07:55:53] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03a3603d8 - fix order
[07:56:35] <Not-80da>	 [02mw-config] 07Universal-Omega opened pull request 03#3905: Merge branch 'master' into REL1_36 - 13https://git.io/JsO2R
[07:56:46] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[07:57:25] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 13https://git.io/JsO26
[07:57:26] <Not-80da>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[07:57:27] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 0334 commits to 03Universal-Omega-patch-1 [+0/-0/±70] 13https://git.io/JsO2i
[07:57:29] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 0346d8e32 - Merge branch 'REL1_36' into Universal-Omega-patch-1
[07:57:31] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3905: Merge branch 'master' into REL1_36 - 13https://git.io/JsO2R
[07:57:39] <Not-80da>	 [02mw-config] 07Universal-Omega closed pull request 03#3905: Merge branch 'master' into REL1_36 - 13https://git.io/JsO2R
[07:57:40] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±0] 13https://git.io/JsO2X
[07:57:42] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 0353492e8 - fix order (#3905)
[07:57:43] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk
[07:57:45] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[07:57:46] <Not-80da>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[07:58:19] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 032 commits to 03REL1_36 [+0/-0/±1] 13https://git.io/JsO2d
[07:58:21] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03cabbea4 - Merge branch 'master' into REL1_36
[07:58:22] <Not-80da>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk
[07:58:56] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[07:59:23] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[08:20:26] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 1.56, 3.49, 2.30
[08:22:26] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 1.09, 2.76, 2.18
[08:26:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 2.08, 5.51, 3.14
[08:28:16] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[08:28:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is WARNING: WARNING - load average: 0.52, 3.79, 2.79
[08:30:19] <icinga-miraheze>	 RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 0.47, 2.82, 2.57
[08:49:45] <icinga-miraheze>	 PROBLEM - arquivo.ucmg.ml - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'arquivo.ucmg.ml' expires in 15 day(s) (Sun 30 May 2021 08:43:51 GMT +0000).
[08:55:15] <Not-80da>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsOyk
[08:55:17] <Not-80da>	 [02miraheze/ssl] 07MirahezeSSLBot 036e27554 - Bot: Update SSL cert for arquivo.ucmg.ml
[08:58:15] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[09:09:53] <icinga-miraheze>	 RECOVERY - arquivo.ucmg.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'arquivo.ucmg.ml' will expire on Thu 12 Aug 2021 07:55:09 GMT +0000.
[09:11:52] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[09:34:16] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[09:47:54] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[10:23:48] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[10:37:24] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[10:50:27] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 8.61, 5.06, 2.47
[10:52:26] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is WARNING: WARNING - load average: 2.88, 3.93, 2.35
[10:54:26] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 0.89, 2.77, 2.12
[11:06:29] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[11:20:05] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[11:35:34] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[11:49:10] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[12:10:12] <Not-80da>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Js34L
[12:10:14] <Not-80da>	 [02miraheze/services] 07MirahezeSSLBot 035702c5f - BOT: Updating services config for wikis
[12:18:15] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[12:31:53] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[12:35:29] <SPF|Cloud>	 !log testing puppet changes on db11
[12:35:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:42:30] <icinga-miraheze>	 PROBLEM - dbbackup1 Puppet on dbbackup1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 31 seconds ago with 1 failures. Failed resources (up to 3 shown): User[dbbackup-user]
[12:46:27] <icinga-miraheze>	 RECOVERY - dbbackup1 Puppet on dbbackup1 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures
[12:47:22] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[12:58:40] <Not-80da>	 [02miraheze/puppet] 07Southparkfan pushed 031 commit to 03master [+0/-0/±5] 13https://git.io/Js3V1
[12:58:42] <Not-80da>	 [02miraheze/puppet] 07Southparkfan 03f9de817 - dbbackup: correct uid/gid for dbbackup-user on all servers
[13:01:16] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp10.miraheze.org
[13:32:34] <icinga-miraheze>	 PROBLEM - phabdigests.bots.miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for phabdigests.bots.miraheze.wiki could not be found
[13:32:34] <icinga-miraheze>	 PROBLEM - unmade.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for unmade.miraheze.org could not be found
[13:39:17] <icinga-miraheze>	 RECOVERY - phabdigests.bots.miraheze.wiki - reverse DNS on sslhost is OK: rDNS OK - phabdigests.bots.miraheze.wiki reverse DNS resolves to cp11.miraheze.org
[13:39:17] <icinga-miraheze>	 RECOVERY - unmade.miraheze.org - reverse DNS on sslhost is OK: rDNS OK - unmade.miraheze.org reverse DNS resolves to cp11.miraheze.org
[13:46:27] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 5.34, 4.09, 2.82
[13:48:27] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 1.22, 2.94, 2.55
[14:06:16] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[14:21:56] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 32.03, 20.50, 15.24
[14:22:27] <icinga-miraheze>	 PROBLEM - cp10 Current Load on cp10 is CRITICAL: CRITICAL - load average: 7.69, 5.56, 3.01
[14:23:56] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.72, 18.27, 15.04
[14:26:26] <icinga-miraheze>	 RECOVERY - cp10 Current Load on cp10 is OK: OK - load average: 1.34, 3.08, 2.56
[14:30:49] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.77, 6.25, 4.76
[14:32:24] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.17, 6.84, 4.78
[14:32:49] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.37, 6.40, 5.01
[14:33:04] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 10.43, 7.44, 5.28
[14:33:47] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.65, 6.83, 5.01
[14:34:24] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.49, 7.23, 5.18
[14:35:03] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.36, 7.64, 5.65
[14:35:47] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.78, 6.59, 5.13
[14:36:24] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.16, 5.86, 4.94
[14:37:04] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.34, 7.65, 5.88
[14:38:48] <icinga-miraheze>	 PROBLEM - www.trollpasta.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.trollpasta.com could not be found
[14:38:52] <icinga-miraheze>	 PROBLEM - wiki.raghuveer.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.raghuveer.net could not be found
[14:38:54] <icinga-miraheze>	 PROBLEM - aman.awiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for aman.awiki.org could not be found
[14:39:04] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.11, 6.75, 5.77
[14:40:23] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[14:42:07] <icinga-miraheze>	 PROBLEM - wiki.thefactoryhka.com.pa - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.thefactoryhka.com.pa could not be found
[14:45:36] <icinga-miraheze>	 RECOVERY - www.trollpasta.com - reverse DNS on sslhost is OK: rDNS OK - www.trollpasta.com reverse DNS resolves to cp11.miraheze.org
[14:45:45] <icinga-miraheze>	 RECOVERY - wiki.raghuveer.net - reverse DNS on sslhost is OK: rDNS OK - wiki.raghuveer.net reverse DNS resolves to cp11.miraheze.org
[14:45:48] <icinga-miraheze>	 RECOVERY - aman.awiki.org - reverse DNS on sslhost is OK: rDNS OK - aman.awiki.org reverse DNS resolves to cp10.miraheze.org
[14:48:58] <icinga-miraheze>	 RECOVERY - wiki.thefactoryhka.com.pa - reverse DNS on sslhost is OK: rDNS OK - wiki.thefactoryhka.com.pa reverse DNS resolves to cp11.miraheze.org
[14:54:19] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 5.99, 5.09, 2.98
[14:54:22] <Not-80da>	 [02miraheze/dns] 07Southparkfan pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Js3ji
[14:54:23] <Not-80da>	 [02miraheze/dns] 07Southparkfan 0366bd191 - Depool cp10 for performance test
[14:55:07] <SPF|Cloud>	 that cp11 alert is pure coincidence
[14:56:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is WARNING: WARNING - load average: 1.52, 3.71, 2.73
[14:58:18] <icinga-miraheze>	 RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 1.72, 3.02, 2.59
[15:01:47] <SPF|Cloud>	 brb
[15:02:41] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[15:15:04] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.82, 7.10, 5.58
[15:16:20] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[15:17:04] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.39, 6.58, 5.59
[15:38:41] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[15:40:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is WARNING: WARNING - load average: 3.45, 3.32, 2.25
[15:42:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 6.35, 3.82, 2.52
[15:52:17] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[15:52:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is WARNING: WARNING - load average: 1.49, 3.60, 3.42
[15:54:18] <icinga-miraheze>	 RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 1.25, 2.72, 3.11
[16:07:50] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[16:21:25] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[16:27:21] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.30, 6.67, 5.48
[16:29:17] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.56, 7.06, 5.78
[16:30:06] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[16:31:12] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.80, 6.57, 5.76
[16:39:48] <SPF|Cloud>	 paladox / Reception123: any of you around in ~six hours?
[16:42:29] <paladox>	 I can I guess
[16:42:52] <paladox>	 Also looks like we can set none as a I/o type on cloud4
[16:42:57] <paladox>	 Haven’t seen any issues
[16:43:16] <SPF|Cloud>	 my graphs tell otherwise (but I question the validity)
[16:43:31] <SPF|Cloud>	 ... and that's one part of my request to you
[16:43:42] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[16:44:00] <SPF|Cloud>	 https://github.com/miraheze/dns/compare/8e29e829d9f7...66bd191fe891 this should be reverted in six hours
[16:44:01] <MirahezeBot>	 [ Comparing 8e29e829d9f7...66bd191fe891 · miraheze/dns · GitHub ] - github.com
[16:44:45] <Reception123>	 I won't be unfortunately 
[16:45:58] <SPF|Cloud>	 (s/six hours/at 10 PM this evening/g)
[16:49:12] <SPF|Cloud>	 paladox: might want to set a reminder
[16:49:25] <SPF|Cloud>	 and please don't change the i/o scheduler yet :-)
[16:49:47] <SPF|Cloud>	 (on cloud4 or on VMs on cloud4, since that will interfere with my tests)
[16:56:28] <paladox>	 SPF|Cloud: what graphs have you been looking at that show issues?
[16:58:27] <SPF|Cloud>	 https://grafana.miraheze.org/d/W9MIkA7iz/miraheze-cluster?viewPanel=287&from=1620840359497&to=1620991718353&var-job=node&var-node=gluster4.miraheze.org&var-port=9100 and https://grafana.miraheze.org/d/W9MIkA7iz/miraheze-cluster?viewPanel=35&from=1620840359497&to=1620991718353&var-job=node&var-node=gluster4.miraheze.org&var-port=9100
[16:58:28] <MirahezeBot>	 [ Grafana ] - grafana.miraheze.org
[16:58:29] <MirahezeBot>	 [ Grafana ] - grafana.miraheze.org
[16:59:15] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[16:59:24] <SPF|Cloud>	 however, https://grafana.miraheze.org/d/W9MIkA7iz/miraheze-cluster?viewPanel=8&from=1620840359497&to=1620991718353&var-job=node&var-node=gluster4.miraheze.org&var-port=9100 shows an improvement actually
[16:59:24] <MirahezeBot>	 [ Grafana ] - grafana.miraheze.org
[17:08:22] <SPF|Cloud>	 afk
[17:15:17] <Reception123>	 !log reception@jobrunner3:/srv/mediawiki/w/maintenance$ sudo -u www-data php deleteBatch.php -u "Miraheze maintenance script" -r "[[phab:T7310|Requested]]" --wiki testwiki /home/reception/test.txt
[17:15:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:34:56] <paladox>	 SPF|Cloud: that graph seems normal or rather I guess that was intended
[17:58:49] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 6.91, 8.59, 6.19
[18:00:49] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.53, 7.03, 5.90
[18:02:49] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.29, 6.07, 5.68
[18:24:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 13.83, 5.73, 2.89
[18:26:26] <icinga-miraheze>	 PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 21.83, 19.04, 13.91
[18:28:27] <icinga-miraheze>	 RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 13.39, 16.66, 13.65
[18:32:18] <icinga-miraheze>	 RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 1.45, 3.36, 3.11
[18:37:15] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[18:54:06] <dmehus>	 !sre I'm getting MediaWiki "The server did not respond within the expected time" red box-style error messages on `metawiki`. It's timing out trying to patrol revisions
[18:54:12] <dmehus>	 Could be load issues
[18:54:29] <icinga-miraheze>	 PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 7.24, 4.48, 2.72
[18:54:43] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is CRITICAL: CRITICAL - load average: 15.35, 9.06, 5.04
[18:54:48] <icinga-miraheze>	 PROBLEM - johanloopmans.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for johanloopmans.nl could not be found
[18:54:49] <icinga-miraheze>	 PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 39.84, 26.45, 18.00
[18:54:49] <icinga-miraheze>	 PROBLEM - www.opendatascot.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.opendatascot.org could not be found
[18:54:59] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 5 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.195.236.250/cpweb, 2001:41d0:800:1bbd::4/cpweb, 2607:5300:205:200::1c30/cpweb
[18:55:10] <icinga-miraheze>	 PROBLEM - mw9 MediaWiki Rendering on mw9 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[18:55:23] <dmehus>	 !sre Persistent MediaWiki timeout errors on `metawiki` and `Queued Jobs: 06559ms (PHP7 via metawiki@mw10 / cp12)`
[18:56:47] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 5 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 2001:41d0:800:1bbd::4/cpweb, 51.222.25.132/cpweb, 2607:5300:205:200::1c30/cpweb
[18:57:04] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[18:57:12] <icinga-miraheze>	 RECOVERY - mw9 MediaWiki Rendering on mw9 is OK: HTTP OK: HTTP/1.1 200 OK - 20901 bytes in 0.252 second response time
[18:58:36] <dmehus>	 Update...MediaWiki "The server did not respond within the expected time" red box-style error messages
[18:58:41] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[18:58:41] <dmehus>	 still persist
[19:00:00] <dmehus>	 Response times seem to be improving and MediaWiki timeout errors are reducing. Will update when fully resolved.
[19:00:28] <icinga-miraheze>	 RECOVERY - gluster4 Current Load on gluster4 is OK: OK - load average: 2.18, 4.35, 3.39
[19:00:44] <icinga-miraheze>	 PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 12.39, 22.17, 19.20
[19:01:45] <icinga-miraheze>	 RECOVERY - johanloopmans.nl - reverse DNS on sslhost is OK: rDNS OK - johanloopmans.nl reverse DNS resolves to cp11.miraheze.org
[19:01:49] <icinga-miraheze>	 RECOVERY - www.opendatascot.org - reverse DNS on sslhost is OK: rDNS OK - www.opendatascot.org reverse DNS resolves to cp11.miraheze.org
[19:02:42] <icinga-miraheze>	 RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 12.64, 19.01, 18.39
[19:09:42] <dmehus>	 Seems to be recovered now
[19:10:24] <dmehus>	 Reception123: see above...I'm wondering if we should create a task for SRE (Infrastructure) to investigate given the length and also that we were getting MediaWiki software timeout errors?
[19:10:38] <dmehus>	 Go back about 20 minutes or so.
[19:10:40] <MH-Discord>	 <DarkMatterMan4500> @Doug How come you investigated the Reverse Crappy Games Wiki? Unless if.....
[19:11:19] <dmehus>	 DarkMatterMan4500, I'll reply via DM. This is the -sre channel
[19:11:42] <MH-Discord>	 <DarkMatterMan4500> You got it @Doug.
[19:11:47] <dmehus>	 thanks :)
[19:14:18] <icinga-miraheze>	 PROBLEM - cp11 Current Load on cp11 is WARNING: WARNING - load average: 1.04, 2.42, 3.85
[19:19:19] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JssxF
[19:19:21] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega 03afd4981 - Update SpecialRequestWiki.php
[19:19:22] <Not-80da>	 [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vpJTL
[19:19:38] <Not-80da>	 [02CreateWiki] 07Universal-Omega opened pull request 03#216: Fix disallowing blank reasons or comments - 13https://git.io/Jssxx
[19:20:18] <icinga-miraheze>	 RECOVERY - cp11 Current Load on cp11 is OK: OK - load average: 1.08, 2.26, 3.39
[19:20:23] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsspI
[19:20:24] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega 03093219b - Update WikiRequest.php
[19:20:26] <Not-80da>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#216: Fix disallowing blank reasons or comments - 13https://git.io/Jssxx
[19:20:38] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[19:21:23] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[19:28:15] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[19:41:53] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[20:11:04] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[20:45:06] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[21:00:36] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[21:10:11] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsGsU
[21:10:12] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega 03df9e68e - Update SpecialRequestWiki.php
[21:10:14] <Not-80da>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#216: Fix disallowing blank reasons or comments - 13https://git.io/Jssxx
[21:10:52] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JsGsY
[21:10:54] <Not-80da>	 [02miraheze/CreateWiki] 07Universal-Omega 03bb359e2 - Update WikiRequest.php
[21:10:55] <Not-80da>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#216: Fix disallowing blank reasons or comments - 13https://git.io/Jssxx
[21:11:13] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[21:11:53] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[21:14:11] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[21:27:04] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.37, 7.12, 5.31
[21:29:04] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.66, 6.96, 5.49
[21:31:04] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.92, 6.17, 5.37
[21:36:29] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[21:50:05] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[22:05:34] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[22:19:11] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[22:48:18] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[23:01:53] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[23:31:02] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[23:44:32] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 12.49, 8.08, 4.30
[23:44:39] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp11.miraheze.org
[23:51:57] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JsGaa
[23:51:59] <Not-80da>	 [02miraheze/mw-config] 07Universal-Omega 03efd8975 - Test DPL3 settings with dcmultiversewiki
[23:52:59] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.