[00:03:16] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 30.13, 27.55, 20.64
[00:05:09] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 13.40, 22.20, 19.50
[00:07:03] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.28, 18.86, 18.59
[00:12:38] <icinga-miraheze>	 PROBLEM - rdb2 APT on rdb2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[00:14:33] <icinga-miraheze>	 RECOVERY - rdb2 APT on rdb2 is OK: APT OK: 5 packages available for upgrade (0 critical updates).
[00:28:24] <Naleksuh>	 Curious if MH wikis use a single installation of MW or multiple
[00:38:28] <MH-Discord>	 <Zppix> I mean technically each wiki is its own mw installation
[00:38:46] <MH-Discord>	 <Zppix> But in the backend its a single
[00:54:19] <icinga-miraheze>	 PROBLEM - wiki.fourta.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.fourta.org' expires in 15 day(s) (Tue 10 Nov 2020 00:47:09 GMT +0000).
[00:54:43] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTwHD
[00:54:44] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 03188b020 - Bot: Update SSL cert for wiki.fourta.org
[00:55:50] <icinga-miraheze>	 PROBLEM - wiki.wikidadds.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.wikidadds.org' expires in 15 day(s) (Tue 10 Nov 2020 00:49:12 GMT +0000).
[01:00:05] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTwQT
[01:00:07] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 0310d62fb - Bot: Update SSL cert for wiki.wikidadds.org
[01:07:53] <icinga-miraheze>	 RECOVERY - wiki.fourta.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fourta.org' will expire on Fri 22 Jan 2021 23:54:36 GMT +0000.
[01:16:29] <icinga-miraheze>	 RECOVERY - wiki.wikidadds.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wikidadds.org' will expire on Fri 22 Jan 2021 23:59:58 GMT +0000.
[02:20:20] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTwbI
[02:20:22] <Not>	 [02miraheze/services] 07MirahezeSSLBot 0311bb687 - BOT: Updating services config for wikis
[10:53:02] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.52, 20.68, 17.29
[10:55:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.27, 17.75, 16.60
[13:29:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.81, 20.79, 17.12
[13:31:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.96, 19.00, 16.92
[13:43:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.25, 20.62, 18.15
[13:45:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 18.98, 20.02, 18.23
[14:00:21] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTrHr
[14:00:22] <Not>	 [02miraheze/services] 07MirahezeSSLBot 03bb91974 - BOT: Updating services config for wikis
[14:13:03] <icinga-miraheze>	 PROBLEM - wiki.lbcomms.co.za - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[14:22:14] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.43, 20.64, 18.31
[14:24:08] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.90, 20.34, 18.46
[14:26:02] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 10.75, 16.90, 17.43
[14:34:23] <icinga-miraheze>	 RECOVERY - wiki.lbcomms.co.za - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.lbcomms.co.za' will expire on Fri 27 Nov 2020 08:17:36 GMT +0000.
[15:05:01] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.84, 21.03, 17.80
[15:07:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.26, 18.50, 17.27
[15:15:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.59, 19.97, 18.00
[15:17:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 19.50, 19.51, 18.06
[15:23:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.21, 21.62, 19.39
[15:27:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 11.73, 18.60, 18.90
[16:22:36] <icinga-miraheze>	 PROBLEM - ping6 on misc1 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 703.99 ms
[16:24:34] <icinga-miraheze>	 PROBLEM - ping6 on misc1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 191.11 ms
[16:26:32] <icinga-miraheze>	 PROBLEM - ping6 on misc1 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 204.79 ms
[16:28:30] <icinga-miraheze>	 PROBLEM - ping6 on misc1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 182.14 ms
[16:30:28] <icinga-miraheze>	 RECOVERY - ping6 on misc1 is OK: PING OK - Packet loss = 0%, RTA = 69.41 ms
[17:29:39] <Not>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+1/-0/±3] 13https://git.io/JTokd
[17:29:41] <Not>	 [02miraheze/CreateWiki] 07JohnFLewis 03ece9ace - T5488: Move WikiCreation to a job
[17:32:39] <Spookreeeno>	 :) JohnLewis
[17:33:40] <JohnLewis>	 It's not enabled yet though, but if anyone wants to deploy it and enable it, let me know if anything seems off with it (plus with the feature flag, its a quick disable)
[17:34:36] <Reception123>	 JohnLewis: oh, what would you mean by "enabling" it? :)
[17:34:39] <Spookreeeno>	 JohnLewis: if it's just setting wgCreateWikiUseJobQueue and bumping REL1_34 branch then can do tonight if no one beats me to it
[17:34:47] <Reception123>	 oh, feel free then!
[17:34:50] <Reception123>	 all yours :D
[17:35:31] <JohnLewis>	 That's all it is
[17:38:56] <Spookreeeno>	 Can do in a few hours then
[18:15:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 22.80, 24.19, 20.24
[18:17:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.46, 19.63, 19.02
[18:21:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 22.79, 24.43, 21.37
[18:23:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 17.66, 22.28, 20.96
[18:25:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 10.81, 18.29, 19.66
[18:33:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 23.02, 20.27, 19.62
[18:37:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 15.04, 19.13, 19.45
[19:05:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.74, 20.17, 19.18
[19:07:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 17.34, 19.99, 19.30
[19:11:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 22.26, 21.44, 19.93
[19:12:38] <MH-Discord>	 <Avengium (Ángel)> Hi. i want to change the language of intercriaturaswiki to ES español. I sent the submit request, but the wiki doesn't seem to remember the request https://intercriaturas.miraheze.org/wiki/Special:ManageWiki/core
[19:12:43] <MirahezeBot>	 [ Manage this wiki's core settings - InterCriaturas ] - intercriaturas.miraheze.org
[19:15:01] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.64, 18.39, 19.20
[19:30:45] <Spookreeeno>	 JohnLewis: ^
[19:34:12] <Not>	 [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTosM
[19:34:14] <Not>	 [02miraheze/ManageWiki] 07JohnFLewis 03e2e5771 - Add missing language setting to S:MW processing
[19:34:14] <JohnLewis>	 Spookreeeno: ^
[19:35:16] <dmehus>	 @JohnLewis Nice way of handling that—add self-serve task processing to ManageWiki. :)
[19:55:01] <MH-Discord>	 <Avengium (Ángel)> i try to change the language to spanish, but the wiki is still on english
[19:56:13] <Spookreeeno>	 Thanks JohnLewis will push with CW later
[19:56:29] <Spookreeeno>	 We know avengium
[20:07:05] <Not>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JToZH
[20:07:06] <Not>	 [02miraheze/mediawiki] 07paladox 0392e2011 - Update ManageWiki
[20:09:33] <Not>	 [02miraheze/mediawiki] 07paladox pushed 037 commits to 03REL1_35 [+0/-0/±10] 13https://git.io/JToZb
[20:09:35] <Not>	 [02miraheze/mediawiki] 07paladox 031e9f735 - Merge branch 'REL1_34' into REL1_35 * REL1_34: Update ManageWiki CWMW Update SocialProfile MW MW CW
[20:19:22] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.89, 20.46, 17.98
[20:20:20] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[20:20:36] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[20:20:53] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[20:21:05] <icinga-miraheze>	 PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[20:21:06] <Spookreeeno>	 paladox: bump CW too while you're doing it all
[20:21:14] <paladox>	 ok
[20:21:16] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 29.52, 23.05, 19.18
[20:21:18] <Spookreeeno>	 I'll sort the config changes for jobs in about 90mins
[20:21:58] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[20:23:56] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 20.20, 23.42, 16.68
[20:24:10] <Not>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JTonK
[20:24:12] <Not>	 [02miraheze/mediawiki] 07paladox 035914465 - Update CreateWiki
[20:25:11] <Not>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTon1
[20:25:13] <Not>	 [02miraheze/services] 07MirahezeSSLBot 03665e4a5 - BOT: Updating services config for wikis
[20:25:57] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 42.38, 28.22, 19.12
[20:27:03] <icinga-miraheze>	 RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures
[20:28:05] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures
[20:28:52] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[20:29:48] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 17.63, 23.45, 19.20
[20:33:41] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CRITICAL - load average: 27.76, 25.12, 20.75
[20:34:35] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures
[20:34:36] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures
[20:35:36] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 22.35, 23.92, 20.81
[20:39:27] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 15.32, 20.03, 19.93
[20:57:02] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 14.58, 18.38, 23.11
[20:58:04] <Not>	 [02miraheze/mediawiki] 07paladox pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JToCE
[20:58:06] <Not>	 [02miraheze/mediawiki] 07paladox 03b6b62f6 - Merge branch 'REL1_34' into REL1_35 * REL1_34: Update CreateWiki
[21:05:42] <JohnLewis>	 !log disable puppet1 on misc1
[21:05:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:07:02] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 26.59, 21.31, 21.96
[21:08:52] <icinga-miraheze>	 PROBLEM - misc1 Puppet on misc1 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 7 minutes ago with 0 failures
[21:09:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.63, 20.77, 21.71
[21:11:28] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 60.75, 36.19, 27.20
[21:14:07] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 11.63, 8.98, 6.07
[21:16:06] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 3.92, 7.01, 5.70
[21:18:09] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 3.32, 5.64, 5.35
[21:20:42] <icinga-miraheze>	 PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 13.06, 10.85, 5.58
[21:21:48] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 23.87, 16.80, 13.72
[21:22:34] <icinga-miraheze>	 PROBLEM - db7 Check MariaDB Replication on db7 is CRITICAL: MariaDB replication - both - CRITICAL - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 236s
[21:24:37] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 23.92, 19.02, 11.52
[21:24:58] <icinga-miraheze>	 RECOVERY - db7 Check MariaDB Replication on db7 is OK: MariaDB replication - both - OK - Slave_IO_Running state : Yes, Slave_SQL_Running state : Yes, Seconds_Behind_Master : 0s
[21:26:08] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 14.67, 16.58, 14.35
[21:28:53] <icinga-miraheze>	 RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 0.76, 6.64, 6.14
[21:34:33] <Not>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTolu
[21:34:35] <Not>	 [02miraheze/CreateWiki] 07JohnFLewis 0365c6769 - -wiki in requestwiki* log entry
[21:34:58] <Not>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JTolz
[21:34:59] <Not>	 [02miraheze/CreateWiki] 07paladox 03d3182d4 - requestaccept -> requestwikiaccept and requestdecline -> requestwikidecline
[21:35:01] <Not>	 [02CreateWiki] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vpJTL
[21:35:05] <Not>	 [02CreateWiki] 07paladox opened pull request 03#160: requestaccept -> requestwikiaccept and requestdecline -> requestwikidecline - 13https://git.io/JTol2
[21:36:11] <Spookreeeno>	 paladox: John fixed above
[21:36:17] <paladox>	 pl
[21:36:21] <paladox>	 ok
[21:36:22] <Spookreeeno>	 Needs deploy though
[21:36:36] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 1.33, 4.11, 7.28
[21:38:20] <Not>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JTolD
[21:38:22] <Not>	 [02miraheze/mediawiki] 07paladox 03e1ec7d2 - Update CreateWiki
[21:38:35] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.05, 3.38, 6.62
[21:40:17] <paladox>	 !log rebuild lc on mw* and jobrunner*
[21:40:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:40:34] <Not>	 [02miraheze/mediawiki] 07paladox pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JTolF
[21:40:35] <Not>	 [02miraheze/mediawiki] 07paladox 03740720e - Merge branch 'REL1_34' into REL1_35 * REL1_34: Update CreateWiki
[21:47:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 19.55, 18.97, 23.39
[21:53:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 24.70, 17.22, 20.74
[21:55:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.31, 15.39, 19.66
[21:59:38] <Spookreeeno>	 dmehus, Naleksuh: I'm gonna deploy an update to CW in a few minutes so if you don't mind hold off on https://meta.miraheze.org/wiki/Special:RequestWikiQueue/14916#mw-section-request pls
[21:59:40] <MirahezeBot>	 [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org
[21:59:53] <MH-Discord>	 <Spookreeeno> @CircleyDoesTest ^
[22:00:12] <MH-Discord>	 <CircleyDoesTest> Ah
[22:00:22] <MH-Discord>	 <CircleyDoesTest> It’s workin
[22:08:20] <Naleksuh>	 spookreeeno : is it finished?
[22:08:51] <Not>	 [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-1 [+0/-0/±1] 13https://git.io/JTo4g
[22:08:53] <Not>	 [02miraheze/mw-config] 07RhinosF1 039c409ca - CreateWiki: wgCreateWikiUseJobQueue -> true
[22:08:54] <Not>	 [02mw-config] 07RhinosF1 created branch 03RhinosF1-patch-1 - 13https://git.io/vbvb3
[22:09:04] <Spookreeeno>	 Naleksuh: no, ~12 minutes
[22:09:09] <Spookreeeno>	 will ping when done
[22:09:16] <Naleksuh>	 Wait 12 minutes from now or from begin
[22:09:17] <Not>	 [02mw-config] 07RhinosF1 opened pull request 03#3314: CreateWiki: wgCreateWikiUseJobQueue -> true - 13https://git.io/JTo4V
[22:09:33] <Spookreeeno>	 Naleksuh: from now
[22:11:42] <MirahezeBot>	 Hello Prueba2! If you have any questions, feel free to ask and someone should answer soon.
[22:11:54] <Prueba2>	 Please, request global ban to joaquinito01
[22:11:59] <Prueba2>	 JohnLewis
[22:12:02] <Prueba2>	 Please, request global ban to joaquinito01
[22:12:13] <Prueba2>	 paladox
[22:12:17] <Prueba2>	 Reception123
[22:12:19] <Prueba2>	 Please, request global ban to joaquinito01
[22:12:40] <Prueba2>	 Please, request global ban to joaquinito01
[22:13:59] <Not>	 [02mw-config] 07RhinosF1 closed pull request 03#3314: CreateWiki: wgCreateWikiUseJobQueue -> true - 13https://git.io/JTo4V
[22:14:01] <Not>	 [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JTo4d
[22:14:02] <Not>	 [02miraheze/mw-config] 07RhinosF1 03bee3fc4 - CreateWiki: wgCreateWikiUseJobQueue -> true (#3314)
[22:14:04] <Not>	 [02miraheze/mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-1
[22:14:05] <Not>	 [02mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-1 - 13https://git.io/vbvb3
[22:18:58] <MirahezeBot>	 Hello faggitnation! If you have any questions, feel free to ask and someone should answer soon.
[22:19:05] <faggitnation>	 hi! hello!
[22:19:07] <faggitnation>	 i need a cloak
[22:19:14] <faggitnation>	 (miraheze/joaquinito01)
[22:19:26] <faggitnation>	 Please, request global ban to joaquinito01
[22:20:05] <jess-o-lantern>	 have you considered a brief +zq $~a
[22:20:48] <Spookreeeno>	 .op
[22:20:48] <MirahezeBot>	 Attempting to OP...
[22:21:41] <Spookreeeno>	 jess-o-lantern: yes
[22:23:09] <Spookreeeno>	 opping those around so we can see messages
[22:24:08] <Spookreeeno>	 Naleksuh: go ahead
[22:24:34] <Naleksuh>	 Dmehus created them first
[22:24:59] <Spookreeeno>	 dmehus: I wanted that to test
[22:25:42] <dmehus>	 @Spookreeeno Oh, sorry, I didn't see the message above. Can you just request a test wiki and create it then delete it afterward?
[22:26:38] <Spookreeeno>	 dmehus: that's work. I'm staying up anyway to help fosshost and handle trolls so guess I wait.
[22:29:32] <dmehus>	 @Spookreeeno, lol, not that much work. I could request a wiki for you? Save you typing a few words in the description and keystrokes. heh
[22:29:52] <Spookreeeno>	 I don't mind
[22:30:00] <Spookreeeno>	 We create wikis often enough
[22:30:06] <dmehus>	 true
[22:30:22] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 17.02, 10.62, 5.90
[22:30:42] <dmehus>	 okay, well now we all know so next wiki request is yours...hopefully it's not a non-qualifying problematic Reception wiki :P
[22:31:01] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 40.65, 30.23, 22.32
[22:34:22] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.47, 6.40, 5.27
[22:35:01] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 11.66, 22.30, 21.05
[22:37:01] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 14.54, 19.37, 20.09
[22:41:02] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 32.72, 27.91, 23.44
[22:41:04] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2607:5300:205:200::2ac4/cpweb
[22:43:05] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[22:47:24] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 6.51, 7.48, 6.20
[22:49:26] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 3.79, 6.74, 6.13
[22:53:27] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 5.45, 7.30, 6.58
[22:55:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 11.99, 20.44, 23.02
[22:55:26] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 1.42, 5.21, 5.90
[23:00:31] <Not>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JTo04
[23:00:33] <Not>	 [02miraheze/CreateWiki] 07JohnFLewis 031f5c8ca - Introduce MainPage title object to fix hard coded MediaWiki quirk?
[23:01:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 28.07, 21.35, 22.13
[23:04:08] <Not>	 [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+7/-3/±4] 13https://git.io/JTo0r
[23:04:10] <Not>	 [02miraheze/puppet] 07JohnFLewis 03cad7772 - push LDAP mail setup
[23:07:29] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is CRITICAL: CRITICAL - load average: 10.79, 10.66, 7.77
[23:09:00] <icinga-miraheze>	 PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 12.76, 21.46, 22.53
[23:09:28] <icinga-miraheze>	 PROBLEM - cp7 Current Load on cp7 is WARNING: WARNING - load average: 2.60, 7.61, 7.00
[23:11:28] <icinga-miraheze>	 RECOVERY - cp7 Current Load on cp7 is OK: OK - load average: 2.44, 6.66, 6.79
[23:17:00] <icinga-miraheze>	 RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 12.80, 17.17, 20.34
[23:23:26] <icinga-miraheze>	 PROBLEM - mail1 APT on mail1 is CRITICAL: APT CRITICAL: 11 packages available for upgrade (3 critical updates).
[23:24:26] <Not>	 [02miraheze/mediawiki] 07RhinosF1 pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JToE5
[23:24:27] <Not>	 [02miraheze/mediawiki] 07RhinosF1 0327ed9d7 - Update CreateWiki
[23:24:51] <Spookreeeno>	 JohnLewis: ^
[23:24:58] <Not>	 [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+7/-3/±4] 13https://git.io/JToEd
[23:25:00] <Not>	 [02miraheze/puppet] 07JohnFLewis 0313d6f1f - push LDAP mail setup
[23:29:14] <Not>	 [02miraheze/mediawiki] 07RhinosF1 pushed 032 commits to 03REL1_35 [+0/-0/±2] 13https://git.io/JTout
[23:29:15] <Not>	 [02miraheze/mediawiki] 07RhinosF1 03d0430af - Merge branch 'REL1_34' into REL1_35
[23:29:34] <Spookreeeno>	 JohnLewis: as soon as puppet runs, it should be deployed.
[23:33:08] <JohnLewis>	 Okay, I’m now access-less
[23:33:49] <Spookreeeno>	 JohnLewis: what do we do with the stuck job if it's still stuck and any future creations then?
[23:34:00] <Spookreeeno>	 I'm off in 25 minutes max
[23:35:56] <JohnLewis>	 If the job is stuck, it’ll need to be deleted from the jobqueue 
[23:36:08] <JohnLewis>	 And then re queued
[23:36:16] <Spookreeeno>	 JohnLewis: how?
[23:36:25] <Spookreeeno>	 and requeue as in re-accept the wiki?
[23:37:45] <JohnLewis>	 Yes
[23:37:58] <Spookreeeno>	 how do I delete the current one?
[23:38:23] <Spookreeeno>	 JohnLewis: ^
[23:39:08] <JohnLewis>	 From redis, but I can’t imagine it still being there
[23:39:34] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:39:36] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:39:42] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:39:44] <Spookreeeno>	 JohnLewis: what am I supposed to do then?
[23:39:57] <JohnLewis>	 What do you mean?
[23:40:08] <Spookreeeno>	 showJobs.php has it as CreateWikiJob: 0 queued; 1 claimed (1 active, 0 abandoned); 0 delayed
[23:40:17] <Spookreeeno>	 I've just ran puppet on jobrunner2
[23:40:35] <JohnLewis>	 Delete it from redis
[23:40:36] <icinga-miraheze>	 PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:40:42] <dmehus>	 Is that recent, @Spookreeeno, as in the job is still showing as claimed?
[23:40:43] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:40:52] <dmehus>	 and do we need to worry about that puppet error?
[23:40:53] <Spookreeeno>	 JohnLewis: I have no clue how to
[23:41:01] <Spookreeeno>	 dmehus: yes and no
[23:41:09] <dmehus>	 ah, okay, thanks :)
[23:41:17] <JohnLewis>	 Then just reapprove the request 
[23:41:40] <Spookreeeno>	 JohnLewis: still don't know how to delete from redis
[23:41:42] <dmehus>	 and let the old job just die if the jobrunner tries to create it I guess?
[23:41:51] <dmehus>	 maybe that's what John means?
[23:41:56] <JohnLewis>	 But the notifs imply MediaWiki isn’t updated 
[23:42:17] <JohnLewis>	 I just said just reapprove the wiki
[23:42:34] <icinga-miraheze>	 RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures
[23:42:44] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures
[23:42:46] <Spookreeeno>	 JohnLewis: ok and puppet has ran on both runners
[23:42:59] <JohnLewis>	 Job runner doesn’t create jobs
[23:43:15] <Spookreeeno>	 JohnLewis: ack
[23:43:23] <Spookreeeno>	 dmehus: which did you just accept?
[23:43:33] <dmehus>	 the same one
[23:43:38] <dmehus>	 to see if that fixed it
[23:43:38] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[23:43:49] <Spookreeeno>	 dmehus: waiting on them icinga errors to clear
[23:43:54] <dmehus>	 oh
[23:43:59] <dmehus>	 gotcha
[23:45:27] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures
[23:45:27] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures
[23:45:48] <Spookreeeno>	 dmehus: press accept again
[23:45:52] <dmehus>	 ok
[23:46:16] <dmehus>	 done
[23:46:20] <Spookreeeno>	 ty
[23:46:49] <Spookreeeno>	 !log rhinos@jobrunner2:/var/log/mediawiki/debuglogs$ sudo -u www-data php /srv/mediawiki/w/maintenance/runJobs.php --wiki=metawiki
[23:46:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:47:09] <dmehus>	 looks like it created
[23:47:27] <dmehus>	 nice, and we didn't even have to create a separate wiki request and update this request's status
[23:48:44] <Spookreeeno>	 JohnLewis: created but still 2 jobs old stuck on showJobs.php
[23:48:50] <Spookreeeno>	 CreateWikiJob: 0 queued; 2 claimed (2 active, 0 abandoned); 0 delayed
[23:49:04] <JohnLewis>	 Yes, they’ll need to be deleted from redis as I have said
[23:49:46] <Spookreeeno>	 JohnLewis: how?
[23:50:12] <JohnLewis>	 If you don’t know, it’s fine don’t worry
[23:59:21] <paladox>	 !log deleted CreateWikiJob from redis on jobrunner1
[23:59:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log