[01:47:25] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 527
[01:55:25] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs
[02:00:37] <ZppixBot>	 Hello do! If you have any questions feel free to ask and someone should answer soon.
[02:27:58] <icinga-miraheze>	 PROBLEM - db4 Disk Space on db4 is WARNING: DISK WARNING - free space: / 24488 MB (6% inode=96%);
[02:34:19] <icinga-miraheze>	 PROBLEM - misc2 Current Load on misc2 is CRITICAL: CRITICAL - load average: 4.03, 3.03, 2.29
[02:36:19] <icinga-miraheze>	 RECOVERY - misc2 Current Load on misc2 is OK: OK - load average: 2.77, 2.91, 2.33
[02:42:19] <icinga-miraheze>	 PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.41, 3.14, 2.60
[02:44:19] <icinga-miraheze>	 RECOVERY - misc2 Current Load on misc2 is OK: OK - load average: 2.63, 3.04, 2.63
[02:55:25] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 574
[03:01:36] <icinga-miraheze>	 PROBLEM - bacula1 Bacula Databases db4 on bacula1 is WARNING: WARNING: Full, 671533 files, 76.35GB, 2019-06-02 02:58:00 (2.1 weeks ago)
[03:02:52] <icinga-miraheze>	 PROBLEM - misc2 Current Load on misc2 is WARNING: WARNING - load average: 3.54, 3.08, 2.81
[03:04:46] <icinga-miraheze>	 RECOVERY - misc2 Current Load on misc2 is OK: OK - load average: 2.41, 2.96, 2.81
[03:07:24] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs
[03:48:04] <paladox>	 !log ran PIIRemoval.php (enforcing ToU)
[03:48:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[03:48:35] <paladox>	 !log ran PIIRemoval.php (enforcing ToU) (again)
[03:48:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[04:02:35] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 4.66, 2.98, 1.47
[04:06:35] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.79, 1.80, 1.31
[04:08:35] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.55, 1.38, 1.22
[05:02:41] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 10.52, 4.51, 1.97
[05:03:22] <icinga-miraheze>	 PROBLEM - misc4 Current Load on misc4 is CRITICAL: CRITICAL - load average: 6.93, 3.97, 1.67
[05:03:25] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[05:03:33] <icinga-miraheze>	 PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is WARNING: WARNING - NGINX Error Rate is 47%
[05:03:40] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[05:04:19] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 3.71, 3.09, 1.39
[05:05:17] <icinga-miraheze>	 RECOVERY - misc4 Current Load on misc4 is OK: OK - load average: 2.25, 3.20, 1.66
[05:05:25] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[05:05:35] <icinga-miraheze>	 RECOVERY - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 3%
[05:05:40] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[05:08:13] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.32, 1.78, 1.24
[05:10:13] <icinga-miraheze>	 RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.24, 1.24, 1.10
[05:12:34] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.54, 1.64, 1.77
[05:14:35] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.16, 1.12, 1.56
[06:02:49] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 13.82, 6.21, 2.58
[06:03:11] <icinga-miraheze>	 PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw2
[06:03:27] <icinga-miraheze>	 PROBLEM - misc4 Current Load on misc4 is CRITICAL: CRITICAL - load average: 6.98, 4.24, 1.80
[06:04:19] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 3.60, 2.81, 1.26
[06:05:08] <icinga-miraheze>	 RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
[06:05:22] <icinga-miraheze>	 RECOVERY - misc4 Current Load on misc4 is OK: OK - load average: 1.28, 3.03, 1.64
[06:06:14] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.54, 1.92, 1.11
[06:08:13] <icinga-miraheze>	 RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.09, 1.29, 0.98
[06:10:42] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.17, 1.68, 1.82
[06:12:40] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.47, 1.31, 1.67
[06:51:58] <icinga-miraheze>	 PROBLEM - db4 Disk Space on db4 is CRITICAL: DISK CRITICAL - free space: / 21968 MB (5% inode=96%);
[09:02:47] <icinga-miraheze>	 PROBLEM - guiasdobrasil.com.br - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[09:02:47] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is CRITICAL: CRITICAL - load average: 13.88, 7.05, 2.95
[09:02:50] <icinga-miraheze>	 PROBLEM - misc4 Puppet on misc4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[09:03:25] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[09:03:31] <icinga-miraheze>	 PROBLEM - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is CRITICAL: CRITICAL - NGINX Error Rate is 73%
[09:03:32] <icinga-miraheze>	 PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[09:03:39] <icinga-miraheze>	 PROBLEM - misc4 Current Load on misc4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[09:03:40] <icinga-miraheze>	 PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 81.4.109.133/cpweb, 2a00:d880:5:8ea::ebc7/cpweb
[09:04:20] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 6.36, 4.05, 1.76
[09:04:51] <icinga-miraheze>	 RECOVERY - guiasdobrasil.com.br - LetsEncrypt on sslhost is OK: OK - Certificate 'guiasdobrasil.com.br' will expire on Tue 03 Sep 2019 02:35:01 PM GMT +0000.
[09:05:25] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[09:05:40] <icinga-miraheze>	 RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online
[09:06:54] <icinga-miraheze>	 RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 14 minutes ago with 0 failures
[09:07:35] <icinga-miraheze>	 RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
[09:07:39] <icinga-miraheze>	 RECOVERY - cp4 HTTP 4xx/5xx ERROR Rate on cp4 is OK: OK - NGINX Error Rate is 3%
[09:11:28] <icinga-miraheze>	 RECOVERY - misc4 Current Load on misc4 is OK: OK - load average: 0.42, 3.13, 2.93
[09:12:13] <icinga-miraheze>	 RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.52, 1.69, 1.61
[09:22:35] <icinga-miraheze>	 PROBLEM - cp4 Current Load on cp4 is WARNING: WARNING - load average: 0.38, 0.80, 1.82
[09:24:35] <icinga-miraheze>	 RECOVERY - cp4 Current Load on cp4 is OK: OK - load average: 0.46, 0.74, 1.67
[10:15:11] <Not-7290>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjaz2
[10:15:13] <Not-7290>	 [02miraheze/services] 07MirahezeSSLBot 0357c3f68 - BOT: Updating services config for wikis
[12:05:12] <Not-7290>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fja25
[12:05:14] <Not-7290>	 [02miraheze/services] 07MirahezeSSLBot 03858e913 - BOT: Updating services config for wikis
[13:42:26] <paladox>	 !log disable blogpage on amazingyoutuberswiki (temp)
[13:42:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[13:43:33] <paladox>	 !log just to note that i re enabled blogpage on amazingyoutuberswiki through MW
[13:43:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[15:28:22] <paladox>	 !log salt -E "mw.*" cmd.run "rm -rf /srv/mediawiki/w/cache/managewiki/**"
[15:28:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[15:47:02] <Not-7290>	 [02MirahezeMagic] 07The-Voidwalker opened pull request 03#80: check root title against special pages - 13https://git.io/fjaKA
[15:51:42] <Not-7290>	 [02MirahezeMagic] 07paladox reviewed pull request 03#80 commit - 13https://git.io/fja63
[15:51:55] <Zppix>	 paladox: is it possible on createwiki to blacklist subdomains for example to make requesting a subdomain like miraheze.miraheze.org impossible
[15:52:30] <Reception123>	 Zppix: I did think about that at one point, and I'm pretty sure the answer is no in the current state
[15:52:33] <Reception123>	 though I'm sure it can be done easily
[15:52:48] <Zppix>	 Reception123: i ask cause i just denied a request with that subdomain
[15:52:49] <Not-7290>	 [02MirahezeMagic] 07The-Voidwalker synchronize pull request 03#80: check root title against special pages - 13https://git.io/fjaKA
[15:53:14] <Reception123>	 yeah I assume you can easily do it with a if (req name) = whatever, return error
[15:53:14] <Not-7290>	 [02MirahezeMagic] 07paladox closed pull request 03#80: check root title against special pages - 13https://git.io/fjaKA
[15:53:16] <Not-7290>	 [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fja6Z
[15:53:17] <Not-7290>	 [02miraheze/MirahezeMagic] 07The-Voidwalker 0331ad7e8 - check root title against special pages (#80) * check root title against special pages Special:CentralAutoLogin/setCookies (required for login) won't work with the current system, but should when checking the root title instead * this be function
[15:53:32] <Reception123>	 Zppix: probably opening a Phab task will make John do it at some point :D
[15:53:49] <Zppix>	 Reception123: we could in theory create the wiki with the subdomain like that and just have the main page be a interwiki redirect to meta?
[15:54:03] <Not-7290>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fja6C
[15:54:04] <Not-7290>	 [02miraheze/mediawiki] 07paladox 03e5c1b8c - Update MM
[15:54:24] <Voidwalker>	 or redirect the subdomain to meta, and create an empty db to prevent wiki creation
[15:54:39] <Zppix>	 Voidwalker: that could work and be easy to do
[15:54:40] <Reception123>	 Voidwalker I almost finished typing exactly that!
[15:54:49] <Reception123>	 I got beat by a few secs :(
[15:54:59] <Reception123>	 paladox: any objections? 
[15:55:01] <Voidwalker>	 :)
[15:55:11] <JohnLewis>	 easier way to blacklist is get an ops member to do "CREATE DATABASE <fakename>"
[15:55:22] <paladox>	 I was just about to say what JohnLewis said :P
[15:55:32] <JohnLewis>	 it's essentially a reservation
[15:55:40] <Zppix>	 JohnLewis: but in this instance a redirect to be put in place would be welcomed
[15:55:47] <paladox>	 Reception123 you just do what JohnLewis just said :)
[15:55:51] <JohnLewis>	 the name remains available, doesn't take up space and shows a 404 because it doesn't exist
[15:56:00] <Reception123>	 Ok
[15:56:09] <JohnLewis>	 Zppix: can be dona via nginx as well
[15:56:09] <Zppix>	 I think a 301 should be done aswell?
[15:56:20] <Zppix>	 (Its 301 right?
[15:56:28] <JohnLewis>	 yeah
[15:56:29] <Voidwalker>	 I would suggest doing the same for subdomain.miraheze.org, but someone's already created a wiki there :I
[15:56:29] <Reception123>	 well we should definitely blacklist everything that already has a service
[15:56:35] <Not-7290>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fja6l
[15:56:36] <Reception123>	 aka phab.mh, matomo.mh etc.
[15:56:37] <Not-7290>	 [02miraheze/mediawiki] 07paladox 030681cfd - Update MM
[15:56:49] <Reception123>	 who approved that request?
[15:57:03] <Zppix>	 Reception123: no one approved that request i declined it?
[15:57:25] <paladox>	 he's talking about the "subdomain" wiki :P
[15:57:44] <Zppix>	 ?
[15:58:11] <Reception123>	 Zppix: Void pointed out that someone has a wiki called subdomain.miraheze.org
[15:58:31] <Voidwalker>	 https://meta.miraheze.org/wiki/Special:RequestWikiQueue/6952
[15:58:31] <ZppixBot>	 [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org
[15:59:02] <Zppix>	 Looks like pioneer did
[16:00:25] <Zppix>	 Perhaps we should ask them what alt subdomain they would like instead (if the wiki has content) if it has no content i can talk to them and ask what subdomain they want and ill just create that for them without going through request process again
[16:07:38] <Zppix>	 Reception123: am i allowed to add an addition proposal to revocation by inactivity?
[16:07:55] <Reception123>	 Zppix: of course
[16:08:02] <Reception123>	 anyone can add whatever proposals they like 
[16:08:14] <Reception123>	 "As always, please feel free to add proposals if you disagree with all the current ones. Reception123 (talk) (C) 05:11, 17 June 2019 (UTC)" :P
[16:08:23] <Zppix>	 Reception123: i wasnt sure of how rfc worked on MH i know thats how they work on wikimedia
[16:09:21] <Reception123>	 Zppix: as for the wiki, it has been inactive since 17 Jan so DP will be in effect soon anyway
[16:09:27] <Reception123>	 after that we will "blacklist" the domain
[16:11:00] <Hispano76>	 Hello!
[16:11:18] <Reception123>	 hi Hispano76 
[16:14:46] <Zppix>	 Reception123: i added a proposal
[16:15:03] <Reception123>	 ok
[16:24:15] <JohnLewis>	 Zppix: and opposed :P
[16:30:05] <Not-7290>	 [02MirahezeMagic] 07The-Voidwalker opened pull request 03#81: fix checking root pages - 13https://git.io/fjaiJ
[16:33:05] <Voidwalker>	 there, that's my fix paladox :)
[16:52:16] <Not-7290>	 [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjai2
[16:52:18] <Not-7290>	 [02miraheze/MirahezeMagic] 07The-Voidwalker 038495579 - fix checking root pages (#81) getRootTitle doesn't work in the Special namespace, so, just hard code it in
[16:52:19] <Not-7290>	 [02MirahezeMagic] 07paladox closed pull request 03#81: fix checking root pages - 13https://git.io/fjaiJ
[17:21:41] <paladox>	 JohnLewis: can you deploy ^^ please?
[17:21:45] <paladox>	 Or Reception123 
[17:31:32] <Not-7290>	 [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fjaPG
[17:31:34] <Not-7290>	 [02miraheze/MirahezeMagic] 07translatewiki 03892dd84 - Localisation updates from https://translatewiki.net.
[17:31:35] <Not-7290>	 [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/fjaPZ
[17:31:37] <Not-7290>	 [02miraheze/CreateWiki] 07translatewiki 035d59735 - Localisation updates from https://translatewiki.net.
[17:31:38] <Not-7290>	 [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjaPn
[17:31:40] <Not-7290>	 [02miraheze/ManageWiki] 07translatewiki 03aca30cc - Localisation updates from https://translatewiki.net.
[17:51:39] <Reception123>	 paladox: ok
[18:01:35] <Not-7290>	 [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_32 [+0/-0/±2] 13https://git.io/fjaPh
[18:01:36] <Not-7290>	 [02miraheze/mediawiki] 07Reception123 030af4dc4 - Update MirahezeMagic
[18:04:58] <Not-7290>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fjaXv
[18:04:59] <Not-7290>	 [02miraheze/mediawiki] 07paladox 03bd75cb1 - Fix MW
[18:15:12] <Not-7290>	 [02MirahezeMagic] 07The-Voidwalker opened pull request 03#82: title -> rootTitle - 13https://git.io/fjaXG
[18:15:44] <Voidwalker>	 :I
[18:19:25] <icinga-miraheze>	 PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 1070
[18:22:08] <Not-7290>	 [02MirahezeMagic] 07paladox closed pull request 03#82: title -> rootTitle - 13https://git.io/fjaXG
[18:22:10] <Not-7290>	 [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjaXB
[18:22:12] <Not-7290>	 [02miraheze/MirahezeMagic] 07The-Voidwalker 0388cb482 - title -> rootTitle (#82)
[18:22:59] <Not-7290>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fjaXR
[18:23:01] <Not-7290>	 [02miraheze/mediawiki] 07paladox 0364bd69a - Update MM
[20:33:33] <Not-7290>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjaDy
[20:33:35] <Not-7290>	 [02miraheze/mediawiki] 07paladox 03d6a4154 - Update MM
[22:15:50] <Not-7290>	 [02miraheze/MirahezeMagic] 07JohnFLewis pushed 031 commit to 03master [+1/-0/±2] 13https://git.io/fjaSc
[22:15:51] <Not-7290>	 [02miraheze/MirahezeMagic] 07JohnFLewis 033be1616 - push MirahezeSurvey code
[22:26:59] <Not-7290>	 [02miraheze/MirahezeMagic] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjaSE
[22:27:00] <Not-7290>	 [02miraheze/MirahezeMagic] 07JohnFLewis 035763fd2 - language fixes
[22:27:22] <Not-7290>	 [02miraheze/mediawiki] 07JohnFLewis pushed 032 commits to 03REL1_32 [+0/-0/±6] 13https://git.io/fjaSu
[22:27:23] <Not-7290>	 [02miraheze/mediawiki] 07JohnFLewis 03c8d456a - update MM
[22:27:25] <Not-7290>	 [02miraheze/mediawiki] 07JohnFLewis 0370ab594 - Merge branch 'REL1_32' of www.github.com:miraheze/mediawiki into REL1_32
[22:43:58] <icinga-miraheze>	 PROBLEM - db4 Disk Space on db4 is WARNING: DISK WARNING - free space: / 22849 MB (6% inode=96%);
[22:44:08] <JohnLewis>	 !log removed binary logs on db4
[22:44:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[23:19:25] <icinga-miraheze>	 RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs