[00:10:09] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjx6m
[00:10:11] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot 03a8a81a4 - BOT: Updating services config for wikis
[00:39:49] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 6.83, 6.38, 5.29
[00:41:50] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 3.66, 5.43, 5.08
[01:20:24] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.34, 6.96, 5.92
[01:22:20] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.91, 6.36, 5.83
[01:28:05] <Examknow>	 Voidwalker:You on?
[01:28:52] <Voidwalker>	 sorta, but not for long
[04:35:07] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxPe
[04:35:09] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot 039ac3ede - BOT: Updating services config for wikis
[04:40:09] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxPT
[04:40:10] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot 03fe5814e - BOT: Updating services config for wikis
[04:57:49] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.56, 7.23, 5.63
[04:59:49] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.31, 6.24, 5.46
[06:26:43] <icinga-miraheze>	 RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 2954 MB (12% inode=94%);
[06:46:16] <Reception123>	 RhinosF1: Edit conflict: User talk:RhinosF1
[06:46:19] <Reception123>	 :P too quick for me
[06:46:36] <RhinosF1>	 Reception123: :)
[06:47:29] <RhinosF1>	 Remember all meta edits ping me
[06:55:02] <RhinosF1>	 Reception123: see their reply - might be easier if another person clarifies
[07:12:41] <RhinosF1>	 Reception123: can I get an import on to publictestwiki
[07:13:54] <RhinosF1>	 Reception123: scrap that looks like it just needed purging and was in the last import :)
[07:15:51] <Reception123>	 Ok :d
[07:16:39] <RhinosF1>	 Reception123: why do enwiki make templates stupidly complex for no reason
[07:33:29] <Reception123>	 hmm no idea
[07:33:51] <RhinosF1>	 honestly, you can half most of their templates
[11:05:50] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.52, 7.46, 5.76
[11:07:50] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.15, 7.23, 5.87
[11:09:49] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 5.31, 6.44, 5.74
[11:59:30] <Not-f817>	 [02ManageWiki] 07OwenFung87 commented on pull request 03#116:  make sidebar for all users opt-in - 13https://git.io/fjxyr
[12:10:10] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxyS
[12:10:11] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot 03d5aa9de - BOT: Updating services config for wikis
[12:59:03] <Not-f817>	 [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjxS9
[12:59:05] <Not-f817>	 [02miraheze/mediawiki] 07JohnFLewis 03147a2bf - SP
[13:27:27] <Not-f817>	 [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjx9g
[13:27:29] <Not-f817>	 [02miraheze/puppet] 07JohnFLewis 038382b72 - update comment
[13:27:30] <JohnLewis>	 Reception123: ^
[13:30:31] <Reception123>	 :)
[13:30:42] <Reception123>	 I actually just remembered something 
[13:30:44] <JohnLewis>	 no :) it's a :'(
[13:30:52] <Reception123>	 paladox: I can change the HDD space to 17GB for lizardfs right?
[13:31:10] <Reception123>	 JohnLewis: oh, it's a bad thing then?
[13:31:38] <JohnLewis>	 yes, we're using 1072 of a possible 491 xD
[13:32:24] <Reception123>	 oh, I thought it was normal since it was above before anyway
[13:32:42] <JohnLewis>	 nope
[13:36:26] <paladox>	 Reception123: Yes
[13:36:44] <paladox>	 You have to restart the chunkservers for it to take affect :)
[13:41:48] <JohnLewis>	 17 would no longer be appropriate
[13:41:55] <Reception123>	 JohnLewis: how much then?
[13:41:56] <JohnLewis>	 since disk size has changed
[13:42:01] <Reception123>	 paladox: on all servers, I know that now XD
[13:42:12] <JohnLewis>	 it should be just above warning level ideally
[13:42:18] * RhinosF1 just saw his exam timetable for next year
[13:42:52] <JohnLewis>	 if that works out ot be 17 somehow then ignore me :P
[13:43:11] <Reception123>	 JohnLewis: warning level meaning icinga warning level?
[13:43:34] <JohnLewis>	 Reception123: yes
[13:45:35] <paladox>	 JohnLewis: As your good at maths, what would you say the value is?
[13:46:01] <JohnLewis>	 I don't know the original value
[13:46:18] <JohnLewis>	 from 100 to 10 is dividing by 10
[13:46:23] <JohnLewis>	 so take the 0 at the end off :)
[13:48:05] <paladox>	 JohnLewis: 10?
[13:48:31] <JohnLewis>	 yes?
[13:49:01] <paladox>	 That’s me answering it ;)
[13:49:10] <paladox>	 Reception123: I think the value should be 10 per ^
[13:49:16] <JohnLewis>	 huh?
[13:49:28] <JohnLewis>	 we only have 100GB of total space?
[13:49:45] <paladox>	 Ohh
[13:49:49] <paladox>	 335g
[13:50:01] <JohnLewis>	 34 then
[13:50:04] <paladox>	 *320g
[13:50:14] <JohnLewis>	 33 then
[13:50:27] <paladox>	 320 divided by 33?
[13:50:43] <icinga-miraheze>	 PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2648 MB (10% inode=94%);
[13:50:45] <paladox>	 9.6969696969697
[13:50:58] <JohnLewis>	 ...
[13:51:07] <JohnLewis>	 I quite clearly said 10%
[13:51:18] <JohnLewis>	 for which 100% to 10% is dividing by 10
[13:51:45] <paladox>	 Hmm
[13:52:21] <paladox>	 32
[13:52:29] <paladox>	 I’m likley wrong with that
[13:52:47] <JohnLewis>	 and then I said just above 10%
[13:53:02] <paladox>	 Yeh, but that bit I doint understand
[13:53:39] <JohnLewis>	 get 10%, make it a bit more than that
[13:53:41] <Reception123>	 If we had 100GB it would be 11 right?
[13:53:47] <JohnLewis>	 yes
[13:53:54] <Reception123>	 Ok pretty straightforward 
[13:54:30] <paladox>	 JohnLewis: so 320 x 10 = 32
[13:54:57] <JohnLewis>	 yes
[13:55:14] <Reception123>	 paladox: don't tell me it's still transferring 
[13:55:24] <Reception123>	 paladox: and 32+1 (a bit more)=33 ;)
[13:57:09] <paladox>	 Err I mean divided by
[13:57:10] <paladox>	 Sorry
[13:57:11] <paladox>	 It is
[13:57:11] <paladox>	 JohnLewis: so then the number is 32, right? :)
[13:57:12] <paladox>	 Value should be that
[13:59:59] <Reception123>	 33....
[14:00:58] <JohnLewis>	 33
[14:01:06] <JohnLewis>	 as Reception123 said and as I said ages ago :P
[14:01:56] * paladox facepalms
[14:02:08] <Reception123>	 I'll change it
[14:02:31] <Reception123>	 paladox: so now I have to restart the service on all 5 servers then? Or only 4 and 5?
[14:02:53] <Reception123>	 And I think you missed my question of whether it's still transferring 
[14:03:55] <paladox>	 Good question, do it on all for now
[14:03:58] <paladox>	 Reception123: I answered it :)
[14:04:18] <RhinosF1>	 14:57:11 <+paladox> It is
[14:04:24] <paladox>	 ^
[14:04:40] <Reception123>	 whoops I'm the one who missed it then
[14:04:46] <Reception123>	 paladox: how long can it take it's been like a week almost
[14:06:17] <Not-f817>	 [02puppet] 07Reception123 commented on pull request 03#1069: [DO NOT MERGE] return HDD_LEAVE_SPACE_DEFAULT to 17gb - 13https://git.io/fjxH4
[14:06:18] <Not-f817>	 [02puppet] 07Reception123 closed pull request 03#1069: [DO NOT MERGE] return HDD_LEAVE_SPACE_DEFAULT to 17gb - 13https://git.io/fjFnh
[14:07:00] <Not-f817>	 [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxHR
[14:07:02] <Not-f817>	 [02miraheze/puppet] 07Reception123 03fc9c324 - HDD_LEAVE_SPACE_DEFAULT to 33 GB (10%)
[14:08:00] <RhinosF1>	 stupid printer
[14:08:50] <paladox>	 Reception123: only reboot it on 4 and 5
[14:08:51] <paladox>	 Not 1-3
[14:08:52] <paladox>	 Secondly that means we have less space for 4-5
[14:11:33] <Reception123>	 paladox: oh thanks for telling me I almost clicked enter on 1 :P
[14:11:49] <Reception123>	 RhinosF1: printer? don't think Miraheze has any printers yet xD
[14:12:09] <paladox>	 I thought we did?
[14:12:11] <RhinosF1>	 Reception123: no, mine won't be in use soon though. keeps breaking down
[14:12:18] <paladox>	 JohnLewis: got one :P
[14:12:25] <Reception123>	 JohnLewis: but the question is why do we need to sacrifice 33GB space? what's the need? (just curious)
[14:12:40] <Reception123>	 paladox: John may be the co-founder but John =! Miraheze :D
[14:13:00] <paladox>	 Heh
[14:13:06] <Reception123>	 !log sudo service lizardfs-chunckserver restart on lizardfs[45]
[14:13:11] <paladox>	 Lol
[14:13:27] * RhinosF1 's printer is technically open to anyone to use via hpeprint but good luck hoping it works
[14:13:35] <JohnLewis>	 Reception123: OOS is more dangerous on a hard fail than a safe fail
[14:13:49] <paladox>	 Heh
[14:13:54] <paladox>	 My printer has a email
[14:13:57] <paladox>	 :P
[14:14:12] <Reception123>	 JohnLewis: oh
[14:14:26] <RhinosF1>	 paladox: same
[14:14:27] <Reception123>	 paladox: everyone spam paladox-printer@miraheze.org! 
[14:14:35] <Reception123>	 then it'll print out thousands of pages
[14:14:38] <paladox>	 If only it was that
[14:14:57] <RhinosF1>	 attempt 3 of printing
[14:15:00] <JohnLewis>	 and pls don't you'll spam SMTP and mail failure emails
[14:15:34] <RhinosF1>	 email - broke, airprint - too big, smart - we'll see
[14:15:48] <RhinosF1>	 and that's all because it refuses to print from my mac
[14:18:50] <Reception123>	 JohnLewis: haha I already get so much spam email about that I definitely wouldn't even think about it
[14:19:09] * RhinosF1 finallly got his printer to print
[14:20:05] <Reception123>	 JohnLewis: also I know Varnish isn't your thing but any ideas how https://github.com/miraheze/puppet/pull/1074 ? 
[14:20:06] <ZppixBot>	 [ temp fix electronpdfservice from displaying CookieWarning by Reception123 · Pull Request #1074 · miraheze/puppet · GitHub ] - github.com
[14:20:08] <Reception123>	 doesn't work
[14:20:28] <Reception123>	 SPF suggested it and in theory it makes sense right if we block it from going through Varnish what else could possibly make that cookie warning appear 
[14:22:14] <RhinosF1>	 Reception123: it doesn't even go away now, comes back on refresh
[14:22:20] <RhinosF1>	 SPF|Cloud: ^
[14:22:21] <JohnLewis>	 Reception123: misc3 has an IPv6 interface as well I believe
[14:22:36] <JohnLewis>	 which means some requests can be via v4 or v6
[14:22:47] <Reception123>	 JohnLewis: ohh, so I should also add that to the rule then
[14:23:21] <JohnLewis>	 yeah
[15:03:11] <Reception123>	  22:05 	Category:Articles by user RhinosF1‎ diffhist  +173‎  Automatic category creator talk contribs Created automatically by the AutoCreateCategoryPages extension.
[15:03:17] <Reception123>	 RhinosF1: ^ you're famous on test1 it seems
[15:08:48] <RhinosF1>	 Reception123: ah from my blog test
[15:13:30] <Reception123>	 RhinosF1: still testing good old cookiewarning
[15:13:35] <Reception123>	 trying John's diea
[15:13:36] <Reception123>	 *idea
[15:13:53] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 12.51, 8.03, 5.58
[15:15:49] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.77, 7.03, 5.50
[15:17:50] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.31, 6.04, 5.32
[15:33:41] <Not-f817>	 [02mw-config] 07Reception123 created branch 03Reception123-patch-2 - 13https://git.io/vbvb3
[15:33:42] <Not-f817>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://git.io/fjx7e
[15:33:44] <Not-f817>	 [02miraheze/mw-config] 07Reception123 032f4fd82 - add ipv6 address for cookiewarn exemption
[15:33:47] <Not-f817>	 [02mw-config] 07Reception123 opened pull request 03#2748: add ipv6 address for cookiewarn exemption - 13https://git.io/fjx7v
[15:34:29] <Reception123>	 ^ paladox this ok? :)
[15:38:36] <Reception123>	 JohnLewis: ^ 
[15:40:13] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjx7k
[15:40:14] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot 032e93930 - BOT: Updating services config for wikis
[15:41:02] <JohnLewis>	 Reception123: not in any way :D
[15:41:25] <Reception123>	 JohnLewis: haha why's that? :P
[15:41:53] <Reception123>	 should it be a &&? I thought about that but doesn't that go false if the first one is false?
[15:42:53] <JohnLewis>	 > $string = '1.1.1.1';
[15:42:53] <JohnLewis>	 > var_dump( ( $sting === '1.1.1.1' || '1.4.4.4' ) );
[15:42:53] <JohnLewis>	 Notice: Undefined variable: sting in /srv/mediawiki/w/maintenance/eval.php(78) : eval()'d code on line 1
[15:42:54] <JohnLewis>	 bool(true)
[15:43:09] <JohnLewis>	 massive typo but point proven :P
[15:44:34] <paladox>	 Lol
[15:45:13] <Reception123>	 I didn't know singers had anything to do with IPs, looks like they do :D
[15:46:19] <Reception123>	 Notice: Undefined index: REMOTE_ADDR in /srv/mediawiki/config/LocalWiki.php on line 76
[15:46:31] <Reception123>	 and JohnLewis ^ of course we're still stuck at this but I don't get how to fix it + why it works on test1 if there's this error
[15:47:08] <JohnLewis>	 because not all requests have it
[15:47:50] <Reception123>	 hmm, so can that be fixed in any way? and what am I supposed to do about the undefined thing?
[15:47:59] <JohnLewis>	 isset check :P
[15:48:14] <paladox>	 Ohhh JohnLewis just went down the street and there’s almost a fight :P
[15:48:15] <paladox>	 In Northampton town center 
[15:48:18] <Reception123>	 oh already going too much into the dev world for me
[15:48:41] <RhinosF1>	 paladox: people
[15:48:54] <Reception123>	 paladox: ^ would you have access soon for that? if I do it we'll be here doing trial and error for hours
[15:50:37] <paladox>	 Uh
[15:50:38] <paladox>	 Wrong channe
[15:50:39] <paladox>	 Channel
[15:50:40] <paladox>	 Reception123: I’m in the middle of the town center :P
[15:50:41] <paladox>	 Going into home bargains
[15:50:44] <paladox>	 Because who dosen’t want a good bargain? ::P
[15:51:05] <JohnLewis>	 #outing
[15:51:26] <Reception123>	 paladox: will you be back soon though?
[15:51:31] <Reception123>	 if not let the trial and error being :D
[15:52:24] <RhinosF1>	 S/being/begin
[15:52:36] <RhinosF1>	 ZppixBot:
[15:52:58] <paladox>	 Not sure though :P
[15:52:59] <paladox>	 When ever the fam decide
[15:53:00] <paladox>	 JohnLewis: outing?
[15:55:35] <paladox>	 JohnLewis: what do you mean outing?
[15:57:55] <JohnLewis>	 nvm :P
[16:00:42] <paladox>	 JohnLewis: why? :P
[16:02:21] <JohnLewis>	 causr
[16:04:12] <paladox>	 Cause?
[16:04:13] <paladox>	 :P
[16:20:10] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjx7Q
[16:20:11] <Not-f817>	 [02miraheze/services] 07MirahezeSSLBot 03d6e590e - BOT: Updating services config for wikis
[18:04:41] <Not-f817>	 [02mw-config] 07paladox created branch 03paladox-patch-4 - 13https://git.io/vbvb3
[18:04:43] <Not-f817>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://git.io/fjxdt
[18:04:44] <Not-f817>	 [02miraheze/mw-config] 07paladox 036318137 - Set wmgUseMobileFrontend to false MangeWiki should set it by default for new wikis and existing wikis will have it set to allow them to disable it if they want.
[18:04:46] <Not-f817>	 [02mw-config] 07paladox opened pull request 03#2749: Set wmgUseMobileFrontend to false - 13https://git.io/fjxdq
[18:08:15] <Reception123>	 paladox: ^ so if a new wiki is created they'll have MF as true right?
[18:08:32] <paladox>	 yeh
[18:28:23] <RhinosF1>	 paladox: [5194592a30340c715f4a0458] 2019-08-30 18:27:01: Fatal exception of type "MWException" - can u look pls/
[18:28:29] <RhinosF1>	 S///?
[18:28:33] <paladox>	 yeh
[18:29:45] <JohnLewis>	 RhinosF1: from doing what?
[18:30:28] <RhinosF1>	 JohnLewis: https://phabricator.miraheze.org/T4682
[18:30:29] <ZppixBot>	 [ ⚓ T4682 When viewing recreated Cargo table, an MWException is thrown. ] - phabricator.miraheze.org
[18:31:33] * RhinosF1 might vote on EK's WC application tonight
[18:31:39] <paladox>	  /wiki/Special:CargoTables/Trainers   MWException from line 238 of /srv/mediawiki/w/extensions/Cargo/includes/CargoUtils.php: Error: Table Trainers not found.
[18:32:49] <RhinosF1>	 paladox: hmm, me wonders what they mean by 'recreate the table'
[18:33:46] <paladox>	 https://github.com/wikimedia/mediawiki-extensions-Cargo/blob/master/maintenance/cargoRecreateData.php
[18:33:46] <ZppixBot>	 [ mediawiki-extensions-Cargo/cargoRecreateData.php at master · wikimedia/mediawiki-extensions-Cargo · GitHub ] - github.com
[18:34:53] <RhinosF1>	 paladox: can you try it pls?
[18:36:50] <paladox>	 "Table "Trainers" is not declared in any template."
[18:38:12] <RhinosF1>	 paladox: read it
[18:38:39] <RhinosF1>	 {{#cargo_declare:_table=TrainersInfo
[18:39:47] <paladox>	 RhinosF1 read wht?
[18:41:09] <RhinosF1>	 paladox: the actual template declaring it (linked from phab) and phab
[18:41:15] <paladox>	 ok
[18:42:17] <paladox>	 i see cargo__TrainersInfo
[18:42:28] <paladox>	 but i doin't see the Trainers table in cargo_table
[18:42:46] <RhinosF1>	 paladox: we know the table isn't forming right
[18:44:14] <paladox>	 yeh
[18:44:29] <RhinosF1>	 paladox: This template defines the table "TrainersInfo". View table. A replacement table has been generated for this table; View replacement table. is at the bottom of the page so it don't make sense
[18:49:17] <paladox>	 hmm
[18:54:28] <paladox>	 i'm gonna delete the tables for them to recreate it
[18:54:35] <paladox>	 there's no data loss as the tables look empty
[18:54:53] <paladox>	 it's so that the table can be created in cargo_tables
[18:54:58] <RhinosF1>	 paladox: k, do you want me to blank those templates first so it fully resets?
[18:55:07] <paladox>	 nah, it's fine
[18:55:12] <RhinosF1>	 paladox: ok
[18:59:16] <paladox>	 !log dropping cargo__Train* from pokemonmasterswiki
[18:59:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[19:05:51] <Examknow>	 RhinosF1: hey
[19:06:40] <RhinosF1>	 Examknow: hiya
[19:12:04] <RhinosF1>	 Where should echo-category-title-request-declined's i18n come from?
[19:12:14] <RhinosF1>	 paladox, JohnLewis: ^
[19:12:20] <paladox>	 echo?
[19:12:26] <Examknow>	 RhinosF1: You really think I am hat collecting by asking for wikicreator?
[19:12:43] <RhinosF1>	 paladox: should it be echo's files
[19:12:53] <paladox>	 yeh, echo i18n files
[19:13:22] <RhinosF1>	 Examknow: you're too soon and you're approach in the SN request was asking for rights if I'm honest not helping them in the end
[19:13:51] <RhinosF1>	 paladox: it's not there properly so if no one beats me I'll add it later (see notification settings)
[19:14:06] <paladox>	 ok, you'll have to do that upstream
[19:14:18] <Examknow>	 RhinosF1: Been working on my Exambot
[19:14:35] <Examknow>	 trying to add a few more features before making it avalible
[19:15:04] <JohnLewis>	 RhinosF1: CreateWiki
[19:15:28] <paladox>	 ohh
[19:18:07] <RhinosF1>	 JohnLewis: thx
[19:18:49] <Not-f817>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjxF4
[19:18:50] <Not-f817>	 [02miraheze/mediawiki] 07paladox 0339c1fed - Update Cargo
[19:19:15] <RhinosF1>	 Examknow: ok
[19:28:35] <icinga-miraheze>	 PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.90, 7.28, 5.07
[19:30:34] <icinga-miraheze>	 PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.18, 7.33, 5.37
[19:33:16] <icinga-miraheze>	 PROBLEM - mw2 Puppet on mw2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[19:34:34] <icinga-miraheze>	 RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.69, 6.44, 5.45
[19:35:17] <icinga-miraheze>	 RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[20:43:49] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 12.81, 8.69, 5.64
[20:45:49] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 5.82, 7.77, 5.70
[20:47:49] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.00, 6.37, 5.43
[20:56:28] <icinga-miraheze>	 PROBLEM - cp2 Varnish Backends on cp2 is CRITICAL: 1 backends are down. mw3
[20:57:29] <icinga-miraheze>	 PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 1 backends are down. mw2
[20:57:41] <RhinosF1>	 Someone look pls?
[20:58:28] <icinga-miraheze>	 RECOVERY - cp2 Varnish Backends on cp2 is OK: All 5 backends are healthy
[20:59:29] <icinga-miraheze>	 RECOVERY - cp4 Varnish Backends on cp4 is OK: All 5 backends are healthy
[21:03:56] <RhinosF1>	 Examknow: check wikimedia phab (the GCU task)
[21:05:30] <Examknow>	 could you send me a link?
[21:06:23] <Not-f817>	 [02CreateWiki] 07RhinosF1 opened pull request 03#121: fix - 13https://git.io/fjxbA
[21:07:34] <RhinosF1>	 Examknow: https://phabricator.wikimedia.org/T212779
[21:07:35] <ZppixBot>	 [ ⚓ T212779 Implement Global CheckUser ] - phabricator.wikimedia.org
[21:07:44] <RhinosF1>	 JohnLewis: ^ can u merge
[21:07:45] <paladox>	 JohnLewis: ^
[21:07:58] <RhinosF1>	 paladox: per up above
[21:48:21] <Examknow>	 are there any rules about who can join projects on phab?
[21:50:34] <JohnLewis>	 no
[21:50:53] <Examknow>	 ok thanks I was thinking about helping in those
[21:56:58] <Examknow>	 JohnLewis: Who is in charge of the security review?
[21:57:37] <JohnLewis>	 whoever does it from ops/delegated
[21:58:05] <Examknow>	 ok
[21:58:15] <JohnLewis>	 ops or https://phabricator.miraheze.org/badges/recipients/14/
[21:58:15] <ZppixBot>	 [ Security Reviewer ] - phabricator.miraheze.org
[22:00:27] <Examknow>	 so is security reviewer given by a sysadmin?
[22:11:37] <JohnLewis>	 it's given based on trust and established history of reviewing extensions satisfactorily 
[22:12:39] <Examknow>	 cool
[22:13:02] <Not-f817>	 [02CreateWiki] 07JohnFLewis closed pull request 03#121: fix - 13https://git.io/fjxbA
[22:13:03] <Not-f817>	 [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxNQ
[22:13:05] <Not-f817>	 [02miraheze/CreateWiki] 07RhinosF1 032c0d57e - fix (#121)
[22:17:13] <Examknow>	 JohnLewis: do you need somebody to work on this? https://phabricator.miraheze.org/T4394
[22:17:14] <ZppixBot>	 [ ⚓ T4394 Convert CreateWiki to use MediaWiki Config over globals ] - phabricator.miraheze.org
[22:19:55] <JohnLewis>	 Yeah anyone can’t 
[22:19:59] <JohnLewis>	 *can
[22:20:10] <Examknow>	 ok I might work on that
[22:20:24] <JohnLewis>	 It’s so low on my radar it’s like mid 2020
[22:21:10] <Examknow>	 it does not seem like to hard of a fix
[22:21:21] <Examknow>	 I will fork it and see what I can do
[22:38:18] <icinga-miraheze>	 PROBLEM - wiki.articmetrosystem.tk - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[22:38:29] <Not-f817>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjxAU
[22:38:30] <Not-f817>	 [02miraheze/mediawiki] 07paladox 03ef010aa - Update SP
[22:38:58] <Not-f817>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjxAT
[22:38:59] <Not-f817>	 [02miraheze/mediawiki] 07paladox 035656c13 - Update CW
[22:39:30] <Not-f817>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjxAk
[22:39:32] <Not-f817>	 [02miraheze/mediawiki] 07paladox 0390c6398 - Update MW
[22:40:11] <Not-f817>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjxAI
[22:40:13] <Not-f817>	 [02miraheze/mediawiki] 07paladox 03f25279b - Update MM
[22:40:40] <Not-f817>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjxAL
[22:40:42] <Not-f817>	 [02miraheze/mediawiki] 07paladox 033f3b017 - Update RL
[22:41:38] <paladox>	 !log running lc on mw*
[22:41:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[22:46:19] <icinga-miraheze>	 RECOVERY - wiki.articmetrosystem.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.articmetrosystem.tk' will expire on Wed 27 Nov 2019 04:50:12 AM GMT +0000.
[22:47:36] <icinga-miraheze>	 PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.86, 1.14, 0.56
[22:47:50] <icinga-miraheze>	 PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.07, 7.02, 5.29
[22:49:36] <icinga-miraheze>	 RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.59, 1.33, 0.69
[22:49:50] <icinga-miraheze>	 RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 6.33, 6.64, 5.36
[22:54:18] <icinga-miraheze>	 PROBLEM - wiki.articmetrosystem.tk - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[22:55:52] <JohnLewis>	 Examknow: it's not a hard fix. It's just a really time consuming onr
[22:56:18] <icinga-miraheze>	 RECOVERY - wiki.articmetrosystem.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.articmetrosystem.tk' will expire on Wed 27 Nov 2019 04:50:12 AM GMT +0000.
[23:07:11] <icinga-miraheze>	 PROBLEM - itpedia.sk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'itpedia.sk' expires in 15 day(s) (Sun 15 Sep 2019 11:04:56 PM GMT +0000).
[23:07:25] <Not-f817>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxAl
[23:07:27] <Not-f817>	 [02miraheze/ssl] 07MirahezeSSLBot 03d2f5912 - Bot: Update SSL cert for itpedia.sk
[23:08:44] <icinga-miraheze>	 PROBLEM - www.itpedia.sk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'itpedia.sk' expires in 15 day(s) (Sun 15 Sep 2019 11:04:56 PM GMT +0000).
[23:11:01] <icinga-miraheze>	 PROBLEM - wiki.scvo.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.scvo.org' expires in 15 day(s) (Sun 15 Sep 2019 11:08:47 PM GMT +0000).
[23:11:16] <Not-f817>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxAR
[23:11:17] <Not-f817>	 [02miraheze/ssl] 07MirahezeSSLBot 03edf2758 - Bot: Update SSL cert for wiki.scvo.org
[23:13:02] <icinga-miraheze>	 RECOVERY - wiki.scvo.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.scvo.org' will expire on Thu 28 Nov 2019 10:11:09 PM GMT +0000.
[23:13:11] <icinga-miraheze>	 RECOVERY - itpedia.sk - LetsEncrypt on sslhost is OK: OK - Certificate 'itpedia.sk' will expire on Thu 28 Nov 2019 10:07:19 PM GMT +0000.
[23:14:44] <icinga-miraheze>	 RECOVERY - www.itpedia.sk - LetsEncrypt on sslhost is OK: OK - Certificate 'itpedia.sk' will expire on Thu 28 Nov 2019 10:07:19 PM GMT +0000.
[23:19:35] <icinga-miraheze>	 PROBLEM - wiki.cloudytheology.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.cloudytheology.com' expires in 15 day(s) (Sun 15 Sep 2019 11:17:19 PM GMT +0000).
[23:19:47] <Not-f817>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxAa
[23:19:49] <Not-f817>	 [02miraheze/ssl] 07MirahezeSSLBot 03b71af40 - Bot: Update SSL cert for wiki.cloudytheology.com
[23:23:18] <icinga-miraheze>	 PROBLEM - wiki.xfbs.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.xfbs.net' expires in 15 day(s) (Sun 15 Sep 2019 11:20:23 PM GMT +0000).
[23:23:30] <Not-f817>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxAr
[23:23:32] <Not-f817>	 [02miraheze/ssl] 07MirahezeSSLBot 03d9d2a3d - Bot: Update SSL cert for wiki.xfbs.net
[23:23:34] <icinga-miraheze>	 RECOVERY - wiki.cloudytheology.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cloudytheology.com' will expire on Thu 28 Nov 2019 10:19:41 PM GMT +0000.
[23:30:09] <Not-f817>	 [02mw-config] 07paladox edited pull request 03#2749: Set wmgUseMobileFrontend to false - 13https://git.io/fjxdq
[23:30:13] <Not-f817>	 [02mw-config] 07paladox closed pull request 03#2749: Set wmgUseMobileFrontend to false - 13https://git.io/fjxdq
[23:30:14] <Not-f817>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxAM
[23:30:16] <Not-f817>	 [02miraheze/mw-config] 07paladox 038328af5 - Set wmgUseMobileFrontend to false (#2749) MangeWiki should set it by default for new wikis and existing wikis will have it set to allow them to disable it if they want.
[23:30:19] <Not-f817>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-4
[23:30:21] <Not-f817>	 [02mw-config] 07paladox deleted branch 03paladox-patch-4 - 13https://git.io/vbvb3
[23:33:18] <icinga-miraheze>	 RECOVERY - wiki.xfbs.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.xfbs.net' will expire on Thu 28 Nov 2019 10:23:24 PM GMT +0000.
[23:43:59] <Not-f817>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjxAb
[23:44:00] <Not-f817>	 [02miraheze/puppet] 07paladox 03787ca20 - redis: Change maxmemory_policy to allkeys-lru We would like to see if this will help with T4638.
[23:45:43] <Not-f817>	 [02miraheze/puppet] 07paladox deleted branch 03Reception123-patch-1
[23:45:44] <Not-f817>	 [02puppet] 07paladox deleted branch 03Reception123-patch-1 - 13https://git.io/vbiAS