[01:01:33] <wychmire>	 Another 503 Backend fetch failed. "Error 503 Backend fetch failed, forwarded for 173.79.232.130, 127.0.0.1 (Varnish XID 3616202) via cp8.miraheze.org at Tue, 14 Apr 2020 01:00:52 GMT."
[01:02:35] <wychmire>	 Reloaded successfully
[01:47:54] <Zppix>	 wychmire:  503's happen every now and then only if it stays like that for a long time is it really worth reporting :) also I recommend avoiding posting your ip in here as it is relayed to discord and is logged
[02:42:34] <musikanimal>	 hello! VisualEditor again has disappeared. This is the third time; removing/re-adding the extension sometimes works, it seems. But why does it keep disappearing?
[02:42:54] <musikanimal>	 this is at https://spcodex.wiki
[02:42:55] <ZppixBot>	 [ SPCodex ] - spcodex.wiki
[02:42:57] <Zppix>	 musikanimal:  whats your dbname again?
[02:43:02] <musikanimal>	 solarawiki
[02:44:32] <Zppix>	 musikanimal:  what about now?
[02:44:53] <Zppix>	 !log $cWJ = new CreateWikiJson( solarawiki ); $cWJ->resetWiki();
[02:44:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[02:46:02] <musikanimal>	 veaction=edit works, but I only see the "Edit source" tab
[02:48:20] <Zppix>	 musikanimal:  I dont understand why it does this
[02:49:17] <musikanimal>	 hmm so it got disabled in the mainspace somehow... Turned that back on, and now I very briefly see "Edit" then it quickly disappears
[02:51:14] <musikanimal>	 relatedly, some of the basic user permissions are disappearing too. I had to re-enable "editmywatchlist" and several other permissions that mysteriously got removed
[02:51:31] <Zppix>	 now that is intersting
[02:51:39] <Zppix>	 paladox:  ^
[02:54:01] <musikanimal>	 I don't know that the permissions thing is a persistent issue. It happened days ago, I think, I just didn't notice the watchlist links were missing
[02:54:54] <Zppix>	 im the only staff member that is around atm with ssh access too.. yay me :P
[02:54:55] <paladox>	 It’ll be due to the cache, try again?
[02:54:59] <paladox>	 Err
[02:55:01] <paladox>	 *?
[02:55:24] <Zppix>	 paladox:  i cleared the wiki's cache using that eval thing you told me about
[02:55:26] <musikanimal>	 permissions are okay now, I re-added them 15 mins ago or so
[02:56:09] <musikanimal>	 but the issue with VE still stands. "Edit" link appears only for a split second. But also, it seems to only happen in the mainspace (where I just re-enabled VE)
[02:56:20] <musikanimal>	 e.g. I see "Edit" at https://spcodex.wiki/wiki/SPCodex:FAQ, but not at https://spcodex.wiki/wiki/Cherub_Rock
[02:56:21] <ZppixBot>	 [ SPCodex:FAQ, - SPCodex ] - spcodex.wiki
[02:56:21] <ZppixBot>	 [ Cherub Rock - SPCodex ] - spcodex.wiki
[02:56:44] <Zppix>	 i wonder if thats varnish cache then paladox
[02:57:14] <paladox>	 Nope
[02:57:22] <Zppix>	 no its local cache
[02:57:27] <Zppix>	 musikanimal:  clear your browser cache
[02:58:06] <musikanimal>	 hmm okay, I must have done that 10 times. Now it worked!
[02:58:31] <Zppix>	 idk musikanimal these yesterday and today are weird
[03:30:51] <Not-1447>	 [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jfeno
[03:30:53] <Not-1447>	 [02miraheze/CreateWiki] 07translatewiki 033049cdc - Localisation updates from https://translatewiki.net.
[03:30:53] <ZppixBot>	 [ Main page - translatewiki.net ] - translatewiki.net.
[03:30:54] <Not-1447>	 [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+1/-0/±2] 13https://git.io/JfenK
[03:30:56] <Not-1447>	 [02miraheze/DataDump] 07translatewiki 03e90bbe5 - Localisation updates from https://translatewiki.net.
[03:30:57] <ZppixBot>	 [ Main page - translatewiki.net ] - translatewiki.net.
[03:30:57] <Not-1447>	 [02miraheze/MatomoAnalytics] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/Jfen6
[03:30:59] <Not-1447>	 [02miraheze/MatomoAnalytics] 07translatewiki 034f9981e - Localisation updates from https://translatewiki.net.
[03:31:00] <ZppixBot>	 [ Main page - translatewiki.net ] - translatewiki.net.
[03:31:00] <Not-1447>	 [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±9] 13https://git.io/Jfeni
[03:31:02] <Not-1447>	 [02miraheze/ManageWiki] 07translatewiki 0346edd71 - Localisation updates from https://translatewiki.net.
[03:31:03] <ZppixBot>	 [ Main page - translatewiki.net ] - translatewiki.net.
[04:35:29] <ZppixBot>	 Hello c0! If you have any questions, feel free to ask and someone should answer soon.
[04:45:49] <icinga-miraheze>	 PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[nagios-plugins]
[04:51:12] <icinga-miraheze>	 RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures
[06:26:41] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[06:27:10] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[06:33:46] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:35:56] <icinga-miraheze>	 PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 13.40, 7.86, 4.47
[06:37:49] <icinga-miraheze>	 PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[06:37:53] <icinga-miraheze>	 PROBLEM - mail1 Puppet on mail1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[06:40:51] <icinga-miraheze>	 PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 7.74, 21.10, 23.39
[06:43:11] <icinga-miraheze>	 RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[06:43:20] <icinga-miraheze>	 RECOVERY - mail1 Puppet on mail1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[06:44:28] <icinga-miraheze>	 PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 0.76, 2.59, 3.47
[06:46:19] <icinga-miraheze>	 RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 4.38, 10.30, 17.95
[06:47:13] <icinga-miraheze>	 RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 0.55, 1.73, 2.99
[06:52:16] <ZppixBot>	 RhinosF1: upstream IR dodgy text size to chrome
[06:52:39] <RhinosF1>	 No cause I found in safari
[08:40:47] <RhinosF1>	 Oh :(
[08:52:06] <ZppixBot>	 Hi! Just contacting you to tell that here are no high priority open tasks. Nice job!
[08:57:57] <RhinosF1>	 We must be doing good
[10:05:25] <ZppixBot>	 Hello Niki_! If you have any questions, feel free to ask and someone should answer soon.
[10:06:36] <Niki_>	 Hi! Is it possible to get back a wiki which I have neglected due to lack of time recently? I would like to continue developing it, but unfortunately it looks like it's too late :/
[10:06:54] <Niki_>	 It's not deleted yet, but closed
[10:09:03] <Niki_>	 Is this "If you are a bureaucrat on this wiki you can go to Special:ManageWiki and uncheck the "closed" box to reopen it." correct way to do that? 
[10:29:40] <Not-1447>	 [02miraheze/mw-config] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfegw
[10:29:41] <Not-1447>	 [02miraheze/mw-config] 07JohnFLewis 037205f35 - Migrate licensing to WI
[10:56:04] <RhinosF1>	 Niki_: it is
[12:26:20] <Niki_>	 Well, I did it, but that notice "This wiki has been closed because there have been no edits or logs made within the last 60 days. This wiki is now eligible for being adopted. " is still visible
[12:27:44] <Niki_>	 I can edit wiki normally, but I'm worried I could lose it or something like that
[12:47:18] <RhinosF1>	 hi JohnLewis 
[12:47:30] <JohnLewis>	 Hi
[12:47:38] <RhinosF1>	 Niki_: it should disappear shortly
[12:48:07] <RhinosF1>	 JohnLewis: blueoath.miraheze.org are saying changes (extensions,logo,favicon) don't apply.
[12:48:26] * RhinosF1 noticed there were 2 log entries for some of the changes
[12:50:11] <JohnLewis>	 Looking
[12:53:37] <JohnLewis>	 RhinosF1: it was one of the wiki which was created during the period where CW failed
[12:53:58] <RhinosF1>	 JohnLewis: it was yep
[12:59:02] <JohnLewis>	 !log insert default mw_settings values for blueoathwiki
[12:59:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[12:59:06] <JohnLewis>	 RhinosF1: fixed
[13:01:29] <RhinosF1>	 JohnLewis: does that need doing for the other wiki
[13:03:48] <JohnLewis>	 Did it for that one as well
[13:03:54] <RhinosF1>	 ty
[13:39:21] <RhinosF1>	 JohnLewis: does 'Kathying' have a rename request outstanding?
[13:41:25] <JohnLewis>	 RhinosF1: Yes
[13:44:21] <RhinosF1>	 JohnLewis: they were asking how long it might take? Thought I'd make sure everything was waiting
[13:44:37] <JohnLewis>	 Can do it now
[13:45:26] <RhinosF1>	 JohnLewis: let them know, go ahead
[14:18:50] <Not-1447>	 [02DataDump] 07rail01 commented on pull request 03#5: Polish i18n - 13https://git.io/Jfeix
[14:18:51] <Not-1447>	 [02DataDump] 07rail01 closed pull request 03#5: Polish i18n - 13https://git.io/JvgrN
[15:08:18] <Zppix>	 musikanimal: Did the VE issue come back after we had fun with it last night
[15:08:52] <musikanimal>	 it's working for now
[15:10:56] <Zppix>	 good
[15:31:51] <icinga-miraheze>	 PROBLEM - ping4 on ns1 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds
[15:34:36] <icinga-miraheze>	 PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 103.25 ms
[16:16:51] <ZppixBot>	 Hello fosterthepolice! If you have any questions, feel free to ask and someone should answer soon.
[16:16:59] <fosterthepolice>	 very sad that you didnt send me requests :'( for national ex spouse day we will have a party and sing! please join for fun!
[16:17:02] <fosterthepolice>	 All the other kids with the pumped up kicks
[16:17:06] <fosterthepolice>	 You'd better run, better run, outrun my gun
[16:17:12] <fosterthepolice>	 You'd better run, better run, faster than my bullet
[16:17:19] <fosterthepolice>	 All the other kids with the pumped up kicks
[16:17:23] <fosterthepolice>	 You'd better run, better run, outrun my gun
[16:17:27] <fosterthepolice>	 All the other kids with the pumped up kicks
[16:17:31] <fosterthepolice>	 You'd better run, better run, faster than my bullet
[16:17:35] <fosterthepolice>	 Daddy works a long day
[16:17:40] <fosterthepolice>	 He be coming home late, and he's coming home late
[16:17:47] <fosterthepolice>	 And he's bringing me a surprise
[16:17:52] <fosterthepolice>	 'Cause dinner's in the kitchen and it's packed in ice
[16:17:57] <fosterthepolice>	 I've waited for a long time, MIRAHEZE
[16:18:01] <fosterthepolice>	 Yeah the sleight of my hand is now a quick pull trigger
[16:18:08] <fosterthepolice>	 I reason with my cigarette
[16:18:11] <fosterthepolice>	 And say your hair's on fire, you must have lost your wits, yeah
[16:18:19] <fosterthepolice>	 All the other kids with the pumped up kicks
[16:20:06] <Zppix>	 And all the other kids with their pump'd up kicks
[16:20:16] <Zppix>	 sorry i couldnt help myself
[16:20:56] <Reception123>	 :p
[16:27:13] <k6ka>	 Can I sing too? :)
[16:27:17] <k6ka>	 'Cause baby you're a firework
[16:27:31] <k6ka>	 Come on show 'em what your worth
[16:28:31] <RhinosF1>	 k6ka: stick to youtube :)
[16:28:38] <Zppix>	 k6ka: I'm not going to lie i almost kickbanned you until i realized it was you
[16:28:48] <k6ka>	 :)
[16:28:56] <Reception123>	 it's dangerous to sing in this channel these days
[16:29:03] <Zppix>	 lol
[16:29:07] <k6ka>	 That's a shame. Singing is healthy.
[16:29:38] <Zppix>	 A long long time ago
[16:29:42] <Zppix>	 I can still remember
[16:29:46] <k6ka>	 I had a professor that made it a rule that, if you were caught going off on your phone in class, you were required to stand up and sing a song for the class.
[16:29:49] <Zppix>	 how the music used to make me smile
[16:30:15] <RhinosF1>	 can we move to a non-logged channel?
[16:30:26] <Reception123>	 #miraheze-offtopic should do it :)
[16:30:47] <Zppix>	 technically all IRCs channels are logged
[16:31:02] <Reception123>	 well you know what Rhinos means ;)
[16:32:44] <ZppixBot>	 Hello queen! If you have any questions, feel free to ask and someone should answer soon.
[16:32:46] <queen>	 yes, thank you k6ka!! You are so right thank you for singing with me! you're the best! Let's sing together! i have a song for this situation 
[16:32:50] <queen>	 Tonight, I'm gonna have myself a real good time
[16:32:54] <queen>	 I feel alive and the world I'll turn it inside out, yeah
[16:32:58] <queen>	 And floating around in ecstasy
[16:33:00] <k6ka>	 Zppix
[16:33:04] <queen>	 So don't stop me now don't stop me ! Don't stop me Miraheze
[16:33:07] <queen>	 k6ka: come on sing with me!!
[16:33:12] <queen>	 I'm a shooting star, leaping through the sky
[16:33:15] <queen>	 Like a tiger defying the laws of gravity
[16:33:20] <queen>	 I'm a racing car, passing by like Lady Godiva
[16:33:24] <queen>	 I'm gonna go, go, go
[16:33:29] <queen>	 There's no stopping me
[16:33:35] <queen>	 that's right you cant stop me you can just sing!!
[16:33:41] <queen>	 come on k6ka !! sing with me again !!
[16:33:44] <queen>	 I'm burnin' through the sky, yeah
[16:33:49] <queen>	 Two hundred degrees
[16:33:58] <queen>	 I'm traveling at the speed of light
[16:34:03] <queen>	 I wanna make a supersonic man out of you, Miraheze
[16:34:09] <queen>	 Don't stop me now, I'm having such a good time (yeah I am!)
[16:34:14] <queen>	 I'm having a ball
[16:34:34] <Zppix>	 I dont remember that song
[16:34:44] <RhinosF1>	 -offtopic ffs
[16:41:32] <fosterthepeople[>	 yes, thank you k6ka!! You are so right thank you for singing with me! you're the best! Let's sing together! i have a song for this situation 
[16:41:32] <ZppixBot>	 Hello fosterthepeople[! If you have any questions, feel free to ask and someone should answer soon.
[16:41:46] <Zppix>	 no you don't
[16:43:03] <ZppixBot>	 Hello ACDCC! If you have any questions, feel free to ask and someone should answer soon.
[16:43:04] <ACDCC>	 Come on sing along Miraheze ! Time for some THUNDER !!
[16:43:06] <ACDCC>	 Thunder, thunder, thunder, thunder
[16:43:09] <ACDCC>	 I was caught
[16:50:13] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3007: Music will live on forever! It's time for Sweet Home Alabama - 13https://git.io/JfeSM
[16:50:22] <RhinosF1>	 Zppix: ^
[16:50:25] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3008: RhinosF1 Reception123 Zppix Voidwalker k6ka SING ALONG GUYS! - 13https://git.io/JfeSy
[16:50:32] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3009: I asked the wise man one sunny day Can you help m - 13https://git.io/JfeSS
[16:50:39] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3010: ALABAMA - 13https://git.io/JfeS9
[16:50:43] <Examknow>	 RhinosF1: oh no
[16:50:53] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3011: ALABAMA - 13https://git.io/JfeSQ
[16:51:00] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3012: RhinosF1 Reception123 Zppix Voidwalker k6ka SING ALONG GUYS! #3008 - 13https://git.io/JfeS7
[16:51:07] <Examknow>	 now even github 😭
[16:51:12] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3013: I asked the wise man one sunny day Can you help me find my way? You're so much older and wiser too - 13https://git.io/JfeS5
[16:51:20] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3014: I asked the wise man one sunny day Can you help me find my way? You're so much older and wiser too - 13https://git.io/JfeSF
[16:51:33] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3015: I asked the wise man one sunny day Can you help me find my way? You're so much older and wiser too - 13https://git.io/JfeSb
[16:51:41] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3016: RhinosF1 Reception123 Zppix Voidwalker k6ka SING ALONG GUYS! #3008 #3012 - 13https://git.io/JfeSN
[16:51:50] <Not-1447>	 [02mw-config] 07autoresponder[bot] commented on issue 03#3017: RhinosF1 Reception123 Zppix Voidwalker k6ka SING ALONG GUYS! #3008 #3012 - 13https://git.io/JfeSx
[17:06:39] <Not-1447>	 [02puppet] 07autoresponder[bot] commented on issue 03#1336: were all patriots its time to sing along to the greatest anthem of them all! - 13https://git.io/Jfe9R
[17:06:42] <Not-1447>	 [02puppet] 07autoresponder[bot] commented on issue 03#1337: Voidwalker RhinosF1 Reception123 Zppix Time to sing the anthem to honor our country! - 13https://git.io/Jfe90
[17:06:44] <Not-1447>	 [02puppet] 07autoresponder[bot] commented on issue 03#1338: Voidwalker RhinosF1 Reception123 Zppix Time to sing the anthem to honor our country! - 13https://git.io/Jfe9E
[17:06:45] <Not-1447>	 [02puppet] 07autoresponder[bot] commented on issue 03#1339: were all patriots its time to sing along to the greatest anthem of them all! - 13https://git.io/Jfe9u
[17:18:18] <ZppixBot>	 Hello kostajh! If you have any questions, feel free to ask and someone should answer soon.
[17:35:09] <Reception123>	 !log sudo -u www-data php fixStuckGlobalRename.php --wiki=earthvisionwiki --logwiki=metawiki "Kathying" "LTSC1980"
[17:35:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[17:38:52] <Reception123>	  !log sudo -u www-data php fixStuckGlobalRename.php --wiki=earthvisionwiki --logwiki=loginwiki "Kathying" "LTSC1980"
[17:38:55] <Reception123>	 ^ paladox that's strange
[17:39:07] <paladox>	 space!
[17:39:16] <paladox>	 hmm, why was i opped?
[17:39:31] <RhinosF1>	 paladox: mass quiet
[17:39:36] <paladox>	 oh
[17:39:49] <RhinosF1>	 Reception123: —logwiki=metawiki ?
[17:40:08] <Reception123>	 me bad, but it still worked
[17:40:13] <Reception123>	 paladox: it's stuck on every wiki, even Meta! 
[17:40:15] <Reception123>	 could you look?
[17:40:41] <paladox>	 Reception123 reload the page
[17:40:48] <paladox>	 don't forget the jobrunner running things!
[17:41:00] <Reception123>	 paladox: I did, still stuck
[17:41:00] <paladox>	 maybe we want a process dedicated to that like we do with DD?
[17:41:15] <Reception123>	 paladox: maybe, but I think it's stuck for good not just because of jobs because it was done quite a while ago 
[17:41:34] <paladox>	 Reception123 link?
[17:42:10] <RhinosF1>	 https://meta.miraheze.org/wiki/Special:GlobalRenameProgress?username=LTSC1980
[17:42:11] <ZppixBot>	 [ Global rename progress - Miraheze Meta ] - meta.miraheze.org
[17:42:14] <RhinosF1>	 paladox: ^
[17:42:18] <paladox>	 I'm going to be closing issues on github
[17:42:31] <Reception123>	 paladox: if you mean the spam I've handled it
[17:42:45] <paladox>	 No
[17:42:51] <paladox>	 i mean being able to write issues
[17:43:07] <Reception123>	 paladox: see -staff
[17:47:27] <paladox>	 !log disabling issues on all of our github repos
[17:47:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[17:50:58] <Reception123>	 paladox: it's still stuck 
[17:51:17] <paladox>	 looking now
[18:45:24] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is WARNING: WARNING - load average: 1.53, 1.83, 1.26
[18:48:17] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 0.65, 1.26, 1.13
[20:13:20] <RhinosF1>	 paladox: any luck fixing the rename?
[20:13:49] <paladox>	 there is no fixing, it just the jobrunner cannot go through things fast enough
[20:14:34] <RhinosF1>	 paladox: oh :(, running on every page load?
[20:14:43] <paladox>	 no
[20:15:18] <RhinosF1>	 paladox: how’s it running them?
[20:15:41] <paladox>	 see https://github.com/miraheze/puppet/blob/master/modules/mediawiki/manifests/jobrunner.pp for how it is running
[20:15:41] <ZppixBot>	 [ puppet/jobrunner.pp at master · miraheze/puppet · GitHub ] - github.com
[20:17:22] <RhinosF1>	 paladox: and which covers renames?
[20:17:44] <paladox>	 the jobrunner runs jobs that are inserted into redis
[20:18:45] <paladox>	 !logs root@jobrunner1:/home/paladox# /usr/bin/nice -19 /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/runJobs.php
[20:19:50] <paladox>	 !log root@jobrunner1:/home/paladox# /usr/bin/nice -19 /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/runJobs.php
[20:19:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[20:27:41] <Not-1447>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JfeA5
[20:27:43] <Not-1447>	 [02miraheze/mw-config] 07paladox 0376ca625 - Remove wgJobRunRate - leaving to the default as 1 Going to experiment how things are handled.
[20:27:44] <Not-1447>	 [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vbvb3
[20:27:46] <Not-1447>	 [02mw-config] 07paladox opened pull request 03#3019: Remove wgJobRunRate - leaving to the default as 1 - 13https://git.io/JfeAd
[20:28:02] <Not-1447>	 [02mw-config] 07paladox edited pull request 03#3019: Remove wgJobRunRate - leaving to the default as 1 - 13https://git.io/JfeAd
[20:28:07] <Not-1447>	 [02mw-config] 07paladox closed pull request 03#3019: Remove wgJobRunRate - leaving to the default as 1 - 13https://git.io/JfeAd
[20:28:08] <Not-1447>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfeAA
[20:28:10] <Not-1447>	 [02miraheze/mw-config] 07paladox 03291e3ab - Remove wgJobRunRate - leaving to the default as 1 (#3019) Going to experiment how things are handled.
[20:28:11] <Not-1447>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2
[20:28:13] <Not-1447>	 [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vbvb3
[20:29:23] <JohnLewis>	 paladox: Please leave runRate as 0
[20:29:28] <JohnLewis>	 We did it for performance reasons
[20:29:35] <paladox>	 oh, ok
[20:29:59] <Not-1447>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfexU
[20:30:00] <Not-1447>	 [02miraheze/mw-config] 07paladox 03fa6e664 - Revert "Remove wgJobRunRate - leaving to the default as 1 (#3019)" This reverts commit 291e3ab3aba1a9314ff6da8c86318a0c592abf5d.
[21:00:30] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is CRITICAL: CRITICAL - load average: 2.66, 2.75, 2.14
[21:08:44] <icinga-miraheze>	 PROBLEM - cp8 Current Load on cp8 is WARNING: WARNING - load average: 1.28, 1.71, 1.87
[21:14:04] <icinga-miraheze>	 RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 0.82, 1.29, 1.65
[21:19:27] <Not-1447>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/Jfehq
[21:19:29] <Not-1447>	 [02miraheze/CreateWiki] 07paladox 0350c567f - Set a default for wgServer - fallback incase wgServer is not set This is mainly for the jobrunner.
[21:19:30] <Not-1447>	 [02CreateWiki] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vpJTL
[21:19:33] <Not-1447>	 [02CreateWiki] 07paladox opened pull request 03#135: Set a default for wgServer - fallback incase wgServer is not set - 13https://git.io/Jfehm
[21:22:03] <travis-ci>	 miraheze/CreateWiki/paladox-patch-2/50c567f - paladox The build was fixed. https://travis-ci.com/miraheze/CreateWiki/builds/160290430
[21:26:33] <Not-1447>	 [02CreateWiki] 07paladox synchronize pull request 03#135: Set a default for wgServer - fallback incase wgServer is not set - 13https://git.io/Jfehm
[21:26:34] <Not-1447>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JfehW
[21:26:36] <Not-1447>	 [02miraheze/CreateWiki] 07paladox 034418ecb - Update WikiInitialise.php
[21:29:08] <Not-1447>	 [02CreateWiki] 07paladox synchronize pull request 03#135: Set a default for wgServer - fallback incase wgServer is not set - 13https://git.io/Jfehm
[21:29:10] <Not-1447>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/Jfeh4
[21:29:11] <Not-1447>	 [02miraheze/CreateWiki] 07paladox 03b76da59 - Update WikiInitialise.php
[21:40:44] <Not-1447>	 [02CreateWiki] 07paladox synchronize pull request 03#135: Set a default for wgServer - fallback incase wgServer is not set - 13https://git.io/Jfehm
[21:40:46] <Not-1447>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JfehF
[21:40:47] <Not-1447>	 [02miraheze/CreateWiki] 07paladox 0333928b2 - Update WikiInitialise.php
[21:41:54] <Not-1447>	 [02CreateWiki] 07paladox synchronize pull request 03#135: Set a default for wgServer - fallback incase wgServer is not set - 13https://git.io/Jfehm
[21:41:56] <Not-1447>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JfehN
[21:41:57] <Not-1447>	 [02miraheze/CreateWiki] 07paladox 031390a04 - Update WikiInitialise.php
[21:43:29] <Not-1447>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfejU
[21:43:30] <Not-1447>	 [02miraheze/CreateWiki] 07paladox 03f39de1d - Stop testing php 7.1
[21:43:42] <Not-1447>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfejT
[21:43:43] <Not-1447>	 [02miraheze/CreateWiki] 07paladox 03a02d312 - Test php 7.4
[21:45:41] <Not-1447>	 [02CreateWiki] 07paladox closed pull request 03#135: Set a default for wgServer - fallback incase wgServer is not set - 13https://git.io/Jfehm
[21:45:42] <Not-1447>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfejL
[21:45:44] <Not-1447>	 [02miraheze/CreateWiki] 07paladox 038f9f7fb - Set a default for wgServer - fallback incase wgServer is not set (#135)
[21:46:43] <Not-1447>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JfejO
[21:46:45] <Not-1447>	 [02miraheze/mediawiki] 07paladox 032f5df50 - Update CreateWiki
[21:51:41] <Not-1447>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfej0
[21:51:43] <Not-1447>	 [02miraheze/puppet] 07paladox 03d072a36 - jobrunner: Tweek config Run as www-data, and also increase runners to 3
[21:54:14] <Not-1447>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfejr
[21:54:15] <Not-1447>	 [02miraheze/puppet] 07paladox 036528381 - Revert "jobrunner: Tweek config" This reverts commit d072a3668516e27d8b0ae339075888830bbc25b5.
[21:55:41] <Not-1447>	 [02CreateWiki] 07shirayuki opened pull request 03#136: Add Special:MyLanguage for better user experience - 13https://git.io/Jfej6
[21:59:26] <Not-1447>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfejQ
[21:59:27] <Not-1447>	 [02miraheze/puppet] 07paladox 031be3573 - Update jobrunner.json.erb
[22:00:32] <paladox>	 !log root@jobrunner1:/home/paladox# sudo -u www-data /usr/bin/nice -19 /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/runJobs.php
[22:00:35] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master
[22:15:50] <Not-1447>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/Jfve0
[22:15:51] <Not-1447>	 [02miraheze/mediawiki] 07paladox 034a9d9aa - Update foreground
[22:30:45] <Voidwalker>	 looks like the services repo hasn't been updated in a few days
[22:31:04] <paladox>	 Voidwalker see -staff
[22:31:18] <Voidwalker>	 oh is that what you're working on now :P
[22:31:58] <Voidwalker>	 yeah, lol
[22:32:01] <paladox>	 yeh
[22:33:26] * hispano76 greetings
[22:33:39] <paladox>	 hi
[23:12:31] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JfvvN
[23:12:32] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox 03190a8d3 - Update addWikiToServices to new CreateWiki cache backend
[23:12:34] <Not-1447>	 [02MirahezeMagic] 07paladox created branch 03paladox-patch-2 - 13https://git.io/fQRGX
[23:12:35] <Not-1447>	 [02MirahezeMagic] 07paladox opened pull request 03#105: Update addWikiToServices to new CreateWiki cache backend - 13https://git.io/JfvvA
[23:13:33] <travis-ci>	 miraheze/MirahezeMagic/paladox-patch-2/190a8d3 - paladox The build was broken. https://travis-ci.com/miraheze/MirahezeMagic/builds/160301911
[23:14:00] <Not-1447>	 [02MirahezeMagic] 07paladox synchronize pull request 03#105: Update addWikiToServices to new CreateWiki cache backend - 13https://git.io/JfvvA
[23:14:01] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/Jfvvp
[23:14:03] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox 03f16bce1 - Update addWikiToServices.php
[23:15:09] <travis-ci>	 miraheze/MirahezeMagic/paladox-patch-2/f16bce1 - paladox The build was fixed. https://travis-ci.com/miraheze/MirahezeMagic/builds/160302066
[23:27:57] <Not-1447>	 [02MirahezeMagic] 07paladox synchronize pull request 03#105: Update addWikiToServices to new CreateWiki cache backend - 13https://git.io/JfvvA
[23:27:59] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/Jfvfc
[23:28:00] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox 03121b127 - Update addWikiToServices.php
[23:30:19] <Not-1447>	 [02MirahezeMagic] 07paladox closed pull request 03#105: Update addWikiToServices to new CreateWiki cache backend - 13https://git.io/JfvvA
[23:30:20] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfvf4
[23:30:22] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox 034070c28 - Update addWikiToServices to new CreateWiki cache backend (#105)
[23:30:53] <Not-1447>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/Jfvf0
[23:30:55] <Not-1447>	 [02miraheze/mediawiki] 07paladox 0334c8e10 - Update MirahezeMagic
[23:34:19] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfvfV
[23:34:20] <Not-1447>	 [02miraheze/MirahezeMagic] 07paladox 032a751d3 - Update addWikiToServices.php
[23:34:45] <Not-1447>	 [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/Jfvfr
[23:34:46] <Not-1447>	 [02miraheze/mediawiki] 07paladox 0368a4384 - Update MirahezeMagic
[23:38:40] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jfvfi
[23:38:42] <Not-1447>	 [02miraheze/services] 07MirahezeSSLBot 03e44982e - BOT: Updating services config for wikis
[23:40:35] <icinga-miraheze>	 PROBLEM - mw4 Puppet on mw4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:42:02] <icinga-miraheze>	 PROBLEM - mw5 Puppet on mw5 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:43:02] <icinga-miraheze>	 PROBLEM - mw7 Puppet on mw7 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:43:07] <icinga-miraheze>	 PROBLEM - mw6 Puppet on mw6 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core]
[23:43:14] <Zppix>	 paladox: ^ why?
[23:44:06] <paladox>	 Apr 14 23:36:32 mw4 puppet-agent[27064]: (/Stage[main]/Mediawiki/Git::Clone[MediaWiki core]/Exec[git_pull_MediaWiki core]/returns) change from 'notrun' to ['0'] failed: Command exceeded timeout (corrective)
[23:44:12] <paladox>	 it timedout apparently
[23:44:48] <icinga-miraheze>	 RECOVERY - mw5 Puppet on mw5 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures
[23:45:46] <icinga-miraheze>	 RECOVERY - mw7 Puppet on mw7 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[23:45:55] <icinga-miraheze>	 RECOVERY - mw6 Puppet on mw6 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[23:46:10] <icinga-miraheze>	 RECOVERY - mw4 Puppet on mw4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[23:53:48] <Not-1447>	 [02puppet] 07Pix1234 synchronize pull request 03#1335: Remove unused memcache code from MediaWiki module - 13https://git.io/JfeYv
[23:54:54] <Not-1447>	 [02puppet] 07paladox closed pull request 03#1335: Remove unused memcache code from MediaWiki module - 13https://git.io/JfeYv
[23:54:55] <Not-1447>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-2/±2] 13https://git.io/Jfvfx
[23:54:57] <Not-1447>	 [02miraheze/puppet] 07Pix1234 03c24b187 - Remove unused memcache code from MediaWiki module (#1335)