[00:05:28] PROBLEM - bacula1 Bacula Private Git on bacula1 is CRITICAL: CRITICAL: Full, 4137 files, 8.488MB, 2019-08-11 00:05:00 (2.3 weeks ago) [01:19:59] Voidwalker: If there is a wiki with innapropriate content would the steward take action or a wiki creator? [01:20:58] only if the request is still open [01:21:21] if the wiki exists, then it should be handled by stewards/staff [01:21:57] ok [01:22:27] RhinosF1 said I should know the policy to be wiki creator so I am just wondering [01:25:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.37, 6.79, 5.65 [01:35:55] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 4.81, 6.99, 6.63 [01:39:55] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.45, 6.06, 6.37 [01:43:55] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.18, 7.21, 6.80 [01:45:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 10.34, 8.39, 7.27 [01:49:56] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.74, 7.68, 7.26 [02:01:55] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 3.63, 5.46, 6.42 [02:10:16] JohnLewis: What would it take to get me a miraheze cloak? [02:13:01] Examknow: just a request to me [02:13:33] can I have one please? [02:13:39] sure [02:13:46] thanks! [02:14:32] in time when Freenode staff reply [02:14:41] ok [02:15:19] have you ever thought that icinga-miraheze should be on a different channel [02:15:35] like #miraheze-maintenence [02:15:46] nope [02:15:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.84, 7.15, 6.52 [02:16:01] this chan serves as the primary technical channel [02:16:30] ah [02:16:45] RhinosF1 and Voidwalker think it should be different too [02:17:55] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.56, 6.68, 6.44 [02:29:57] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 10.33, 7.91, 6.89 [02:35:05] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 140 failures. Last run 2 minutes ago with 140 failures. Failed resources (up to 3 shown) [02:35:23] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 7 failures. Last run 2 minutes ago with 7 failures. Failed resources (up to 3 shown) [02:36:41] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 158 failures. Last run 3 minutes ago with 158 failures. Failed resources (up to 3 shown): File[wiki.bonessdiving.club],File[wiki.bonessdiving.club_private],File[wiki.rmbrk.sk],File[wiki.rmbrk.sk_private] [02:37:55] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 4.89, 7.04, 7.11 [02:40:27] JohnLewis: will I have the cloak by tomorrow? [02:40:51] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [02:41:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.26, 7.72, 7.35 [02:43:55] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.82, 7.65, 7.36 [02:45:04] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [02:45:50] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:45:57] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.73, 8.22, 7.59 [02:46:40] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:49:15] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [02:51:55] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.43, 7.69, 7.61 [02:53:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.71, 8.07, 7.75 [02:55:55] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.22, 7.87, 7.72 [03:01:54] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 1.70, 4.37, 6.24 [03:23:56] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.25, 6.95, 5.98 [03:25:56] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.21, 7.22, 6.21 [03:31:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.31, 7.48, 6.62 [03:33:56] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.98, 7.50, 6.72 [03:35:58] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.38, 8.06, 7.00 [03:37:56] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.55, 7.94, 7.09 [03:39:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.19, 8.50, 7.40 [04:01:54] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 3.62, 6.75, 7.63 [04:17:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.27, 8.06, 7.78 [04:19:55] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 5.63, 7.31, 7.54 [04:29:55] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.40, 7.22, 7.25 [04:31:55] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.78, 6.87, 7.11 [04:35:55] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 5.39, 6.05, 6.70 [05:17:27] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.14, 6.80, 5.76 [05:19:22] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 4.06, 5.81, 5.52 [05:37:29] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.20, 1.77, 1.38 [05:39:29] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.98, 1.75, 1.41 [05:41:29] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.40, 1.55, 1.37 [05:45:29] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.89, 1.93, 1.57 [05:47:29] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.03, 1.61, 1.50 [06:09:15] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 3.68, 2.44, 1.81 [06:11:13] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.51, 1.93, 1.69 [06:15:11] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.03, 1.46, 1.56 [06:26:33] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 3109 MB (12% inode=94%); [06:50:04] !log UPDATE cw_wikis SET wiki_settings = '{"wgDefaultSkin":"vector","wgLocaltimezone":"Asia\/Seoul","wgServer":"","wmgWikiLicense":"cc-by-sa"}' WHERE wiki_dbname = 'kkutuwiki'; (custom domain no longer points to us) [06:50:09] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjA1J [06:50:11] [02miraheze/services] 07MirahezeSSLBot 0382194be - BOT: Updating services config for wikis [06:50:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [06:51:27] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/fjA1k [06:51:28] [02miraheze/ssl] 07Reception123 0373f7962 - rm kkutu.wiki cert no longer points to us [06:54:55] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[kkutu.wiki],File[kkutu.wiki_private] [06:55:08] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[kkutu.wiki],File[kkutu.wiki_private] [06:55:29] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[kkutu.wiki],File[kkutu.wiki_private] [06:56:20] oh come on I removed the key what more do you want [06:56:39] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[kkutu.wiki],File[kkutu.wiki_private] [06:56:40] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[kkutu.wiki],File[kkutu.wiki_private] [06:56:53] oh it's the opposite :P [06:57:05] PROBLEM - cp2 Puppet on cp2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[kkutu.wiki],File[kkutu.wiki_private] [06:58:20] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[kkutu.wiki],File[kkutu.wiki_private] [06:59:28] ^ will be fixed very soon by itself [07:00:36] (as always with puppet) [07:01:39] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 3.49, 2.15, 1.56 [07:03:13] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [07:03:22] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [07:03:26] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [07:03:47] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [07:04:38] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:04:55] here we go Reception123 [07:04:59] all fine [07:05:17] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:05:24] yup [07:05:33] * Reception123 names RhinosF1 puppetmaster :P [07:05:50] Reception123: at least we got a dose of puppet spam [07:06:24] I wonder if we'll ever get to see a day where Icinga leaves us alone [07:06:25] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:06:42] Reception123: nope, that'll never happen [07:07:00] * RhinosF1 thinks we'll probably be doing something wrong to find that [07:07:28] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.84, 1.58, 1.53 [07:07:45] if you don't give Icinga problems it makes its own :P [07:07:56] Yep [07:09:45] once I tried to get rid of all the issues but of course didn't work [07:09:53] :) [07:10:25] Reception123: I think the test1 load stuff gave Examknow a shock [07:11:10] people have always wanted icinga to move to a separate tech channel but tbh there's just not enough traffic here for that usually [07:12:29] traffic here would then mostly be MirahezeSSLBot from not-**** [07:13:29] yeah soon the bots will be talking to each other around here [07:13:53] Reception123: 2.6 and 2.7 in your RfC cross over a bit [07:14:29] and I once had a bug where a bot I had literally started talking to another bot in a loop [07:14:41] lol [07:15:36] RhinosF1: true for the RfC, maybe you could find a way to combine them? [07:15:50] Reception123: it was a test channel with 2 bots running the same code and someone said hi triggering off both greetings functions who then endlessly said hi to each other until I moderated the chat to break them up and looking [07:16:02] :p [07:17:07] RhinosF1: I find it really offensive that you would make fun of bots talking to each other [07:17:33] ZppixBot: it was an endless loop. [07:17:38] lol [07:17:50] was /me :P [07:18:08] ZppixBot: and that is a bug. A human shouldn't be able to control the bot from the backend (although funny) [07:18:31] ZppixBot has actually not been that used lately, but the joke function is still there :P [07:18:50] I remember once pretty much all the maintainers were saying stuff from ZppixBot and it was impossible to tell what was going on [07:19:00] Reception123: :) [07:19:59] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.76, 1.85, 1.66 [07:21:54] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.24, 1.63, 1.60 [07:22:27] Reception123: made some changes [07:25:45] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.59, 1.92, 1.75 [07:27:41] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.68, 2.20, 1.87 [07:27:57] thanks [07:27:59] will look [07:28:06] icinga-miraheze: stop lighting up my phone [07:28:10] Reception123: np [07:29:36] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.48, 1.90, 1.79 [07:29:36] RhinosF1: for next year's april fools I'll mark every service as down :P [07:30:02] Reception123: are Miraheze good with fools stuff? [07:30:26] RhinosF1: not really actually, we need to think of something [07:31:02] Reception123: we do, someone will have to get planning [07:31:31] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.88, 1.52, 1.66 [07:32:10] RhinosF1: though it can't be too big like "Miraheze has merged with Wikia and all wikis and data will be transferred there in 24 hours" [07:32:14] or that would just scare everyone [07:32:18] Reception123: no, no [07:32:40] something really fun [07:32:50] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.96, 7.31, 5.54 [07:33:13] RhinosF1: "Miraheze has invited the Wikimedia T&S team to help us, and they will be taking over all safety operations." "The T&S's first action is to ToS ban RhinosF1 on Meta instead of asking for local consensus" [07:33:39] Reception123: stop reminding me sutherland is still ignoring me [07:34:17] they're useless T&S at times [07:35:16] * RhinosF1 even once had to ask sutherland to answer the emergency@ line on irc because it took that long even though it aggressively pings them supposedly [07:35:32] hmm [07:35:55] Reception123: not very emergency about that [07:36:10] indeed [07:36:39] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.23, 7.99, 6.29 [07:37:19] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 1.69, 2.02, 1.85 [07:37:21] Reception123: the whole point of that line is for immediate help when someone/thing is at risk of harm [07:37:35] although they're normally quick [07:38:04] and I think the time someone threatened on IRC to stick a magnet to all the WMF servers they responded quick [07:38:30] lol a magnet? [07:38:34] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 3.29, 6.41, 5.91 [07:38:36] Reception123: yep [07:38:41] icinga-miraheze: shut up [07:39:20] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.93, 1.74, 1.77 [07:39:46] Hello icinga-miraheze_! If you have any questions feel free to ask and someone should answer soon. [07:39:54] RhinosF1: haha it actually listened to me [07:39:57] Reception123: no you shut up [07:40:01] xDD [07:40:12] ./ban icinga-miraheze Impersonating an annoying bot [07:40:26] Reception123: it is me btw [07:40:32] RhinosF1: I can tell :P [07:40:47] PROBLEM - icinga-miraheze Being impersonated CRITICAL: CRITICAL [07:41:12] * icinga-miraheze_ loves the miraheze way of doing things [07:41:20] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.69, 2.11, 1.90 [07:41:22] * RhinosF1 does as well [07:41:33] icinga-miraheze_: can you tell your cousin icinga-miraheze to stop with the spam already [07:41:58] Reception123: it's like it all the time, always finding issues [07:42:44] icinga-miraheze_: I think we'll hire you instead of icinga-miraheze [07:43:03] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.69, 2.11, 1.90 [07:43:14] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 2.69, 2.11, 1.90 [07:43:18] ^ now will . you [07:43:39] icinga-miraheze_: No, I only want to see OKs not CRITICALs [07:44:27] RECOVERY - ALL SERVICES OK [07:44:36] ^ that better [07:44:39] icinga-miraheze_: hired [07:44:46] bye icinga-miraheze it's been nice having you around [07:44:48] (not) [07:44:59] * icinga-miraheze_ loves this [07:46:36] RhinosF1: at one point I used to have icinga email notifications but definitely not anymore or I'd be completely spammed daily [07:47:12] Reception123: ah, I'm getting used to never having inbox zero on my wikimedia/miraheze inbox [07:48:22] Reception123: I have filters though applied for some things [07:48:55] heh [07:49:12] Reception123: works well [07:49:39] you should ask Andre Klapper for his how to not get overwhelmed by emails guides [07:49:52] heh [07:49:58] he must get an email every second [07:50:03] Reception123: he must [07:50:23] * RhinosF1 never gets that many from miraheze [07:50:44] nah, relatively calm here [07:50:51] * RhinosF1 is on most phab tasks from the last few month and all mw-config commits [07:51:00] for some reason I have two emails: my @mh.org and my gmail wiki email [07:51:32] Reception123: one came first, one is a 'work' one [07:51:43] * RhinosF1 doesn't class this much fun as work [07:51:58] yeah, well I also use gmail for non-Miraheze wiki related stuff I guess [07:52:29] yeah, my rhinosf1[at]gmail.com one takes a lot of wikimedia mailing lists as well [07:54:17] when paladox I have to go back to that annoying cookiewarning thing [07:54:45] ah that pain [08:05:36] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.87, 1.65, 1.96 [08:05:48] * RhinosF1 knocks icinga-miraheze out [08:07:03] * RhinosF1 looks for it's nicer cousin [08:07:31] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 4.41, 2.46, 2.19 [08:07:36] oh come on [08:07:40] ok ok icinga-miraheze [08:07:42] will it never give up [08:07:52] Reception123: is paladox still running that import? [08:08:16] I'd think so yeah [08:08:36] Reception123: it hasn't shut up since about midnight [08:08:44] * RhinosF1 stares at paladox [08:09:33] well test1 isn't big enough to be able to take on imports [08:09:38] it's supposed to be test-only [08:09:52] Reception123: ah, looks like mw2 was most of the night [08:10:14] don't we end up using test1 cause of JQ [08:10:27] yes [08:10:44] * RhinosF1 whacks the JobQueue on the head [08:11:57] PROBLEM: JobQueue Error - JobQueue is injured - take to A&E [08:12:17] * RhinosF1 drags the JobQueue to A&E [08:12:39] RECOVERY - JobQueue is working (for once) [08:13:15] PROBLEM - RhinosF1 Current Load on test1 is ANNOYED: ANNOYED - load average very annoyed at test1 [08:13:32] * RhinosF1 laughs at Reception123 [08:15:04] * RhinosF1 thinks most places should come see how we do things [08:15:55] * RhinosF1 better get changed out of his PJs before his grandparents come [08:16:12] :) [08:34:22] I think icinga-miraheze finally listened to us [08:34:46] RhinosF1: I payed it off [08:35:11] was the only way [08:35:16] Reception123: :) [08:39:20] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.97, 1.35, 1.97 [08:39:43] didn't last then [08:41:28] RhinosF1: I couldn't afford paying it more, it wanted 100€/hour [08:42:12] ah [08:42:24] it's an expensive tool then [08:45:19] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.12, 1.66, 1.87 [08:47:19] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.21, 1.43, 1.76 [08:51:19] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.64, 1.49, 1.70 [08:51:45] yey [09:05:53] Reception123: https://phabricator.miraheze.org/T4679 looks clear now but can you confirm a ok [09:05:53] [ ⚓ T4679 Error 503 ] - phabricator.miraheze.org [09:08:43] Reception123: thx [09:08:49] yw [09:09:05] * RhinosF1 looks at the wikimedia train and thinks there's no way that will move in the next 4 hours [09:45:35] Reception123: we can downtime the check [09:49:03] paladox: Ok, I tried to acknowledge but that didn't work [09:49:13] paladox: what's the status on lizardfs? :) [10:20:29] Still transfering [10:20:57] paladox: wow how long will it take? [10:21:03] And what happens with new uploads? [10:51:02] New uploads will go to the new host [10:51:03] And I’m not sure how long it’ll take [12:10:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fjA9X [12:10:13] [02miraheze/services] 07MirahezeSSLBot 03a8cb280 - BOT: Updating services config for wikis [13:40:16] anyone lazy: T4678 [13:44:25] ^ https://m.phab.wiki/4678 [13:44:26] [ ⚓ T4678 SSL certificate for mastodonkrwiki ] - m.phab.wiki [13:54:02] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 3.08, 1.98, 1.33 [13:55:58] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 1.19, 1.62, 1.27 [14:15:20] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.78, 1.78, 1.46 [14:17:20] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.61, 2.02, 1.58 [14:19:19] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.85, 1.91, 1.59 [14:21:20] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.52, 2.06, 1.67 [14:26:51] revi: I'll do it as soon as I have access [14:27:14] revi: in ~2 or 3 hours [14:27:17] ack [14:27:19] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.53, 2.00, 1.79 [14:33:20] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 2.63, 2.10, 1.87 [14:37:19] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 1.57, 1.98, 1.88 [14:41:20] PROBLEM - test1 Current Load on test1 is CRITICAL: CRITICAL - load average: 4.28, 2.56, 2.09 [15:43:19] PROBLEM - test1 Current Load on test1 is WARNING: WARNING - load average: 0.30, 0.66, 2.00 [15:47:19] RECOVERY - test1 Current Load on test1 is OK: OK - load average: 0.10, 0.34, 1.55 [16:44:50] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/fjAF0 [16:44:52] [02miraheze/ssl] 07Reception123 038c0e075 - add wiki.mastodon.kr cert [16:45:02] .remind [16:50:50] revi: done :) [17:23:55] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2649 MB (10% inode=94%); [17:34:05] Reception123: thx :-h [17:34:06] :-)* [17:34:13] np [18:37:22] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjAN2 [18:37:23] [02miraheze/mediawiki] 07paladox 03f861b48 - Update Echo [18:49:57] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjAND [18:49:58] [02miraheze/mediawiki] 07paladox 030e0b641 - Update Echo [19:15:50] !log deleted and dropped agrolibrarywiki; akdorfgeschichtewiki; alerte112wiki; alientoasterdogwiki; alloverwiki; allwikiswiki; amcwiki; anarchymcwiki; angelwisewiki; arbreapalabrewiki; armourywikiwiki; arnathwiki;aufterrawiki; aukumniawiki; aweiowiki;battleaxewiki;bean3dwiki;billcgenealogywiki;bmsswiki; bncc3wiki; bokwiki; brucefamilywiki; brynda1231wiki; bscwiki;c105opwiki; calibrowiki;capouwiki; captainchumakwiki;cdisenoneswiki; [19:15:50] cedarcraftwiki;charleroiwiki; cheesewiki; cimphoniec2nwiki;clarencewiki; clarketransportwiki; closinglogoswiki;clubpenguinbrasilfanonwiki; cmhocwiki; collabuibfcwiki; comnumthwiki;esigningwiki; hypotheticalmetawiki; inprincipowiki; kyivstarwiki; mirahezefakenewswiki;orangistwiki; tallercristianowiki; testdelete10wiki; testdelete2wiki; weatherwiki; [19:15:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:17:53] paladox: are you still running that script? even after all those dbs dropped db4 is still only at 15GB [19:19:16] !log reception@mw1:/srv/mediawiki/w/extensions/CentralAuth/maintenance$ sudo -u www-data php fixStuckGlobalRename.php --logwiki metawiki --wiki metawiki JJTA1211 Jordan3047 [19:19:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:20:15] !log reception@mw1:/srv/mediawiki/w/extensions/CentralAuth/maintenance$ sudo -u www-data php fixStuckGlobalRename.php --logwiki metawiki --wiki metawiki AntiJawn PapercutsExist [19:20:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [19:34:26] Reception123: which script? [19:42:42] paladox: import i mean [19:59:47] !log MariaDB [mhglobal]> DELETE FROM renameuser_status WHERE ru_wiki = 'allwikiswiki'; [19:59:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:00:07] !log MariaDB [mhglobal]> DELETE FROM renameuser_status WHERE ru_wiki = 'besttvchannelswiki'; [20:00:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:04:33] !log fixed further rename stuck issues after removing entries from db [20:04:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:09:43] !log MariaDB [mhglobal]> DELETE FROM renameuser_status WHERE ru_wiki = 'brynda1231wiki'; [20:09:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:01:40] hey [21:02:56] Examknow: Can You use a test wiki to work out the CSS issue and post the answer in your userspace and link them? [21:03:01] Examknow: can you pm Swant about your cloak :) [21:03:16] he needs you to confirm because you already have a cloak [21:03:21] ok [21:04:32] Also we can give more than 24 hours for a response [21:06:09] huh? [21:08:37] JohnLewis: see SN [21:09:00] link pls looking at code [21:10:03] JohnLewis: https://meta.miraheze.org/wiki/Stewards%27_noticeboard#Hiding_the_.22from_.2Awikiname.2A.22_text [21:10:04] [ Stewards' noticeboard - Miraheze Meta ] - meta.miraheze.org [21:11:11] alternatively just give the relevant changes needed [21:11:24] Miraheze's support model is all about educating over doing [21:11:54] * Voidwalker just dropped a response with two suggestions [21:12:19] Voidwalker: thanks and check your Discord [21:16:23] RhinosF1: I'm gonna change the wiki exists error from an exception to a fatal, then drop exception handling [21:16:38] which means if the wiki exists, it'll say so. If there's an exception, it won't mask it [21:19:20] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/fjAxb [21:19:21] [02miraheze/CreateWiki] 07JohnFLewis 032281234 - drop from exception to fatal [21:19:56] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjAxx [21:19:58] RhinosF1: there you go [21:19:58] [02miraheze/mediawiki] 07JohnFLewis 03dd5bee1 - CW [21:22:42] JohnLewis: ok [21:22:44] thx [21:22:49] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.11, 6.53, 4.32 [21:23:17] JohnLewis: any chance of a footer or header with links between each subpage on the ManageWiki pages [21:23:47] side bar navigation is the current preferred methd [21:24:11] no easy way really to integrate such movement, but it's always something I'm keeping an eye on with upstream developments [21:24:47] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.97, 6.68, 4.65 [21:25:57] JohnLewis: ah cool [21:26:42] JohnLewis: only minor issue is when looking from a fixing bugs side where it doesn't appear in the sidebar. (unless there's a hack for that) [21:26:46] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.81, 7.50, 5.19 [21:27:18] hm? [21:28:03] JohnLewis: like a js/css way of adding them [21:28:35] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_33 [+0/-0/±1] 13https://git.io/fjApv [21:28:37] [02miraheze/mediawiki] 07paladox 034a81b14 - Update Echo [21:28:38] if they are not appearing, then has that been reported/investigated? [21:28:46] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 7.68, 7.66, 5.52 [21:30:03] Voidwalker: they don't without the 'managewiki' right [21:30:26] but it's still helpful for us without to navigate easily when looking at issues [21:31:07] https://github.com/miraheze/ManageWiki/blob/master/includes/ManageWikiHooks.php#L370 [21:31:07] [ ManageWiki/ManageWikiHooks.php at master · miraheze/ManageWiki · GitHub ] - github.com [21:31:47] not so much of a bug, but since MW is readable by all, should it be adjusted? [21:32:35] JohnLewis: thoughts? [21:33:41] I'd prefer them to read "view" instead of "manage" without managewiki but no issue others [21:33:44] *otherwise [21:34:47] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 6.49, 6.67, 5.74 [21:35:21] could probably handle that with additional localization and a simple flag [21:35:28] Voidwalker: we can adjust but not sure how to make the title change as that comes from the page name [21:36:11] Reception123 script is now finished running! [21:36:17] !log running runJob on test1 [21:36:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:36:37] RhinosF1, link text should come from https://github.com/miraheze/ManageWiki/blob/master/i18n/en.json#L108-L112 [21:36:38] [ ManageWiki/en.json at master · miraheze/ManageWiki · GitHub ] - github.com [21:36:53] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [21:37:16] Voidwalker: ye, correct [21:37:29] hmm well [21:37:55] I'll be back later [21:38:04] Voidwalker: we'd need to create a new message to use for read only users [21:38:32] Shall I drop a note on phab so we don't forget? [21:38:44] if you want [21:40:32] I mean you could [21:40:37] but it's like a 2-3 minute job [21:40:53] it'll take longer to make the task than do the work :P [21:41:55] JohnLewis: :P I'm not 100% sure on it and void is off for a bit so that leaves you [21:42:32] fine give me a minute [21:43:16] https://phabricator.miraheze.org/T4680 [21:43:17] [ ⚓ T4680 Add ManageWiki sidebar links for users without 'managewiki' right ] - phabricator.miraheze.org [21:43:37] also gives me a reference as I'll leave a note advertising the change so people aren't shocked [21:43:39] on CN [21:49:33] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+1/-0/±3] 13https://git.io/fjApC [21:49:34] [02miraheze/ManageWiki] 07JohnFLewis 03facf653 - add 'view' options to sidebar' [21:49:36] RhinosF1: [21:50:00] JohnLewis: ok [21:50:02] thx [21:50:29] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 9.09, 7.71, 6.65 [21:55:42] JohnLewis: don't forget to update CW as by the time I sync and re-pull it, you could have done it [21:56:00] (in /mediawiki) [21:56:45] [02miraheze/mediawiki] 07JohnFLewis pushed 032 commits to 03REL1_33 [+0/-0/±2] 13https://git.io/fjApB [21:56:47] [02miraheze/mediawiki] 07JohnFLewis 0385d3028 - update MW [21:56:48] [02miraheze/mediawiki] 07JohnFLewis 0334341c7 - Merge branch 'REL1_33' of github.com:miraheze/mediawiki into REL1_33 [21:57:42] JohnLewis: thx [21:58:21] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 4.57, 7.41, 7.18 [22:00:19] RECOVERY - mw2 Current Load on mw2 is OK: OK - load average: 3.01, 5.86, 6.63 [22:01:23] JohnLewis: the i18n hasn't synced [22:03:57] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [22:04:44] RhinosF1: not ran LC yet :) [22:04:58] JohnLewis: please do [22:08:11] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.47, 7.03, 6.64 [22:09:49] RhinosF1: should be all done now [22:10:00] JohnLewis It appears that john lewis is away [22:10:23] JohnLewis: It appears that swant is away [22:10:31] Examknow: yeah probably [22:11:08] Examknow: he's normally around towards 12 midday UK time [22:11:34] is there somebody else I could talk to? [22:12:06] Examknow: no one on stats p but el was around not so long ago [22:12:21] and D[_] is [22:13:43] Examknow: if you tell him that you want just @miraheze/Examknow, he'll do it when he's around [22:13:56] and I'll poke him when he's around if it's not done [22:14:06] k [22:19:56] https://github.com/miraheze/ManageWiki/blob/master/sql/mw_settings.sql don't suppose that's supposed to be there yet :P [22:19:57] [ ManageWiki/mw_settings.sql at master · miraheze/ManageWiki · GitHub ] - github.com [22:20:22] Como va la solicitud de Replace Texto de Commons Miraheze? Reception123 :) [22:20:31] Voidwalker: john added it with the change for view links [22:20:38] Hispano76: Reception123 will be asleep [22:20:50] yeah, but it's not used yet [22:20:58] JohnLewis: ^ [22:21:10] I'm guessing a mistake with git add [22:21:41] doesn't hurt being there, and I can guess at what it's for [22:24:39] Voidwalker: yeah mistake with git add :P [22:31:51] PROBLEM - mw2 Current Load on mw2 is WARNING: WARNING - load average: 6.15, 7.64, 7.82 [22:41:45] PROBLEM - mw2 Current Load on mw2 is CRITICAL: CRITICAL - load average: 8.86, 7.32, 7.39 [22:43:42]