[00:08:36] paladox: Reception123 https://feralarchives.miraheze.org/wiki/Main_Page Bug "report" https://meta.miraheze.org/wiki/Special:RequestWikiQueue/11597#mw-section-request [00:08:38] [ Feral Item Worth Wiki ] - feralarchives.miraheze.org [00:08:38] [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org [00:09:21] oh [00:13:03] !log remove wgDefaultSkin from feralarchiveswiki [00:13:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:13:26] hispano76 fixed [00:17:37] paladox: I get the same message, can you check it for me? [00:17:44] hispano76: clear cache [00:17:45] same? [00:17:48] works for me [00:18:58] !log un-closing feralarchiveswiki as it was inactive due to technical issues [00:19:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:19:24] Zppix it wasen't inactive due to technical issues otherwise it would have been reported by now :) [00:19:56] paladox: per the wiki request, " Our project got a bit delayed and now we don't seem to have site access!" [00:20:03] yeh [00:20:19] but it was never "inactive due to technical issues" [00:20:34] paladox: thats not how i interpret that [00:20:44] works :) [00:21:11] they said " Our project got a bit delayed and now we don't seem to have site access!" implying that they had other things to deal with which delayed using the wiki - hence why it wasn't reported till now [00:22:58] [[SRE]] [00:23:04] uh :( [00:23:10] .mh meta SRE [00:23:10] https://meta.miraheze.org/wiki/SRE [00:25:49] :) [02:10:16] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUm6 [02:10:18] [02miraheze/services] 07MirahezeSSLBot 0395894ce - BOT: Updating services config for wikis [03:20:17] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUYH [03:20:18] [02miraheze/services] 07MirahezeSSLBot 037e319ba - BOT: Updating services config for wikis [03:26:39] PROBLEM - cp8 Current Load on cp8 is WARNING: WARNING - load average: 0.87, 1.90, 1.37 [03:29:23] RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 1.32, 1.60, 1.33 [03:40:17] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUOB [03:40:19] [02miraheze/services] 07MirahezeSSLBot 03a179d1f - BOT: Updating services config for wikis [04:32:46] PROBLEM - wiki.8b8t.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.8b8t.com' expires in 15 day(s) (Tue 05 May 2020 04:28:03 GMT +0000). [05:21:24] !log reception@jobrunner1:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki kiddancerswiki /home/reception/kiddancers_pages_full.xml [05:21:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [11:44:45] JohnLewis: can we add a column to the mediawiki board for maint script runs? [11:45:21] Yeah [11:45:53] JohnLewis: I’ll do it now [11:45:54] Though -> Reception123 or someone more active inside MediaWiki tasks - I've not done anything with that project intentionally [11:47:58] {{done}} seems basic. [11:48:37] The whole project needs attention [11:49:32] Fair enough [11:54:27] Ok [11:54:30] And yeah, it does [11:55:42] Reception123: we’ve done well with cleaning phab so far [12:57:49] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[nagios-plugins] [13:03:27] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [13:08:51] RhinosF1: Reception123: Have you heard back from BrowserStack? [13:09:04] ZppixBot: we did [14:36:07] JohnLewis, Reception123: can we update whose on duty? [14:37:09] Afaik, when the person ends their duty they can change the topic with the next person [14:37:37] and it says "Duty is from a Monday-Monday (a standard normalised week)." so John is still on duty [14:38:01] there's no exact time at which the duty needs to be transferred just sometime tomorrow [14:38:33] PROBLEM - cp6 Current Load on cp6 is CRITICAL: CRITICAL - load average: 1.96, 6.52, 4.33 [14:39:20] PROBLEM - cloud1 Current Load on cloud1 is WARNING: WARNING - load average: 6.54, 20.76, 18.77 [14:39:27] Reception123: ok [14:40:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUE4 [14:40:20] [02miraheze/services] 07MirahezeSSLBot 0310cf6fc - BOT: Updating services config for wikis [14:41:39] PROBLEM - cp6 Current Load on cp6 is WARNING: WARNING - load average: 0.87, 3.91, 3.70 [14:42:20] RECOVERY - cloud1 Current Load on cloud1 is OK: OK - load average: 8.83, 15.96, 17.27 [14:44:42] RECOVERY - cp6 Current Load on cp6 is OK: OK - load average: 1.87, 2.92, 3.33 [14:47:47] PROBLEM - db6 MySQL on db6 is CRITICAL: Access denied for user 'icinga'@'51.89.160.138' (using password: YES) [14:51:47] Reception123: ^ that doesnt sound good [14:52:26] RhinosF1: nope [14:52:27] ^ paladox [14:53:07] db6 is not in use, secondly its perfectly ok [14:53:17] happening to db7 too [14:55:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUE5 [14:55:17] [02miraheze/puppet] 07paladox 03e7828ad - Update default-grants.sql.erb [14:56:18] RECOVERY - db6 MySQL on db6 is OK: Uptime: 766059 Threads: 11 Questions: 75896895 Slow queries: 23959 Opens: 15526 Flush tables: 1 Open tables: 2000 Queries per second avg: 99.074 [14:56:25] RECOVERY - db7 MySQL on db7 is OK: Uptime: 3607040 Threads: 28 Questions: 3389194140 Slow queries: 173992264 Opens: 1546869 Flush tables: 1 Open tables: 26592 Queries per second avg: 939.605 [14:57:37] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUEx [14:57:39] [02miraheze/puppet] 07paladox 034504f1a - db: Remove misc2 and misc4 from firewall [15:11:43] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JfUu8 [15:11:45] [02miraheze/dns] 07paladox 036881b62 - Add 8b8t.com to dns [15:13:54] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUuR [15:13:55] [02miraheze/ssl] 07paladox 03a447cf9 - Update wiki.8b8t.com.crt [15:13:55] paladox: thx for clarfication :) [15:17:47] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [15:22:33] RECOVERY - wiki.8b8t.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.8b8t.com' will expire on Sat 18 Jul 2020 14:13:36 GMT +0000. [15:30:18] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUuH [15:30:19] [02miraheze/services] 07MirahezeSSLBot 030dcc81f - BOT: Updating services config for wikis [16:25:30] [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+11/-0/±4] 13https://git.io/JfUgR [16:25:31] [02miraheze/puppet] 07paladox 035e2cf21 - Add openldap class From https://github.com/wikimedia/puppet/blob/dcec24a9c07e0d38f9586d4201798ad40f549c55/modules/profile/manifests/openldap.pp and https://github.com/wikimedia/puppet/tree/dcec24a9c07e0d38f9586d4201798ad40f549c55/modules/openldap Also add the class to test2 to test [16:25:32] [ puppet/openldap.pp at dcec24a9c07e0d38f9586d4201798ad40f549c55 · wikimedia/puppet · GitHub ] - github.com [16:25:32] [ puppet/modules/openldap at dcec24a9c07e0d38f9586d4201798ad40f549c55 · wikimedia/puppet · GitHub ] - github.com [16:25:33] [02miraheze/puppet] 07paladox 0373d2292 - Merge branch 'master' of github.com:miraheze/puppet [16:27:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JfUga [16:27:37] [02miraheze/puppet] 07paladox 038398fe9 - Merge branch 'master' of github.com:miraheze/puppet [16:28:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUgr [16:28:48] [02miraheze/puppet] 07paladox 0349c432e - openldap: Fix data types [16:30:06] PROBLEM - puppet2 Puppet on puppet2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [16:32:50] PROBLEM - test2 Puppet on test2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): Service[slapd] [16:32:55] RECOVERY - puppet2 Puppet on puppet2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:37:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfUgj [16:37:37] [02miraheze/puppet] 07paladox 03111245c - openldap: Fix part 2 [16:50:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfU24 [16:50:55] [02miraheze/puppet] 07paladox 03145578d - openldap: Fix part 3 [16:53:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JfU2z [16:53:23] [02miraheze/puppet] 07paladox 03f3a74ac - openldap: Fix part 4 [16:56:29] !log add openldap to ssl-cert group on test2 [16:56:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [16:58:34] RECOVERY - test2 Puppet on test2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:08:25] paladox: exciting [17:17:09] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 21.78, 20.94, 17.70 [17:20:02] PROBLEM - cloud2 Current Load on cloud2 is CRITICAL: CRITICAL - load average: 25.31, 21.62, 18.40 [17:25:46] PROBLEM - cloud2 Current Load on cloud2 is WARNING: WARNING - load average: 20.26, 21.65, 19.62 [17:28:39] RECOVERY - cloud2 Current Load on cloud2 is OK: OK - load average: 13.63, 19.73, 19.38 [17:36:12] paladox: meta is messed up. I just downloads a file called ‘miraheze’ when I go to meta.miraheze.org [17:36:44] no its not, it dosen't download a file for me at https://http://meta.miraheze.org [17:36:45] working again [17:36:47] * http://meta.miraheze.org [17:36:48] [ Meta ] - meta.miraheze.org [17:37:00] Happened for at least ~30s [17:37:45] This is the file it gave when it did happen https://usercontent.irccloud-cdn.com/file/oypIrk1N/Miraheze [17:37:45] [ Meta ] - usercontent.irccloud-cdn.com [17:37:59] paladox: working now, very strange [17:39:28] looks like a print, so i guess you clicked some button. [17:40:30] I litteraly typed meta then clicked the 1st link that showed [18:55:07] PROBLEM - cp8 Current Load on cp8 is CRITICAL: CRITICAL - load average: 2.02, 2.15, 1.40 [18:57:52] RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 0.69, 1.53, 1.28 [19:29:09] [02miraheze/ssl] 07Pix1234 created branch 03hibernuswiki 13https://git.io/JfUKB [19:29:10] [02ssl] 07Pix1234 created branch 03hibernuswiki - 13https://git.io/vxP9L [19:30:00] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03hibernuswiki [+0/-0/±1] 13https://git.io/JfUKE [19:30:01] [02miraheze/ssl] 07Pix1234 03734ffc8 - + wiki.hibernusmc.net [19:30:47] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03hibernuswiki [+1/-0/±0] 13https://git.io/JfUKz [19:30:49] [02miraheze/ssl] 07Pix1234 03f3b0b20 - Create wiki.hibernusmc.net.crt [19:31:02] [02ssl] 07Pix1234 opened pull request 03#288: + Hibernuswiki config - 13https://git.io/JfUK2 [19:31:10] [02ssl] 07Pix1234 closed pull request 03#288: + Hibernuswiki config - 13https://git.io/JfUK2 [19:31:11] [02miraheze/ssl] 07Pix1234 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JfUKV [19:31:13] [02miraheze/ssl] 07Pix1234 03fc2155f - + Hibernuswiki config (#288) * + wiki.hibernusmc.net * Create wiki.hibernusmc.net.crt [19:31:19] [02ssl] 07Pix1234 deleted branch 03hibernuswiki - 13https://git.io/vxP9L [19:31:21] [02miraheze/ssl] 07Pix1234 deleted branch 03hibernuswiki [19:34:00] [02mw-config] 07Hispano76 opened pull request 03#3029: [NOT APPROVE] Adding CommentStream settings in ManageWiki - 13https://git.io/JfUKr [19:35:59] [02mw-config] 07Reception123 commented on pull request 03#3029: [NOT APPROVE] Adding CommentStream settings in ManageWiki - 13https://git.io/JfUK1 [19:37:59] I just realized, LocalExtensions can't edit it, I guess what I wanted to add I ask in Phab? [19:38:43] hispano76: hm? There is no need for an edit in LocalExtensions if you add that to ManageWikiSettings [19:42:39] hum, Reception123 to add settings that would only be enabled in certain name spaces (such as wgCommentStreamsAllowedNamespaces for example) [19:42:49] Oh [19:44:25] [02mw-config] 07Hispano76 commented on pull request 03#3029: [NOT APPROVE] Adding CommentStream settings in ManageWiki - 13https://git.io/JfUK5 [19:59:57] [[SRE]] [20:00:02] !linkie on [20:00:02] 12Linkie12 03enabled03 [20:00:06] [[SRE]] [20:00:07] https://meta.miraheze.org/wiki/SRE [20:00:08] [ System administrators - Miraheze Meta ] - meta.miraheze.org [20:00:36] Reception123: Sometimes it just gets disabled and you have to use "!linkie on" [20:00:37] Examknow: thanks [20:00:49] np [20:02:43] what's up with -feed? [20:04:18] Voidwalker: dont know ill see if i have access to restart [20:04:50] I dont i thought i ran on jobrunner [20:04:56] paladox: can you restart -feed [20:05:05] Zppix: yeah the bot isn't on jobrunner [20:05:27] Reception123: i knew before we moved to OVH it was running on a server i had access too IIRC [20:05:53] maybe that was temporary but normally bots never ran on mw-admin accessible servers [20:06:15] Reception123: Voidwalker: it probably pinged out due to tindallgramswiki * [[Special:Log/upload]] upload * Darrencubitt * uploaded "[[File:Tindallgrams02-186.png]]": File uploaded with MsUpload [20:06:15] https://meta.miraheze.org/wiki/File:Tindallgrams02-186.png [20:06:17] [ File:Tindallgrams02-186.png - Miraheze Meta ] - meta.miraheze.org [20:06:39] im going to have to make it ignore SigmaBot aint i [20:07:06] * Reception123 tries to figure out where the bot is to restart it before paladox [20:07:11] (since he's on away) [20:07:34] it may be on misc Reception123 [20:07:39] I think it was Mon1 [20:07:40] it should just be a systemctl restart [20:07:50] its like mirahezercfeed or something [20:07:53] Reception123: mon1 think [20:08:00] Should be in puppet config [20:08:04] yeah [20:08:40] !log restarted RC bot [20:08:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [20:09:01] and it's back [20:10:13] Reception123: fwiw, https://github.com/miraheze/puppet/blob/73d2292dcaff669dafd0bacb6529bd46639bb9f8/manifests/site.pp#L87 [20:10:13] [ puppet/site.pp at 73d2292dcaff669dafd0bacb6529bd46639bb9f8 · miraheze/puppet · GitHub ] - github.com [20:14:32] why the hell is it not letting me do it [20:16:09] tf [20:20:37] Hello jess! If you have any questions, feel free to ask and someone should answer soon. [20:24:05] Zppix: did I not ban that range a while back? [20:24:13] RhinosF1: i figured it out [20:24:21] Zppix: what? [20:24:35] dont worry about it, im just going a bit nuts [20:25:06] Zppix: You probably should [20:25:14] Zppix: I’m getting a dB error trying to sort the block on wiki (per Reception123 pm) [20:25:20] See 712db7bc0ea033d5d0a929f0 on mw5 [20:25:25] RhinosF1: give me a sec [20:25:55] Examknow: we’ve all gone nuts [20:26:04] I see that [20:26:13] TIL: you cant do sudo -us you have do it like sudo -su [20:26:23] Zppix: do you know that you are still opped? :P [20:26:51] yes im aware im still handling something [20:28:02] RhinosF1: found the error let me see what i can do [20:28:16] error log message that is [20:59:54] paladox: Ignore that error Zppix just told you that I found, it's a good thing [21:00:16] huh? [21:00:38] paladox: Did Zppix just tell you about an exception I found on BrowserStack? [21:00:57] yes [21:01:05] how is an error a good thing :P [21:01:34] Zppix: I was trying to prove that supporting these browsers isn't worth it [21:02:04] Now doing the android tests and it looks like Grade Cs don't even connect to us. I think TLS version issue. [21:03:56] You proved nothing [21:04:00] Yeah, we work on devices that can access us so lucky us [21:04:36] paladox: I mainly wanted to see when we start working and if it's on the Grade A ones, which is right [21:04:49] we aren't even accessible on Grade C Android [21:05:09] Or some Grade As from my tests [21:13:15] PROBLEM - cp8 Current Load on cp8 is WARNING: WARNING - load average: 0.95, 1.84, 1.48 [21:13:27] * RhinosF1 has done his testing [21:14:39] paladox: Also, I proved that mediawiki/we are providing support for a device that can't access the site. [21:14:56] We do not provide support for IE [21:15:20] at least i won't, i cannot speak for others on the team though [21:15:58] RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 0.56, 1.40, 1.37 [21:16:03] so "we are providing support for a device that can't access the site" is misleading unless someone said we were? [21:16:09] afaik IE isnt supported by microsoft anymore [21:16:39] paladox: mediawiki/we - it's on the browser matrix for Grade C. I want it gone as well. [21:16:53] what is "we" [21:17:25] The mediawiki developers and developers of extensions as a whole [21:17:48] I can't even get on enwp [21:17:56] i think you miss the point [21:18:02] IE is not supported [21:18:04] period [21:18:07] Well i don't maintain it. And also our extensions use OOUI so we don't actually provide the support. [21:19:00] You can't even get on the site from the android 2 ones [21:19:06] enwp or miraheze [21:19:10] IE [21:19:11] is [21:19:12] and will [21:19:13] not [21:19:15] be supported [21:19:15] android 2 is very old [21:19:18] Zppix: By mediawiki, it is unfortunately [21:19:31] paladox: I know, I'll be glad if they drop grade c support [21:19:42] we dont control that [21:19:51] go bug wikimedia [21:19:56] ^ [21:19:57] no, but there is a ticket that I can give opinions on [21:20:09] I am doing this to have evidence to add to it [21:20:38] why do you need evidence? its pretty obvious that a slim amout of users are still using IE or android v2. [21:20:47] Secondly wikimedia would have gathered the evidence. [21:21:00] why should anyone support anicent tech [21:21:24] its like if i complained because i cannot use miraheze on a MS DOS [21:21:25] paladox: It's a discussion and turning into RfC, baseless +1's don't help [21:21:35] Zppix: they shouldn't [21:21:58] Then why complain about android 2 and IE [21:22:03] its the same thing [21:22:36] Zppix: I want them gone [21:22:53] [[WP:SOFIXIT]] [21:22:53] https://meta.miraheze.org/wiki/WP:SOFIXIT [21:23:11] I have commented on both tickets with my findings [21:23:40] so let me get this straight you've talked to the PROPER people and then come expect us to do something? [21:23:41] Ok, then why did you waste our time looking for exceptions caused by a browser such as IE? [21:24:33] I simply wanted to know what the trace said [21:24:52] I don't want you to do anything about it [21:24:59] This discussion is over [21:25:04] please move on to a different topic [21:26:29] * RhinosF1 sleeping now [21:30:12] PROBLEM - cp8 Current Load on cp8 is WARNING: WARNING - load average: 1.17, 1.78, 1.68 [21:31:34] * hispano76 greetings [21:31:42] hi [21:32:51] RECOVERY - cp8 Current Load on cp8 is OK: OK - load average: 1.27, 1.55, 1.60 [23:32:57] * sario waves goodbye [23:53:28] PROBLEM - housing.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds