[00:02:10] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeFJG [00:02:11] [02miraheze/mediawiki] 07paladox 037c993f6 - Update pivot 0b6882ad2fe330b94ef2ca0988042afef23f2147 [00:03:16] JohnLewis: 4748419885d446cb53fbf846 on create wiki edit [00:04:02] like some subdomains are failing [00:04:04] JohnLewis, paladox: create wiki is down [00:04:08] ok [00:04:14] paladox: not ok [00:04:25] Can you get it fixed as it’s a 1.34 issue [00:04:29] i'm responding so that you know that i've got the message [00:04:30] yes [00:05:16] if only for a few seconds, it'll be some https or certificed/certificado? [00:05:42] 2019-12-23 00:02:40 mw1.miraheze.org metawiki: [4748419885d446cb53fbf846] /wiki/Special:RequestWikiEdit/10274 UnexpectedValueException from line 462 of /srv/mediawiki/w/includes/libs/rdbms/loadbalancer/LoadBalancer.php: Invalid server index index #DB_SLAVE [00:06:50] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 11 failures. Last run 5 minutes ago with 11 failures. Failed resources (up to 3 shown): Service[ufw],Service[prometheus-node-exporter],Service[nagios-nrpe-server],Package[openssh-client] [00:06:52] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFJn [00:06:54] [02miraheze/CreateWiki] 07paladox 03fdb8555 - DB_SLAVE -> DB_REPLICA [00:07:26] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeFJc [00:07:27] [02miraheze/mediawiki] 07paladox 036e56dce - Update CW [00:10:08] PROBLEM - mw3 Current Load on mw3 is WARNING: WARNING - load average: 7.46, 7.25, 6.90 [00:12:12] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [00:12:58] PROBLEM - mw3 Current Load on mw3 is CRITICAL: CRITICAL - load average: 8.03, 7.58, 7.14 [00:15:46] RECOVERY - mw3 Current Load on mw3 is OK: OK - load average: 4.82, 5.79, 6.48 [00:15:53] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFJW [00:15:55] [02miraheze/MirahezeMagic] 07paladox 034a748a3 - DB_SLAVE -> DB_REPLICA [00:16:41] [02miraheze/MirahezeMagic] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFJl [00:16:42] [02miraheze/MirahezeMagic] 07paladox 03313aab3 - DB_SLAVE -> DB_REPLICA [00:18:10] Is this hrznwiki a new wiki? [00:25:33] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 3 minutes ago with 9 failures. Failed resources (up to 3 shown): Package[openssh-server],Service[ssh],Package[exim4],Service[postfix] [00:25:35] yes [00:25:37] it's mine [00:25:57] paladox, [00:26:05] thanks [00:26:45] !log recreating hrznwiki. [00:26:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:28:47] !log MariaDB [mhglobal]> delete from cw_wikis where wiki_dbname = 'hrznwiki'; [00:28:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [00:29:10] paladox: reason you're not using WikiManager? [00:29:17] i tried that [00:29:23] apparently it didn't remove it from there [00:29:26] heh, did hrznwiki exist previously? [00:29:33] paladox: it should... [00:29:35] half way exists [00:29:42] it didn't have the page... or user table [00:29:43] strange [00:30:00] what server did you run it on? [00:30:01] now i got "[cb1c94c7fb50003ff01cc87a] 2019-12-23 00:29:51: Fatal exception of type "Wikimedia\Rdbms\DBUnexpectedError"" [00:30:05] JohnLewis mw1 [00:30:55] JohnLewis 2019-12-23 00:29:51 mw3.miraheze.org metawiki: [cb1c94c7fb50003ff01cc87a] /wiki/Special:RequestWikiQueue/10274 Wikimedia\Rdbms\DBUnexpectedError from line 444 of /srv/mediawiki/w/includes/libs/rdbms/database/DBConnRef.php: Database selection is disallowed to enable reuse. [00:31:41] Okay, wiki creation is dead for now then [00:33:14] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:33:39] this should have been picked up pre-release and either myself or SPF told [00:34:14] 1.34 giving you guys a headache? [00:35:36] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±2] 13https://git.io/JeFJw [00:35:37] [02miraheze/mediawiki] 07paladox 0314b4f74 - Update foreground and pivot [00:39:41] PROBLEM - db4 Current Load on db4 is WARNING: WARNING - load average: 6.81, 7.98, 4.97 [00:42:19] RECOVERY - db4 Current Load on db4 is OK: OK - load average: 2.78, 5.73, 4.59 [00:43:24] [02mw-config] 07Hispano76 opened pull request 03#2831: Add $wgMaxCredits on ManageWiki - 13https://git.io/JeFJ6 [00:43:49] [02mw-config] 07Hispano76 edited pull request 03#2831: Add $wgMaxCredits on ManageWiki per request T5011 - 13https://git.io/JeFJ6 [00:46:48] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JeFJM [00:46:49] [02miraheze/CreateWiki] 07paladox 03e953567 - Convert wfGetDB() calls to using getConnectionRef() [00:46:51] [02CreateWiki] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vpJTL [00:46:52] [02CreateWiki] 07paladox opened pull request 03#126: Convert wfGetDB() calls to using getConnectionRef() - 13https://git.io/JeFJy [00:47:13] JohnLewis ^? [00:47:38] and the difference between that and wfGetDB is..? [00:48:12] [02miraheze/CreateWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFJ7 [00:48:14] [02miraheze/CreateWiki] 07JohnFLewis 037806792 - create temporary db connection for new wikis [00:51:39] JohnLewis ohh [00:51:45] that method returns the same... [00:51:50] (my change i mean) [00:51:51] Indeed [00:52:36] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures [00:56:35] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFUT [00:56:37] [02miraheze/mw-config] 07paladox 03ff8a72c - Rename GlobalBlocking sql schema [00:58:24] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFUk [00:58:26] [02miraheze/mw-config] 07paladox 034efa3a7 - Rename OAuth schema [00:58:59] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFUt [00:59:01] [02miraheze/mw-config] 07paladox 03aeb9779 - fix typo [00:59:04] why does it disallow database selection if you reuse a connection? some async magic? [00:59:47] no idea [00:59:58] JohnLewis works \o/ though it dosen't seem to have notified in -feed [01:00:05] > stares at the lib [01:01:02] paladox: you used S:CW? [01:01:05] yup [01:01:09] proxied through test1 [01:01:21] i created https://meta.miraheze.org/wiki/Special:RequestWikiQueue/10274 [01:01:22] [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org [01:01:44] well it RC'd [01:02:05] ohhh [01:02:14] that's right test1 dosen't RC [01:02:27] ? [01:03:06] JohnLewis test1 never notifies -feed [01:03:20] the server itself doesn't? [01:03:40] yeh, backend. I've never seen it notify -feed [01:03:56] firewall probably [01:04:38] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 3 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22] [01:04:58] ok [01:06:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFUZ [01:06:03] [02miraheze/puppet] 07paladox 03364e3cb - irc: Add test1 to firewall for port 5070 [01:06:12] JohnLewis ^ [01:06:32] I mean it's not really needed but ok [01:07:53] do wiki bureaucrats have oversighters? [01:09:53] !log MariaDB [mhglobal]> delete from cw_wikis where wiki_dbname = 'howtimhardingreplacedstevienicholsonwiki'; [01:10:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:10:00] !log MariaDB [mhglobal]> drop database howtimhardingreplacedstevienicholsonwiki; [01:10:05] !log recreating howtimhardingreplacedstevienicholsonwiki [01:10:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:10:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:10:32] paladox, must mention > https://i.cwlf.uk/W24bZ [01:10:48] looks like I'm in administrators + bureaucrats, but alas [01:10:59] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeFUC [01:11:01] [02miraheze/mediawiki] 07paladox 0312749ad - Update CW [01:13:58] c^ hmm [01:14:09] logged out however https://i.cwlf.uk/lx9EL [01:14:22] Yeah, take a look at https://hrzn.miraheze.org/wiki/Special:ListGroupRights [01:14:23] [ User group rights - Horizon Studio ] - hrzn.miraheze.org [01:14:23] I can edit the main page when logged out, not in .-. [01:14:53] :O [01:15:02] let me recreate that wiki i guess [01:15:07] hah [01:15:08] including droping it from mwn and mwp [01:15:11] oh [01:15:21] love it when the cyber pixies ruin everything [01:15:22] nope you have the groups so ignore my oh [01:15:27] lol [01:16:17] WikiManger does those steps [01:16:45] you should marry it then. [01:18:07] c^ try now (may take a minute) [01:18:16] JohnLewis yup, done it through mw :) [01:18:18] \o/ [01:18:21] err wm [01:18:27] good [01:18:38] success [01:18:48] !log $wm = new WikiManager( 'hrznwiki' ); $wm->delete( true ); (through eval) [01:18:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [01:21:36] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [01:26:05] paladox, I'm getting permission issues every few refreshes https://i.cwlf.uk/J7Vlj [01:26:11] something taking a while to propogate? [01:26:25] Are you still logged in? [01:26:29] aye [01:26:42] https://i.cwlf.uk/Z4jJw [01:26:47] https://i.cwlf.uk/WnQXj [01:26:51] that's two refreshes ^ [01:27:00] both served by cp4 [01:28:53] c^ try logging out and back in [01:29:12] same thing [01:29:17] I'll try another browser [01:29:22] ok [01:29:51] this is a fresh browser, not logged in [01:29:52] <+paladox> ok [01:29:58] oops, wrong paste https://i.cwlf.uk/5BwKn [01:30:08] looks like anon edit perms on main again [01:30:22] Yeh, that should work. [01:30:28] unless your wiki is private [01:30:37] good, so expected [01:30:50] same intermittent permissions on a second browser [01:30:58] I'll try from a different origin IP [01:31:06] .. on a different network [01:33:09] https://i.cwlf.uk/KoXZJ https://i.cwlf.uk/yDglL [01:33:19] same thing from a different device/network [01:33:27] hmm [01:34:26] some load balancing thing I imagine [01:34:35] i doin't think so [01:34:49] as it worked for (so my global perms work) [01:34:55] it just seems your local perms doin't [01:36:31] https://i.cwlf.uk/8nwN5 this is the one which works https://i.cwlf.uk/ORbJ0 this is the one that doesn't [01:36:50] debian10 box is fine, debian9 box isn't [01:38:20] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±2] 13https://git.io/JeFUD [01:38:22] [02miraheze/mediawiki] 07paladox 039fcc927 - Update foreground and pivot [01:38:42] oh [01:38:42] mw1 [01:38:48] unfortunately your backends don't attach any additional headers, but maybe that varnish header can help you find a log [01:40:37] funnily enough, and probably a red herring, dev tools 'failed to load response data' on the page loads without permissions and is perfectly fine with [01:40:55] 2019-12-23 01:35:35 mw1.miraheze.org hrznwiki: [395ea151f129d7b6e5548632] /wiki/Main_Page ErrorException from line 66 of /srv/mediawiki/w/extensions/ManageWiki/includes/ManageWikiHooks.php: PHP Warning: Invalid argument supplied for foreach() [01:41:07] nice, a log [01:41:35] i get that on mw2 though too [01:41:50] oh, how about 3/4 [01:42:25] more the question, which one is running debian9? [01:42:48] gotta go mobile to do some 2am grocery shopping ~~ switching devices brb [01:42:51] c^ can you try now? :) [01:42:53] yes [01:42:56] you just caught me [01:43:04] 2am grocery shop? :P [01:43:16] which country are you in? [01:43:19] seems like it's working [01:43:20] UK [01:43:25] same [01:43:29] tescos? [01:43:30] I live in Edinburgh right now [01:43:34] Asda x.x [01:43:45] oh lol the other side of the UK then me :P [01:43:50] c^ lol [01:43:59] asda open at 2am?!?! [01:44:00] I'm regularly in LON/BRS/NCL [01:44:04] yeah, 24 hours boiis [01:44:13] i live near london (around 1-2hrs) [01:44:25] loads of places open 24 hours tbf [01:44:26] c^ so your issue is fixed now [01:44:35] I thought they closed around now. [01:44:50] nah [01:45:08] https://storelocator.asda.com/store/leith [01:45:09] [ Asda Leith Superstore - opening times & facilities ] - storelocator.asda.com [01:45:11] decent xmas times [01:45:15] I feel sorry for the staff [01:45:47] Yeh due to the contracts they were forced to get :( [01:45:55] I also feel sorry for the topless staff on that page who allowed themselves to be photographed for promotional material [01:46:19] lol [01:46:21] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 4 minutes ago with 10 failures. Failed resources (up to 3 shown): Exec[ufw-default-deny],Service[ufw],Service[prometheus-node-exporter],Service[nagios-nrpe-server] [01:46:59] asda still have people on 0 hour contracts afaik [01:47:16] fortunately I work for Aviva [01:47:25] most companies do, it's not necessarily a bad thing [01:47:37] it is :P [01:47:38] *if they supply hours, I agree [01:47:39] Banning of zero-hour contracts is not something I support [01:47:54] There are people who prefer them and some who require them [01:47:56] i do support banning them [01:47:59] agree, but regulating companies who abuse zero-hour contracts, I absolutely support [01:48:07] Regulation absolutely [01:48:11] Banning, no :) [01:48:16] ^ [01:48:21] #captalism [01:48:39] #socialism [01:48:56] #workersrighttochoose0hours [01:48:56] #communism, let's go full spectrum while we're at it [01:49:18] JohnLewis they doin't really have the right to choose it... [01:49:36] c^ lets not :P [01:49:36] Some do, and some choose it [01:49:44] i hate communism but love socialism [01:50:23] speaking of spectrums, do we have a way to export/import all of these [01:50:23] For some, banning zero hours might make it so they're not able to work [01:50:23] <+paladox> i hate communism but love socialism [01:50:30] damn it clipboard [01:50:34] https://en.wikipedia.org/wiki/Template:Done/See_also [01:50:34] [WIKIPEDIA] Template:Done/See also | "..." [01:50:39] that.. that is what I meant to paste [01:50:51] heh [01:51:37] I'm genually surprised anyone goes shopping at 2am :P [01:51:52] .-. I need to travel for christmas week tomorrow morning [01:52:05] so.. I need to buy cat food and stuff for the cat sitter [01:52:32] and I've been a lazy fuck all day buying all of my xmas gifts at the last minute, but forgot about the other warm bodies in my home [01:53:09] heh [01:53:17] just prime it :P [01:53:22] everyone does it (lol) [01:53:41] I primed something for myself in a drunken mess the night before last [01:53:56] one of those LED panel tile set things [01:54:02] why. who knows [01:55:15] I'm going to sit down tomorrow and go through template.miraheze.com.. it's still ass-slow for me though [01:55:26] lol [01:55:29] any guesses guys? barely getting page loads in under 10 seconds [01:55:52] yes, we've been having that issue for months. [01:56:11] other wikis seem to be fine for me, it's just this one [01:56:12] Now that we are incorporated, we are comming up with a plan to improve the reliability and increase capcity. [01:56:39] sounds sensible, become scalable and all that jazz [01:56:41] c^ someone typed it wrong :P [01:56:41] https://template.miraheze.org [01:57:02] s/com/org/g [01:57:02] c^ meant to say: sounds sensible, beorge scalable and all that jazz [01:57:15] c^ since 2018 we've grown quite heavily it appears (though i guess the word heavily depends on what you define as heavy) [01:57:23] [ Template Wiki, a repository of MediaWiki templates. ] - template.miraheze.org [01:57:25] .-. thanks zppixbot, I appreciate you [01:57:43] * paladox has a couple of asda in his town [01:57:54] Though i prefer tescos or sainsbury's [01:58:08] if I can be so demure, I prefer wholefoods. [01:58:13] * paladox has a local tesco and then another larger tesco up the road [01:58:13] and waitrose [01:58:18] heh [01:58:23] waitrose is expensive :P [01:58:29] that's why I love it [01:58:31] also that's right by the garden centre for me [01:58:34] I can laugh at the prices [01:58:37] lol [01:59:38] M&S foods can be too [02:00:52] [02mw-config] 07Hispano76 opened pull request 03#2832: add ExtraSignatureNamespaces on ManageWiki - 13https://git.io/JeFTq [02:01:18] c^ heh Leith is only 5hrs and 59 minutes which is more 8 hrs [02:01:20] [02mw-config] 07Hispano76 edited pull request 03#2832: add ExtraSignatureNamespaces on ManageWiki - 13https://git.io/JeFTq [02:01:55] but it's not just food, it's M&S food [02:02:16] lol [02:02:22] premium quality :P [02:03:26] Milton Keynes shopping centre is HUGE [02:04:14] aye, we're getting a new one soon, they've been building it for almost 3 years [02:04:21] that thing is an absolute unit [02:04:58] heh [02:05:09] c^ but when i say huge, it's very very huge. [02:05:16] lots of walking, lots of shops [02:05:25] bigger then my towns :P [02:05:42] and a new shopping centre opened outside of town which is dragging buisness from my town. [02:06:08] Why? Well because the town looks old! Is not attracting people. [02:16:42] PROBLEM - mw3 MediaWiki Rendering on mw3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:18:03] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 2 backends are down. mw1 mw3 [02:19:06] RECOVERY - mw3 MediaWiki Rendering on mw3 is OK: HTTP OK: HTTP/1.1 200 OK - 18592 bytes in 0.906 second response time [02:20:22] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 6 backends are healthy [02:21:36] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [02:36:43] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 9 failures. Last run 5 minutes ago with 9 failures. Failed resources (up to 3 shown): Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22],Exec[ufw-allow-tcp-from-any-to-any-port-5666] [02:42:02] !log 127.0.0.1:6379> CONFIG SET timeout 0 [02:42:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [02:49:30] Does the lets encrypt stuff take a while paladox? [02:50:00] nope [02:50:12] as long as your domain points at us, we can generate a cert [02:53:22] c^ see your back from asda already :P [03:03:14] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:35:26] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 10 failures. Last run 3 minutes ago with 10 failures. Failed resources (up to 3 shown): Service[bacula-fd],Service[salt-minion],Exec[ufw-logging-low],Exec[ufw-allow-tcp-from-any-to-any-port-22] [04:02:11] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures [04:13:51] paladox, that was on the move, now I'm back [04:14:11] reason I wondered, domain is pointing at you :) https://wiki.hrznstudio.com/ [04:14:51] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 17 failures. Last run 3 minutes ago with 17 failures. Failed resources (up to 3 shown): Service[prometheus-node-exporter],Service[nagios-nrpe-server],Package[openssh-client],Package[openssh-server] [04:22:03] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [04:34:26] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 6 failures. Last run 2 minutes ago with 6 failures. Failed resources (up to 3 shown): Service[prometheus-node-exporter],Service[nagios-nrpe-server],Package[openssh-client],Package[openssh-server] [04:49:51] PROBLEM - cp3 Disk Space on cp3 is CRITICAL: DISK CRITICAL - free space: / 1445 MB (5% inode=94%); [05:00:07] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFLu [05:00:09] [02miraheze/services] 07MirahezeSSLBot 0389b255d - BOT: Updating services config for wikis [05:03:27] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:16:01] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 4 minutes ago with 3 failures. Failed resources (up to 3 shown): Service[puppetserver],Exec[ops_ensure_members],Exec[puppet-users_ensure_members] [05:33:15] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:45:35] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 4 minutes ago with 5 failures. Failed resources (up to 3 shown): Package[openssh-client],Package[openssh-server],Service[ssh],Package[exim4] [06:02:42] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:26:28] PROBLEM - cp3 Disk Space on cp3 is WARNING: DISK WARNING - free space: / 2449 MB (10% inode=94%); [08:35:07] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFYB [08:35:09] [02miraheze/services] 07MirahezeSSLBot 03020a732 - BOT: Updating services config for wikis [09:38:11] paladox: Will be going out at 11:45 for half an hour but ping me when you're around [10:17:40] [02mediawiki] 07samwilson opened pull request 03#129: Update Genealogy extension - 13https://git.io/JeFGQ [10:18:52] Reception123: ^ [10:22:07] [02mediawiki] 07Reception123 closed pull request 03#129: Update Genealogy extension - 13https://git.io/JeFGQ [10:22:08] [02miraheze/mediawiki] 07Reception123 pushed 032 commits to 03REL1_33 [+0/-0/±2] 13https://git.io/JeFGp [10:22:10] [02miraheze/mediawiki] 07samwilson 03f04e18f - Update Genealogy extension [10:22:11] [02miraheze/mediawiki] 07Reception123 03f186877 - Merge pull request #129 from samwilson/update-genealogy Update Genealogy extension [10:25:20] [02mediawiki] 07samwilson opened pull request 03#130: Update Genealogy extension to 1.9.2 - 13https://git.io/JeFZe [10:25:47] [02mediawiki] 07Reception123 closed pull request 03#130: Update Genealogy extension to 1.9.2 - 13https://git.io/JeFZe [10:25:49] [02miraheze/mediawiki] 07Reception123 pushed 032 commits to 03REL1_34 [+0/-0/±2] 13https://git.io/JeFZv [10:25:50] [02miraheze/mediawiki] 07samwilson 03226aafc - Update Genealogy extension to 1.9.2 [10:25:52] [02miraheze/mediawiki] 07Reception123 0356b99cc - Merge pull request #130 from samwilson/update-genealogy-34 Update Genealogy extension to 1.9.2 [10:26:07] Reception123: should 1_33 be maintained now? [10:27:12] ah, didn't realize it was 1.33, I thought it was just an extra update [10:27:29] SantaRhino: and no I think the policy is to remove the REL1_33 branch [10:28:00] Reception123: wait for paladox to come so we can be sure we've unbroke everything first [10:28:07] yes [10:33:03] samwilson: thanks for sorting all that :) [10:36:31] .at 11:20 get ready to leave house [10:36:31] SantaRhino: Okay, I will set the reminder for: 2019-12-23 - 11:19:59UTC [11:19:59] SantaRhino: get ready to leave house [12:36:09] SantaRhino hi? [12:56:20] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±2] 13https://git.io/JeF8a [12:56:22] [02miraheze/mediawiki] 07paladox 0374bd8bd - Update Translate [12:57:53] !log rebuild lc on mw* and lizard* [12:58:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [13:54:47] Reception123: did you know that a locked account will be merged if the assign edits if a local account exists? it should be local anyway rather than global [13:55:28] paladox, Reception123: anyone around to do an import? [14:06:08] Zppix, paladox, Reception123: https://phabricator.miraheze.org/T5013 [14:06:09] [ ⚓ T5013 Import for rhinodiarywiki ] - phabricator.miraheze.org [14:06:25] ok, i'll do it in a bit [14:08:02] paladox: thx [14:39:09] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeFRD [14:39:11] [02miraheze/mediawiki] 07paladox 038a32e36 - Update SP [14:44:04] !log rebuild lc on mw* and lizard* [14:44:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [14:53:19] !log starting upload for rhinodiarywiki - T5013 (mw1) [14:53:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [14:58:17] paladox: ping me when done, should be small [14:58:24] SantaRhino it's done. [15:05:07] c^ would you be able to create a task to add the domain to your wiki please? [15:05:08] paladox: thx [15:07:24] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeF0r [15:07:26] [02miraheze/CreateWiki] 07translatewiki 037a19379 - Localisation updates from https://translatewiki.net. [15:07:26] [ Main page - translatewiki.net ] - translatewiki.net. [15:07:27] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±5] 13https://git.io/JeF0o [15:07:29] [02miraheze/ManageWiki] 07translatewiki 03d1eae98 - Localisation updates from https://translatewiki.net. [15:07:29] [ Main page - translatewiki.net ] - translatewiki.net. [15:10:40] paladox: and all working, interwiki transclusion is poor but my wiki uses a mix of it and imported pages from meta on the homepage where I've got the comments from users about my health [15:14:01] paladox: can you edit commit for https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Flow/+/560392/ to show https://phabricator.wikimedia.org/T232351 [15:14:05] [ Gerrit Code Review ] - gerrit.wikimedia.org [15:14:06] [ ⚓ T232351 Increase data limit for 'ref_src_wiki' column ] - phabricator.wikimedia.org [15:17:15] paladox: that lovely edit commit message button on gerrit does absolutely nothing, can you have a look seen as you have a clue about gerrit? [15:18:08] paladox: actually, I got as far as an error now: "Server error: modifying commit message not permitted" [15:18:32] Yeh your not allowed to edit other users commits [15:18:49] paladox: okay, can you edit your own then? [15:20:24] yes, no need to constantly ping me :) [15:20:58] thanks [15:21:12] * SantaRhino should learn gerrit one day [15:21:28] * hispano76 greeting [15:25:28] hi [15:28:13] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFEB [15:28:15] [02miraheze/mw-config] 07paladox 033d2b1f0 - Make $wgApexLogo use $wgLogo [16:00:08] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFuR [16:00:09] [02miraheze/services] 07MirahezeSSLBot 03bfb598e - BOT: Updating services config for wikis [16:44:19] PROBLEM - cp3 Stunnel Http for mw3 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [16:45:25] PROBLEM - db5 Current Load on db5 is CRITICAL: CRITICAL - load average: 4.68, 3.85, 2.45 [16:47:00] RECOVERY - cp3 Stunnel Http for mw3 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 24662 bytes in 0.937 second response time [17:31:51] paladox: aye will do [17:32:02] thanks! [17:32:14] i’m in nandos, so now is as good of a time as any [17:34:09] lol [17:34:32] c^ i've only been there once for the unlimited drinks in london :P [17:34:41] since going around london in the heat can make your thirsty! [17:34:58] i find soda just makes me feel thirstier [17:35:04] heh [17:44:24] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://git.io/JeFgK [17:44:25] [02miraheze/ssl] 07paladox 037a99848 - Add wiki.hrznstudio.com ssl certificate [17:44:27] [02ssl] 07paladox created branch 03paladox-patch-2 - 13https://git.io/vxP9L [17:44:28] [02ssl] 07paladox opened pull request 03#249: Add wiki.hrznstudio.com ssl certificate - 13https://git.io/JeFg6 [17:45:04] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-0/±0] 13https://git.io/JeFgX [17:45:05] [02miraheze/ssl] 07paladox 037741e03 - Create wiki.hrznstudio.com.crt [17:45:07] [02ssl] 07paladox synchronize pull request 03#249: Add wiki.hrznstudio.com ssl certificate - 13https://git.io/JeFg6 [17:45:38] [02ssl] 07paladox edited pull request 03#249: Add wiki.hrznstudio.com ssl certificate - 13https://git.io/JeFg6 [17:45:42] [02ssl] 07paladox closed pull request 03#249: Add wiki.hrznstudio.com ssl certificate - 13https://git.io/JeFg6 [17:45:44] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JeFgM [17:45:45] [02miraheze/ssl] 07paladox 03c265502 - Add wiki.hrznstudio.com ssl certificate (#249) * Add wiki.hrznstudio.com ssl certificate * Create wiki.hrznstudio.com.crt [17:46:59] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-2 [17:46:59] [02ssl] 07paladox deleted branch 03paladox-patch-2 - 13https://git.io/vxP9L [17:47:00] c^ done [17:57:27] JohnLewis: can you turn replace text on for meta [17:57:37] Voidwalker, PuppyKun: ^ [18:01:27] log MariaDB [hrznwiki]> INSERT INTO `content_models` (`model_id`,`model_name`) VALUES (1, 'wikitext'); [18:01:30] !log MariaDB [hrznwiki]> INSERT INTO `content_models` (`model_id`,`model_name`) VALUES (1, 'wikitext'); [18:01:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:02:02] SantaRhino why the mass ping? [18:03:35] !log MariaDB [hrznwiki]> INSERT INTO `content_models` (`model_id`,`model_name`) VALUES (3, 'javascript'); [18:03:40] !log MariaDB [hrznwiki]> INSERT INTO `content_models` (`model_id`,`model_name`) VALUES (2, 'css'); [18:03:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:03:47] !log MariaDB [hrznwiki]> INSERT INTO `content_models` (`model_id`,`model_name`) VALUES (5, 'json'); [18:03:51] !log MariaDB [hrznwiki]> INSERT INTO `content_models` (`model_id`,`model_name`) VALUES (4, 'Scribunto'); [18:03:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:04:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:04:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:04:32] SantaRhino: what do you need it for? [18:05:41] It dosen't work with meta as meta has compression mode enabled i think. [18:06:07] meta is compressed? [18:07:33] ohh [18:07:34] nvm [18:07:37] I thought it was [18:09:08] JohnLewis: automating replaces the role titles [18:09:40] SantaRhino: done [18:10:07] Thx [18:11:25] First time I've actually used ManageWiki in a non-technical capacity - it actually is pretty useful :P [18:11:45] Hopefully I find to give it and CW the love it needs over this Christmas period [18:12:50] JohnLewis: pls do [18:32:47] my bad [18:34:13] I'll have to undo the mentions on archive/old pages, as it was Operations at that time [18:34:27] Reception123: I’m going to do it shortly [18:34:32] SantaRhino: ok, thanks [18:34:37] PROBLEM - mw3 Puppet on mw3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:34:47] SantaRhino: anything that is not a guide for now should be changed back to Operations [18:34:57] PROBLEM - misc4 Puppet on misc4 is CRITICAL: CRITICAL: Puppet has 16 failures. Last run 3 minutes ago with 16 failures. Failed resources (up to 3 shown) [18:34:57] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 7 failures. Last run 3 minutes ago with 7 failures. Failed resources (up to 3 shown) [18:35:10] PROBLEM - cp4 Puppet on cp4 is CRITICAL: CRITICAL: Puppet has 406 failures. Last run 3 minutes ago with 406 failures. Failed resources (up to 3 shown) [18:35:17] PROBLEM - mw2 Puppet on mw2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:35:45] PROBLEM - lizardfs6 Puppet on lizardfs6 is CRITICAL: CRITICAL: Puppet has 423 failures. Last run 4 minutes ago with 423 failures. Failed resources (up to 3 shown) [18:35:46] PROBLEM - misc1 Puppet on misc1 is CRITICAL: CRITICAL: Puppet has 46 failures. Last run 4 minutes ago with 46 failures. Failed resources (up to 3 shown) [18:36:04] JohnLewis: done [18:36:11] PROBLEM - bacula1 Puppet on bacula1 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 4 minutes ago with 3 failures. Failed resources (up to 3 shown) [18:36:50] PROBLEM - misc3 Puppet on misc3 is CRITICAL: CRITICAL: Puppet has 13 failures. Last run 5 minutes ago with 13 failures. Failed resources (up to 3 shown) [18:36:52] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 6 failures. Last run 5 minutes ago with 6 failures. Failed resources (up to 3 shown) [18:36:53] PROBLEM - db4 Puppet on db4 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 5 minutes ago with 8 failures. Failed resources (up to 3 shown) [18:36:59] PROBLEM - mw1 Puppet on mw1 is CRITICAL: CRITICAL: Puppet has 424 failures. Last run 5 minutes ago with 424 failures. Failed resources (up to 3 shown) [18:37:06] PROBLEM - misc2 Puppet on misc2 is CRITICAL: CRITICAL: Puppet has 15 failures. Last run 5 minutes ago with 15 failures. Failed resources (up to 3 shown) [18:37:07] PROBLEM - test1 Puppet on test1 is CRITICAL: CRITICAL: Puppet has 432 failures. Last run 5 minutes ago with 432 failures. Failed resources (up to 3 shown) [18:37:34] PROBLEM - db5 Puppet on db5 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:38:03] PROBLEM - cp3 Puppet on cp3 is CRITICAL: CRITICAL: Puppet has 135 failures. Last run 5 minutes ago with 135 failures. Failed resources (up to 3 shown): File[wildcard.miraheze.org_private],File[/etc/default/stunnel4],File[/etc/stunnel/mediawiki.conf],File[/usr/lib/nagios/plugins/check_varnishbackends] [18:43:02] RECOVERY - misc4 Puppet on misc4 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [18:43:04] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [18:43:09] RECOVERY - db5 Puppet on db5 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [18:43:28] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [18:43:40] RECOVERY - misc1 Puppet on misc1 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [18:43:41] RECOVERY - lizardfs6 Puppet on lizardfs6 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [18:44:01] RECOVERY - bacula1 Puppet on bacula1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:44:50] RECOVERY - misc3 Puppet on misc3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:44:58] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:45:01] RECOVERY - db4 Puppet on db4 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:45:01] RECOVERY - test1 Puppet on test1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:45:02] RECOVERY - mw1 Puppet on mw1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:45:04] RECOVERY - misc2 Puppet on misc2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:45:12] RECOVERY - mw3 Puppet on mw3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:46:00] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:46:12] RECOVERY - mw2 Puppet on mw2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:46:49] so I did not make any big fuck ups then? [18:48:31] TreesideMiners: nope [18:48:34] good [18:48:42] JohnLewis: should the ops tag on phab change to SRE [18:49:35] SantaRhino: I've already changed it [18:51:38] Reception123: then I can leave the change for that [18:51:51] yes [18:51:57] Just waiting for FuzzyBot to wake up and reset translations [18:55:33] !log reception@mw2:/srv/mediawiki/w/maintenance$ sudo -u www-data php runJobs.php --wiki metawiki [18:55:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [18:57:19] PROBLEM - db5 Current Load on db5 is WARNING: WARNING - load average: 0.29, 0.39, 3.83 [18:59:44] RECOVERY - db5 Current Load on db5 is OK: OK - load average: 0.27, 0.34, 3.31 [19:20:33] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeFaV [19:20:35] [02miraheze/mediawiki] 07reedy 03b2adc06 - Don't redefine MW_ENTRY_POINT in thumb.php if already defined Bug: T241340 Change-Id: I95914267bf22910391a54ec524ed11bc076f83e3 [19:50:46] PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: 2 backends are down. mw1 mw3 [19:52:01] JohnLewis: should staff be renamed now it’s lost Labster and Board have their own page. Or a list for technical staff? [19:52:12] MetaWiki no work [19:52:29] hispano76: in what way? [19:54:00] RECOVERY - cp4 Varnish Backends on cp4 is OK: All 6 backends are healthy [19:55:10] um, it wouldn't let me access MetaWiki but it would let me access CommonsWiki and other wikis. Is it something from CP4? [19:55:40] hispano76: what’s the full error? [19:55:45] paladox: ^ [19:56:03] hispano76 what's the error? [19:56:07] As meta's working for me [19:56:56] Some failed connection, but strangely enough I did let myself in to CommonsWiki, AllTheTropes and HispanoWiki [19:57:04] and Wikipedia [19:58:12] I guess may have been related to above notifications. [19:58:16] Should have recovered now [20:00:39] ok [20:05:08] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JeFVO [20:05:09] [02miraheze/services] 07MirahezeSSLBot 03e8e8765 - BOT: Updating services config for wikis [20:13:08] SantaRhino: yeah [20:15:57] Thx [20:20:39] JohnLewis: should mail alias be redone? [20:21:29] Could do but staff should be fine for an alias to remain I guess [20:22:27] JohnLewis: I’ll open a phab task with ideas [20:26:14] JohnLewis: https://phabricator.miraheze.org/T5016 [20:26:15] [ ⚓ T5016 Renew mail alias config ] - phabricator.miraheze.org [20:28:14] Shared view [20:31:31] JohnLewis: replies [20:32:37] JohnLewis: I can sort everything else if that’s fine and send staff@ to sysadmins@ for now tommorow if you want [20:33:39] Contact@ could also as we expand become useful for allowing volunteers to answer via an OTRS like system [20:34:44] I've also proposed that in the past [20:34:56] Reception123: see T5016 [20:36:42] replied. As I said as long as our duties remain as they are now I support keeping 'staff' [20:38:39] Reception123: legally, “staff” is no one [20:38:49] Hint at the change to the on wiki page [20:39:18] SantaRhino: don't know why you changed that, there was no official decision to remove the 'staff' name [20:39:31] it was never a legal name staff just = the people who manage Miraheze to me [20:39:35] there's nothing legal about it [20:39:47] The board delegates to staff [20:39:57] Reception123: discussion with Owen + John [20:40:25] ok, well I was not made aware of this change and I mentioned that I supported keeping the name... [20:40:32] Because that page wasn’t going to have the board on and Owen also keeps using it for linking to the technical team [20:40:43] Reception123: it essentially was a list of sysadmins [20:40:54] Because as I've said sysadmin implies only technical, when as we have many other responsibilities other than maintaining servers [20:41:17] and by changing all names we're just going to confuse people even more [20:41:49] ^ [20:42:13] Sysadmins do but “staff” doesn’t include the board who are [20:42:27] the board are not staff? [20:42:44] paladox: not in the sense we’re using it [20:42:45] I wouldn't say the board are staff as they delegate to us [20:43:06] but okay, if we take the staff name out I'd still want something to replace it that underlines our responsibilities as representatives of Miraheze [20:43:21] Reception123: I disagree. They are just another department in Miraheze. [20:43:35] If you have a better title, pls share ideas [20:43:47] Erm [20:43:55] It's not "lets remove" then discuss later. [20:44:12] It should be the other way around. [20:44:13] SantaRhino: but if we're purely 'technical team' why do we still deal with non-technical things? [20:44:30] ^ [20:44:31] and I agree with paladox we can't just get rid of the 'staff' name but not find something else to replace it with at least [20:44:40] Reception123: the size of Miraheze [20:44:41] For me to chime in... I never really liked "staff" for describing us [20:44:46] ^ [20:44:53] JohnLewis: sure, but then we need another name [20:44:59] JohnLewis yup, but there should be a replacement first :) [20:45:19] Sysadmins, Ops etc. have always been my preferred replacements [20:45:24] Because isn't it weird that a member of a 'technical team' and a 'system administrator' is in charge of dealing with violations of the ToS [20:45:38] yup [20:45:41] I just find that many of our responsibilities are not technical in nature so they should be under a different title [20:45:45] ToU enforcement doesn't make us "not sysadmins", it's just a responsbility inferred, not another entirely different responsbility [20:45:51] Reception123: we have a wide scope for sysadmins but there isn’t a better name [20:46:09] As we don’t have a Trust & Safety team to do it [20:46:30] We are sort of taking on any work that we don’t have a current volunteer to do [20:46:37] i suggested a T&S [20:46:53] Yeah, so since we're taking on that work it needs to be recognized as something different [20:46:55] That would be ideal [20:47:03] because when we eventually have someone to do it, it will be called something different [20:47:19] Reception123: what we do is shoulder the work of T&S who don’t (yet) have any members [20:47:24] * paladox makes Reception123 head of T&S :P [20:47:44] I feel people are reading way too much into it [20:48:14] ToU enforcement currently and pretty has always been within the purview of Sysadmins, from day 1. We've not split that responsbility away, it's always been under "sysadmin" purvie [20:48:22] * SantaRhino suggests this is a lot bigger debate that needs more work and Miraheze to recruit more people for [20:48:26] The only reason we split to use "staff" was we got Labster [20:48:43] JohnLewis: it isn’t under normal situations though at any other media company [20:49:13] We're not normal and never have been [20:49:47] But spending hours and hours debating the name for a team which has no impact on it's ability to do anything, is a waste of time to me considering our numerous problems which need to be resolved [20:50:29] JohnLewis: I agree with point one, it’s not hours (yet) - we should maybe expand a bit first though before getting into this [20:50:58] SPF has told us we're SRE - which is a name given to a Technical Team or "sysadmins" so for me, problem solved [20:51:09] JohnLewis: I agree [20:51:40] Okay, let's say you're right but then isn't it super confusing to keep the staff@ email? [20:51:45] Board equivilently have told us, by calling us "Technical Team", we manage the ToU on their behalf, this is a matter to be taken beyond us frankly but the response I imagine we'll get is "what does this new name solve?" [20:52:03] Reception123: yes [20:52:15] Reception123: considering we'd had it since day 1, it'll be reckless to remove it currently [20:52:22] JohnLewis: a better title for our legal role [20:52:29] It should be deprecated and removed, but hard deprecation is reckless :) [20:52:43] JohnLewis: SantaRhino Yeah I agree we need to clearly explain the new roles and changes, since even now people don't know the difference between Sysadmins and Stewards [20:52:47] That’s why I say redirect staff@ to something else [20:52:48] we can start with a redirect from it [20:52:58] I do say that in the task [20:53:10] But we need to be very clear on what each role does and clarify that the board delegates day-to-day running of Miraheze to sysadmins [20:53:20] Should we drop contact@ and replace with a sysadmins@ email [20:53:33] sysadmins? [20:53:35] With staff@ redirecting to sysadmins@ for now [20:53:43] paladox: large debate this [20:53:44] We're SRE now per rename:) [20:53:56] paladox: SRE isn’t Zppix [20:53:59] yes, but we're not known as "sysadmins" now :) it's SRE [20:54:12] paladox: we're still system administrators though as always [20:54:16] I think me and JohnLewis discussed that [20:54:21] paladox: Operations is SRE - this is for Zppix as well [20:54:24] though sysadmins have two categories - SRE and MediaWiki Admins [20:54:27] technically he is one. [20:54:32] unless i got that wrong [20:54:36] Reception123: yep [20:54:44] paladox: zppix isn’t SRE [20:54:47] the sysadmin is a larger category that incorporates everyone with access [20:54:51] technically he is... [20:54:54] SRE replaces operations [20:54:59] yes [20:55:01] JohnLewis: ^ please clarify [20:55:08] Zppix: wasn’t operations [20:55:15] paladox: Zppix is MediaWiki Administrator [20:55:23] i said technically not full on sre :P [20:55:26] (instead of previously being MediaWiki System Administrator) [20:55:32] paladox: well he's not at all [20:55:41] Thats what i thought too [20:55:45] until JohnLewis explained [20:56:42] Such confusion, this is for SPF|Cloud to clarify personally, but this was heavily discussed and this was my concern. That it's confusion frankly and the role of previously delegated roles aren't fully and entirely qualified and clarified [20:57:51] https://meta.miraheze.org/wiki/Tech:Access [20:57:53] [ Tech:Access - Miraheze Meta ] - meta.miraheze.org [20:58:45] implies they are different, because "Site Reliability Engineering […] is the department whose are responsible for day-to-day administration of the servers/services[…] They have unrestricted access on servers" [20:58:57] Which fails to meet the MediaWiki Administrators test here [20:59:06] JohnLewis: they’re different is what I think [20:59:14] * SantaRhino looks at @Owen [20:59:46] I have no idea what you're expecting me to contribute here 🙂 [21:00:36] Explain whether a MediaWiki admin is part of SRE based on the recent board meeting [21:00:57] Roles aren't a Board issue [21:01:01] ^ [21:01:24] You lot came up with the names [21:01:31] But I’m very confused [21:01:40] No they doin't, it's the technically department that do. [21:01:45] I just want to remove the “staff” name from use [21:01:55] We didn't. Ferran told us they were changing and that's it - the documents we received had the name "Operations" in them [21:02:12] Oh @southparkfan, please clarify this [21:06:16] is away for an hour [21:09:21] From what I understood this was proposed by SPF after a consultation with us (as the board doesn't decide on roles) [21:19:58] SantaRhino: hey, thanks for your question. As said, it was not a change by the Board - roles are up to the technical team. You have a good point though (I can see how this is ambiguous), mind if I come back to it later for a proper response? In said case, you are free to explain how this could be clarified more [21:30:03] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeFwM [21:30:05] [02miraheze/mediawiki] 07paladox 031b8d2e2 - Update Flow to d5de5e133683e64d1839227630bf528374eb46a3 [21:32:23] !log /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/extensions/Flow/db_patches/patch-increase-varchar-ref_src_wiki.sql [21:32:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:50:32] SPF|Cloud: pretty much an explicit answer on who SRE are, who are sysadmins and where subgroups fall (MW-admin/puppet-admin etc.) and some help rewriting the mail system and meta pages [21:53:44] !log /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/maintenance/archives/patch-drop-archive-ar_usertext_timestamp.sql [21:53:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:53:58] !log /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/maintenance/archives/patch-drop-archive-usertext_timestamp.sql [21:54:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [21:54:26] !log /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/maintenance/archives/patch-drop-user-fields.sql [21:54:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:05:19] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.84, 7.71, 6.51 [22:12:31] Hello ningzing! If you have any questions, feel free to ask and someone should answer soon. [22:12:34] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 6.16, 6.59, 6.75 [22:12:35] hello [22:13:01] would a support group wiki for brain injury patients be appropriate on this service? [22:16:58] Hi, yes. [22:17:20] ok [22:17:44] i just tried to create an account but received a 503 back end failed, should I just wait a little while and try again? and does the account need to have a confirmed email in order to request a wiki? [22:21:39] ningzing: keep trying, should recover quickly and no but it’s highly recommended [22:22:34] okay, thanks [22:24:52] !log /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/extensions/Flow/db_patches/patch-flow_tree_idx_fix_2.sql [22:25:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:25:07] !log /usr/local/bin/foreachwikiindblist /srv/mediawiki/dblist/all.dblist /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/extensions/AbuseFilter/db_patches/patch-drop_afl_log_id.sql [22:25:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log, Master [22:27:28] now something about an authentication token [22:28:22] ningzing: what does it say? [22:28:34] PROBLEM - mw1 Current Load on mw1 is CRITICAL: CRITICAL - load average: 9.29, 8.61, 7.30 [22:30:55] PROBLEM - mw1 Current Load on mw1 is WARNING: WARNING - load average: 7.22, 7.85, 7.35 [22:32:14] oh wait nm it worked [22:32:20] after i reloaded the page I'm now logged in [22:33:38] ningzing: great [22:33:40] so the online support group I'm in wants to start off with a private wiki, and then transition portions of it to a public wiki later [22:33:42] is that OK? [22:34:11] ningzing: you can start with a private wiki but it’s either private or public [22:34:20] i see. we don't mind creating a second one [22:34:29] ningzing: that would work [22:34:37] it's just that in the beginning there is likely to be a lot of info that wouldn't really be relevant to a casual visitor [22:34:41] cos its specific to the group [22:35:00] Yeah I understand [22:35:06] thanks [22:35:41] thanks for all yalls help, probably chat again when the request is reviewed [22:36:22] ningzing: I’ll look now [22:36:26] paladox: check discord [22:36:51] no need to ping in 2 places [22:37:28] ningzing: created [22:37:45] thanks! [22:38:21] RECOVERY - mw1 Current Load on mw1 is OK: OK - load average: 4.88, 5.88, 6.59 [22:40:01] .status mhmeta off [22:40:06] SantaRhino: Updating User:RhinosF1/Status to off! [22:40:14] .status mhmeta Off [22:40:19] SantaRhino: Updated! [22:40:20] SantaRhino: Updating User:RhinosF1/Status to Off! [22:40:31] SantaRhino: Updated! [22:52:04] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeFof [22:52:06] [02miraheze/mediawiki] 07paladox 0325937f1 - Remove space from strings Change-Id: Id81dab1d806f2b93b5bad47cfd2a9fa37dedcd02 [23:15:22] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_34 [+0/-0/±1] 13https://git.io/JeFoW [23:15:24] [02miraheze/mediawiki] 07paladox 03d5fa61f - Update VisualEditor