[00:29:46] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj30C [00:29:47] [02miraheze/ManageWiki] 07JohnFLewis 03cbf2af5 - pre-json_encode AP [00:30:18] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fj30W [00:30:19] [02miraheze/mediawiki] 07JohnFLewis 038138875 - update MW [01:20:28] [02mw-config] 07The-Voidwalker opened pull request 03#2677: add permissions to ajaxpoll install - 13https://git.io/fj30p [01:31:31] [02ManageWiki] 07The-Voidwalker opened pull request 03#89: prevent accidental loss of information - 13https://git.io/fj3EI [01:37:00] any thoughts on this wiki request? https://meta.miraheze.org/wiki/Special:RequestWikiQueue/7884 [01:37:02] Title: [ Wiki requests queue - Miraheze Meta ] - meta.miraheze.org [01:58:59] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 514 [02:00:56] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [02:33:06] [02ManageWiki] 07JohnFLewis closed pull request 03#89: prevent accidental loss of information - 13https://git.io/fj3EI [02:33:08] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj3EP [02:33:09] [02miraheze/ManageWiki] 07The-Voidwalker 03ec2cda8 - prevent accidental loss of information (#89) groups such as interface-admin are getting truncated to interface [02:33:38] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fj3EX [02:33:39] [02miraheze/mediawiki] 07JohnFLewis 033c77b94 - update MW [03:00:15] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj3ue [03:00:17] [02miraheze/services] 07MirahezeSSLBot 0308e29a1 - BOT: Updating services config for wikis [07:49:43] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 1 backends are down. mw2 [07:51:09] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb [07:51:37] PROBLEM - misc1 GDNSD Datacenters on misc1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb [07:57:34] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 5 backends are healthy [07:59:03] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [07:59:21] RECOVERY - misc1 GDNSD Datacenters on misc1 is OK: OK - all datacenters are online [10:49:00] 11 [15:55:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj3MV [15:55:13] [02miraheze/services] 07MirahezeSSLBot 03f0b61d9 - BOT: Updating services config for wikis [18:16:27] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 514 [18:22:27] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [18:31:19] PROBLEM - mw3 JobQueue on mw3 is CRITICAL: JOBQUEUE CRITICAL - job queue greater than 300 jobs. Current queue: 587 [18:33:15] RECOVERY - mw3 JobQueue on mw3 is OK: JOBQUEUE OK - job queue below 300 jobs [19:53:51] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is CRITICAL: CRITICAL - NGINX Error Rate is 63% [19:55:51] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 22% [22:15:52] JohnLewis: on T4311 they are wondering how they can setup a mobile link like m.foobar.foo would that just be a standard dns record or what i can answer them i just need to be given a direction [22:16:01] .task 4311 [22:16:03] https://phabricator.miraheze.org/T4311 - Set Custom domain for panawiki [Open] authored by alireza, assigned to Reception123 [22:16:23] Sorry for the ping r3ception123 [22:17:02] afaik it's like another custom domain, unsure on the format I've never handled mobile domains [22:17:27] but m.foobar.foo sounds right paladox [22:17:29] JohnLewis same as custom domains. [22:17:33] yeh. [22:27:04] paladox: so is it something they do or you? [22:27:12] We have to do it [22:27:19] As we also have to update the cert. [22:27:28] paladox: well if your not to busy there you go :P [22:27:44] paladox: we dont do wildcard certs for custom domains? [22:27:46] heh, though i am busy, discussing something with someone :D [22:27:50] Zppix we do [22:28:00] Then why does cert need update [22:28:07] that someone is not JohnLewis before you ask :P [22:28:18] Zppix because we doin't do wildcards automatically [22:28:31] only when needed, since we have to make sure to renew wildcard certs [22:29:31] Sounds like a lot of stuff for me to break for you paladox [22:29:51] heh [22:29:52] yup [22:30:06] JohnLewis got the training manual :D [22:31:23] paladox: the training manual? I wrote that all it is is explaining how to do the fetal position when all catches fire because i broke everything [22:31:36] lol [22:32:16] wait, wildcard? [22:32:28] don't we SNI m subdomains? [22:32:47] SNI? [22:32:51] ^ [22:32:58] JohnLewis yes, we doin't do a wildcard unless we have to [22:33:02] e.g many subdomains [22:33:17] so then it's moot [22:33:29] because we're not doing a wildcard? [22:34:09] yup [22:34:21] well some of our users have wildcards [22:34:58] but why? we're not hosting a large number of wikis under a certain domain [22:35:45] JohnLewis: its not bad to future proof? [22:36:04] JohnLewis i forgot why as that was months ago :) [22:36:05] Zppix: when it's manual, it aint future proofing [22:36:18] JohnLewis: it could be automated i would assume? [22:36:59] it requires to be manual, idk [22:37:07] going off what I'm told [22:37:32] definitly never ever going to be automated. [22:37:40] for security reasons [22:37:47] paladox: thats what they said about me breaking stuff xD [22:38:12] i doin't want any of our hosts to be able to ssh/tcp or what ever to our nameservers [22:38:31] though mind you, misc1 curl's a https url [22:39:58] paladox: couldnt you have the nameservers pull from a server ? [22:40:05] Nope [22:40:21] i want to make sure that no one can get to ns1 at least :P [22:41:10] paladox: but i want all the ns1 access [22:41:13] xD [22:41:15] heh [22:41:19] speak to JohnLewis :D [22:41:26] because i deny the request :P [22:41:42] Poor john getting pinged because of my jokes [22:42:00] * paladox can do alot worse. [22:42:20] paladox: dont make take your ctrl+v powers lol [22:42:45] lol [22:42:47] mass ping me and your pay is docked by £20 [22:43:09] JohnLewis: none of get paid [22:43:13] huh [22:43:16] who's getting payed £20? [22:43:33] paladox: dunno if we get charged i say we defer it to labster [22:43:40] lol [22:43:43] Write it off as operating expenses [22:43:56] that's fraud though? [22:43:57] Zppix: exactly, do if you're docked, 0 - 20 = -20 therefore you owe me £20 :D [22:44:12] JohnLewis [22:44:14] JohnLewis [22:44:15] JohnLewis [22:44:16] JohnLewis [22:44:16] :D [22:44:17] Wait wouldnt you owe us though [22:44:26] paladox: how the hell do you avoid klines [22:44:41] My client enforces flood protection [22:45:06] paladox: didnt seem like it the other day [22:46:03] heh [22:46:15] i know, when i pasted the whole phab web page into irc [22:46:23] i was not impressed with my self [22:46:40] I was, that you got so far along with it [22:47:13] Well it prooved my flood protections worked [22:47:25] but .... caused massive spam [22:47:51] If it worked it wouldnt of let you do what you did [23:34:26] Hi! Here is the list of currently open high priority tasks on Phabricator [23:34:33] No updates for 15 days - https://phabricator.miraheze.org/T4128 - Fix SSH not working after reboot for various servers - authored by Southparkfan, assigned to None [23:37:14] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/fj35y [23:37:15] [02miraheze/ManageWiki] 07JohnFLewis 0339e08b1 - handle case of no AP conditions [23:37:47] [02miraheze/mediawiki] 07JohnFLewis pushed 031 commit to 03REL1_32 [+0/-0/±1] 13https://git.io/fj35S [23:37:49] [02miraheze/mediawiki] 07JohnFLewis 03122ce5e - update MW