[15:00:49] <T13|mobile>	 Apparently no emails on enwp are working through Special:EmailUser.  Is this related to [[Phab:66795]] or a new bug?
[15:08:32] <andre__>	 T13|mobile: define "apparently"? I'm only aware of https://en.wikipedia.org/wiki/Wikipedia:Village_pump_%28technical%29#Wikipedia.27s_eMail_interface
[15:10:19] <T13|mobile>	 [[En:user talk:MSGJ#email]] [[EN:User talk:Technical_13#Mail call]]
[15:10:26] <T13|mobile>	 @linm
[15:10:28] <T13|mobile>	 @link
[15:10:28] <wm-bot>	 https://wikitech.wikimedia.org/wiki/En:user_talk:MSGJ#email https://wikitech.wikimedia.org/wiki/EN:User_talk:Technical_13#Mail_call
[15:13:51] <T13|mobile>	 andre__: ^^
[15:18:20] <andre__>	 can't hurt to add those links to 66795 I guess
[15:18:40] <andre__>	 still if it really worked for nobody I'd expect more screaming around
[17:16:40] <guillom>	 Power issue causing problems for all sites
[17:16:47] <guillom>	 Being worked on
[17:17:58] <Juandev>	 the best way how to invite folks on this channel
[17:18:17] <yannf>	 hi
[17:18:18] <yannf>	 Commons broken?
[17:18:20] <cgt>	 Yes
[17:18:24] <guillom>	 All wikis are broken
[17:18:28] <guillom>	 Power issue
[17:18:42] <yannf>	 ok
[17:18:50] <guillom>	 Sites should be recovering now
[17:20:01] <Nemo_bis>	 I was just looking for a rehearse of 503 looks
[17:21:20] <Juandev>	 time for a break
[17:22:19] <T13|mobile>	 Okay, who tripped over the power cord this time?
[17:22:26] <AnnaKoval>	 Hello Wikimedia-tech. Just a head's up, in case you weren't aware, that at least a couple of the wikis seem to be down: Wikimania 2015 and Office wiki, that I know of... 
[17:22:32] <cgt>	 AnnaKoval: we know
[17:22:51] <cgt>	 T13|mobile: It was a gopher
[17:23:03] <AnnaKoval>	 That's great! At least it wasn't me! ;) 
[17:23:06] <AnnaKoval>	 Thanks, folks! <3 
[17:25:37] <T13|detached>	 Wasn't the last big outage blamed on a gopher eating the transmission lines too? Come up with a new one!
[17:26:41] <KTC>	 it's a tough gopher, they still haven't caught it!
[17:26:54] <T13|detached>	 lol Fair enough..
[17:28:59] <Tito123>	 wikipedia down?
[17:29:04] <devunt>	 yes.
[17:29:05] <cgt>	 yes
[17:29:49] <andre__>	 see "Status: Down" in channel topic
[17:35:13] <waldir>	 maybe the status could be edited to make it clear the problem has been identified and is being worked on. Something like "Status: Down - power issues, recovering"
[17:36:00] <greg-g>	 thanks brion :)
[17:36:06] <brion>	 :)
[17:36:15] <guillom>	 So many channels!
[17:36:27] <brion>	 ok while ops are working on that i guess i’ll head downtown. at least phabricator’s still working so i can poke bugs ;)
[17:42:42] <Base>	 keep it down, let wikimedians rest :)
[17:43:07] <Polsaker>	 They won't, Base... thousands of F5 keys are suffering right now
[17:43:46] <Ford351thru460>	 Request: GET http://en.wikipedia.org/wiki/Main_Page, from 10.64.0.105 via cp1055 cp1055 ([10.64.32.107]:3128), Varnish XID 1328098057 Forwarded for: 75.100.1.61, 10.64.0.105 Error: 503, Service Unavailable at Thu, 05 Feb 2015 17:41:08 GMT
[17:44:16] <devunt>	 Ford351thru460, ops are working on it
[17:44:21] * ^d goes for a walk outside
[17:44:31] <Ford351thru460>	 OK, thanks for the help.
[17:44:36] <waldir>	 a rare sight! http://wikipulse.herokuapp.com/
[17:45:13] <Glaisher>	 aww
[17:45:35] <mbh>	 what happens?
[17:45:43] <Glaisher>	 see topic
[17:46:06] <Polsaker>	 Wondering why they're coming back up and down
[17:47:53] <Base>	 Polsaker: xD
[17:48:25] <Revi>	 no server, no vandals.
[17:48:26] <waldir>	 haha the gauges show the edit rate slowly going up!
[17:48:29] <Revi>	 peaceful wikiworld
[17:48:36] <cgt>	 Cluebot must be bored
[17:49:18] <Base>	 Revi: definitely
[17:49:27] <Base>	 no drama on talk pages either
[17:49:37] <Mardus>	 So hi. en-wiki && et-wiki are down, both on http and https. Ye probably know already, but that's just a report.
[17:49:39] <cgt>	 We've solved enwiki!
[17:49:46] <cgt>	 Mardus: see topic
[17:50:04] <Mardus>	 cgt: Mhm.
[17:50:08] <Base>	 oh it's back(
[17:50:24] <cgt>	 Our sysadmins are currently running around in the DC chasing gophers. Please stand by.
[17:50:25] <Base>	 back to up mean(
[17:50:33] <MusikAnimal>	 I can't log in
[17:50:48] <Mardus>	 It's up, it's up (-:
[17:50:52] <kline>	 MusikAnimal: itll take a while for everything to come up completely
[17:50:57] <devunt>	 not fully solved yet
[17:51:14] <Revi>	 Server is up and vandals are coming :(
[17:51:36] <Revi>	 Go down the switch again to throw the vandals away!
[17:52:20] <JD|cloud>	 system messages are missing
[17:52:26] <JD|cloud>	 internationalization cache?
[17:52:52] <Mardus>	 et-wiki works.
[17:52:54] <guillom>	 JD|cloud: Things are coming back up slowly
[17:53:36] <kegns>	 @wikimedia on twitter said that it's network problem...
[17:53:53] <Mardus>	 Login apaprently doesn't work yet, but there's not general error page, but this: "The provided authentication token is either expired or invalid."
[17:53:55] <uwe>	 Um, Issues with login ... "The provided authentication token is either expired or invalid."
[17:54:02] <MusikAnimal>	 I assume the API is fine, and hopefully I'm reverting as my account and not my IP on Huggle right now
[17:54:04] <Mardus>	 * no
[17:54:32] <Mardus>	 The auth token error appears after submitting username and password.
[17:54:51] <devunt>	 ops are working on login issues
[17:55:29] <cgt>	 MusikAnimal: I think you need to be a rollbacker on enwiki to use Huggle.
[17:55:41] <MusikAnimal>	 yeah it's rolling back as me
[17:55:46] <MusikAnimal>	 I checked the page history
[17:55:50] <Mardus>	 The login error takes to this page: https://login.wikimedia.org/wiki/Special:CentralLogin/start?token=l0ngnum3r1cg1bb3r15h
[17:55:57] <MusikAnimal>	 so I can't use https but I can use the API
[17:56:05] <MusikAnimal>	 which is good enough for vandal-fighting
[17:56:12] <devunt>	 Mardus, yes ops are working on it
[17:56:24] <Mardus>	 devunt: Thank you.
[17:56:25] <Revi>	 cgt: MusikAnimal is admin on enwiki! :p
[17:56:34] <Revi>	 He has rollback by default!
[17:56:56] <cgt>	 Okay, I just meant that he wouldn't be able to use Huggle if he wasn't logged in
[17:57:18] <MusikAnimal>	 indeedy :) I was just hoping with the login issues Huggle wasn't flaking or something and rolling back as my IP
[17:57:19] <Revi>	 :o k
[17:57:44] <MusikAnimal>	 guess Huggle doesn't use central auth
[17:57:50] <Revi>	 Maybe.
[17:58:02] <Revi>	 it goes to loginwiki and everything starts to suck
[18:05:57] <mbh>	 some ruwiki users can't log in
[18:06:27] <^d>	 Logins should be coming back to normal
[18:06:38] <^d>	 Fallout from earlier outage
[18:23:38] <MissGayle>	 good morning :)
[18:24:23] <^d>	 Hi MissGayle. You missed the excitement :)
[18:24:39] <MissGayle>	 Oh, I heard about it :)
[18:38:49] <Mardus>	 Login works, too.
[19:52:36] <Mardus>	 bye
[20:05:01] * guillom is vamished.
[20:27:33] <Helder>	 Is it possible to get stats on the number of requests to deprecated¹ mwlib export formats we get from WMF wikis?
[20:27:36] <Helder>	 ¹ https://gerrit.wikimedia.org/r/#/c/164099/
[20:28:13] <Helder>	 That way we could have a list of pages to fix issues like this:
[20:28:14] <Helder>	 https://phabricator.wikimedia.org/T73342#1018603
[20:35:20] <Nemo_bis>	 Helder: probably easier to get someone to mwgrep template namespace
[20:36:01] <Helder>	 isn't mwgrep restricted to JS/CSS pages in MW and USER ns?
[20:36:34] <Nemo_bis>	 IIRC it has a namespace switch. If not, that should be trivial to fix I think?
[20:37:48] <Nemo_bis>	 Helder: see also https://phabricator.wikimedia.org/T73846 for the underlying issue
[20:38:18] <Helder>	 yeah, that might fix other issues, I think
[20:38:34] <Helder>	 (parameters disappearing, or something like that)
[20:54:51] <Krenair>	 Helder, Nemo_bis: it has options for NS_USER and NS_MODULE only, NS_MEDIAWIKI is the default
[20:55:25] <Krenair>	   --user           search NS_USER rather than NS_MEDIAWIKI
[20:55:26] <Krenair>	   --module         search NS_MODULE rather than NS_MEDIAWIKI
[20:55:30] <Krenair>	 (from --help)
[20:57:39] <legoktm>	 Helder: it's easy to tweak mwgrep to search other namespaces if necessary
[21:33:19] <Excirial>	 Was the Mediawiki installation on EnWiki updated sometime today?
[21:33:43] <marktraceur>	 Believe so, yes
[21:33:47] <marktraceur>	 Excirial: Problems?
[21:33:55] <Excirial>	 https://en.wikipedia.org/wiki/Wikipedia:Village_pump_%28technical%29#Visible_markup_on_category_pages
[21:34:26] <Excirial>	 Apparently all category headers suddenly contained a visible <a> tag due to the < being escaped.
[21:35:01] <Excirial>	 It was just worked around by removing the anchor from the mediawiki category header though: https://en.wikipedia.org/w/index.php?title=MediaWiki%3ACategory_header&diff=645801717&oldid=86207875
[21:35:17] <marktraceur>	 jackmcbarn said he's working on it
[21:35:25] <marktraceur>	 I don't see it anymore, so I guess it's pretty much set?
[21:35:32] <jackmcbarn>	 it's band-aid'ed for now
[21:35:36] <MatmaRex>	 eh, a software bug? more like a software fix?
[21:35:47] <jackmcbarn>	 MatmaRex: no, bug. it causes safe html to get escaped too
[21:36:10] <MatmaRex>	 you mean it now correctly escapes HTML when it was not escaping it before?
[21:36:41] <jackmcbarn>	 MatmaRex: yes, but it also escapes html that the wikitext parser generates
[21:36:47] <jackmcbarn>	 so it was a fix that went overboard
[21:37:14] <jackmcbarn>	 (basically, the fix escaped the output of ->text() instead of using ->parse())
[21:41:26] <jackmcbarn>	 MatmaRex: can i actually bug you to merge https://gerrit.wikimedia.org/r/188891 so i can send it out for swat tonight?
[21:41:55] <MusikAnimal>	 anyone here use Chrome for OSX? Try loading this wikidata page: https://www.wikidata.org/wiki/Q4039395
[21:43:05] <MaxSem>	 MusikAnimal, yep - crases
[21:43:20] <MusikAnimal>	 looks like it's this: https://phabricator.wikimedia.org/T88478
[21:43:58] <MatmaRex>	 jackmcbarn: i commented
[21:45:24] <jackmcbarn>	 replied
[22:56:46] <harej>	 Hello. I am interested in uploading 14 million (~1.5 TB) of image files to Wikimedia Commons. Whose buy-in do I need to do this so that I don't accidentally kill Commons?
[22:57:28] <MaxSem>	 harej, #-ops, or even better, wikitech-l
[22:58:09] <harej>	 I have moved the discussion to -ops. Thanks!
[22:59:37] <harej>	 and now -operations
[22:59:45] <harej>	 MaxSem: #wikimedia-ops and #wikimedia-operations are two different things
[23:00:08] <MaxSem>	 heh. that's the usual abbreviation:)
[23:00:44] <huh>	 I've fallen for that /many/ times
[23:48:53] <jeblad>	 It seems like the free text search is broken on nowiki, multi word searches fails
[23:49:36] <MaxSem>	 ^d, ^^^
[23:50:17] <jeblad>	 This search fails https://no.wikipedia.org/w/index.php?title=Spesial%3AS%C3%B8k&profile=advanced&search=tinget+demotilgang+atekst&fulltext=Search&ns4=1&profile=advanced
[23:51:22] <^d>	 weird
[23:59:57] <jeblad>	 Not sure when it started, it is long since I did a similar search.