[01:42:16] <Hispano76>	 hi
[04:43:30] <snitch>	 [[Tech]]; JJMC89; /* Google indexing and caching new pages too fast */ comment; https://meta.wikimedia.org/w/index.php?diff=18945426&oldid=18939607&rcid=13320164
[09:36:01] <snitch>	 [[Tech]]; Nemo bis; /* Google indexing and caching new pages too fast */ +re; https://meta.wikimedia.org/w/index.php?diff=18945677&oldid=18945426&rcid=13320698
[14:06:14] <snitch>	 [[Tech]]; Hugo.arg; /* Bot script for demographic histograms at lt.wikipedia */; https://meta.wikimedia.org/w/index.php?diff=18946160&oldid=18945677&rcid=13321945
[15:16:01] <RhinosF1>	 Hi, Could someone get https://quarry.wmflabs.org/query/34487 working? Need it ASAP.
[15:17:05] <Reedy>	 You'd probably need to subquery to get the link son https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Apple_Inc./Subscribe
[15:17:48] <RhinosF1>	 Reedy, Could you whip the SQL up? Not my code.
[15:17:55] <Reedy>	 Never mind that revision part looking at a loooot of pages (so it'll be slow)
[15:19:01] <RhinosF1>	 Yeah, got the code from Talk: Quarry. If there's a better way then that's fine Reedy.
[15:21:08] <Reedy>	 select pl_title from pagelinks where pl_from = 57597719 AND pl_namespace =3
[15:21:14] <Reedy>	 that'll give you the list of usernames
[15:21:54] <Reedy>	 I wonder if user_touched is accurate enough for your usage
[15:22:52] <Reedy>	 SELECT user_name FROM user WHERE user_name IN ( select pl_title from pagelinks where pl_from = 57597719 AND pl_namespace = 3 ) AND user_touched > '20140301000000';
[15:22:55] <Reedy>	 So 41 don't match
[15:26:52] <RhinosF1>	 Reedy, brings back nothing https://quarry.wmflabs.org/query/34490
[15:27:48] <Reedy>	 user_touched is blank on replicas
[15:27:50] <Reedy>	 unhelpful :)
[15:28:04] <Reedy>	 RhinosF1: I can give you the result from the production DB if user_touched is enough filtering for you
[15:28:14] <Reedy>	 Doesn't mean they've edited, but the account has at least been active
[15:28:27] <RhinosF1>	 Reedy, Yes, that will be fine.
[15:28:59] <Reedy>	 https://phabricator.wikimedia.org/P8216
[15:32:36] <RhinosF1>	 Reedy, not being awkward but I'm on mobile so could you convert to user talk links. Might be be quicker for you.
[15:40:59] <RhinosF1>	 Reedy, Any chance??
[15:42:08] <RhinosF1>	 Reedy, just thought would be easier for me if the time stamp was other way round.
[15:42:21] <Reedy>	 Other way round?
[15:42:26] <Reedy>	 Oh, who to remove?
[15:42:49] <RhinosF1>	 Reedy, yes who to remove
[15:42:50] <Reedy>	 Somehow, that only gives two results
[15:43:11] <RhinosF1>	 Which two?
[15:43:15] <Reedy>	 Which is right
[15:43:17] <Reedy>	 I can't maths today
[15:43:24] <Reedy>	 Cjmcblonde and Waterfox
[15:43:34] <RhinosF1>	 Thanks, reedy.
[16:49:05] <Krinkle>	 thedj: have you found also that links on wiki in Safari jiggle around when hovered? It's making me mad, wondering if it's just me..
[16:51:51] <sjoerddebruin>	 I've had that experience as well
[16:52:01] <sjoerddebruin>	 Never could figure it out or met someone who had the same problem. :)
[16:54:39] <sjoerddebruin>	 We both seem to have some font-family overrides though
[17:19:01] <FR30799386>	 Phab seems to be down....
[17:19:10] <Reedy>	 Yup
[17:21:06] <RhinosF1>	 me as well, where do you report that? Phab is for issues.
[17:21:14] <paladox>	 It's known
[17:21:19] <paladox>	 see -operations
[17:23:37] * RhinosF1 joins
[17:23:55] <Baylee>	 uh, is anyone else having an issue with phab, or is it just me?
[17:24:15] <paladox>	 Baylee see -operations
[17:24:46] <andre__>	 Baylee, please always define "issue" clearer
[17:26:42] <RhinosF1>	 andre_ https://usercontent.irccloud-cdn.com/file/qpkUjrTy/Screenshot%202019-03-18%20at%2017.26.14.png
[17:26:55] <Baylee>	 andre__: was mostly trying to see if it was a just me thing or if it was already known, but I'm getting `Error: 503, Backend fetch failed`
[17:27:08] <bawolff>	 Its a known issue
[17:27:19] <Baylee>	 ah
[17:27:39] <RhinosF1>	 bawolff - any update on recovery/cause?
[17:27:48] <bawolff>	 We are working on it
[17:27:58] <andre__>	 RhinosF1, so "Error 503".
[17:28:07] <RhinosF1>	 yes
[17:28:08] <andre__>	 No need to more than 9 bytes to describe it. :P
[17:28:09] <bawolff>	 p.s. If someone has op in channel, please add that phab/gerrit are down for maintenance into the topic
[17:30:40] <RhinosF1>	 bawolff - posted in -ops asking someone to go round and do it.
[18:34:38] <Krenair>	 Something is up with tools-static.wmflabs.org, it's being looked at.
[18:35:09] <Krenair>	 In the mean time some tools may experience problems loading
[18:35:43] <sjoerddebruin>	 Thank you for the update
[18:37:01] <RhinosF1|afk>	 Krenair - Is there an up to date status page?
[18:37:36] <Krenair>	 for wmflabs stuff RhinosF1|afk ?
[18:38:18] <Krenair>	 can't think of one
[18:38:52] <RhinosF1|afk>	 Krenair - All WMF sites. Tracking Phab/Gerrit and whatever else is down.
[18:39:20] <Krenair>	 Well I don't think there would be anything that monitors both production and labs stuff on one site.
[18:39:44] <RhinosF1|afk>	 Krenair - Thanks
[18:40:23] <Zppix>	 RhinosF1|afk:  for production stuff theres status.wikimedia.org
[18:41:20] <Zppix>	 err stratch that it's been depreciated 
[18:41:23] <Zppix>	 scratch*
[18:47:18] <Krenair>	 tools-static appears to be okay now.
[18:47:25] <Krenair>	 There was some NFS thing.
[18:52:31] <Krenair>	 PAWS has a known problem (s?), but otherwise wmflabs.org things should be functioning as normal. Please report anything otherwise (that isn't explained by the gerrit/phab outage of course).
[18:52:51] <chicocvenancio>	 PAWS is good from a user POV
[18:57:04] <Iluvatar_>	 tools-static.wmflabs is down (cdn)
[18:59:17] <Krenair>	 Iluvatar_, it seems to be working for me?
[18:59:35] <Krenair>	 Iluvatar_, maybe you can elaborate on what behaviour you're seeing from it?
[19:01:34] <chicocvenancio>	 PAWS is all good now
[19:02:10] <Iluvatar_>	 Now is works static, yes. A few minutes ago not worked, which led to the inoperability of all tools without a cache (timeout)
[19:02:28] <Krenair>	 yeah
[19:03:35] <RhinosF1|afk>	 Tools works for me but looks stupid https://usercontent.irccloud-cdn.com/file/SbdcoxJo/A6434CED-584D-4AD1-8D98-0C1294450341.png
[19:04:17] <Krenair>	 well
[19:04:22] <Krenair>	 normally I'd say make a task
[19:04:45] <Krenair>	 RhinosF1|afk, when phab comes back up, make a task about the rendering of that page on mobile?
[19:05:15] <RhinosF1|afk>	 Okay, yeah would report but that is not happening.
[19:05:33] <Reedy>	 You can create tasks by email
[19:06:43] <RhinosF1|afk>	 Reedy, how? Will it still work?
[19:06:43] <Krenair>	 is it still processing email?
[19:06:50] <Reedy>	 I've no idea
[19:06:52] <RhinosF1|afk>	 Per Krenair
[19:06:54] <sjoerddebruin>	 What? Next you'll be telling me we can chat via Internet Relay Chat...
[19:06:56] <Reedy>	 But it'll process it eventually if not
[19:06:57] <Krenair>	 I suppose if not it will get delivered when phab comes back up...
[19:07:16] <Krenair>	 sjoerddebruin, the ability to create tasks by email is quite obscure
[19:07:31] <Krenair>	 I'd wager most people use the web interface
[19:08:09] <RhinosF1>	 Krenair / Reedy, how what email?
[19:08:20] <sjoerddebruin>	 Or send a postcard to the WMF!
[19:08:40] <Krenair>	 it's in the docs
[19:08:46] <Zppix>	 I perfer reporting tasks by snail mail
[19:08:47] <Krenair>	 https://www.mediawiki.org/wiki/Phabricator/Help#Using_email
[19:15:00] <RhinosF1>	 Sent the email
[19:15:45] * McJohn is curious about the timeline of when that gets created
[19:17:15] <RhinosF1>	 McJohn - We all are with Phab/Gerrit being down.
[19:17:27] <RhinosF1>	 It's my first phab email as well.
[19:18:01] * RhinosF1 wonders what could go wrong
[19:18:09] <bawolff>	 Reporting bugs like its 1990!
[19:18:53] <Krenair>	 well as sjoerddebruin pointed out we're using IRC
[19:19:09] <RhinosF1>	 Very true, Krenair.
[19:19:42] <RhinosF1>	 Bawolff, What happens when tech fails? This.
[19:20:03] <bawolff>	 We all get to have an irc party!
[19:20:56] <RhinosF1>	 Yes, in this case. Imagine if IRC failed. We'd be forced to do something on wiki.
[19:22:25] <liw>	 email is 60s tech. irc is 80s tech. wikis are 90s tech. git is 00s tech. we're lacking something from the 70s and something from the 10s.
[19:23:03] <McJohn>	 For an off-topic question, is there a good reason not to upgrade jquery.ui?
[19:29:19] <andre__>	 McJohn: upgrade where? From which version?
[19:29:24] <andre__>	 MW Core itself?
[19:29:36] <McJohn>	 yeah
[19:29:44] <McJohn>	 $.ui.version says 1.9.2
[19:30:11] <andre__>	 McJohn: https://phabricator.wikimedia.org/T71386 is about upgrading to 1.11
[19:30:28] <McJohn>	 <3
[19:30:41] * McJohn adds it to the ever-growing list of tabs to reload
[19:31:21] <RhinosF1>	 I have 20 open
[19:38:33] * quiddity feeds the pigeons.
[19:47:26] <ankry>	 hi
[19:47:33] <ankry>	 phabricator is dead?
[19:47:47] <Baylee>	 see channel topic
[19:47:54] <Reedy>	 We're going back to bugzilla
[19:48:38] <paladox>	 i hope you are joking? :P
[19:48:40] <ankry>	 where to report an error in score?
[19:49:21] <Krenair>	 Reedy, shush
[19:49:27] <Krenair>	 ankry, when it's back, Phabricator
[19:49:28] <hauskatze>	 bugzilla ftw
[19:49:34] <Krenair>	 unless it's urgent
[19:49:40] <Baylee>	 why not just use email? create a mailing list for each bug :P
[19:50:03] <Baylee>	 `3432432@bugs.wikimedia.org`
[19:50:31] <Baylee>	 s/bugs/ticket
[19:53:37] <andre__>	 Reedy: Uh, Bugzilla? I thought the notes of that secret kabal meeting said we go for Google Spreadsheets to track issues?
[19:54:02] * Krenair triggered
[19:54:29] <andre__>	 Baylee: Why not just use email? https://www.mediawiki.org/wiki/Phabricator/Help#Using_email
[19:54:35] <RhinosF1>	 Any reason https://www.mediawiki.org/w/index.php?title=User:ShakespeareFan00/commons.js&action=history won't work for the user.
[19:55:02] <andre__>	 RhinosF1, won't work as in "that history page is not loading in a web browser", or what?
[19:55:29] <RhinosF1>	 Andre_ JavaScript is not running for them
[19:55:50] <andre__>	 RhinosF1: See https://www.mediawiki.org/wiki/Help:Locating_broken_scripts how to debug
[19:58:30] <andre__>	 RhinosF1: Script works for me. Got logged out :D
[19:59:04] <RhinosF1>	 I'll tell him
[20:00:00] <RhinosF1>	 Fixed - typo
[20:22:47] <sjoerddebruin>	 I wonder if Wikimedia Germany still has a fax...
[20:23:04] <sjoerddebruin>	 Yep! https://wikimedia.de/wiki/Kontakt
[20:24:00] <sjoerddebruin>	 https://www.youtube.com/watch?v=tEJYNtI2ul4
[20:25:34] <RhinosF1>	 I just reloaded my tabs and realised phab is 2 of them. Then still checked if it loaded.
[20:25:40] <Krenair>	 WMF has a fax too sjoerddebruin 
[20:25:44] * RhinosF1 trouts himself
[20:26:25] <sjoerddebruin>	 Krenair: is it getting rare in the US or?
[20:26:30] <Krenair>	 no idea
[20:26:37] <sjoerddebruin>	 i have numbers of germany... https://www.thelocal.de/20170324/stuck-in-the-80s-70-percent-of-german-firms-still-use-fax-machines
[20:26:45] <Krenair>	 I don't live in the US
[20:27:25] <Reedy>	 Apparently the NHS in the UK spends too much money on fax machines
[20:27:41] <McJohn>	 fax is still pretty widely used in the US if only due to the healthcare system.  A lot of systems don’t interact with each other and fax is the common denominator between transfering documents
[20:27:44] <sjoerddebruin>	 Yeah, because it's cheaper as some encrypted e-mail system
[20:28:06] <bawolff>	 But faxes aren't encrypted?
[20:28:34] <Reedy>	 That's why it's cheaper :P
[20:28:42] <bawolff>	 Then again PGP is also free, provided your time is not worth anything
[20:30:03] <thedj>	 Krinkle: haven't noticed that
[20:30:56] <sjoerddebruin>	 I'm not sure what I rather have, faxing or https://www.bbc.com/news/technology-40507440
[20:36:14] <bawolff>	 FYI: phab and gerrit are back now
[20:41:21] <RhinosF1>	 Yay
[20:44:40] <chicocvenancio>	 bawolff: is it expected to have new gerrit outages in the near future?
[20:44:58] <Reedy>	 chicocvenancio: We hope not.
[20:45:05] <bawolff>	 what reedy said
[20:47:30] <chicocvenancio>	 I'm asking because of T218600
[20:47:51] <chicocvenancio>	 basically if gerrit is down PAWS doesn't work if I set it to update pywikibot
[20:48:02] <chicocvenancio>	 (as we currently have things)
[20:48:55] <chicocvenancio>	 I don't like serving old pywikibot to users, but I rather do that then not having PAWS work...
[20:49:49] <thedj>	 chicocvenancio: just test the connection in a try/catch like structure before pulling, adapt behavior based on result ?
[20:50:35] <chicocvenancio>	 I could create a shell script with that behaviour and rebuild the image, and change the kubernetes hook
[20:50:49] <chicocvenancio>	 but not quite a simple live edit thedj 
[20:53:06] <thedj>	 well in case you want it: git ls-remote --exit-code -h ssh://username@gerrit.wikimedia.org:29418/mediawiki/core.git
[20:53:12] <thedj>	 0 success, 128 fail
[20:53:18] <thedj>	 exit codes
[20:56:45] <chicocvenancio>	 Thanks thedj that's probably the long-term answer there. 
[21:00:15] <chicocvenancio>	 But the exit code by the wrapper will have to be 0 regardless of Gerrit 
[21:54:18] <chicocvenancio>	 thedj: I'm considering changing `sh -c "cd /srv/paws/pwb && git pull"` to  `sh -c "cd /srv/paws/pwb && git pull || exit 0"`
[22:03:00] <thedj>	 chicocvenancio: i guess that could work...