[08:28:26] <zhuyifei1999_>	 !log tools unmount dumps & remount on tools-bastion-02 (can someone clush this?) T189018 T190126
[08:28:30] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[08:28:30] <stashbot>	 T189018: Toolforge Iinstances (maybe only Jessie?) are having issues with NFS/LDAP - https://phabricator.wikimedia.org/T189018
[08:28:30] <stashbot>	 T190126: Unable to read  dumps - https://phabricator.wikimedia.org/T190126
[08:30:36] <zhuyifei1999_>	 ^ copied the entire command and forgot to replace scratch with dumps
[10:45:11] <jynus>	 CC from -operations <jynus> !log upgrade and reboot db1102 - this can create tempory lag on wikireplicas
[11:06:28] <jynus>	 also <jynus> !log upgrade and reboot db1095 - this can create temp. lag on wikireplicas
[14:02:34] <wikibugs>	 (03PS1) 10Tobias Gritschacher: Changing the channel for wikimedia-de related messages [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/420709
[14:16:44] <dsaez>	 hey Arturo, just saw your msg from yesterday, did you find out what you were looking for?
[14:22:06] <chasemp>	 thanks jynus 
[15:07:52] <arturo>	 yeah dsaez thanks
[15:35:15] <wikibugs>	 (03CR) 10Legoktm: [C: 032] "Please add the new channel to the list at https://meta.wikimedia.org/wiki/IRC/Channels#General_development_and_technical_discussion" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/420709 (owner: 10Tobias Gritschacher)
[15:35:35] <wikibugs>	 (03Merged) 10jenkins-bot: Changing the channel for wikimedia-de related messages [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/420709 (owner: 10Tobias Gritschacher)
[15:35:45] <wikibugs>	 (03CR) 10jenkins-bot: Changing the channel for wikimedia-de related messages [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/420709 (owner: 10Tobias Gritschacher)
[15:35:48] <wikibugs>	 !log tools.wikibugs Updated channels.yaml to: d038766effad436a63321f9bf90012dad8fbd7b6 Changing the channel for wikimedia-de related messages
[15:35:49] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL
[16:54:13] <bstorm_>	 phe: you might be one of the people I'm looking for.  wsexport left a huge number of temp files in /tmp on one of the toolforge web servers.  Can I blow those away or is there some cleanup than can be done with the app?
[17:02:38] <bstorm_>	 I'll create a task
[18:02:06] <Los>	 hi
[18:02:41] <Los>	 I need access on toolforge
[18:03:02] <Los>	 can you active my request please? 
[18:03:18] <chicocvenancio>	 Hey Los 
[18:03:30] <Los>	 hey!
[18:03:47] <chicocvenancio>	 Have you filed the request? Do you have the link handy? 
[18:04:00] <Los>	 i have code request
[18:04:02] * chicocvenancio is on mobile, will take longer to find it
[18:05:41] <chicocvenancio>	 Los, you have read this https://wikitech.wikimedia.org/wiki/Help:Getting_Started#Requesting_access ? 
[18:05:47] <Los>	 the code request is: 7c06b16b826648a0bcc2f4a7d98dfcf3
[18:06:51] <chicocvenancio>	 Los: where did you file that? 
[18:07:34] <Los>	 now i m reading the page
[18:08:05] <Los>	 i need to create bot for t
[18:08:24] <Los>	 i need to create bot for it wikiversity
[18:08:37] <Los>	 how i do it?
[18:09:09] <Los>	 https://toolsadmin.wikimedia.org/tools/membership/status/274
[18:09:50] <chicocvenancio>	 Could you edit that to indicate what you bot will do? 
[18:10:23] <Los>	 ok
[18:11:21] <Los>	 done
[18:15:51] <Los>	 i have updated the request
[18:16:01] <Los>	 what i do??
[18:16:24] <Los>	 again...
[18:28:45] <arturo>	 wow, chicocvenancio https://meta.wikimedia.org/w/index.php?title=Special%3ACentralAuth&target=Los%20Vegas the user has been blocked in it.wikipedia.org
[18:29:53] <chicocvenancio>	 Yes, I saw that
[18:31:07] <chicocvenancio>	 Did not respond either) with the bot purpose either... 
[18:32:22] <arturo>	 if the user is a troll, then giving a toolforge account would be like giving a weapon of mass destruction :-)
[18:32:46] * arturo pings bd808 
[18:34:41] <Sagan>	 !log rcm Neon: Running update
[18:34:42] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL
[19:28:22] <chicocvenancio>	 mmecor: I'm on my notebook now
[19:42:32] <MaxSem>	 hey bstorm_, do you have a minute to run https://gerrit.wikimedia.org/r/#/c/403833/ ?
[19:43:34] <bstorm_>	 Ah I have to run the indexes first.  Let me look into that.  It's a newer setup, and I am not in the best timezone for talking with the DBAs.  Sorry for the delay!
[20:00:36] <ShakespeareFan00>	 https://quarry.wmflabs.org/query/18892
[20:00:38] <ShakespeareFan00>	 Jams
[20:00:46] <ShakespeareFan00>	 Doesn't even give an error
[20:00:52] <ShakespeareFan00>	 What's wrong?
[20:01:38] <chicocvenancio>	 ShakespeareFan00: what do you mean?
[20:01:45] <chicocvenancio>	 was an error expected?
[20:04:22] <ShakespeareFan00>	 I click the "Submit Query" button and nothing happens
[20:04:33] <ShakespeareFan00>	 On other queries I get a "This query is running" etc...
[20:04:53] <Reedy>	 There's results below
[20:04:57] <ShakespeareFan00>	 Yes
[20:05:01] <chicocvenancio>	 yeah, its giving back a 500, I see that after forking the query
[20:05:02] <ShakespeareFan00>	 Which needed updating
[20:06:19] <ShakespeareFan00>	 I was re-running the query to update it
[20:06:28] <ShakespeareFan00>	 And something silently went wrong
[20:06:29] <ShakespeareFan00>	 :(
[20:06:43] <chicocvenancio>	 a simple nginx 500, btw
[20:06:51] <chicocvenancio>	 ShakespeareFan00:  could you create a task?
[20:09:26] <ShakespeareFan00>	 Task on phabricator?
[20:09:44] <ShakespeareFan00>	 I'll give it 24 hours
[20:09:52] <ShakespeareFan00>	 Temporary fault usally clear by then
[20:12:39] <chicocvenancio>	 Well, it'd be useful to file a task about it anyway 
[20:12:48] <chicocvenancio>	 Even if it is a temporary issue
[20:14:34] <Reedy>	 chicocvenancio: But that's effort. And it might fix itself
[20:14:47] <Reedy>	 And you can't come back in 24 hours and complain it's still brokent hen
[21:04:09] <wikibugs>	 (03CR) 10Bstorm: [V: 032 C: 031] Add Chicocvenancio's key for Cloud Services [labs/private] - 10https://gerrit.wikimedia.org/r/405376 (https://phabricator.wikimedia.org/T185273) (owner: 10Chico Venancio)
[21:04:41] <wikibugs>	 (03CR) 10Bstorm: [V: 032 C: 032] Add Chicocvenancio's key for Cloud Services [labs/private] - 10https://gerrit.wikimedia.org/r/405376 (https://phabricator.wikimedia.org/T185273) (owner: 10Chico Venancio)
[21:42:03] <chasemp>	 !log project-proxy novaproxy-01:/var# aptitude clean
[21:42:05] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Project-proxy/SAL
[21:42:14] <chasemp>	 !log project-proxy novaproxy-01:/var/log# rm -f *\.gz
[21:42:15] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Project-proxy/SAL
[23:37:21] <Niharika>	 bd808: Can I bribe you to run https://gerrit.wikimedia.org/r/#/c/403833/? It's a blocker for GlobalPrefs which need to go out tomorrow. 
[23:38:04] <Reedy>	 Niharika: Send unicorns to....
[23:38:20] <bd808>	 Niharika: hmmm.. I think we may have maintain-views in a scary state to run right now...
[23:38:46] <bd808>	 Niharika: we can maybe hack around the config file though to make it possible
[23:39:00] <Niharika>	 🦄🦄🦄🦄🦄🦄🦄🦄🦄🦄🦄🦄🦄
[23:39:06] <bd808>	 <3
[23:39:09] <Niharika>	 That'd be awesome. Thank you!
[23:39:27] <bd808>	 I don't think that having the views should be a blocker to deploy though honestly
[23:39:53] * bd808 tries to remember if its easy to jsut do one view
[23:40:28] <Niharika>	 bd808: Jaime said it's a blocker in ''bold'' on phabricator.
[23:41:10] <bd808>	 hmmm... ok
[23:43:38] <bd808>	 ugh. there's a --table option but it says is only works on full views
[23:46:46] <bd808>	 Niharika: can you do me a favor and make a ticket specifically about getting this view created? I think I'm going to need bstorm_ or another root to actually do it because we will need to tweak the config file
[23:47:06] <Niharika>	 bd808: On it. 
[23:47:08] <bd808>	 you can assign it to me and I'll get it handled one way or another tomorrow
[23:48:21] <bd808>	 I did verify that the raw table is *not* visible in the replicas now, so that's at least safe from leaking stuf
[23:49:37] <Niharika>	 bd808: https://phabricator.wikimedia.org/T190235 I tagged it with ToolForge.
[23:51:47] <bd808>	 ah. I think this may be easy actually. the comment on the flag looks to be out of date
[23:54:43] <bd808>	 Niharika: where does this table actually live? in the centralauth db?
[23:54:52] <Niharika>	 bd808: Yup.