[13:21:35] <wikibugs>	 (03PS1) 10Ema: Add fake trusted_proxy.json [labs/private] - 10https://gerrit.wikimedia.org/r/426913 (https://phabricator.wikimedia.org/T187014)
[13:32:04] <wikibugs>	 (03PS2) 10Ema: Add fake trusted_proxies.json [labs/private] - 10https://gerrit.wikimedia.org/r/426913 (https://phabricator.wikimedia.org/T187014)
[13:32:27] <wikibugs>	 (03CR) 10Ema: [V: 032 C: 032] Add fake trusted_proxies.json [labs/private] - 10https://gerrit.wikimedia.org/r/426913 (https://phabricator.wikimedia.org/T187014) (owner: 10Ema)
[15:58:07] <oxguy3>	 !help Hey, maybe I'm just an idiot, but I'm having trouble getting started on Toolforge. My membership request got approved a few days ago, but toolsadmin.wikimedia.org isn't showing me the "Create new tool" button and other options, and when I try to SSH to tools-login.wmflabs.org, the connection immediately drops. Is there something else that needs to happen after my request getting approved?
[15:58:07] <wm-bot>	 oxguy3: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[15:58:20] <oxguy3>	 Here's my membership request: https://toolsadmin.wikimedia.org/tools/membership/status/289
[15:58:31] <bd808>	 hi oxguy3 
[15:58:54] <oxguy3>	 hello
[15:59:14] <bd808>	 the first issue is most likely stale information in your session with https://toolsadmin.wikimedia.org/
[15:59:44] <bd808>	 There is a known bug that permissions are only updated on login to that website
[15:59:53] <oxguy3>	 I've tried logging out and back in and it still doesn't update
[16:00:28] <bd808>	 hmmm... let me look at your user record in the LDAP directory
[16:00:52] <oxguy3>	 kk thanks -- my LDAP username is IagoQnsi fyi
[16:02:31] <bd808>	 it looks like things may not have worked as expected when I approved your membership. I need to dig a bit deeper here.
[16:02:54] <oxguy3>	 oh you're BryanDavis, hi! ok thanks
[16:03:06] <andrewbogott>	 bd808: I'm here (briefly), let me know if I can help debug
[16:04:32] <bd808>	 andrewbogott: There is no "memberOf: cn=project-tools,ou=groups,dc=wikimedia,dc=org" association for oxguy3 and it looks like at least one other account that was approved recently
[16:04:59] <bd808>	 I'm not sure yet why
[16:06:30] <andrewbogott>	 I'd expect something to show up in the striker logs but I don't see it yet
[16:06:59] <bd808>	 looks like just 2 messed up approvals: https://toolsadmin.wikimedia.org/tools/membership/status/289 and https://toolsadmin.wikimedia.org/tools/membership/status/290
[16:09:34] <bd808>	 oxguy3: I just created T192302 to track this
[16:09:35] <stashbot>	 T192302: Tooforge membership requests approved, but LDAP not updated - https://phabricator.wikimedia.org/T192302
[16:09:58] <oxguy3>	 cool, thanks. i gotta take off in a second but i'll keep an eye on the ticket
[16:10:16] <bd808>	 ok. I'll try to ping you if I make any progress
[16:10:31] <oxguy3>	 thanks! i appreciate it
[16:11:40] <andrewbogott>	 bd808: would you expect a note in one of the logs when a membership is approved?
[16:12:29] <bd808>	 andrewbogott: I'm not sure actually. I'd need to look at the code. Right now I'm starting a test account to see if it's still happening
[16:17:00] <bd808>	 yeah... approval is happening way too fast. It's practically instant which is not normal
[16:17:11] <bd808>	 I don't see anything at all in the log though
[16:17:15] <andrewbogott>	 This log file sure has a lot to say about child-src
[16:17:22] <bd808>	 yeah :/
[16:17:38] <bd808>	 that's a totally bogus deprecation message from the CSP library we are using
[16:18:36] <andrewbogott>	 striker talks directly to ldap, right?  Not intervening API calls?
[16:18:44] <bd808>	 the talk page notice is happening -- https://wikitech.wikimedia.org/wiki/User_talk:T192302 -- but not the LDAP change
[16:18:44] <stashbot>	 T192302: Tooforge membership requests approved, but LDAP not updated - https://phabricator.wikimedia.org/T192302
[16:19:31] <bd808>	 yes. Its directly modifying it in theory. It should also be talking to keystone and that may be where things are going sideways
[16:20:24] <andrewbogott>	 keystone would fit a bit better
[16:21:03] <andrewbogott>	 it uses 'novaobserver' for that?  or novaadmin?
[16:21:18] <bd808>	 It should use novaadmin
[16:23:20] <andrewbogott>	 bd808: mind trying to register that user again, while I watch the keystone log?
[16:24:10] <bd808>	 andrewbogott: ready for it?
[16:24:17] <andrewbogott>	 yep, ready
[16:24:34] <bd808>	 done
[16:25:08] <andrewbogott>	 no complaints from keystone
[16:27:34] <andrewbogott>	 https://www.irccloud.com/pastebin/kyQTvAHg/
[16:27:39] <andrewbogott>	 Looks to me like the keystone part is working properly
[16:28:16] <bd808>	 hmmm... isn't that how the LDAP record is created too?
[16:29:05] <bd808>	 was that one of the things we put into a hook in the keystone process?
[16:29:54] <andrewbogott>	 I think so, yeah
[16:30:03] <andrewbogott>	 so maybe that keystone hook is broken, I'll have a look
[16:39:54] <bd808>	 oxguy3: If you are still around, could you try logging out and back in at https://toolsadmin.wikimedia.org/ and see if things are looking better now?
[16:40:01] <oxguy3>	 ok
[16:40:03] <bd808>	 I made a manual LDAP update
[16:40:44] <oxguy3>	 yep, all good! i get tools access on toolsadmin and i am able to ssh in. thanks a ton!!
[16:41:18] <bd808>	 oxguy3: thanks for reporting the problem. 
[16:41:47] <oxguy3>	 no prob -- i was just happy to learn that it was indeed a bug and i wasn't just being dumb lol
[16:43:37] <andrewbogott>	 bd808: I'm working on https://phabricator.wikimedia.org/T192304, this is probably the main cause of this
[16:44:04] <bd808>	 andrewbogott: heh. yeah, that would probably cause it
[16:49:09] <andrewbogott>	 bd808: can you try once more?
[16:49:32] <bd808>	 sure.
[16:49:53] <bd808>	 here goes
[16:50:05] <andrewbogott>	 I see the hook getting called now
[16:50:07] <andrewbogott>	 did it work?
[16:50:10] <bd808>	 its taking longer... that's a good sign
[16:50:35] <bd808>	 andrewbogott: LDAP looks right :)
[16:50:43] <andrewbogott>	 cool.  I'll make a patch
[16:59:05] <andrewbogott>	 bd808: should be fixed for real now.  Did you already fix up tdombos? 
[16:59:30] <bd808>	 andrewbogott: yes, I fixed both broken accounts I found
[16:59:39] <andrewbogott>	 great
[17:08:00] <bd808>	 thanks for the quick fix andrewbogott 
[17:49:43] <bd808>	 !log tools.enwp10 Restarted webservice (T192192)
[17:49:45] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.enwp10/SAL
[17:49:45] <stashbot>	 T192192: 502 error for https://tools.wmflabs.org/enwp10 - https://phabricator.wikimedia.org/T192192
[18:58:17] <awight>	 !log deploy-prep Update ORES editquality; T185903
[18:58:18] <stashbot>	 awight: Unknown project "deploy-prep"
[18:58:18] <stashbot>	 T185903: Train/test damaging and goodfaith model for Hungarian Wikipedia - https://phabricator.wikimedia.org/T185903
[18:58:27] <awight>	 !log deployment-prep Update ORES editquality; T185903
[18:58:30] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL
[22:21:58] <Zppix>	 Hey, so I tried doing take in a new tool, and I still get permission errors when trying to do anything in my tool dir
[22:22:02] <Zppix>	 any ideas?
[22:23:49] <Zppix>	 Ah, nevermind
[22:23:53] <Zppix>	 I found my mistake
[22:28:57] <Zppix>	 !help NPM errors out with  Error: CERT_UNTRUSTED
[22:28:57] <wm-bot>	 Zppix: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[23:58:04] <zhuyifei1999_>	 Zppix I’ll look into it in ~15 mins
[23:58:07] <zhuyifei1999_>	 dinner
[23:58:23] <zhuyifei1999_>	 (sorry for being late)