[04:13:07] <zhuyifei1999_>	 !log tools.pywikibot recursively chown /data/project/pywikibot/public_html{,.old}/core/ to tools.pywikibot T200616
[04:13:10] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.pywikibot/SAL
[04:13:10] <stashbot>	 T200616: Web proxy on Cloud VPS should give a more helpful error - https://phabricator.wikimedia.org/T200616
[04:13:52] <zhuyifei1999_>	 !log tools.pywikibot recursively chown /data/project/pywikibot/public_html{,.old}/core/ to tools.pywikibot T200600
[04:13:54] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.pywikibot/SAL
[04:13:54] <stashbot>	 T200600: Pwb nightly downloads and /shared/pywikibot/core are outdated - https://phabricator.wikimedia.org/T200600
[04:20:01] <zhuyifei1999_>	 !log tools.pywikibot force a run of nightly script T200600
[04:20:03] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.pywikibot/SAL
[04:20:03] <stashbot>	 T200600: Pwb nightly downloads and /shared/pywikibot/core are outdated - https://phabricator.wikimedia.org/T200600
[07:07:46] <Balaji030698>	 Hi everyone, I'm currently working on building a tool in Toolforge. I'm building sinatra application using ruby. I wrote a script to run sinatra app using Puma server and created webservice to run that script. But When I tried to hit that webservice using broswer I'm getting  502 error.
[07:07:57] <Balaji030698>	 Anyone knows how to run sinatra apps in Toolforge? 
[07:15:50] <zhuyifei1999_>	 Balaji030698: by sinatra you mean https://github.com/sinatra/sinatra?
[07:16:19] <zhuyifei1999_>	 what's the name of your tool?
[07:47:12] <Balaji030698>	 Yeah that's it. Tool name is 'facebook-messenger-chatbot'.
[08:44:29] <zhuyifei1999_>	 (sorry, went debugging)
[08:50:12] <Balaji030698>	 Ok no problem
[08:51:12] <Balaji030698>	 Do have any suggestions to run this webservice?
[08:52:14] <zhuyifei1999_>	 Balaji030698: is it expected that it listens on port 9292?
[08:52:33] <Balaji030698>	 You are right 
[08:52:52] <Balaji030698>	 I can see in error.log file that puma had started listening in the port 9292
[08:52:58] <Balaji030698>	 how to access that?
[08:53:13] <Balaji030698>	 When I tried to hit that page using browser I got 5022
[08:53:17] <Balaji030698>	 502*
[08:53:21] <zhuyifei1999_>	 and that is an http service that should be served at http://tools.wmflabs.org/facebook-messenger-chatbot ?
[08:53:28] <zhuyifei1999_>	 I mean the port 9292 service
[08:53:50] <Balaji030698>	 Yes
[08:54:40] <zhuyifei1999_>	 ok I see it's responding to http https://www.irccloud.com/pastebin/F9WcBt8l/
[08:55:09] <zhuyifei1999_>	 let me check how we support ruby webservices
[08:59:01] <Balaji030698>	 how did you got that response?
[08:59:08] <zhuyifei1999_>	 Balaji030698: how did you start this service? the information contained in your service.manifest suggests it's a default setup (lighthttpd on grid engine)
[08:59:28] <zhuyifei1999_>	 oh I'm on the host your webservice is running on
[09:00:26] <Balaji030698>	 I wrote a bash script for run puma server and started the 'webservice using the command webservice --backend=gridengine generic restart /data/project/facebook-messenger-chatbot/.../server.bash'
[09:00:46] <zhuyifei1999_>	 ok
[09:01:49] <zhuyifei1999_>	 according to https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web#Other_/_generic_web_servers, you need to bind it to a port specified in the environment variable `PORT`
[09:02:40] <zhuyifei1999_>	 so it can't be a constant 9292
[09:05:08] <Balaji030698>	 oh! Can you tell me how to bind that?
[09:06:00] <zhuyifei1999_>	 I never used rackup
[09:06:16] <zhuyifei1999_>	 so not sure
[09:06:57] <zhuyifei1999_>	 you have -o 0.0.0.0, maybe port is another parameter?
[09:08:18] <Balaji030698>	 Yeah -p <port_number> can be another parameter as well. But I've tried that method also?
[09:08:30] <Balaji030698>	 Is there any specific port number to be given?
[09:08:43] <zhuyifei1999_>	 it's in the environment variable `PORT`
[09:09:09] <zhuyifei1999_>	 the numbers are dynamically assigned
[09:09:49] <zhuyifei1999_>	 if your webservice listens on a different port than the one that is assigned, out proxy can't connect to you
[09:12:30] <Balaji030698>	 I've used 'printenv' command, I couldn't see env variable with the name PORT
[09:14:36] <zhuyifei1999_>	 printenv inside /data/project/facebook-messenger-chatbot/www/ruby2/server.bash?
[09:14:56] <zhuyifei1999_>	 it's only available to the job running the webervice
[09:15:38] <Balaji030698>	 Oh! I've tried inside the tool console not inside the bash file
[09:16:02] <zhuyifei1999_>	 your currently running webservice has PORT=56734
[09:16:45] <zhuyifei1999_>	 if you are okay with me pasting the whole environment here I can also do that
[09:18:39] <Balaji030698>	 Can you ping me that?
[09:19:31] <zhuyifei1999_>	 what do you mean by ping you that?
[09:24:05] <Balaji030698>	 I mean to say that, could you send me that via private message?
[09:26:11] <zhuyifei1999_>	 ok
[11:49:04] <sDrewth>	 can someone tell me the -sparqlendpoint for quarry? guessing that there is one
[12:28:00] <zhuyifei1999_>	 quarry don't do sparql, only sql
[12:31:41] <Hauskatze>	 wdqs i guess
[12:57:58] <sDrewth>	 okay, thx
[14:19:51] <Gratus>	 Hello
[14:21:25] <zhuyifei1999_>	 (hi)
[14:21:33] <Gratus>	 When I try to connect to login.tools.wmflabs.org, I get the error : Disconnected: No supported authentification methods available (serveur sent: public key, hostbased)
[14:22:01] <zhuyifei1999_>	 did you upload your public key?
[14:22:05] <Gratus>	 But I already create a ssh key in https://toolsadmin.wikimedia.org/profile/settings/ssh-keys
[14:23:28] <zhuyifei1999_>	 can you paste the debug output somewhere (the ssh command, append `-vvv`)?
[14:24:30] <zhuyifei1999_>	 addshore, legoktm: congrats :) (two more people I can bug :P)
[14:25:09] <Krenair>	 what username are you trying to use when connecting Gratus?
[14:25:45] <Gratus>	 gratus
[14:27:22] <Krenair>	 Gratus, yeah you're not using the right ssh key format
[14:27:38] <Krenair>	 according to the base64 decoding of the key in `ldapsearch -x uid=gratus sshPublicKey`, you've got this:
[14:27:42] <Krenair>	 ---- BEGIN SSH2 PUBLIC KEY ----
[14:27:42] <Krenair>	 Comment: "rsa-key-wikimedia"
[14:27:42] <Krenair>	 AAAAB3NzaC1yc2EAAAABJQAAAQEAn6iQCpmzoJ1U26PWGwC+fgQvd0R2HMLh7Rbz
[14:27:42] <Krenair>	 4pNA1A/VSxryznkvimc015OvFFZLGFHYFzHGjJh66P0m6zhKH/fsMBQeuHENxZwi
[14:27:42] <Krenair>	 9n1Sv1/Ro+W8GNt9qYEmoq6Ql/tYCUFQvKo6pVDUJS+qQpnJJ6ffV39DUSSjnMNr
[14:27:43] <Krenair>	 G9AIwOGQLLQq502zxsxnFiBptMJLaFF3TZookCYcJVGt8qbzz9OU5ctuRTWZaKpO
[14:27:44] <Krenair>	 UBDHFNCW9cttkL545qYJW1m/ZeCaJI7qK4NTHYAlvXeHnu2x4gsGlfiOHL8KvnHo
[14:27:46] <Krenair>	 y9mIPX40x1kKlkBiNRq+VaX5ThBc9kbPcbHwv1t2nfM6Zmr+Cw==
[14:27:50] <Krenair>	 ---- END SSH2 PUBLIC KEY ----
[14:28:04] * zhuyifei1999_ did `ssh-key-ldap-lookup`
[14:28:18] <Krenair>	 instead of something more like this: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYxCqZkGys8gZB6Mq61Fw08CB7m1huxpnpII2ay3e0H krenair@gmail.com inspiron
[14:28:37] <zhuyifei1999_>	 I wonder why incorrectly formatted public keys are accepted by striker
[14:29:05] <Krenair>	 https://unix.stackexchange.com/a/84122/182989
[14:33:44] <Gratus>	 With what format I should convert my ssh key ?
[14:35:31] <zhuyifei1999_>	 openssh
[14:42:09] <Gratus>	 When i made PuttyKeyGen > Conversions > ExportOpenSSH key, it give me only private key
[14:44:11] <zhuyifei1999_>	 I have no idea about putty
[14:45:32] <Gratus>	 (I was blind, it was just before my eyes)
[14:45:45] <Gratus>	 I changed my key
[14:45:59] <Gratus>	 I have now ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAn6iQCpmzoJ1U26PWGwC+fgQvd0R2HMLh7Rbz4pNA1A/VSxryznkvimc015OvFFZLGFHYFzHGjJh66P0m6zhKH/fsMBQeuHENxZwi9n1Sv1/Ro+W8GNt9qYEmoq6Ql/tYCUFQvKo6pVDUJS+qQpnJJ6ffV39DUSSjnMNrG9AIwOGQLLQq502zxsxnFiBptMJLaFF3TZookCYcJVGt8qbzz9OU5ctuRTWZaKpOUBDHFNCW9cttkL545qYJW1m/ZeCaJI7qK4NTHYAlvXeHnu2x4gsGlfiOHL8KvnHoy9mIPX40x1kKlkBiNRq+VaX5ThBc9kbPcbHwv1t2nfM6Zmr+Cw== rsa-key-wikimedia
[14:47:55] <Gratus>	 but I have the same error message
[14:50:40] <Krenair>	 strange
[14:50:54] <Krenair>	 is the key in your SSH agent?
[14:50:57] <Gratus>	 As login, we must write the Shell account name ?
[14:51:01] <zhuyifei1999_>	 I don't see your username in /var/log/auth.log
[14:51:01] <Krenair>	 yes
[14:51:28] <Krenair>	 you need to ensure it uses your shell username gratus instead of whatever you've logged into your local computer as
[14:53:37] <Gratus>	 I have in the terminal "Using username "gratus"." and the same error message
[14:54:47] <Krenair>	 strange
[14:55:03] <Krenair>	 zhuyifei1999_, anything in tools-bastion-03's auth.log now?
[14:56:26] <zhuyifei1999_>	 I don't think so
[14:56:32] <zhuyifei1999_>	 grep no results
[14:56:55] <Krenair>	 Gratus, can you show us the results of the full verbose logging (ssh -vvv) ?
[15:00:28] <Gratus>	 =~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2018.07.29 16:59:58 =~=~=~=~=~=~=~=~=~=~=~= login as: gratus
[15:03:15] <Krenair>	 oh, PuTTY
[15:03:43] <Krenair>	 are you using pageant?
[15:04:16] <Gratus>	 pageant ?
[15:04:32] <Krenair>	 what is your ssh agent?
[15:04:45] <Gratus>	 Putty
[15:04:53] <Krenair>	 or are you just pointing PuTTY straight at your SSH key?
[15:10:27] <Gratus>	 I've just tried on my linux (more easy that putty ^^) and I get gratus@login ... : Permission denied (publickey, hostbased)
[15:11:17] <Krenair>	 can you paste the whole terminal output somewhere?
[15:11:25] <Krenair>	 and command that you ran
[15:17:06] <Krenair>	 hi gratus_
[15:17:26] <gratus_>	 hi
[15:18:22] <Krenair>	 gratus_, please paste the whole terminal output including the command you ran somewhere
[15:18:26] <gratus_>	 https://framagit.org/Gratus/ssh-login-temp/blob/master/log
[15:19:12] <Krenair>	 okay well it doesn't look like you provided a key
[15:19:35] <Krenair>	 try adding "-i path/to/your/id_rsa" after the -vvv
[15:19:54] <Krenair>	 substituting the path/to/your/id_rsa with your actual one of course :)
[15:21:09] <gratus_>	 where can I find this file ? Is it the key that I generated ?
[15:21:15] <Krenair>	 yes
[15:21:19] <zhuyifei1999_>	 your private key
[15:21:21] <Krenair>	 the private part
[15:25:25] <Gratus>	 i will past the response
[15:26:12] <gratus_>	 updated, same link
[15:26:37] <gratus_>	 it's seem there is a problem of permission now
[15:32:12] <Krenair>	 gratus_, chmod 600 /home/gratus/Bureau/private.ppk
[15:32:13] <Krenair>	 then try it
[15:33:42] <gratus_>	 updated, same link
[15:34:19] <Krenair>	 does that file begin with begin ssh2 private key?
[15:35:00] <gratus_>	 PuTTY-User-Key-File-2: ssh-rsa
[15:35:08] <gratus_>	 Encryption: aes256-cbc
[15:35:16] <gratus_>	 Comment: rsa-key-wikimedia
[15:35:25] <gratus_>	 Public-Lines: 6
[15:38:58] <Krenair>	 gratus_, yeah I don't know how to convert from that format to openssh
[15:39:32] <Krenair>	 maybe just start again and generate the key from openssh this time
[15:40:56] <gratus_>	 I know 
[15:41:03] <gratus_>	 I logged in
[15:42:18] <gratus_>	 thanks for your help
[15:43:05] <Krenair>	 no worries
[15:43:24] <gratus_>	 So, just avoid Windows when you have to use command lines :)
[15:43:44] <Krenair>	 openssh can work fine on windows
[15:43:55] <Krenair>	 I used the one that's part of git bash when I had to use windows
[19:32:27] <wikibugs>	 (03CR) 10Rosalieper: [C: 032] modified the reply function and the reply_tweet class. Bot now reply to tweets [labs/tools/Commons-twitter-bot] - 10https://gerrit.wikimedia.org/r/445849 (https://phabricator.wikimedia.org/T190163) (owner: 10Rosalieper)
[19:38:54] <wikibugs>	 (03CR) 10D3r1ck01: [V: 032] modified the reply function and the reply_tweet class. Bot now reply to tweets [labs/tools/Commons-twitter-bot] - 10https://gerrit.wikimedia.org/r/445849 (https://phabricator.wikimedia.org/T190163) (owner: 10Rosalieper)
[19:39:31] <wikibugs>	 (03CR) 10D3r1ck01: [V: 032] added a friendly reply to blocked emojies [labs/tools/Commons-twitter-bot] - 10https://gerrit.wikimedia.org/r/445891 (https://phabricator.wikimedia.org/T190163) (owner: 10Rosalieper)
[19:39:57] <wikibugs>	 (03CR) 10D3r1ck01: [V: 032] Added License and Author name to the images tweeted. [labs/tools/Commons-twitter-bot] - 10https://gerrit.wikimedia.org/r/447443 (https://phabricator.wikimedia.org/T190163) (owner: 10Rosalieper)
[19:40:26] <wikibugs>	 (03CR) 10D3r1ck01: [V: 032] Documenting Code [labs/tools/Commons-twitter-bot] - 10https://gerrit.wikimedia.org/r/447662 (https://phabricator.wikimedia.org/T190163) (owner: 10Rosalieper)
[19:46:41] <NicoV>	 Hi, can anyone help me correctly setup my account on WMFLabs ?
[19:47:04] <NicoV>	 I created my developer account on https://toolsadmin.wikimedia.org/
[19:47:37] <wikibugs>	 (03PS4) 10Lokal Profil: Ensure unicode encoding of query results [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/447794 (https://phabricator.wikimedia.org/T200325)
[19:47:51] <NicoV>	 I added my tool wpcleaner, but on my home page, it says "Your account is not associated with any tools"
[19:48:30] <Krenair>	 bd808, ^
[19:48:57] <NicoV>	 I also followed the doc to generate a SSH Key and add it to my account, but when I try to connect through SSH, I get a Permission denied (publickey,hostbased)
[19:49:36] <NicoV>	 !help can anyone help me correctly setup my account on WMFLabs ?
[19:49:36] <wm-bot>	 NicoV: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team
[19:49:57] <Krenair>	 krenair@tools-bastion-03:~$ ldapsearch -x cn=tools.wpcleaner member -LLL
[19:49:57] <Krenair>	 dn: cn=tools.wpcleaner,ou=servicegroups,dc=wikimedia,dc=org
[19:49:57] <Krenair>	 member: uid=nicov,ou=people,dc=wikimedia,dc=org
[19:50:14] <Krenair>	 looks fine
[19:50:14] <legoktm>	 https://toolsadmin.wikimedia.org/tools/id/wpcleaner shows that you're the maintainer
[19:50:16] <Krenair>	 NicoV, alright well let's focus on getting you SSH access to tools first
[19:50:26] <NicoV>	 ok, thanks
[19:50:48] <Krenair>	 NicoV, are you using OpenSSH?
[19:50:52] <bd808>	 NicoV: try logging out of toolsadmin and then back in again. There is a known bug about it only updating some data on login
[19:51:08] * bd808 is not really here
[19:52:57] <NicoV>	 I logged out and logged in again: the message has changed
[19:53:36] <Krenair>	 what is the message now?
[19:53:53] <NicoV>	 Krenair: I don't know, I just setup an Ubuntu VM and using the ssh provided
[19:54:04] <Krenair>	 NicoV, alright that'll be OpenSSH
[19:54:18] <Krenair>	 what is the command you are using to connect to login.tools.wmflabs.org?
[19:54:27] <NicoV>	 Krenair: message is "Add a git repository to a tool"
[19:54:39] <Krenair>	 I think that's an optional thing
[19:54:46] <NicoV>	 Just  ssh login.tools.wmflabs.org
[19:55:14] <wikibugs>	 (03CR) 10Lokal Profil: [C: 04-1] Ensure unicode encoding of query results (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/447794 (https://phabricator.wikimedia.org/T200325) (owner: 10Lokal Profil)
[19:55:23] <Krenair>	 NicoV, what is your local username inside the VM?
[19:55:33] <NicoV>	 wpcleaner
[19:55:39] <Krenair>	 alright well that won't work
[19:55:51] <Krenair>	 your username on tools is nicov
[19:56:01] <Krenair>	 not wpcleaner
[19:56:10] <Krenair>	 you'll need to ssh nicov@login.tools.wmflabs.org
[19:56:37] <NicoV>	 ok, will give it a try
[19:57:45] <NicoV>	 Krenair: yes, that was the problem, stupid me...
[19:58:17] <Krenair>	 I should put together a little SSH troubleshooting checklist
[19:58:41] <Krenair>	 1) username specified (or local one if not), and what is the correct remote one
[19:59:03] <NicoV>	 While I'm at it : can you explain to me what are the "Diffusion repositories" for a tool ?
[19:59:11] <Krenair>	 2) key specified (or in agent if not), and what is the correct remote one
[19:59:19] <Krenair>	 3) key format on both ends
[19:59:34] <NicoV>	 do they allow me to host a new release of a tool for people to download it ?
[19:59:35] <Krenair>	 4) dealing with crappy restrictive networks
[20:00:05] <Krenair>	 NicoV, those are source code repositories
[20:00:49] <Krenair>	 Phabricator Diffusion will host repositories in Git (Wikimedia uses this), and also Subversion (Wikimedia last used this like 6.5 years ago), and Hg (unused?)
[20:01:22] <Krenair>	 for a while people were thinking about moving from Gerrit to Diffusion+Differential. dunno where we are with that
[20:03:11] <NicoV>	 ok, so I won't use that, I'm already using GitHub
[20:04:02] <NicoV>	 Thanks for the help !
[20:04:48] <Krenair>	 uh
[20:04:49] <Krenair>	 ok
[20:04:58] <Krenair>	 I think we normally use Gerrit
[20:09:52] <wikibugs>	 (03CR) 10Lokal Profil: [C: 032] Add unit tests for group_missing_commonscat_by_source method [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/448025 (owner: 10Jean-Frédéric)
[20:11:17] <wikibugs>	 (03Merged) 10jenkins-bot: Add unit tests for group_missing_commonscat_by_source method [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/448025 (owner: 10Jean-Frédéric)
[20:12:16] <wikibugs>	 (03CR) 10jenkins-bot: Add unit tests for group_missing_commonscat_by_source method [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/448025 (owner: 10Jean-Frédéric)
[20:20:45] <wikibugs>	 (03PS2) 10Lokal Profil: [WIP]Use table creation logic from common [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/447782
[20:41:22] <wikibugs>	 (03PS1) 10Legoktm: Revert "Disable the rest of the Phabricator integration" [labs/tools/extreg-wos] - 10https://gerrit.wikimedia.org/r/449086 (https://phabricator.wikimedia.org/T200232)
[20:42:15] <wikibugs>	 (03CR) 10Legoktm: [C: 032] Revert "Disable the rest of the Phabricator integration" [labs/tools/extreg-wos] - 10https://gerrit.wikimedia.org/r/449086 (https://phabricator.wikimedia.org/T200232) (owner: 10Legoktm)
[20:42:32] <wikibugs>	 (03Merged) 10jenkins-bot: Revert "Disable the rest of the Phabricator integration" [labs/tools/extreg-wos] - 10https://gerrit.wikimedia.org/r/449086 (https://phabricator.wikimedia.org/T200232) (owner: 10Legoktm)
[20:45:45] <Krenair>	 https://wikitech.wikimedia.org/wiki/User:Alex_Monk/SSH_troubleshooting
[21:23:47] <legoktm>	 Krenair: move to Help: ? :)
[21:24:41] <Krenair>	 guess so
[21:58:23] <wikibugs>	 (03PS1) 10Lokal Profil: Introduce tests for categorize.images.outputStatistics() [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/449092
[21:59:14] <wikibugs>	 (03PS2) 10Lokal Profil: Introduce tests for categorize_images.py:outputStatistics() [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/449092
[22:19:17] <wikibugs>	 (03PS3) 10Lokal Profil: Use table creation logic from common [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/447782
[22:32:25] <wikibugs>	 (03CR) 10Lokal Profil: "ran this using the proxy patch for ge_ka and ro_ro. (i.e. removed all other configs). the resulting table can be found at https://phabrica" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/447782 (owner: 10Lokal Profil)
[22:37:49] <wikibugs>	 (03PS1) 10Lokal Profil: Extend gitignore [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/449098