[05:13:04] (03PS197) 10Ricordisamoa: Initial commit [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 [05:25:54] (03CR) 10Ricordisamoa: [C: 04-2] "PS197 splits session and loading from ChangeEmitter into EntityLoaderAndChangeEmitter" [labs/tools/wikidata-slicer] - 10https://gerrit.wikimedia.org/r/241296 (owner: 10Ricordisamoa) [07:13:31] (03PS1) 10Legoktm: Initial commit [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399346 [07:13:43] (03CR) 10Legoktm: [V: 032 C: 032] Initial commit [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399346 (owner: 10Legoktm) [08:27:13] (03PS1) 10Legoktm: Point file links to Phabricator, only poll repos every hour [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399354 (https://phabricator.wikimedia.org/T183336) [08:27:25] (03CR) 10Legoktm: [V: 032 C: 032] Point file links to Phabricator, only poll repos every hour [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399354 (https://phabricator.wikimedia.org/T183336) (owner: 10Legoktm) [09:49:14] (03PS1) 10Legoktm: Support multiple search profiles [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399365 [09:51:04] (03CR) 10Legoktm: [V: 032 C: 032] Support multiple search profiles [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399365 (owner: 10Legoktm) [10:24:09] (03PS1) 10Legoktm: Don't bind hound_proxy to localhost [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399371 [10:24:11] (03PS1) 10Legoktm: Add README [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399372 [10:24:22] (03CR) 10Legoktm: [V: 032 C: 032] Don't bind hound_proxy to localhost [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399371 (owner: 10Legoktm) [10:24:28] (03CR) 10Legoktm: [V: 032 C: 032] Add README [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399372 (owner: 10Legoktm) [10:43:53] (03PS1) 10Legoktm: Add core-only search profile, improve UI [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399375 [10:44:02] (03CR) 10Legoktm: [V: 032 C: 032] Add core-only search profile, improve UI [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399375 (owner: 10Legoktm) [10:51:34] (03PS1) 10Legoktm: Bold search profile currently in use [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399378 [10:51:47] (03CR) 10Legoktm: [V: 032 C: 032] Bold search profile currently in use [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399378 (owner: 10Legoktm) [10:54:05] sneak preview: http://codesearch2.wmflabs.org/search/ [11:13:53] legoktm: wow you're fast. but the icon for the search is broken for me [11:14:05] (the icon which is shown while it is searching) [13:01:04] (from -operations), Can someone take a look at https://dpaste.de/Vnh5/raw -- cannot vagrant ssh apparently [13:17:12] * arturo looks [13:19:28] tonythomas: no idea, better wait for bd808. He will be around in a couple of hours, give or take [13:21:24] feel free to open a task in phabricator [14:25:24] (03Draft1) 10Paladox: Add support for gerrit 2.15 [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/399386 [14:25:26] (03PS2) 10Paladox: Add support for gerrit 2.15 [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/399386 [14:25:43] (03CR) 10jerkins-bot: [V: 04-1] Add support for gerrit 2.15 [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/399386 (owner: 10Paladox) [14:28:23] (03PS3) 10Paladox: Add support for gerrit 2.15 [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/399386 [14:28:41] (03CR) 10jerkins-bot: [V: 04-1] Add support for gerrit 2.15 [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/399386 (owner: 10Paladox) [14:28:52] (03PS4) 10Paladox: Add support for gerrit 2.15 [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/399386 [14:33:15] tonythomas: that error is caused by updating an older MediaWiki-Vagrant install past the change where we removed the local plugin gem. There should be a task in phab (probably closed) that explains how to fix [14:33:48] I’m on mobile and searching is not finding it, but I know it’s there [14:35:06] You have to purge Vagrant’s memory of the old plugin [14:36:52] https://phabricator.wikimedia.org/T151928 [14:37:22] https://phabricator.wikimedia.org/T156066 [14:59:21] !log deployment-prep Dumping all databases on deployment-db03 so I can restore replication on deployment-db04. This may cause MediaWiki writes to fail while the dump runs [14:59:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [15:07:26] !log deployment-prep Dropped invalid view labswiki.updates, restarting dump [15:07:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [15:30:57] !log deployment-prep Restarting dump again, failed due to lack of disk space [15:31:05] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [16:41:17] any help on ssh? [16:41:53] I getting Authentication failed error [16:42:21] roni: What are you trying to do? [16:42:32] Before getting the authentication failed error? [16:43:14] login to toolforge ssh -i ~/.ssh/id_rsa username@login.tools.wmflabs.org [16:43:43] with my username [16:43:54] Is your public key on Wikitech? [16:44:23] it is on toolforge because they wrote to put it in either of them [16:44:46] Associate your SSH public key with your Wikitech account using the Preferences > OpenStack tab or Toolforge admin console [16:44:48] Also, does your RSA key pair have a password attached to it? [16:45:01] roni: Okay! [16:45:03] no it doesn't [16:45:10] Okay! [16:45:22] Can you check your shellname on Wikitech preferences? [16:45:28] Your username should be your shellname [16:45:39] yea already did, it is the same [16:46:14] Okay! Let me walk you through something (another option) [16:46:22] run this on your terminal [16:46:30] eval `ssh-agent` [16:46:50] ssh-add ~/.ssh/id_rsa [16:47:04] Then try to connect using ssh username@login.tools.wmflabs.org [16:47:10] Tell me what you get! [16:48:20] still Authentication failed [16:48:55] roni: Okay! So the issue maybe at the level of the key? [16:49:06] Can you add your public key (id_rsa.put) content to Wikitech? [16:49:20] I will try [16:49:21] *id_rsa.pub [16:49:27] roni: Please give it a try [16:49:41] you can use the "cat ~/.ssh/id_rsa.pub" [16:49:54] Get the content (copy) and then paste in Wikitech [16:54:47] still not working.. [16:55:43] Can you use -vvv connect when trying to connect via SSH? [16:56:05] So the command should be like this: ssh -i -vvv ~/.ssh/id_rsa username@login.tools.wmflabs.org [16:56:33] Lets a full trace of what is happening [16:56:49] Can you send me a link to your account? I mean your Wikitech account? [16:58:10] roni: Don't want to think you are not in the "Shell user" group on Wikitech? [16:58:28] Warning: Identity file -vvv not accessible: No such file or directory. [16:58:47] how can I send you my account? [16:58:52] Sorry about that, the -vvv should be before the -i [16:59:11] roni: your Wikitech username [16:59:44] Roni.zhelenchuk [16:59:53] Try out the command again [17:00:02] With -vvv before -i [17:00:33] OpenSSH_7.5p1, OpenSSL 1.0.2k 26 Jan 2017 debug1: Reading configuration data /etc/ssh/ssh_config debug2: resolving "login.tools.wmflabs.org" port 22 debug2: ssh_connect_direct: needpriv 0 debug1: Connecting to login.tools.wmflabs.org [208.80.155.163] port 22. debug1: Connection established. debug1: identity file id_rsa type 1 debug1: key_load_public: No such file or directory debug1: identity file id_rsa-cert type -1 debug1: [17:01:20] roni: Connection was established [17:01:55] roni: Perfect! [17:02:14] So you can't access toolforge because you are not in the group "Shell users" on Wikitech [17:02:32] roni: Can you confirm this to me looking at your "member group" on Wikitech? [17:03:40] where can I see that? [17:04:28] You preference page [17:04:34] Preferences > User profile [17:04:38] * bd808 looks [17:05:05] Preferences > User profile > Member of group [17:05:19] I can see you are a member of "Autoconfirmed users" *only* [17:05:30] roni: It doens't look like you are a toolforge member yet. Did you apply and we forgot to approve it? [17:06:46] bd808: This sounds like a problem that was faced by someone sometime back [17:07:08] legoktm had to add the user to the "Shell users" group before the user could get into a Cloud VPS instance [17:07:13] This sounds like a similar problem [17:07:33] I do not see Roni.zhelenchuk in https://toolsadmin.wikimedia.org/tools/membership/?o=-status [17:07:38] bd808: But the error now is different :( [17:07:46] and there no welcome message on their talk page [17:08:06] roni: Did you apply for access on Toolforge? [17:08:11] I applied and it is "Approved." It really seems as it is from anothey user RoniBot(ronibot) [17:08:56] ah. ok -- https://wikitech.wikimedia.org/wiki/User_talk:RoniBot [17:10:08] roni: so are you using ronibot@login.tools.wmflabs.org in your ssh command? [17:10:10] roni: Okay! :) [17:10:47] but I dont have the user RoniBot :\ [17:11:13] roni: I'm confused now [17:11:36] Hmmm... :/ [17:12:18] Could this be possible? A bot files a Toolforge membership account request? [17:13:13] 'I applied and it is "Approved." It really seems as it is from anothey user RoniBot(ronibot)' -- so is Roni.zhelenchuk your "normal" Wikimedia user name and then you created a developer account through https://toolsadmin.wikimedia.org named RoniBot? [17:14:10] yes [17:15:05] so then you do have the user RoniBot [17:15:36] and the RoniBot account is the one that is currently a Toolforge member [17:16:17] when I try to login via RoniBot it says that username does not exists [17:17:29] Hmmm.... [17:18:12] On Wikitech, username != shellname (but can be the same if user wants it that way) [17:18:15] I can see in the database that the Developer account (LDAP account) RoniBot is linked to the SUL account Roni.zhelenchuk [17:18:35] created_at: 2017-12-10 15:36:45 [17:18:40] bd808: Wuh.. Now I'm also confused :( [17:19:34] roni has created multiple Developer accounts: Roni.zhelenchuk and RoniBot [17:19:57] both share the same email address [17:20:10] But the RoniBot is a Toolforge member [17:20:24] and the Roni.zhelench account has an ssh key [17:20:39] So ... I think the fix is probably to backup a step [17:20:54] and abandon the RoniBot account [17:21:12] and apply for Toolforge membership with the Roni.zhelenchuk account [17:21:37] Ok. Thank you very much for your help!!! My parter also got approved and it works for her [17:21:43] roni is any of this making sense? [17:22:20] Yes I understand, thank you! you helped a lot [17:22:49] roni: if you open a Phabricator ticket I can remove the SUL association between the RoniBot developer account and the Roni.zhelench SUL account so that you can add the Roni.zhelench SUL account to the Roni.zhelench Developer account [17:23:21] and we can remove the RoniBot Developer account from Toolforge and leave it abandoned [17:23:41] then you can join Toolforge as the Roni.zhelench Developer account [17:23:45] Can you please remove the RoniBot account? [17:23:57] and if you want make a tool named ronibot to run your bot [17:24:01] I will use my partners account [17:24:21] Thank you! [17:24:28] which I'm guessing is what you were trying to do originally but the instructions were not clear enough [17:25:23] The split between SUL accounts and Developer accounts is confusing to many people. We need to make it less confusing :/ [17:27:18] roni: can you go to and open a ticket to request the change please [17:27:35] I would like to have a better audit trail than just an irc discussion [17:27:46] but this should be pretty easy to fix at this point [17:28:44] ok [18:00:38] !log deployment-prep Importing dump from deployment-db03 on deployment-db04 [18:00:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [18:42:36] bd808: you can terminate my experiment [19:06:30] matanya: which one? The collab suite stuff? [19:06:40] yes [19:06:52] too hard to setup, or just no time? [19:07:35] conflicts with puppet and i found little user base interested [19:07:42] *nod* [19:07:46] so not worth the time as seems [19:12:07] matanya: when you get a chance, could you make at note on T181662 ? [19:12:07] T181662: Evaluate if 'collaborate' project is successful - https://phabricator.wikimedia.org/T181662 [19:15:59] done bd808 [19:16:34] Hey wait a min whats this project [19:20:57] see link. [19:21:03] Sagan: ah yeah, it's getting eaten by one of the proxies, I need to figure out where/why [19:22:24] matanya: same if be interested in that :/ oh well [19:22:28] Shame* [19:22:34] Id* [19:54:17] !log tools.zppixbot restarted bot to stop duplicate reminder msgs being sent [19:54:19] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot/SAL [20:27:56] (03PS1) 10Legoktm: If not mangling, treat everything as binary [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399461 (https://phabricator.wikimedia.org/T183409) [20:27:58] (03PS1) 10Legoktm: Add footer links to hound and source code [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399462 (https://phabricator.wikimedia.org/T183350) [20:37:55] (03CR) 10Legoktm: [V: 032 C: 032] If not mangling, treat everything as binary [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399461 (https://phabricator.wikimedia.org/T183409) (owner: 10Legoktm) [20:38:03] (03CR) 10Legoktm: [V: 032 C: 032] Add footer links to hound and source code [labs/codesearch] - 10https://gerrit.wikimedia.org/r/399462 (https://phabricator.wikimedia.org/T183350) (owner: 10Legoktm) [21:12:56] !log collaborate Deleting instance (T181662) [21:12:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Collaborate/SAL [21:12:59] T181662: Evaluate if 'collaborate' project is successful - https://phabricator.wikimedia.org/T181662 [21:13:46] !log collaborate Deleted proxy ynh.wmflabs.org (T181662) [21:13:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Collaborate/SAL [21:19:07] !log collaborate Deleted project (T181662) [21:19:08] bd808: Unknown project "collaborate" [21:19:08] T181662: Evaluate if 'collaborate' project is successful - https://phabricator.wikimedia.org/T181662 [21:19:12] heh [21:30:30] bd808: lol i dont think stashbot works on deleted projects :P [21:30:51] nope. that was actually a good test that the delete worked :) [21:31:53] bd808: be funny if stashbot said umm you just deleted that and you want to log to it are you nuts? [21:32:52] [22:20:48] chasemp: if you have some time, how would I go about figuring out the real error message from https://phabricator.wikimedia.org/T173478#3852774 ? I don't see it in puppet.log [22:34:31] legoktm: try `sudo -i puppet agent -tv --debug` [22:34:54] * legoktm runs [22:35:07] that should spew a bunch of extra puppet logging at you [22:35:22] Debug: Exec[git_clone_labs/libraryupgrader](provider=shell): Executing '["/bin/sh", "-c", "/usr/bin/git clone -b master https://gerrit.wikimedia.org/r/labs/libraryupgrader /srv/libraryupgrader"]' [22:35:22] Debug: Executing with uid=libraryupgrader gid=libraryupgrader: '/bin/sh -c /usr/bin/git clone -b master https://gerrit.wikimedia.org/r/labs/libraryupgrader /srv/libraryupgrader' [22:35:22] Error: /usr/bin/git clone -b master https://gerrit.wikimedia.org/r/labs/libraryupgrader /srv/libraryupgrader returned 1 instead of one of [0] [22:35:22] Error: /Stage[main]/Profile::Wmcs::Tenants::Libraryupgrader/Git::Clone[labs/libraryupgrader]/Exec[git_clone_labs/libraryupgrader]/returns: change from notrun to 0 failed: /usr/bin/git clone -b master https://gerrit.wikimedia.org/r/labs/libraryupgrader /srv/libraryupgrader returned 1 instead of one of [0] [22:35:22] Notice: /Stage[main]/Profile::Wmcs::Tenants::Libraryupgrader/Git::Clone[labs/libraryupgrader]/Exec[git_pull_labs/libraryupgrader]: Dependency Exec[git_clone_labs/libraryupgrader] has failures: true [22:35:49] it still doesn't tell me the git error message :// [22:35:55] I wonder if it's an ownership problem? [22:36:20] /srv/libraryupgrader is libraryupgrader:www-data, but we're cloning it as libraryupgrader:libraryupgrader (I don't know if the group matters here) [22:36:21] ok. next step is to run the command that is failing and see if it says something [22:36:40] if the dir is u+wx it should be fine [22:37:16] drwxr-xr-x 2 libraryupgrader www-data 4096 Dec 20 21:20 libraryupgrader [22:37:52] root@upgrader-03:~# sudo -u libraryupgrader /usr/bin/git clone -b master https://gerrit.wikimedia.org/r/labs/libraryupgrader /srv/libraryupgrader [22:37:52] fatal: Could not change back to '/root': Permission denied [22:39:18] libraryupgrader@upgrader-03:~$ /usr/bin/git clone -b master https://gerrit.wikimedia.org/r/labs/libraryupgrader /srv/libraryupgrader [22:39:18] Cloning into '/srv/libraryupgrader'... [22:39:20] worked fine :/