[00:52:46] got a little bored tonight [00:53:15] just looking through RC trying to do a little proofreading [10:10:00] !log tools.zppixbot rhinosf1 - tar + gzip old raw sopel logs [10:10:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot/SAL [12:26:37] !log clouddb-services add myself as project admin [12:26:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL [12:52:21] !log tools install python3-pykube on tools-k8s-control-3 for some tests interaction with the API from python [12:52:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [18:11:21] Hi, how long does it usually take for an m1.small flavoured instance with a debian-10.0-buster image to be created? Initially it took a few seconds, then I had to delete the instance but after that it's taking suspiciously long for the instance to be created. The status is 'Build' and task is 'Scheduling'. [18:12:31] UYScuti: if the VM doesn't build within a minute, then a failure occurred somewhere [18:13:28] ah, it's probably that then. Should I scrap it and create a new one? [18:13:28] or is an intervention required? [18:14:18] btw, the project is wikilink [18:14:29] UYScuti: you could just drop it and create a new one. If that happens again, please open a phab task so we can investigate [18:14:43] the error shouldn't happen even once, but hey... [18:14:43] alright, will do. Thanks! [18:14:50] ikr ;) [18:29:46] hmm, no luck. Will file a task. Thanks for the support arturo! [18:54:59] !log tools launching tools-docker-imagebuilder-01 T248703 [18:55:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [18:55:03] T248703: Rebuild the docker builder for Toolforge - https://phabricator.wikimedia.org/T248703 [19:36:01] How do I know transfer files from my toolforge main account to a tool account (without using git)? [19:36:27] !help [19:36:27] thehelveticaguy: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [19:39:31] thehelveticaguy: you can transfer them to your account on the bastion, then "take" them as your tool account: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_Accounts#Manage_files_in_Toolforge [19:39:51] thehelveticaguy: if the files are already on the bastion then something like `cp ~tools./; become ; take ` should work [19:40:22] Yup that :) [19:47:35] bstorm_ bd808 thanks [19:48:04] what does the "take" command do? It seems to work without the take command [19:50:03] makes sure your tool account is marked as the owner of the files instead of your user account [19:51:07] !log admin start haproxy on cloudcontrol2003-dev.wikimedia.org [19:51:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [19:52:15] Another query: is it possible to directly ssh into a tool account? [19:52:51] "ssh tools.TOOLNAME@login.tools.wmflabs.org" gives a publickey error for me [19:52:58] no, you can't do that [19:53:47] Oh okay! [19:56:52] So is there a way to directly transfer files from local system to a tool account? [19:57:54] without going through the personal account? [19:58:10] this would be useful to automate file upload from a script [19:58:20] * bd808 is looking for the wikitech doc [20:00:10] thehelveticaguy: I'm still looking for the docs, but the answer is yes & sort of. You can only ssh connect as a human and not a tool, but you can do tricks with ssh/scp to end up manipulating files inside a tool's $HOME as your human account. [20:01:07] I guess this winscp doc was what I was remembering -- https://wikitech.wikimedia.org/wiki/Help:Access_to_Toolforge_instances_with_PuTTY_and_WinSCP#How_to_set_up_WinSCP_for_direct_access_to_your_Toolforge_account [20:05:35] thanks will look into it [20:06:42] One last query: all files in a tool account's directory are publicly visible from /data/project/TOOLNAME ?? [20:07:05] if that's the case, where do we store bot password and other private stuff? [20:07:09] unless you chmod them, yes [20:07:31] Ah! [20:10:50] `chmod o= ` should do it, but you should check the docs yourself to be sure [20:11:14] * AntiComposite can never remember the chmod syntax even with symbolic notation [20:12:01] haha i guess chmod 700 should do the trick [20:12:47] thehelveticaguy: you will want to be cautious about stripping shared group permissions. Shared groups are how your human user account can put files into the tools' $HOME [20:13:30] but yes, 0700 perms on files with passwords, OAuth secrets, etc are a good and standard practice [20:15:16] (it should go without saying, but please please please don't put secrets in your code, put them in a config file) [20:41:34] hi guys, it seems that DNS record huggle-rc.wmflabs.org got lost? [20:41:46] this is used for https://wikitech.wikimedia.org/wiki/XmlRcs [20:41:51] which is now defunct :( [20:42:10] I don't seem to be able to add DNS records in horizon anymore [20:42:50] petan: is it a floating ip you need or ah http proxy? [20:43:38] it's not a web service [20:43:49] I already have a floating I [20:43:51] * IP [20:44:00] it's just the DNS record that got removed for some reason [20:44:58] I honestly don't remember how long ago we removed the ability for folks to make their own top level DNS records, but it has been a while. [20:45:34] petan: I should be able to recreate the needed record. what instance, project, and IP should ti point towards? [20:45:37] well I don't know when exactly this stopped working, but maybe the record itself was removed only a while ago [20:46:05] the record was huggle-rc.wmflabs.org pointing to instance xmlrcs (port 8822) [20:46:07] TCP [20:46:40] I would probably be fine with NAT as well which could save you 1 IPv4 address but I doubt wmf cloud can do that now [20:47:15] I found a record for https://huggle-wl.wmflabs.org/ [20:47:22] 185.15.56.24 xmlrcs 172.16.2.29 wan-transport-eqiad [20:47:22] but not huggle-rc [20:47:45] huggle-rc is something else, rc is the XmlRcs recent changes stream [20:47:50] this service was around for years [20:47:59] it's documented here https://wikitech.wikimedia.org/wiki/XmlRcs [20:48:12] it's from 2015 [20:48:55] it's ancient but documented :) [20:49:57] !log wmflabsdotorg Created huggle-rc.wmflabs.org. A 185.15.56.24 [20:49:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wmflabsdotorg/SAL [20:50:58] petan: `dig +short huggle-rc.wmflabs.org` says it is back [20:53:07] great thanks [20:55:48] petan: I'm not going to guarantee that this won't get broken again. Letting Cloud VPS projects all stick their DNS records in the same zone is problematic in a lot of ways [20:56:32] we should setup something like rc.huggle.wmcloud.org for this and get your users to migrate [21:00:19] it's also possible to create a huggle-rc.wmflabs.org zone in petan's project and make a zone apex A record [21:01:56] I think there's a script for the creation of the zone by an admin [21:13:05] fortunatelly I was thinking ahead so it's possible to change this DNS record for all users rather easily [21:13:40] if it's a very big deal to use WMF domain for this I could probably setup a DNS record on my personal domain too but it's gonna look weird that Huggle uses yet another 3rd party domain for its components :P [21:15:20] !log tools deleted tools-docker-builder-06 T248703 [21:15:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [21:15:23] T248703: Rebuild the docker builder for Toolforge - https://phabricator.wikimedia.org/T248703 [21:17:44] petan: its not the domain, its delegation rules. and the wmcloud.org root domain I suggested is the future of most wmflabs.org hostnames. We just are not quite in that future everywhere yet :) [21:19:14] !log huggle Added BryanDavis (self) to project as an admin to look at DNS record stuff [21:19:14] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Huggle/SAL [21:22:17] !log tools removed puppet prefix tools-docker-builder T248703 [21:22:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [21:22:20] T248703: Rebuild the docker builder for Toolforge - https://phabricator.wikimedia.org/T248703 [21:28:08] !log admin Created huggle.wmcloud.org Designate zone and allocated it to the huggle project [21:28:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [21:28:57] !log huggle Created rc.huggle.wmcloud.org A 185.15.56.24 Designate recordset [21:28:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Huggle/SAL [21:30:33] !log huggle Created wl.huggle.wmcloud.org A 185.15.56.49 Designate recordset [21:30:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Huggle/SAL [21:31:35] petan: ^ you now have records that you can mange yourself through Horizon. I'm going to follow up by making the associated *.wmflabs.org records CNAMEs to these that you can control [21:38:09] !log wmflabsdotorg Replaced A records for huggle-{rc,wl}.wmflabs.org with CNAME records pointing to {rc,wl}.huggle.wmcloud.org [21:38:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wmflabsdotorg/SAL