[00:10:12] 06Labs, 10wikitech.wikimedia.org: Get rid of SemanticMediaWiki/SRF/SF from wikitech.wikimedia.org - https://phabricator.wikimedia.org/T53642#3138988 (10bd808) [00:20:51] 06Labs, 10wikitech.wikimedia.org: Get rid of SemanticMediaWiki/SRF/SF from wikitech.wikimedia.org - https://phabricator.wikimedia.org/T53642#3139013 (10bd808) [00:28:16] 06Labs, 10wikitech.wikimedia.org: Get rid of SemanticMediaWiki/SRF/SF from wikitech.wikimedia.org - https://phabricator.wikimedia.org/T53642#3139019 (10Reedy) [00:31:04] 06Labs, 10wikitech.wikimedia.org: Get rid of SemanticMediaWiki/SRF/SF from wikitech.wikimedia.org - https://phabricator.wikimedia.org/T53642#3139020 (10Reedy) [00:33:11] 06Labs, 10wikitech.wikimedia.org: Get rid of SemanticMediaWiki/SRF/SF from wikitech.wikimedia.org - https://phabricator.wikimedia.org/T53642#3139023 (10Reedy) [00:35:11] 06Labs, 10wikitech.wikimedia.org: Get rid of SemanticMediaWiki/SRF/SF from wikitech.wikimedia.org - https://phabricator.wikimedia.org/T53642#545071 (10Reedy) ``` Method editArticle Found usages (6 usages found) Method call (6 usages found) MediaWiki (6 usages found) extensions/Op... [00:51:30] 06Labs, 10Tool-Labs, 10wikitech.wikimedia.org, 15User-bd808: Replace SMW data on project instances with a tool using the OpenStack APIs - https://phabricator.wikimedia.org/T161662#3139068 (10bd808) https://tools.wmflabs.org/openstack-browser/ is the replacement tool that allows browsing the list of project... [01:03:15] 06Labs, 10wikitech.wikimedia.org: Get rid of SemanticMediaWiki/SRF/SF from wikitech.wikimedia.org - https://phabricator.wikimedia.org/T53642#3139101 (10bd808) [03:30:43] bd808: Would be nice if https://tools.wmflabs.org/sal/cvn could maybe interlink to openstack-browser [03:31:00] Makes the loop complete :) [03:31:53] Krinkle: not a bad idea. File a task to remind me? https://github.com/bd808/SAL/issues [03:33:00] it will be a bit of a hack to put in there but I can probably figure out a reasonable way [03:34:02] bd808: Yeah. [03:34:03] bd808: Done [03:34:23] bd808: Alternatively, (but you won't like this) a SAL viewer on a certain openstack-browser url or view [03:34:40] yeah. I actually thought about that too [03:34:42] I only just found out that per-project views exist for SAL in the tool. [03:35:12] the "other" link lists all of them that are in the index [03:35:23] Yeah, saw that. [03:35:34] I actually discovered it just now via a different route (openstack-browser) [03:35:59] * Krinkle requires a lot of effort every single time he types openstack-browser as to not type browserstack) [03:36:16] ewww [03:37:06] bd808: btw, random Q. I just audited the server monitoring for CVN instances. Mostly stable, except one thing: the root partition slowly fills up over time. I suspect it isn't anything my apps or bots are writing, nor is it any lack of log rotation. [03:37:18] But more Linux or Ubuntu or apt or puppet kind of stuff [03:37:34] I ran apt-get autoremove which reclaimed about 40% of what I lost in the last 6 months [03:37:35] but it's not all [03:39:18] interesting [03:39:25] https://graphite-labs.wikimedia.org/render/?title=cvn-apache8+Disk+space+last+year&from=-1year&target=aliasByNode%28maximumAbove%28cvn.cvn-apache8.diskspace.%2A.byte_avail%2C0%29%2C-3%2C-2%29 [03:39:43] given only 20GB in total, it drops from 16GB post-install-and-provision to about 8GB free now [03:39:48] autoremove got it back to 12GB or so [03:40:21] (which removed like a hundred boot/vmlinuz-* files or so [03:40:37] still curious where the rest went, but this suffices for now [03:40:56] Ideally my instances aren't going to crash by design if stable for more than 10 months [03:41:30] (probably more like months to reach 0, but still) [03:41:33] 20 [03:42:52] I wonder if the rest is apt cache? [03:44:01] Krinkle: you might try `sudo apt-get clean` and see what changes [03:44:28] that would dump old package versions in /var/cache/apt [03:45:42] bd808: got me another 1GB. [03:45:48] nice [03:46:11] there must be some logs that aren't rotating somewhere [03:47:26] Started with 16.2GB, dropped to 15GB last year, somehow I was able to reclaim that. Forgot how. Now it dropped to 8GB but back up to ~ 15.0GB now [03:48:33] you should figure out a monthly cleanup script that we can cron :) [03:53:31] bd808: also, autoremove does not seem to work unattended [03:53:57] I passed -y as option before autoremove, but I still get the purple screen telling me "A new version of /boot/grub/menu.lst is available, but the version installed" for every file [03:54:03] which is *very* tedious [03:54:10] "keep the local version currently installed " is what I select [03:54:43] No idea what this is (beyond my self-taught devops skils from a distance) [03:55:42] grub's menu.lst is the list of available kernels that you can boot if you break into the interactive grub menu [03:57:18] do we modify it somehow? [03:57:28] It seems like it expects it to be something different [03:57:40] I'll paste the next diff [03:57:57] we may add something, yeah [03:58:00] https://gist.githubusercontent.com/Krinkle/239acadba1f8441d55cdd0601a231e1f/raw [03:58:09] you can try `export DEBIAN_FRONTEND=noninteractive` [03:58:51] maybe --force-confold and --force-confdef too [03:59:01] --really-really-y ? [03:59:08] messing with grub can be a bit scary [03:59:22] I'm just keeping it all as-is, only removing things not changing [04:00:13] It seems like mainly just the last few updates didn't get listed in the grub menu [04:00:54] maybe because we modify it, it's not safe for the auto update to add itself to grub menu [04:01:05] but then, what am I removing? Did the new updates not really apply then? [04:01:08] * Krinkle doesn't know [04:01:41] sounds like a question for a real sys admin :) [04:02:12] * bd808 is a manager now and old enough to be forgetful [04:02:20] The prod solution is to not have a 20GB root drive and otherwise replace or reinstall within 2 years, right? [04:02:49] (or 8 years, would still be fine given 100GB+ drives) [04:03:50] the "really don't ask" apt invocation is something like: DEBIAN_FRONTEND=noninteractive apt-get $ACTION -q -y -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" [04:05:35] but how would the script ask if stdin is not a tty? (or better closed fd)? [04:06:27] for some things it would just error [06:25:57] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3139285 (10Joe) [06:27:06] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3139297 (10Joe) [07:51:05] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/GoranSMilovanovic was modified, changed by GoranSMilovanovic link https://wikitech.wikimedia.org/w/index.php?diff=1754187 edit summary: [07:56:20] Hi there. I have started working as a Data Analyst for Wikimedia Deutschland recently. If I understand correctly, I can use the Labs machines to do some stats and access some DB replicas, and also if I understand this page: https://wikitech.wikimedia.org/wiki/Help:Getting_Started#Projects correctly, I need to create a Project in order to be able to spin virtual machines and work there. I already have Production access (NDA signed [07:58:37] GoranSM: your post has been truncated. ends with "I already have Production access (NDA signed" [07:59:16] Danny_B: I already have Production access (NDA signed, etc) on stat1002 and stat1003. Q: How do I proceed to access Labs and work there? Thanks a lot! Goran [07:59:32] Hopefully now everything is there [07:59:49] GoranSM: i can try to help you a bit with basics [07:59:57] do you have accound on wikitech? [08:00:03] *account [08:00:07] Yes I do, Danny_B. [08:00:35] in preferences, do you have two factor authentication enabled? [08:00:48] I think so, let me check [08:01:13] so i assume you basically need to crank up the new project under tools? [08:02:47] First, I have to enable 2factorAuth, which I will do right now. Second: can you please explain what exactly are tools on Wikimedia Labs? I understand that there are projects under Labs, and then there are some projects under tools under Labs; what are these tools and why do they have a specific status? [08:02:57] Third, thanks for support! :) [08:08:48] well, tbh, the difference to me is not so clear as well. apart from my assumption that tools is a specific subset of labs (they are going to rename everything to wikimedia cloud services or sth like that to have the only single name) [08:09:55] Danny_B: thanks. I am setting up 2FacAuth now. [08:09:56] aside of tools there are couple specific projects - bastion (that's what you will be logging in through) and some further targetted for testing of specific apps [08:10:10] GoranSM: win or linux? [08:10:35] Danny_B: I already have access to Bastion (I use it to proxy towards stat 1002 and stat 1003 on production) . Linux of course. [08:11:45] * Danny_B is not familiar with access to production via labs bastion, but assumes once you have it, it's worth to try if you can log in to horizon [08:12:14] assuming you have set your ssh key in preferences [08:16:34] Danny_B: Are you implying that there are different bastion hosts to access (a) production and (b) labs? My 2FactAuth on Wikitech is set. [08:21:10] GoranSM: nope, not implying anything. i just said i am not familiar with it. as i said earlier, i can help you only with simple beginning steps, further assistance needs to be provided by admins or more experienced users [08:22:05] anyway, it seems you need to wait for admins to add you to tools anyway, the doc says requests are usually processed on daily basis [08:22:55] Danny_B: Thanks for support, Danny_B! I have filed a request for a new project on Labs on Wikitech, I guess someone will here my cries anytime soon... :) Thanks a lot! [08:22:58] did you see https://wikitech.wikimedia.org/wiki/Help:Tool_Labs#Getting_access_to_Tool_Labs ? [08:23:15] as well as the rest of the page [08:23:34] i guess it can help to answer at least some of your questions in the meantime [08:24:26] also, i guess all relevant admins who can proceed the request are based in the u.s., so you'll have to wait couple hours, since they most probably sleep now ;-) [08:24:47] (but i might be wrong and there will be some european or awake amarican ;-)) [08:27:06] :-D [08:42:55] 06Labs, 10Tool-Labs: Cannot access replica databases - access denied - https://phabricator.wikimedia.org/T151296#3139570 (10MnemonicFlow) Thanks everyone for helping! Got everything working now! (y) [09:38:56] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Have Edit Counter use same architecture and front-end as the other pieces that have been re-written - https://phabricator.wikimedia.org/T160481#3139620 (10MusikAnimal) No, maybe SUL is probably a misnomer. "Top global contributions" or something similar is wou... [09:41:03] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3139285 (10hashar) > We might want to have all nodes in this environment derive from a base node that includes all the labs b... [09:50:02] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3139659 (10Joe) @hashar the point is to have something that resembles production, including the role-based hiera lookup. It... [09:51:35] 10Tool-Labs-tools-Xtools, 06Community-Tech: Output data for new XTools: Articleinfo - https://phabricator.wikimedia.org/T157706#3139661 (10DannyH) [10:08:09] 06Labs, 10Tool-Labs: Provide jessie (or later) grid compute on Tool Labs - https://phabricator.wikimedia.org/T161690#3139716 (10Magnus) [10:13:14] 06Labs, 10Labs-Infrastructure, 10DNS, 06Discovery, and 3 others: multi-component wmflabs.org subdomains doesn't work under simple wildcard TLS cert - https://phabricator.wikimedia.org/T161256#3139736 (10grin) >>! In T161256#3138330, @Peachey88 wrote: >>>! In T161256#3138272, @grin wrote: >> I would expect... [10:33:31] (03CR) 10MtDu: "Can someone do a review? Thanks!" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/345087 (https://phabricator.wikimedia.org/T161421) (owner: 10MtDu) [11:29:50] 10PAWS, 10MediaWiki-extensions-OAuth: Oauth for PAWS fails - presumably because of username change - https://phabricator.wikimedia.org/T161696#3139903 (10FaFlo) [13:41:27] 10PAWS, 10MediaWiki-extensions-OAuth: Oauth for PAWS fails - presumably because of username change - https://phabricator.wikimedia.org/T161696#3139903 (10Framawiki) Related: T135306 Yes, paws locally save username at the first login. Thé new name broke it. [14:04:07] 06Labs, 06DC-Ops, 06Operations: Move labstore1002 and labstore1002-array1 and labstore1002-array2 to different rack (currently in C3) - https://phabricator.wikimedia.org/T158913#3140321 (10Cmjohnson) I mentioned this to Chase in PM on IRC...there is not a labs-support vlan in row B currently. [14:49:08] 06Labs, 13Patch-For-Review: Disable multiarch support in all Labs precise instances - https://phabricator.wikimedia.org/T111760#3140459 (10Dzahn) [14:49:14] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Deprecate precise instances in Labs by 2017-03-31 - https://phabricator.wikimedia.org/T143349#3140460 (10Dzahn) [14:50:53] 06Labs, 13Patch-For-Review: Disable multiarch support in all Labs precise instances - https://phabricator.wikimedia.org/T111760#1615743 (10Dzahn) I assume this is already resolved because of T143349 or it will be in 2 days at least. I found it because i saw: modules/aptly/manifests/client.pp ``` 5 if... [14:51:40] 10MediaWiki-extensions-OpenStackManager: Convert OpenStackManager to use extension registration - https://phabricator.wikimedia.org/T87950#3140468 (10Reedy) p:05Low>03Lowest [14:58:16] 10MediaWiki-extensions-OpenStackManager: Convert OpenStackManager to use extension registration - https://phabricator.wikimedia.org/T87950#1001696 (10Reedy) Due to T161553, this probably isn't worth doing [15:47:33] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3139285 (10bd808) > on the deployment-prep puppetmaster, define a disk-based hiera hierarchy to mimic 1:1 what we have in pro... [15:57:13] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3140702 (10Joe) >>! In T161675#3140664, @bd808 wrote: >> on the deployment-prep puppetmaster, define a disk-based hiera hiera... [16:03:20] 06Labs, 10Horizon: Stop requiring two-factor authentication for horizon.wikimedia.org - https://phabricator.wikimedia.org/T161473#3140735 (10Andrew) 05Open>03declined Wikitech has always required 2fa for any actions that affect VMs. Since that's all that Horizon does, requiring 2fa for all of Horizon main... [16:12:44] 06Labs, 10Tool-Labs: replica.my.cnf appears to not exist for my tool labs account - https://phabricator.wikimedia.org/T158389#3140805 (10Hall1467) @madhuvishy Yes, the file is there now. Thank you! [16:18:55] 06Labs: Graphite vs. archive-instances - https://phabricator.wikimedia.org/T161518#3140826 (10bd808) p:05Triage>03Normal [16:26:01] #wikimedia-labs] [16:48:51] 06Labs: Graphite vs. archive-instances - https://phabricator.wikimedia.org/T161518#3141002 (10Andrew) 05Open>03Resolved Seems fixed. [16:50:26] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org: Stop using OpenStackManager, make Wikitech an SUL wiki - https://phabricator.wikimedia.org/T161553#3135041 (10Jdforrester-WMF) Is moving wikitech to SUL a good idea? There's a lot of complications from doing that which aren't blockers... [16:52:35] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org: Stop using OpenStackManager, make Wikitech an SUL wiki - https://phabricator.wikimedia.org/T161553#3141011 (10Andrew) The goal is to have wikitech be just a normal wiki like any other, the source of Wikimedia technical documentation.... [16:54:55] 06Labs, 10Tool-Labs, 07Tracking: Tool Labs users missing replica.my.cnf (tracking) - https://phabricator.wikimedia.org/T135931#3141032 (10madhuvishy) [16:57:11] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org: Stop using OpenStackManager, make Wikitech an SUL wiki - https://phabricator.wikimedia.org/T161553#3141039 (10Jdforrester-WMF) I thought there were some quite horrible issues with the shell/account naming stuff? There's also the probl... [17:01:27] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org: Stop using OpenStackManager, make Wikitech an SUL wiki - https://phabricator.wikimedia.org/T161553#3135041 (10Dzahn) The wikitech user name won't match the SUL username. So that would mean all wikitech users start to use their SUL use... [17:02:28] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org: Stop using OpenStackManager, make Wikitech an SUL wiki - https://phabricator.wikimedia.org/T161553#3141057 (10Dzahn) I would also recommend to split this into 2 tasks, one about using OpenStackManager and one about making Wikitech use... [17:06:44] 06Labs, 10Tool-Labs: Provide jessie (or later) grid compute on Tool Labs - https://phabricator.wikimedia.org/T161690#3139716 (10bd808) Related: {T155063} It turns out that jessie doesn't ship a modern nodejs either. The WMF repo does include a backport from somewhere though of 6.x (currently 6.9.1~dfsg-1+wmf1... [17:36:49] (03CR) 10Luke081515: [C: 031] Wikibugs realname should use HTTPS over HTTP [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/345087 (https://phabricator.wikimedia.org/T161421) (owner: 10MtDu) [17:36:50] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3139285 (10thcipriani) > * on the deployment-prep puppetmaster, configure a 'staging' environment for puppet, with its own si... [17:47:16] 10Tool-Labs-tools-Pageviews: Add daily date type to all Pageviews apps - https://phabricator.wikimedia.org/T158900#3141191 (10MusikAnimal) 05Open>03Invalid Not sure what I was getting at here... the default date type is Daily and is supported in all the apps. [17:48:48] question chasemp, madhuvishy I want to remove user fhocutt from two tool groups (tools.grantsbot and tools.hostbot). where do I make the request? it's not particularly time-sensitive. [17:51:42] wikimedia-sibu [17:55:01] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3141211 (10bd808) >>! In T161675#3141154, @thcipriani wrote: >>>! In T161675#3140664, @bd808 wrote: >> I think I would sugges... [17:57:04] 10Tool-Labs-tools-Pageviews, 13Patch-For-Review: Add ability to query for legacy pageviews for projects - https://phabricator.wikimedia.org/T149358#3141213 (10MusikAnimal) @Nuria Sorry for the confusion... this ticket was for me to add support in Pageviews Analysis for the new endpoint (which does not use page... [17:57:26] 10PAWS, 10MediaWiki-extensions-OAuth: Oauth for PAWS fails - presumably because of username change - https://phabricator.wikimedia.org/T161696#3139903 (10Tgr) Is T136114 related? You can use the central user ID (the `sub` field of the identifying JWT) as a more stable identifier. [17:58:48] 10Tool-Labs-tools-Pageviews: Make it more clear stats.grok.se is an option, and explain it's approximate - https://phabricator.wikimedia.org/T153990#3141218 (10MusikAnimal) 05Open>03Invalid We will be using the new API endpoint to get the legacy data, see T149358 [18:02:13] 10Tool-Labs-tools-Pageviews: Add hourly stats to Siteviews - https://phabricator.wikimedia.org/T148610#3141252 (10MusikAnimal) [18:05:58] 10Tool-Labs-tools-Pageviews: Show error massage when requesting unsupported date ranges - https://phabricator.wikimedia.org/T144782#3141269 (10MusikAnimal) 05Open>03Invalid All apps now allow querying of any supported date range, and soon we'll have the legacy data supported as well (T149358) [18:06:32] 10Labs-project-Wikistats: wikistats: add new wikipedias: kbp, khw, dty - https://phabricator.wikimedia.org/T160947#3141275 (10Dzahn) 05Open>03stalled waiting for those to be installed (createwiki) [18:09:23] 10Tool-Labs-tools-Pageviews, 13Patch-For-Review: Add ability to query for legacy pageviews for projects - https://phabricator.wikimedia.org/T149358#3141279 (10MusikAnimal) Or actually, maybe you simply thought I was using pageviews.js, in which case your updates here are very helpful. If that is case let me si... [18:09:44] J-Mo: you can do it yourself from http://tools.wmflabs.org/?list [18:10:00] there's a manage maintainers link under the toolname [18:10:40] you can also log here like '!log tools.x removed user ' [18:11:54] madhuvishy thank you! [18:12:25] J-Mo: yw :) [18:16:44] 06Labs, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Puppet, 15User-Joe: Re-think puppet management for deployment-prep - https://phabricator.wikimedia.org/T161675#3141291 (10Joe) >>! In T161675#3141154, @thcipriani wrote: > Will this repo //just// be a different `site.pp` for beta node d... [18:41:39] !log deployment-prep upgrading elasticsearch and kibana to 5.1.2 on deployment-logstash2 to test puppet+integration prior to prod deployment [18:41:44] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [18:53:12] 10Tool-Labs-tools-Pageviews, 13Patch-For-Review: Add ability to query for legacy pageviews for projects - https://phabricator.wikimedia.org/T149358#3141376 (10Nuria) @MusikAnimal I see, I agree with not adding Pageview_API tag to tags that identify your backlog, otherwise it is going to be confusing. That is t... [19:03:32] !log admin-monitoring updated image, cleared out old stuck instances [19:03:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin-monitoring/SAL [19:05:53] 10Tool-Labs-tools-Pageviews, 13Patch-For-Review: Add ability to query for legacy pageviews for projects - https://phabricator.wikimedia.org/T149358#3141395 (10MusikAnimal) >>! In T149358#3141376, @Nuria wrote: > @MusikAnimal I see, I agree with not adding Pageview_API tag to tags that identify your backlog, ot... [19:06:53] 10Tool-Labs-tools-Pageviews, 13Patch-For-Review: Add ability to query for legacy pageviews for projects - https://phabricator.wikimedia.org/T149358#3141396 (10Nuria) @MusikAnimal we still to triple vet data and fix docs, we will send an announcement when all this work is done. [20:14:43] Hi all, does anyone know how to run a program through an instance? [20:16:35] jsub ? [20:19:39] its .java [20:19:43] specifically .idea [20:20:50] and? [20:21:02] how would you launch it locally? [20:22:02] ? Through terminal [20:22:14] what do you write in your terminal? [20:23:16] Normally I run it with ./idea.sh in the /bin file [20:23:35] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labcontrol1003/1004 - https://phabricator.wikimedia.org/T158207#3141742 (10chasemp) [20:23:57] if you would usually do ./idea.sh [20:24:07] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labcontrol1003/1004 - https://phabricator.wikimedia.org/T158207#3029754 (10chasemp) [20:24:10] with jsub you would do jsub ./idea.sh [20:24:22] (on its most basic incarnation, see https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Grid for the full docs) [20:24:33] if you need a specific folder [20:24:50] you can cd as the first command in the sh [20:25:09] ok [20:25:19] I will try that [20:25:23] thanks [20:25:34] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labnet1003/1004 - https://phabricator.wikimedia.org/T158204#3141755 (10chasemp) [20:25:46] or you can use -wd [20:26:10] ie. jsub -wd /my/folder ./idea.sh [20:26:50] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labnet1003/1004 - https://phabricator.wikimedia.org/T158204#3029672 (10chasemp) [20:27:24] hmm [20:27:31] where is jobutils source? [20:28:33] labs/toollabs [20:30:01] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labnet1003/1004 - https://phabricator.wikimedia.org/T158204#3141783 (10chasemp) >>! In T158204#3116230, @RobH wrote: > Is there a specific cpu seed we have to stick to? 24 cores without HT is dual 12 core CPUs. Anything between... [20:30:09] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labnet1003/1004 - https://phabricator.wikimedia.org/T158204#3141784 (10chasemp) 05stalled>03Open [20:33:38] @Platonides: jsub is not recognized as a command [20:33:57] where are you running it? [20:34:13] I assumed you wanted to run it from toollabs [20:34:16] I am in the instance, using bash [20:34:40] what kind of instance? [20:34:57] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labcontrol1003/1004 - https://phabricator.wikimedia.org/T158207#3141806 (10chasemp) [20:35:02] I dont think Im in toolabs, its a different project [20:35:08] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labnet1003/1004 - https://phabricator.wikimedia.org/T158204#3141807 (10chasemp) [20:35:30] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtest - https://phabricator.wikimedia.org/T154706#3141810 (10chasemp) [20:35:34] then you don't have access to the tools grid [20:36:06] however, in that case you could probably do ./idea.sh [20:36:11] which project is it? [20:36:17] The math project [20:37:05] I can use./idea, but the directory doesn't exist on the instance [20:37:54] Can I transfer the program from my computer? [20:38:35] so, you developed something locally [20:38:41] and now want to run it on an instance? [20:38:56] Yes [20:40:03] then you will indeed need to copy the relevant files [20:40:43] how do I do that? [20:41:01] from which OS are you copying? [20:41:34] also, you can ssh directly to the instance? [20:41:43] Linux [20:41:49] and yes [20:42:55] there are a few ways to copy [20:43:04] my favourite is to use rsync [20:43:19] rsync -avz myproject remoteinstance: [20:45:00] 06Labs, 06Operations, 10hardware-requests: eqiad: (1) hardware access request for dedicated labmon1002 - https://phabricator.wikimedia.org/T161750#3141878 (10chasemp) [20:45:17] ok [20:46:58] ok, I entered that with the project and instance name [20:47:27] it says sync failed, no such file or directory [20:47:46] I didnt specify which files? [20:49:22] what I named "myproject" would be the local folder [20:49:41] you can use absolute paths, of course [20:49:57] also, you can swap the parameters to move from the instance to local [20:50:23] just a note: a trailing / in the folder name means copying the folder files, without the folder itself [20:51:00] ok, so I'm guessing I do this locally [20:51:59] can you provide the actual names? [20:52:32] the document is idea-IC-171.3780.107 [20:52:45] the instance is drmf-beta [20:53:50] oh it looks like it worked [20:54:54] :) [20:54:59] Thank you! [20:55:05] you are welcome, amao ! [20:57:13] 06Labs, 06Operations, 10hardware-requests: eqiad: (1) hardware access request for labnodepool1002 - https://phabricator.wikimedia.org/T161753#3141989 (10chasemp) [21:16:15] 06Labs, 10DBA, 06Operations: eqiad: (2) hardware access request for labsdb1004 & 5 - https://phabricator.wikimedia.org/T161754#3142042 (10chasemp) [21:16:44] 06Labs, 10DBA, 06Operations: eqiad: (2) hardware access request for labsdb1004 & 5 refresh - https://phabricator.wikimedia.org/T161754#3142056 (10chasemp) [21:18:06] 06Labs, 10DBA, 06Operations: eqiad: (2) hardware access request for labsdb1006 & 7 refresh - https://phabricator.wikimedia.org/T161755#3142057 (10chasemp) [21:18:24] 06Labs, 06Operations, 10hardware-requests: eqiad: (1) hardware access request for dedicated labmon1002 - https://phabricator.wikimedia.org/T161750#3142069 (10chasemp) [21:27:55] 06Labs, 06Operations, 10hardware-requests: eqiad: (1) hardware access request for labnodepool1002 - https://phabricator.wikimedia.org/T161753#3141989 (10faidon) labnodepool wasn't actually on my list, since it was slated for Q4 of FY17-18 and I only focused on accelerating more immediate orders (Q1 mostly).... [21:31:05] 06Labs, 06Operations, 10hardware-requests: eqiad: (1) hardware access request for labnodepool1002 - https://phabricator.wikimedia.org/T161753#3142153 (10chasemp) 05Open>03stalled I had noted on the procurement sheet to forward to Q4 of 16/17 if budget allowed due to the age from a previous convo. I'm go... [21:40:17] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestneutron refresh - https://phabricator.wikimedia.org/T154706#3142206 (10chasemp) [21:43:09] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestneutron refresh - https://phabricator.wikimedia.org/T154706#3142213 (10chasemp) [21:45:16] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestnet2003 [region 2] - https://phabricator.wikimedia.org/T161764#3142232 (10chasemp) [21:48:45] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestvirt2003 [region 2] - https://phabricator.wikimedia.org/T161765#3142249 (10chasemp) [21:50:43] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestnet2003 [region 2] - https://phabricator.wikimedia.org/T161764#3142261 (10chasemp) [21:52:37] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestvirt2003 [region 2] - https://phabricator.wikimedia.org/T161765#3142262 (10chasemp) [21:52:52] 06Labs, 06Operations, 10hardware-requests: Codfw: (2) hardware access request for labtest [region 2] - https://phabricator.wikimedia.org/T161766#3142263 (10chasemp) [21:53:57] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labcontrol1003/1004 - https://phabricator.wikimedia.org/T158207#3142274 (10chasemp) a:03RobH [21:54:05] 06Labs, 06Operations, 10hardware-requests: Eqiad: (2) hardware access request for labnet1003/1004 - https://phabricator.wikimedia.org/T158204#3142275 (10chasemp) a:03RobH [21:54:22] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestneutron refresh - https://phabricator.wikimedia.org/T154706#3142276 (10chasemp) a:03RobH [21:54:45] 06Labs, 06Operations, 10hardware-requests: eqiad: (1) hardware access request for dedicated labmon1002 - https://phabricator.wikimedia.org/T161750#3142277 (10chasemp) a:03RobH [21:55:13] 06Labs, 10DBA, 06Operations: eqiad: (2) hardware access request for labsdb1006 & 7 refresh - https://phabricator.wikimedia.org/T161755#3142279 (10chasemp) a:03RobH [21:55:20] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestnet2003 [region 2] - https://phabricator.wikimedia.org/T161764#3142280 (10chasemp) a:03RobH [21:55:29] 06Labs, 06Operations, 10hardware-requests: Codfw: (1) hardware access request for labtestvirt2003 [region 2] - https://phabricator.wikimedia.org/T161765#3142281 (10chasemp) a:03RobH [21:55:35] 06Labs, 06Operations, 10hardware-requests: Codfw: (2) hardware access request for labtest [region 2] - https://phabricator.wikimedia.org/T161766#3142282 (10chasemp) a:03RobH [22:06:01] 06Labs, 06Operations, 07Wikimedia-Incident: Investigate need and candidate for labstore100(1|2) kernel upgrade - https://phabricator.wikimedia.org/T121903#3142322 (10chasemp) [22:06:03] 06Labs, 06Operations, 13Patch-For-Review: Reimage labstore1001 and labstore1002 for DRBD storage setup - https://phabricator.wikimedia.org/T158196#3142320 (10chasemp) [22:06:05] 06Labs, 10Tool-Labs: Provide jessie (or later) grid compute on Tool Labs - https://phabricator.wikimedia.org/T161690#3142323 (10Magnus) 05Open>03Invalid Figured out a way to do it with the "n" node manager. Clunky, but it works. [23:38:33] 06Labs, 13Patch-For-Review: Disable multiarch support in all Labs precise instances - https://phabricator.wikimedia.org/T111760#3142544 (10Dzahn) @chasemp @andrewbogott I believe this can be resolved and my change above can be merged now or soon when the last precise instance is gone in labs.