[00:55:16] Any idea why npm is OOMing when I try to run it on the grid? Happens even if I do -m 1g [00:56:30] How are you running it Gaelan? [00:59:22] jsub -mem 1g -j y -sync y -stderr -cwd npm install [00:59:24] jsub -mem 1g -j y -sync y -stderr update.sh [00:59:43] (where update.sh is a script that git pulls, calls npm install, etc) [00:59:45] neither works [01:00:33] chicocvenancio ^ [01:01:43] Grid is weird with mem calculations, I'd try increasing it to 2g or even 4g before looking further [01:04:29] Gaelan: ^ [01:04:39] running [01:05:07] seems to be working [01:05:10] thanks! [03:21:34] Hi I am with Tool account "wikiloop", I wonder if developer like me can leverage Docker service to deploy my service and job? [04:17:55] xinbenlv: unfortunately we do not have a “bring your own container” setup for kubernetes [10:25:24] Hello! I've job name 'itwiki-deletionbot' that does not quit from the grid [10:27:14] My last line of log.out is it's successful quit, and my last line of log.err is 'there is a job named 'itwiki-orphanizerbot' already active' [10:27:52] I followed this: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Grid#Stuck_jobs but problem persists [10:28:42] How to kill my 'itwiki-deletionbo' process sent to the grid yesterday (22 March)? [11:01:25] I've writed via mail, regards I have to go :) [13:22:36] https://tools.wmflabs.org/whois/ is giving me a http 500 [13:40:09] f2k1de, contact Whym [13:40:18] who is listed as the author [15:17:25] Hi, what owners and groups should have files and directories in /shared? (I ask because some files in /shared/pywikibot and /shared/pywikipedia can not be manipulated using `become pywikibot`) [15:17:55] Or is there any way to fix file/folder permissions? [15:27:13] What exactly I want to do is to remove old core_old and create a symlink core_old > /data/project/pywikibot/publish_html/core_stable [15:27:25] (in pywikipedia folder) [15:56:50] Dvorapa: looking [15:57:58] the two symlinks are owned by tools.pywikibot [15:58:29] yeah, but core_old is a folder owned by russ blaus [15:59:31] you mean, these? [15:59:35] https://www.irccloud.com/pastebin/e9V0PA0G/ [15:59:56] I'd recommend you ask russblau then [16:00:04] I mean the folder (first), yes [16:00:22] I don't understand what it is and why is it there [16:00:50] For me I think it should point to the current core_stable [16:01:01] But maybe it has some special purpose [16:01:03] ? [16:02:09] given that you own /shared/pywikipedia, you might be able to just move the directory out of the way if you insist [16:02:47] idk what it was used for in 2013 [16:03:04] I can not move it anyhow [16:03:08] nor remove it [16:04:18] https://www.irccloud.com/pastebin/i1CCR00j/ [16:05:47] I can not move it anyhow <= did you actually try? [16:07:37] Dvorapa: ^ [16:08:21] zhuyifei1999_: yes. how could you achieve that? [16:09:25] mv. you own a non-stick directory, you can move files/subdirectories in if even if you don't own the files/subdirectories themselves [16:10:17] file name is stored in the directory entries, not the inodes [16:11:07] you just need permission on the directory entry (by owning the parent directory inode) [16:12:43] anyways, too much filesystem talk. just google inode or read https://en.wikipedia.org/wiki/Inode [16:26:35] anyway thank you! [16:40:39] np [17:36:23] !help Hi, why I can`t connect to login.tools.wmflabs.org [17:36:23] Zoranzoki21: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [17:36:32] It gives me connection closed error [17:38:58] Ok, I connected now to login.tools.wmflabs.org [17:39:07] But I can`t become ircclient [17:39:22] It shows me this error: [17:39:22] zoranzoki21@tools-sgebastion-07:~$ become ircclient [17:39:23] You were added to the group tools.ircclient after you started this login session. [17:39:23] You need to log out and in again to be able to "become ircclient". [17:39:31] But I tried it already and still happens [17:52:59] Zoranzoki21: maybe just ldap taking a while to change group membership. Can you try logging out and in again? [17:53:28] chicocvenacio: I tryed it few times [17:53:44] *tried [17:54:00] Oh, works now :) [18:03:14] :) yeah, it was probably ldap being weird [18:12:37] hare, thank you for the answer. Therefore what's the recommended deploy mechanism? [18:13:05] (to ensure deployment consistency etc.) [18:30:21] xinbenlv: unfortunately at this moment, you have to use the toollabs-* container images, run `webservice shell` and deploy from there. you data will be on a NFS share and it'll be used to run any new replicas [20:19:27] I see, thank you gtirloni [20:19:38] gtirloni, thank you! [20:28:15] By the way, why is the WMF Toolforge currently not accepting new developer account signup? [20:37:08] xinbenlv: Yes, that's a temporary issue. Sorry for the inconvenience. [21:06:05] I see [21:45:38] can I use "screen" or "tmux" inside the tools. ? [21:46:30] xinbenlv: yes, but that does worry me about using bastion for non-interactive jobs [21:47:03] it should not be interactive, that's why I want to put it into a screen [21:47:11] maybe that's not suggested way to do it [21:47:37] sorry my questions might seem dump. what's recommended way to run a job within my toolforge? [21:47:45] well, we're not allowed to use non-interactive things in the bastion [21:47:55] what does it mean? [21:47:57] you're supposed to use either kubernetes or the job grid [21:48:15] such as cronjob [21:48:35] job grid is the grid engine [21:49:17] This is what i found: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#Kubernetes_cronjobs [21:49:25] It is possible to run cron jobs on kubernetes (see upstream documentation for a full description), however this functionality is not officially supported by the Wikimedia Cloud Services team and should be considered an experimental feature. [21:49:54] yes, currently it is probably better to use the grid engine for cron jobs [21:50:05] what is the thing you are trying to do? [21:50:11] running a script? [21:51:55] xinbenlv: ^ [21:58:19] yes, a daily job to copy released datasets into a mysql db. My bot depend on these data to be updated [21:58:54] I am not super familiar with job grid nor kubernates. that's why I asked about the docker a few hours ago. [22:00:09] then a cronjob with `jsub -quite` is probably your best option [22:00:23] *`jsub -quiet` [22:01:06] let me learn about it [22:01:39] sure, https://wikitech.wikimedia.org/wiki/Help:Toolforge#Architecture_and_terminology has some good initial points [22:03:07] basically the bastions should only be for interactive things and submitting jobs to kubernetes or the grid engine. Using it for non-interactive stuff degrades the experience for everyone and might be stopped at any time [22:03:54] wait a miniute [22:04:09] a cronjob needs to be run with "tools account", which is what I am trying to do [22:04:10] https://wikitech.wikimedia.org/wiki/Help:Toolforge#Tool_Accounts [22:05:14] Any process intended to keep running while you are not actively interacting with it (e.g., through a detached screen session, as a background process, or through cron) must be run through a tool account, and not your personal account. [22:06:23] yes [22:06:29] so my understanding is, it's permitted to run a cron job directly with my tool account, in this case "tools.wikiloop", with a cron job? (instead of using a Job Grid)? [22:07:08] well, the crontab will just send it to the job grid without asking you [22:07:53] what you are quoting there is rule 3, what I was quoting was rule 4 https://wikitech.wikimedia.org/wiki/Help:Toolforge/Rules [22:08:21] but you can just do `crontab -e` and add your command [22:08:53] the especial crontab wrapper will add `jsub` in front of your cron entry though [22:09:34] I assume that also means the job will be run under the environment (e.g. dependencies like nodejs installed) when I use cronjob to run my program under /data/project//. ? [22:10:23] that depends how you "installed" the dependencies [22:10:55] the job grid has a lot of stuff pre-installed, but you can customize with version managers [22:11:46] it does have nodejs preinstalled, version 8 something iirc [22:25:30] Em... [22:25:48] I guess then the best thing for me to do is to checkout the kubernates docker approach [22:29:35] It seems we can run docker, except that it requires only run on certain image docker-registry.tools.wmflabs.org [23:34:48] https://www.irccloud.com/pastebin/EZWU9VD2/ [23:34:57] keeps getting ErrIamgePull [23:35:16] anyone familiar with kubernetes in Toolforge?