[16:53:46] Hello! I strongly miss jsub / jstop in the cloud. [16:55:49] I have to maintain a program using mono and this hangs from time to time. So I tried to write a watchdog which checks the date of the logfiles and in case of such a possible hang ist stops the job and restarts it. But jstop/jsub is not available :-( [16:55:55] Any solution? [17:09:45] Wurgl: is this on a cloud vps instance? why not write a systemd unit to manage it? [17:11:07] s/cloud/grid/ [17:12:17] oh, do you mean you have a program that runs on the grid, and then you want that program to be able to restart itself? [17:12:50] But I managed it. You may hate me. But every hour I check the date of 10 logfile and if they are not modified within 4000 seconds, I do one database query. [17:13:04] And it runs now on the login server [17:14:01] 48 * * * * [ $(myscript) ] && /usr/bin/jsub -N cron-16 -once -quiet true 2>>dev/null [17:14:17] This makes that magic crontab-modifier happy [17:14:37] ok, I think that's reasonable, but be aware that if anything on the login server takes up too many resources it will get killed [17:14:52] I would have recommended using the -once option [17:15:02] oh, you're already using it [17:18:17] I know it is dirty [17:19:04] you should probably figure out why your program keeps hanging :) [17:19:14] Mono [17:19:30] During startup. [17:20:26] Sometime I see an excetion, but this is thrown from some point of the program which is before my code [17:20:49] And I am just the maintainer, I did not write it :-( [17:32:08] Wurgl: I would suggest checking why it hangs [17:33:09] but that will require ptrace on grid and it not really available for us mortals [17:33:26] Wurgl: is your code on github or something i could look to see if its something in code causing performance issues [17:33:45] zhuyifei1999_: thou shall consult thy cloud gods xD [17:34:07] my watchdog-like script? [17:34:29] jsub is only available on the submission hosts and that include the cron host, bastions, and webgrid [17:34:37] Wurgl: whatever is giving issues [17:35:45] if your watchdog is cron-based low-runtime you can use jlocal to run it on cronhost [17:37:21] https://ctrlv.it/id/65139/2009218364 [17:38:06] $statOut = stat("/data/project/wikihistory/dewiki_update$i.out"); <-- 10 times that check. This is the usual thing it does [17:38:34] The body with the queries is done about twice a day [17:38:58] uh this looks too much for the cron host [17:39:45] I really suggest checking why it hangs instead of making a watchdog [17:40:24] gdb/strace is your friend :) [17:40:38] Well, I do C/C++ for 40/20 years. C# ist just another language and I am not very familiar with it [17:41:01] neither am I [17:41:05] I would rewrite the program in C++ but my time is limited [17:41:49] is the c# source available somewhere? [17:43:39] https://ctrlv.it/id/65142/2934344624 <-- I get "sometimes" that exception [17:44:20] But I do not have any get_Project() in my code (line 28) [17:49:44] And no, the c#-source is not online – Just checked the authors homepage [18:59:38] andrewbogott: ping [19:04:17] matanya: what's up? [19:04:38] andrewbogott: i am planning to start a new service for labs users [19:04:55] calling it collaborate.wmflabs.org [19:05:00] or something [19:05:22] i need a debian jessie to test it, can one get such an image on labs ? [19:07:14] There should be a jessie image available pretty much wherever — do you need a new project or do you have space in an existing project? [19:09:14] i need an new project please andrewbogott [19:09:58] ah, ok — we generally review and approve new projects on Tuesdays; if you can make a ticket I'll put it on the agenda. Instructions are here https://phabricator.wikimedia.org/project/view/2875/ [19:10:13] (we're trying to be more methodical about project and quota changes, mostly so that >1 person knows about them) [19:11:04] will do, thanks! [19:14:29] andrewbogott: before i open and waste your time, my intention is to have nextcloud in this project with some tooling around it [19:14:45] I wanted to make sure it falls within the labs policy [19:15:22] * andrewbogott googles [19:16:36] would that be mostly as a replacement for http://download.wmflabs.org/ ? [19:16:55] Like, a way to host static content and files for other projects? [19:17:12] that, and also a meeting tool [19:17:38] sure [19:17:47] and maybe a calendar and a labs webamil, if permitted [19:17:59] That sounds great — as long as it's clear to users that they shouldn't store things that they don't want the world to see :) [19:18:14] i have one at home which i can share with you as a demo, if you wish [19:18:17] It looks like the license will be fine, but if you can find a link to their license page and included it in the project request that'll save us a bit of time. [19:18:53] For the file store you'll probably want a larger-than-normal disk quota as well, but maybe that's something we can postpone if you want to tinker first. [19:19:06] andrewbogott: https://github.com/nextcloud [19:19:26] i think i can start small and grow [19:19:31] great [19:19:52] Sounds useful to me anyway :) [19:20:05] want to get a demo link ? [19:21:52] andrewbogott: https://phabricator.wikimedia.org/T181369 [19:22:39] sure, pm me the link [19:22:50] (although I'm doing a bunch of different things at the moment) [23:13:41] Are the new database server already overloaded? This doesn't seem like it should take 40 sec with index: [23:13:45] SELECT 1 FROM wikidatawiki_p.wb_items_per_site WHERE ips_site_page='Harrington Place, Stellenbosch' AND ips_site_id != 'enwiki'; [23:16:57] The index: https://github.com/wikimedia/mediawiki-extensions-Wikibase/blob/master/repo/sql/Wikibase.sql#L28 [23:17:49] What does superseded mean on quarry? [23:24:25] https://tools.wmflabs.org/tools-info/optimizer.py <-- this page is known? [23:24:27] Oh yes, Wikidata stuff is incredibly slow today [23:25:54] Yeah icinga has been going nuts about wdqs [23:25:59] In -operations [23:42:52] Zppix: superseded means a new query revision is running, and the query revision you are checking is halted [23:43:17] Wurgl: what do you mean about that optimizer? [23:45:28] I was wandering if you could use some hint like USE KEY(wb_ips_site_page) but this seems to be impossible with Views :-( [23:46:09] This is a legal statement, but sadly not with views: SELECT 1 FROM wikidatawiki_p.wb_items_per_site USE KEY(wb_ips_item_site_page) WHERE ips_site_page='Harrington Place, Stellenbosch' AND ips_site_id != 'enwiki'; [23:48:25] with keys it’s not possible [23:48:36] *views [23:50:02] Ty zhuyifei1999_ [23:51:27] Ive tried multiple different syntax i cant get the results to exclude bots (https://quarry.wmflabs.org/query/22719) [23:51:38] Someone help? [23:52:06] check user rights [23:52:19] Ugh how? [23:52:39] method 1: left join on null [23:53:13] method 2: not-in or not-exists subquery [23:54:01] ... and some obscure methods [23:55:34] Whats the easiest for a person who knows just enough sql to manage to select a table... and well that is it.? [23:56:21] well, user rights is in a different table than user [23:56:52] so ‘select a table’ don’t really work here [23:57:16] idk if a simple select on two tables work [23:57:49] You already have explained more than i know so whatever xD [23:58:12] anyways, google left join