[00:14:45] !log clouddb-services T224062 wikilabels postgres is now replicating to clouddb-wikilabels-01 [00:14:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL [00:14:48] T224062: clouddb1002 low on space -- move wikilabelsdb - https://phabricator.wikimedia.org/T224062 [00:17:14] bd808: hi! Welcome back from the hackathon. I am still interested in monitoring webservice for dupdet tool, so that if it dies, it restarts automatically. [00:17:59] By "dies" you mean... what exactly? [00:22:12] Sveta: [00:17] < bd808> By "dies" you mean... what exactly? [00:22:25] I saw you refuse to open a phab task about this a couple of times [00:22:28] bd808: it is no longer running, gives error 500 as I remember. [00:22:55] bd808: then I 'webservice restart' and I get '"Restarting webservice...............ERROR: Pod resisted shutdown" [00:23:04] bd808: then I 'webservice restart' again, and this time it works ok. [00:23:52] bd808: I tried to use phabricator before; its notifications does not integrate into Echo on-wiki, and I forget about it. I can throw some money at someone who implements this feature. [00:23:53] $HOME/service.manifest for that tool says it is running on the grid engine and not kubernetes... [00:24:02] bd808: is that a good thing? [00:25:03] Sveta: running on the grid makes the "ERROR: Pod resisted shutdown" message nonsense [00:25:33] but maybe you had it running on kubernetes at some point so that was not nonsense? [00:25:50] bd808: I didn't change it before, and do not know what either of these two things are. [00:25:56] bd808: which one is more reliable and more modern? [00:26:01] Kubernetes [00:26:30] bd808: ok, I'll change it to kubernetes and restart the webservice, if that works then I'll need to monitor it for dying. [00:27:03] bd808: that says "type must be one of golang,jdk8,node10,nodejs,php5.6,php7.2,python,python2,python3.5,ruby2,tcl". This is a php tool. [00:27:13] php5.6,php7.2 [00:27:17] both in that list [00:27:23] php7.2 is the one to use [00:27:23] Yes, I'll try php7.2. One sec. [00:27:59] bd808: http://dpaste.com/0GBGKZ9.txt [00:28:03] bd808: I'm confused what it wants. [00:29:23] hmmm... `webservice status` gives that type error too. What's going on here? [00:30:12] Sveta: what did you type just before `webservice restart`? [00:30:34] your service.manifest thinks you are on kubernetes now, but the job is actually running on the grid engine backend [00:35:43] bd808: I only edited the services.manifest, and then restarted the webservice. [00:35:58] bd808: I thought that'd be enough for it to move to kubernetes [00:36:15] Sveta: so you ignored the "# Please do not edit manually at this time." comment in that file [00:36:20] ;) [00:36:31] bd808: yes, I did. what is the correct way? [00:36:56] bd808: I didn't see it, until you showed it to me on the chat. [00:38:23] Sveta: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web#Switching_between_GridEngine_and_Kubernetes [00:40:31] ok thanks [00:41:44] Sveta: for you meta question about monitoring for the running process, both backends have systems that automatically do that. This is why folks from my team keep being confused about what you are asking for. [00:42:15] bd808: http://dpaste.com/09X7Y6W.txt and it just froze here [00:43:21] Sveta: ugh. Let me kill all the things and get it running for you on the kubernetes backend with the php7.2 type as a sane base. [00:44:34] bd808: yes, please - thanks. [00:47:34] Sveta: wow. that took quite a bit, but -- https://tools.wmflabs.org/dupdet/ [00:50:12] Sveta: is that tool really running a php file that was last edited 7 years ago? https://github.com/wikigit/Duplication-Detector [00:50:19] bd808: yes, it is. [00:50:34] bd808: it is pretty popular at English Wikipedia, too. (Popular enough that it dies every day or two.) [00:51:14] bd808: some URLs, perhaps from sciencedirect.com, cause it to die while retrieving the page content. I'm editing it to log more verbosely, hoping to fix it. [00:51:22] it probably "dies" because the code is rotten... [00:52:28] * bd808 sees 123M of error.log going back to 2016-02-09 and weeps [00:52:48] bd808: if there are any particular tips about retaining the functionality and improving the code, I would be glad to follow. [00:53:17] bd808: it started with jalexander not having time to even restart the tool timely, and he does not have time to edit the code, so now it is my task. [00:53:46] bd808: is space a problem? Do you want me to download that file? Clearly the tool doesn't need it. [00:54:35] Sveta: is the pdf functionality actively used? That part of the code will not work on the Kubernetes backend [00:55:21] I don't think it is [00:55:47] Its 7pm local time for me and I've been working since 7:30am this morning, so ... I'm going to stop really soon [00:56:10] nice, thanks bd808 [00:59:48] I've added a note at the top of the page, noting I've changed the backend and if there are any issues then people must query my immediately [10:52:16] !log huwiki-dev T223812 create project and add tgr as projectadmin [10:52:19] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Huwiki-dev/SAL [10:52:19] T223812: Request creation of huwiki-dev VPS project - https://phabricator.wikimedia.org/T223812 [11:02:20] !log wikidata-autodesc T223494 create project and add rabhowmi as projectadmin [11:02:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikidata-autodesc/SAL [11:02:23] T223494: Request creation of wikidata-autodesc VPS project - https://phabricator.wikimedia.org/T223494 [11:43:21] !log tools.zppixbot remove a unneeded reminder (requested by a user) [11:43:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.zppixbot/SAL [13:11:42] !log tools.integraality Deploy latest from Git master: 2fdede2, 6b6c07c, c17cb78 (T224090) [13:13:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL [14:01:00] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @alaa_wmde & @nuria - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [14:48:53] bd808: I'm having trouble clearing out clutter from one of my tools. Rm -r seems to just hang and do nothing. When I run rm -rv I get no verbose output. [14:50:58] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @alaa_wmde & @nuria - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:02:53] !log mobile deleted edit-actions instance [15:02:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Mobile/SAL [15:21:10] Cyberpower678: that doesn't sound fun. I'm guessing that there is some overload of the NFS server from the bastion you are using? [15:21:57] !log wikidata-autodesc T223494 drop rabhowmi as projectadmin/user and add rbhowmik as projectadmin/user instead [15:22:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikidata-autodesc/SAL [15:22:01] T223494: Request creation of wikidata-autodesc VPS project - https://phabricator.wikimedia.org/T223494 [16:39:33] !log tools.integraality Deploy latest from Git master: 8e76a8a [16:39:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL [17:47:37] bd808: I finally got it to wipe the directory [17:47:52] It just took over an hour to run [18:32:57] Cyberpower678: another case of Wiki(m|p)edia eventualism :) [18:50:25] bd808: will I be seeing you this August? [18:55:53] Cyberpower678: hopefully so yes! I got approved to attend Wikimania yesterday :) [18:56:57] bd808: I have my flight tickets, conference tickets, and hotel room booked. :D [19:04:27] Wheres wikimania this year? [19:04:48] Zppix: Sweden [19:05:32] Yeah i dont think ill be able to make it, gotta have money to do that [19:15:36] Zppix: well, it's probably too late but for next time.. money should not hold you back https://scholarships.wikimedia.org/apply [19:16:07] mutante: i hate using other ppls money