[11:41:54] !log tools aborrero@tools-elastic-01:~$ sudo apt-upgrade -u -f exclude upgrade oldstable -y [11:41:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:53:02] !log tools (10 exec canary nodes) aborrero@tools-clushmaster-01:~$ clush -q -w @exec-upgrade-canarys 'sudo apt-upgrade -u upgrade trusty-wikimedia -y' [11:53:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:57:29] !log tools aborrero@tools-elastic-01:~$ sudo apt-upgrade -u -f exclude upgrade jessie-backports -y [11:57:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:58:09] !log tools aborrero@tools-elastic-01:~$ sudo apt-upgrade -u -f exclude upgrade jessie-wikimedia -y [11:58:14] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:42:41] !log tools aborrero@tools-clushmaster-01:~$ clush -q -w @exec-upgrade-canarys 'DEBIAN_FRONTEND=noninteractive sudo apt-upgrade -u upgrade trusty-updates -y' [12:42:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [13:00:10] !log tools upgrades in tools-exec-14[01-10].eqiad.wmflabs were fine [13:00:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [17:36:20] !log tools upgrading oldstable, jessie-backports, jessie-wikimedia packages in tools-k8s-master-01 (excluding linux*, libpam*, nslcd) [17:36:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [18:21:24] !log tools upgrading tools-proxy-01 and tools-paws-master-01, same as others [18:21:29] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [18:42:48] Hi! Setting "gpllimit = ['2500']" means put "gpllimit = ['2500']" everywhere in user-config.py, is it correct? [18:43:23] hello. quick question. what is the default mysql python library installed in toollabs? [18:54:14] !help Hi! Setting "gpllimit = ['2500']" means put "gpllimit = ['2500']" everywhere in user-config.py, is it correct? [18:54:14] avgas: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [18:54:42] avgas: do you have more context? [18:54:53] mmecor: on the grid exec hosts, python2 will have mysql.connector, mysqldb and oursql, python3 will have mysql.connector. If you want another library, the easiest option is to install it in a virtualenv [18:54:55] * chicocvenancio is checking on mmecor question [18:55:03] * chicocvenancio was [18:56:21] valhallasw`cloud: thanks. when u say mysql.connector you mean this: https://pypi.python.org/pypi/mysql-connector-python/8.0.6 ? [18:56:29] for python3 [18:56:50] hi chicocvenancio! yes, problem is this: https://phabricator.wikimedia.org/T187087 [18:56:55] mmecor: k8s will probably not have any until you install in your virtualenv [18:57:44] ok, thanks [18:57:45] I would recommend you install the library in your virtualenv [18:58:55] as what is currently installed might not be installed in the future [18:59:31] yes, i must check how to use both venv and use a tool as a toolaccount with become. but i guess there will be no interference between both things [19:00:17] I can help [19:00:26] avgas: have you asked on the pywikibot channel? I'm not entirely sure how it scopes things like that. [19:02:48] avgas: yes, that is good advice. [19:05:18] avgas: I don't see you in #pywikibot, so let me answer here -- I can't find any reference to gpllimit in the pywikibot source code nor in the linked script. Are you using a recently updated version of pywikibot? [19:07:57] valhallasw`cloud: see the task T187087 Its a message in the error log [19:07:58] T187087: Non-JSON response (HTTP error 503) on orphanize_redirect.py - https://phabricator.wikimedia.org/T187087 [19:08:11] I think its from wikidata api response [19:09:25] avgas: does your bot have a bot flag in wikidata? [19:09:51] chicocvenancio: negative but it's running on itwiki as usually [19:10:10] ah! ok, it's a bit more subtle. What the code is supposed to do is halve the limits, then retry the request. [19:10:11] oh, sorry [19:10:13] valhallasw`cloud: sure, I'm using shared version [19:10:28] pywikibot/data/api.py:1996 [19:10:28] I don't know why I had wikidata in mind [19:12:01] ok, so it's a bit difficult to understand what's going on without seeing the exact data received from the server. If you add -debug to the command line, you should get a log file with more detail in logs/orphanize_redirects-bot.log [19:19:31] valhallasw`cloud: perfect, thank you. I'll debug and also I'll ask in pywikibot channel [19:19:36] thanks, see you later [20:18:45] !log paws changed userhomes group for T185434 workarround [20:18:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [20:18:49] T185434: PAWS fails creating a server for new user - https://phabricator.wikimedia.org/T185434 [20:57:36] Hmm, my ssh session to tool labs is really slow... [20:58:35] * chicocvenancio checked IO and cpu, all good [20:58:38] bawolff: which bastion are you on? [20:58:53] 03 [20:58:58] * chicocvenancio only did that for tools-bastion-03 [20:58:59] It seems to be picking up a bit now [20:59:21] cpu is a bit spiky there. somebody probably jsut stopped doing something horrible [21:03:44] * zhuyifei1999_ things it was a grep according to https://phabricator.wikimedia.org/P6507 [21:03:56] *thinks [21:05:49] lol naughty_detector.py [21:06:52] yeah lol [21:07:28] lol [21:11:01] question: anyone knows how to create a database in tools.db.svc.eqiad.wmflabs using python? [21:11:13] i mean tables [21:11:23] i'm trying to connect to this server and i put db='local' [21:11:25] but it gives me error [21:11:32] _mysql_exceptions.OperationalError: (1049, "Unknown database 'local'") [21:12:02] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database here it says the toolsdb where i can create tables is local [21:12:25] I haven't yet felt the need to create databases for my tools, but let me see if I can help [21:12:52] you need to create a database first before you can create tables [21:13:29] mmecor: ^ [21:13:54] zhuyifei1999_: how can i do that? [21:14:14] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#Steps_to_create_a_user_database_on_tools.db.svc.eqiad.wmflabs [21:14:19] you could do that with python, but https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#Steps_to_create_a_user_database_on_tools.db.svc.eqiad.wmflabs seems easier [21:14:40] in `sql local`, local is simply a pointer to the host [21:14:56] it does not stand for a database name, unlike `sql enwiki` [21:15:17] ah, i was confused by the 'sql local' thing [21:15:39] i'm going to create the database as it says in the url [21:16:43] mmm [21:17:18] if i become the toolaccount, then i will create the database using the toolaccount and it won't be possible to access it using my regular user, right? [21:17:36] yes [21:18:06] that will force me every little improvement on the tool to be run using the toolaccount [21:18:26] in other words, i won't be able to use the user account for anything related to the tool project [21:19:10] ok [21:20:16] maybe you can explain your use case of using your user account? [21:21:20] it is just for the ease of updating the python scripts in local (having the toolforge disk space mounted in a local folder) and then run it and see if it works well [21:21:38] i haven't tried using the toolaccount yet (with the become and all that) [21:22:14] i'd like to keep it comfortable [21:22:37] part of the reason for having a greater priority and ease of use for toolaccounts is to have more cooperation and maintainability of tools [21:23:11] yes, chicocvenancio i understand that, and it is very reasonable when the tool is maintained by several ppl, but at the moment i'm just creating it :) [21:23:24] oh yeah about that ssh-in-directly-as-tool-account thing, I wish there is a solution [21:23:41] mmecor: using the tool account is for many reasons one of htem is if your Tool does something resource intensive that requires being killed or blocked it doesn't effect your user and you can still get it to address the concerns. Also https://wikitech.wikimedia.org/wiki/Help:Toolforge/Rules [21:23:45] https://phabricator.wikimedia.org/T113979 [21:23:46] Do not use your personal account for noninteractive use [21:24:20] you should be able access and mount the tool folder (I haven't tried) [21:26:09] chasemp: do not worry about the noninteractive use [21:26:29] chicocvenancio: yes, i'm just seeing how to access the toolaccount and move files and all that [21:33:12] mmm [21:33:22] i cannot change permissions [21:33:27] as it is put in the example [21:33:30] https://wikitech.wikimedia.org/wiki/Help:Toolforge#Using_Toolforge_and_managing_your_files [21:33:47] after i become the tool [21:34:05] what are the files? [21:34:17] and where are the file? mmecor [21:34:34] chmod -R g+w /data/project/wcdo [21:34:47] now the folder should be empty, as i just 'become' for the first time [21:34:57] i see there is replica.my.cnf and logs folder [21:35:11] yes [21:35:41] I see the directory is g+w already [21:36:34] i tried to mount the tool location in a folder in my laptop [21:36:43] using my user ssh [21:36:46] and i could do it [21:36:58] but it seems that i cannot drag-drop files there [21:37:07] perhaps i need more permissions [21:37:07] thats weird [21:37:29] g+w don't make? [21:37:53] the folder is properly mounted as i see the 'replica.my.cnf' and the 'logs' in my os x interface [21:38:45] apparently, when i try to read replica.my.cnf in sublime in my os x it is empty (which is not true, so i may need more permissions) [21:39:05] replica.my.cnf should not be readable [21:39:08] that is correct [21:39:24] but you should be able to write to the directory [21:39:50] albeit `take` will probably be necessary [21:40:19] sshfs myuser@login.tools.wmflabs.org:/data/project/wcdo/ /Users/Desktop/toolforge_disk_tool [21:40:27] this is how i mount [21:40:30] replica.my.cnf is immutable. you cannot chmod it so you cannot read it with your tool account [21:40:59] zhuyifei1999_: actually, i can read it with my toolaccount ('cat') but not with my user account [21:41:14] logs is owned by root and is part of the toolforge k8s infrastructure [21:41:33] yeah, replica.my.cnf is only readable with your tool account [21:42:08] that's fine, i don't care about reading replica from my user account, but i'd like to drarg drop to the tool account [21:42:25] you should be able to create files with your user account on your tool's home dir [21:43:24] I dunno how sshfs works though, but by unix permissions things are supposed to work [21:43:56] zhuyifei1999_: i just echo 'hey' > hey.txt and it worked [21:44:13] well, then that's a finder issue I guess :P [21:44:21] : S [21:44:38] isn't giving more permissions an option? [21:44:55] what do you mean by more permission? [21:45:06] chmod -R g+w [21:45:08] this is how it is now [21:45:49] you already have the permission to do read and write and create and delete and list and blah blah blah on that directory [21:46:01] oh, g+w is like 777 [21:46:05] idk what else is there to give [21:46:22] no, 777 is like giving everyone all permissions [21:46:24] drwxrwsr-x 4 tools.wcdo tools.wcdo 4096 Feb 16 21:32 wcdo [21:46:43] g specifies that permission is only given to the group. i.e. tool account memebers [21:46:55] +w means add permission to write [21:47:38] ok, it seems i cannot drag and drop, but i can edit on sublime and save [21:47:45] so it must be Finder's getting crazy [21:47:53] :) [21:48:10] is there a helpful log message about that? [21:48:24] current permission is 2775, ignore that 2 at the front, the two 7 means your user account and tool account has every permission possible, and 5 means everyone else can only read and list files [21:48:25] I do not have a mac to test this scenario [21:48:46] * zhuyifei1999_ don't use mac either [21:49:25] this scenario is not that bad if i can edit on sublime and save code, then keep the terminal open to throw the tests [21:49:47] tell apple to fix finder :) [21:50:42] :) zhuyifei1999_ does not seem very straightforward [21:51:09] i wish they went that fast at every bug reported [21:51:30] sigh [21:51:51] yup :( [21:51:59] btw, what is this .kube folder i see? [21:52:20] part of toolforge kubernetes infrastructure [21:52:46] I think it stores some credentials for a tool to operate k8s [21:52:54] (not entirely sure) [21:53:28] it has the per-tool certificate iirc [21:53:40] and some settings potentially to interact w/ k8s [21:53:50] or per-tool preshare potentially [21:54:03] * zhuyifei1999_ gtg [21:56:36] ok folks, it seems i cna keep working, now with the tool account, so thank u very much for all your help :) [23:52:15] (03PS1) 10Umherirrender: Add lucene-explain-parser and textcat to upgrade list [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/411521