[01:28:06] !log account-creation-assistance `apt-get update && apt-get dist-upgrade -y` on all instances [01:28:09] Logged the message, Master [01:58:26] scfc_de: errrr, isn't the solution "`become xyz` should change your $HOME too" ? [01:58:48] or something. but my edit looks fine [01:59:21] anomie: ^ [02:03:08] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Needed Toolserver features was modified, changed by 209.235.2.8 link https://www.mediawiki.org/w/index.php?diff=697421 edit summary: [+258] /* Bots and webservices project */ disagree [02:03:16] jeremyb: Is this about https://wikitech.wikimedia.org/w/index.php?title=Nova_Resource:Tools/Help&diff=71723&oldid=71472 ? The problem wasn't the use of $HOME, it was the --defaults-extra-file. [02:03:56] anomie: which i tested in the last 10 mins and it works [02:04:14] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Needed Toolserver features was modified, changed by 209.235.2.8 link https://www.mediawiki.org/w/index.php?diff=697422 edit summary: [+3] /* Bots and webservices project */ correct location of comment [02:04:15] jeremyb: Do you have a non-default ~/.my.cnf? [02:04:27] (or did they change the default at some point?) [02:07:44] anomie: i don't have a .my.cnf [02:08:58] jeremyb: There you go then. The default for a tool installs a ~/.my.cnf with credentials for tools-db. And so when I try it, it winds up passing two --user and two --password entries to mysql (one from ~/.my.cnf and one from ~/replica.my.cnf), and mysql uses the second set (from ~/.my.cnf). [02:10:07] i'm confused. why should the tool skel be any different than for a user? (at least wrt mysql?) [02:10:41] anyway... the real answer is get an `sql` that does the right thing(tm) and then just have people use that [02:10:49] There already is one. [02:11:02] /usr/bin/sql [02:11:27] I think petan created it earlier today (or yesterday, depending on your timezone) [03:32:23] Warning: There is 1 user waiting for shell: Owl (waiting 0 minutes) [03:45:43] Warning: There is 1 user waiting for shell: Owl (waiting 13 minutes) [03:59:17] Warning: There is 1 user waiting for shell: Owl (waiting 27 minutes) [04:09:30] yoyo, any chance I can get a shell request expedited at this hour? [04:09:32] https://wikitech.wikimedia.org/wiki/Shell_Request/MahmoudHashemi [04:12:42] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 40 minutes) MahmoudHashemi (waiting 10 minutes) [04:13:29] Mr. Slaporte [04:13:34] some supporte? [04:13:43] mahmoud_: yo! [04:14:25] irc's neet [04:26:11] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 54 minutes) MahmoudHashemi (waiting 23 minutes) [04:39:40] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 67 minutes) MahmoudHashemi (waiting 37 minutes) [04:53:05] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 81 minutes) MahmoudHashemi (waiting 50 minutes) [05:06:29] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 94 minutes) MahmoudHashemi (waiting 63 minutes) [05:19:54] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 107 minutes) MahmoudHashemi (waiting 77 minutes) [05:33:19] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 121 minutes) MahmoudHashemi (waiting 90 minutes) [05:46:45] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 134 minutes) MahmoudHashemi (waiting 104 minutes) [06:00:09] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 148 minutes) MahmoudHashemi (waiting 117 minutes) [06:13:43] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 161 minutes) MahmoudHashemi (waiting 131 minutes) [06:27:08] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 175 minutes) MahmoudHashemi (waiting 144 minutes) [06:40:42] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 188 minutes) MahmoudHashemi (waiting 158 minutes) [06:52:32] just checking in: anyone approving Labs accounts right now by chance? [06:54:11] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 202 minutes) MahmoudHashemi (waiting 171 minutes) [07:07:41] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 215 minutes) MahmoudHashemi (waiting 185 minutes) [07:07:42] Warning: There is 1 user waiting for access to tools project: MahmoudHashemi (waiting 10 minutes) [07:21:10] Warning: There are 2 users waiting for shell, displaying last 2: Owl (waiting 229 minutes) MahmoudHashemi (waiting 198 minutes) [07:21:11] Warning: There is 1 user waiting for access to tools project: MahmoudHashemi (waiting 23 minutes) [07:30:30] !rq Owl [07:30:31] https://wikitech.wikimedia.org/wiki/Shell_Request/Owl?action=edit https://wikitech.wikimedia.org/wiki/User_talk:Owl?action=edit§ion=new&preload=Template:ShellGranted https://wikitech.wikimedia.org/wiki/Special:UserRights/Owl [07:30:37] !tr MahmoudHashemi [07:30:38] request page: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/MahmoudHashemi?action=edit talk page: https://wikitech.wikimedia.org/wiki/User_talk:MahmoudHashemi?action=edit§ion=new&preload=Template:ToolsGranted link: https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=addmember&projectname=tools [07:31:27] !rq MahmoudHashemi [07:31:28] https://wikitech.wikimedia.org/wiki/Shell_Request/MahmoudHashemi?action=edit https://wikitech.wikimedia.org/wiki/User_talk:MahmoudHashemi?action=edit§ion=new&preload=Template:ShellGranted https://wikitech.wikimedia.org/wiki/Special:UserRights/MahmoudHashemi [07:32:43] mahmoud_ :o [07:32:47] mahmoud_ sorted [07:34:35] Warning: There is 1 user waiting for shell: Rtdwivedi (waiting 6 minutes) [07:37:01] thanks! [07:39:37] !rq MahmoudHashemi [07:39:37] https://wikitech.wikimedia.org/wiki/Shell_Request/MahmoudHashemi?action=edit https://wikitech.wikimedia.org/wiki/User_talk:MahmoudHashemi?action=edit§ion=new&preload=Template:ShellGranted https://wikitech.wikimedia.org/wiki/Special:UserRights/MahmoudHashemi [07:39:39] oh [07:39:44] !rq Rtdwivedi [07:39:44] https://wikitech.wikimedia.org/wiki/Shell_Request/Rtdwivedi?action=edit https://wikitech.wikimedia.org/wiki/User_talk:Rtdwivedi?action=edit§ion=new&preload=Template:ShellGranted https://wikitech.wikimedia.org/wiki/Special:UserRights/Rtdwivedi [08:19:44] scfc_de I updated sql command, now it doesn't output anything unless you give it --verbose or -v parameter [08:26:26] !log tools petrb: updated sql command [08:26:28] Logged the message, Master [08:27:03] !log deployment-prep Added Nikerabbit to the project. Will setup solr for translate [08:27:06] Logged the message, Master [08:29:23] aight, logged in, lookin good. thanks again petan! [08:29:59] (have a look if you're curio: http://tools.wmflabs.org/revisionstats/cgi-bin/clastic_test/meta/ ) [08:30:10] night! [10:23:21] Warning: There is 1 user waiting for shell: SirReal (waiting 0 minutes) [10:36:54] Warning: There is 1 user waiting for shell: SirReal (waiting 13 minutes) [10:50:23] Warning: There is 1 user waiting for shell: SirReal (waiting 27 minutes) [11:03:57] Warning: There is 1 user waiting for shell: SirReal (waiting 40 minutes) [11:17:27] Warning: There is 1 user waiting for shell: SirReal (waiting 54 minutes) [11:26:31] Why do we have to use keys to log in? It screws up most of my tools for remote access. [11:31:01] Warning: There is 1 user waiting for shell: SirReal (waiting 67 minutes) [11:44:31] Warning: There is 1 user waiting for shell: SirReal (waiting 81 minutes) [11:58:05] Warning: There is 1 user waiting for shell: SirReal (waiting 94 minutes) [12:11:34] Warning: There is 1 user waiting for shell: SirReal (waiting 108 minutes) [12:17:05] a930913: because some people believe passwords are insecure, on other hand, you can't really use password in a script [12:17:14] !rq SirReal [12:17:14] https://wikitech.wikimedia.org/wiki/Shell_Request/SirReal?action=edit https://wikitech.wikimedia.org/wiki/User_talk:SirReal?action=edit§ion=new&preload=Template:ShellGranted https://wikitech.wikimedia.org/wiki/Special:UserRights/SirReal [12:19:52] guys I can't copy files into my projects return Permission denied [12:19:54] what's wrong [12:19:58] I used winscp and putty [12:20:02] everything [12:20:16] Amir1_ there is a bug we are working on it :/ [12:20:41] until then you need to copy files to some location that is acessible for you and then copy it from your tool account [12:21:41] @seenrx andrewbog*ot [12:21:42] petan: Last time I saw andrewbogott they were changing the nickname to andrewbogott_afk, but andrewbogott_afk is no longer in channel because he quitted the network 10:32:23.7528460 ago. The nick change was done in #wikimedia-e3 at 5/29/2013 10:51:47 PM (13:29:54.1238030 ago) (multiple results were found: andrewbogott_afk, andrewbogott_af-) [12:21:59] @notify andrewbogott [12:21:59] I'll let you know when I see andrewbogott around here [12:24:09] !log tools petrb: deleted job 1862 from queue (error state) [12:24:11] Logged the message, Master [12:24:47] ok [12:24:59] until can i run my bot via my tool account? [12:25:12] petan: OK [12:25:22] Amir1 it's not so hard to copy these files using a tool account [12:25:34] Amir1 are these files private? [12:25:39] or public [12:28:10] these are public [12:28:26] create a folder in /tmp like /tmp/amir then chmod a+rx /tmp/amir [12:28:33] copy all files to that folder [12:28:38] then become [12:28:54] and do cp /tmp/amir/* /data/project//... [12:28:54] but I locked my account [12:28:54] chmod 700 ~ [12:28:54] how i can reverse that? [12:29:01] huh? [12:29:08] which account you mean [12:30:31] petan: So symlinking is not the way to go? [12:30:54] a930913 now I have no idea what you talk about [12:31:27] petan: Symbolic links. Junctions. [12:31:41] I know what symlink is but I don't know what you mean [12:32:05] my account [12:32:12] So symlink ~/bracketbot to /data/project/bracketbot [12:32:27] a930913 as which user? [12:32:43] a930913 plz use absolute paths I have no idea what ~ substitute to [12:32:50] petan: As yourself. [12:32:57] ~=/home/a930913 [12:32:58] who is "yourself" [12:33:02] aha [12:33:33] so link /home/a930913/bracketbot to /data/project/bracketbot - I don't see how that would help? [12:33:47] I believe that you would still get permission denied if you tried to copy anything there [12:33:54] unless you to sg [12:33:56] "ladsgroup" [12:34:10] Amir1 ok, so did you upload the files to /tmp? [12:34:14] Then you ought to be able to use an external tool to modify d/p/bb/ [12:34:30] a930913 now I totally don't know what you talk about [12:34:35] what is d/p/bb [12:34:58] I'm trying [12:35:10] petan: /d[ata]/p[roject]/b[racket]b[ot]/ [12:35:15] aha [12:35:24] I'm using short hand. :p [12:35:32] external tool? [12:35:37] Stop punishing me by making me type it again :p [12:35:45] petan: Such as filezilla. [12:35:57] ah, you mean some scp / sftp client... [12:36:02] of course it wouldn't work [12:36:09] symlink is just a link [12:36:21] it would be just as if you copied the files directly to /data/project/bracketbot [12:36:28] same error [12:36:39] petan: As in permissions? [12:36:49] symlink doesn't change anything about permissons [12:36:57] it's just like "alias" for a folder or file [12:37:16] Yeah, but change the permissions. [12:37:26] of course it doesn't change permissions... [12:37:34] it uses the target permissions only [12:37:52] so if target doesn't let you write, symlink won't let you as well [12:38:51] petan: As in you mean that if you change the permissions, you may as well copy direct? [12:39:09] a930913 if you change the permissions of target then yes [12:39:13] but it would be insecure [12:39:20] you would have to chmod it 777 [12:40:16] Warning: There is 1 user waiting for shell: StoneBird (waiting 0 minutes) [12:40:17] Can't you add all users of a tool to a group? [12:40:25] a930913 they are [12:40:35] (I'll admit I don't know linux permissions too well.) [12:40:38] a930913 this is a bug on side of nfs server, normally you wouldn't need to do this [12:41:04] the thing is that groups stopped working correctly [12:41:11] that is what is wrong [12:41:20] So my home and bracketbot are on two computers? [12:41:32] not really [12:41:37] home is also on nfs [12:41:40] on same one [12:41:45] but it has different permissions [12:41:51] you are owner [12:42:20] So there is a group bit bug? [12:45:37] yes [12:53:46] Warning: There is 1 user waiting for shell: StoneBird (waiting 13 minutes) [12:57:21] !rq StoneBird [12:57:21] https://wikitech.wikimedia.org/wiki/Shell_Request/StoneBird?action=edit https://wikitech.wikimedia.org/wiki/User_talk:StoneBird?action=edit§ion=new&preload=Template:ShellGranted https://wikitech.wikimedia.org/wiki/Special:UserRights/StoneBird [13:47:01] petan: what were the shortcut commands you had for connecting to dbs? [13:47:19] sql [13:47:24] :o [13:47:30] awesome ;p [13:47:33] ty :) [13:47:36] I forgot :) [13:47:37] np [13:47:41] sql local is tools-db [13:47:46] otherwise you can either: [13:47:57] sql en for enwiki (very short) or sql enwiki or sql enwiki_p [13:48:04] basically it's project_p [13:48:11] like sql dewikisource_p [13:48:24] but if you forget _p the tool will automagically fix it :P [13:48:45] there is a help page if you type sql -h [13:48:49] s3 and s6 still unreadable? [13:48:51] but it doesn't say very much [13:49:25] Coren, ^ [13:50:59] Krenair: he's busy fixing the group permissions [13:51:57] oh, ok [14:02:09] !log nagios petrb: fixed nlogin o [14:02:11] Logged the message, Master [14:14:13] svn version is not work? [14:14:19] Mahdiz? [14:14:32] yes [14:14:35] :) [14:14:38] what u mean [14:14:48] The program 'svn' is currently not installed. To run 'svn' please ask your administrator to install the package 'subversion' [14:14:55] which instance [14:16:29] for run svn checkout [14:16:36] hello, is there a help page how to run a tool on labs? [14:16:52] kindly [14:18:10] Mahdiz, why do you want SVN...? [14:18:19] Pyfish: 2 very useful pages i know about: https://wikitech.wikimedia.org/wiki/User:Magnus_Manske/Migrating_from_toolserver (concise) and https://www.mediawiki.org/wiki/Wikimedia_Labs/Migration_of_Toolserver_tools [14:20:27] Mahdiz: Please respond in the channel, not PM. [14:20:49] ok man [14:20:59] is for test [14:21:03] nothing [14:21:08] no problem [14:21:09] thanks [14:28:43] !toolsdocs [14:28:43] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [14:28:48] Pyfisch did you read this? [14:32:12] petan: I worked around the problem, at least temporarily we'll have groups working right. The limit is still there in the LDAP server (I'll need Ryan) but now I've restricted the search so we won't hit it until there are very many more service groups. [14:32:25] ok [14:32:29] Coren great work! [14:33:06] Coren now you can go back to the beach or where you were :P [14:33:31] Nah, my vacation is done. I'm on light duty today (jetlag) but I'm going to be catching up email and the more urgent stuff. [14:34:16] ah ok [14:38:12] Coren on so you may want to have a look on https://bugzilla.wikimedia.org/show_bug.cgi?id=48890 [14:55:23] where should i create an experimental tool? [14:55:36] I think on bots but I am not really sure. [14:56:33] Pyfisch you can either on bots or tools [14:56:59] but if the tool requires experimental stuff (like some special software) bots is probably better [14:57:23] in which directory best? in /data/project/ i cant create a directory on tools [14:57:27] there is a small difference between these 2 projects [14:57:37] no it don't need special software [14:57:52] you can't do that on bots neither, you just need to create a new service account so that the folder is created for it [15:19:37] petan: how do I create a service account? [15:20:19] on project page [15:20:54] !add is https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=addservicegroup&projectname=tools [15:20:55] Key was added [15:21:00] Pyfisch click it [15:46:30] Coren: yes, problem solved [15:47:00] Yeah, looks like not all accounts that existed when s3 came online got the new grants. [15:47:46] Coren: sorry s3 still not, only s6 for me [15:48:38] "show grants" show correct grants on s3 [15:49:24] GRANT SELECT ON `%_p`.* TO 'p1234g1234'@'%' [15:50:42] select * from frrwiki_p.page limit 1; [15:50:42] ERROR 1045 (28000): Access denied for user 'p1234g1234'@'%' (using password: YES) [15:52:22] ...! [15:52:23] Oh! [15:52:26] I think I know. [15:53:54] * Coren facepalms. [15:54:26] Merlissimo: Try it? [15:55:29] yeah, now it works. tested s3 and s6 [15:56:25] Coren: what should i do if a job breaks because of a database connection error? on toolserver is simply reschedule this job on sge but on tool labs that could lead to a problem [15:56:58] Merlissimo: Are you talking about a continuous job, or a one-shot? [15:57:12] daily one-shot [15:57:30] wb Coren :) [15:57:37] * Coren ponders. [15:58:40] on toolserver this job is queue and not directly restarted because of empty sge resource sql-sx-user if there is a database problem [15:58:46] Merlissimo: *Ideally* I'd invoke a shell script that checks for error-free completion as reschedule if it fails. If you use the -sync y option to [jq]sub, it'll wait until the job is complete so you can check the result. [16:00:28] legoktm: *wave* [16:01:42] so i'll do rescheduling and try again and again and agin of a problem. Easy solution for me. i only hope it is ok for tool labs sge load, too. [16:09:35] Merlissimo: You might want to add a 60s delay before restarting, just to be on the safe side, but I expect that the load isn't going to be horrible if your code just fails with no DB connection. [16:10:01] ok [16:11:07] Coren: what's the name of the second host for working with tools I rembeber only (tools-login.wmflabs.org) [16:11:21] tools-dev [16:13:39] New review: coren; "Oops. :-)" [labs/toollabs] (master) C: 2; - https://gerrit.wikimedia.org/r/65707 [16:17:34] New patchset: coren; "Add script "toolwatcher"." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/62348 [16:18:23] New review: coren; "(Updated to current version)" [labs/toollabs] (master) C: 2; - https://gerrit.wikimedia.org/r/62348 [16:18:42] New review: coren; "(Updated to current version)" [labs/toollabs] (master); V: 2 - https://gerrit.wikimedia.org/r/62348 [16:18:42] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/62348 [16:19:17] New patchset: coren; "Add script "become"." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/62349 [16:19:36] New review: coren; "LGM" [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/62349 [16:19:36] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/62349 [16:20:15] New patchset: coren; "latest version of rmtool" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/62350 [16:20:28] New review: coren; "LGM" [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/62350 [16:23:15] New review: coren; "Sorta ugly, but does the trick." [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/65007 [16:23:16] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/65007 [16:25:23] New review: coren; "Using harness was a nice touch." [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/65642 [16:25:23] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/65642 [16:26:05] New review: coren; "As intended." [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/64596 [16:26:05] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/64596 [16:26:27] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/64585 [16:28:12] Warning: There is 1 user waiting for shell: Heb (waiting 0 minutes) [16:34:54] Coren, when I was poking around on labstore3 it seemed like there were some tools (e.g. lgwatcher) that are custom but not puppetized. Is that right? [16:40:16] New patchset: coren; "Fix typo in jsub and enable warnings." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/65643 [16:40:52] New review: coren; "Merged." [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/65643 [16:40:53] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/65643 [16:41:24] New patchset: coren; "Fix jstart to start only one job instance." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/65707 [16:41:46] Warning: There is 1 user waiting for shell: Heb (waiting 13 minutes) [16:41:47] Warning: There is 1 user waiting for access to tools project: Matanya (waiting 8 minutes) [16:41:47] New review: coren; "Still good after rebase" [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/65707 [16:41:51] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/65707 [16:42:28] New patchset: coren; "Remove debug output." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/65322 [16:42:42] New review: coren; "Trivially correct." [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/65322 [16:42:42] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/65322 [16:51:27] New patchset: coren; "Add (parts of) qcronsub functionality into jsub:" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/64586 [16:52:01] New review: coren; "Merged." [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/64586 [16:52:01] Change merged: coren; [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/64586 [16:55:16] Warning: There is 1 user waiting for shell: Heb (waiting 27 minutes) [16:55:17] Warning: There is 1 user waiting for access to tools project: Matanya (waiting 22 minutes) [17:00:29] Damianz, do you have a moment to verify that https://bugzilla.wikimedia.org/show_bug.cgi?id=40945 is fixed? [17:08:45] Warning: There is 1 user waiting for access to tools project: Matanya (waiting 35 minutes) [17:20:50] "SELECT * FROM tbl;" should show everything in the table, right? [17:22:14] Warning: There is 1 user waiting for access to tools project: Matanya (waiting 49 minutes) [17:23:06] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Needed Toolserver features was modified, changed by Pietrodn link https://www.mediawiki.org/w/index.php?diff=697719 edit summary: [+189] /* Database replication/access */ note [17:26:43] a930913: yes. [17:27:53] legoktm: So if I explain table, -> "10 rows in set (0.00 sec)" If I selext * -> "Empty set (0.01 sec)" [17:28:37] because the 10 rows is the info the explain returned [17:28:45] select * == the actual rows [17:28:50] Ok. [17:29:08] So then explain "1062: Duplicate entry '100' for key 'PRIMARY'" [17:30:03] uhhhhh idk what that means. [17:31:15] legoktm: It meant that I'm trying to insert some data in a supposed empty table, but it won't because there is data which already has the primary key '100'. [17:31:31] hm [17:31:35] no clue! [17:33:13] legoktm: :( [17:35:44] Warning: There is 1 user waiting for access to tools project: Matanya (waiting 62 minutes) [17:36:48] !rt Matyana [17:36:49] http://rt.wikimedia.org/Ticket/Display.html?id=Matyana [17:36:54] Hm. [17:37:02] petan: What's the magic keyword again? [17:38:03] !rq Matyana | Coren [17:38:03] Coren: https://wikitech.wikimedia.org/wiki/Shell_Request/Matyana?action=edit https://wikitech.wikimedia.org/wiki/User_talk:Matyana?action=edit§ion=new&preload=Template:ShellGranted https://wikitech.wikimedia.org/wiki/Special:UserRights/Matyana [17:38:51] !rqt Matyana [17:38:55] Hm. [17:38:59] rq is for shell access [17:41:08] !tr Matyana | Coren [17:41:09] Coren: request page: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Matyana?action=edit talk page: https://wikitech.wikimedia.org/wiki/User_talk:Matyana?action=edit§ion=new&preload=Template:ToolsGranted link: https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=addmember&projectname=tools [17:41:50] Aha. That's the one. [17:41:54] !tr Matanya [17:41:54] request page: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Matanya?action=edit talk page: https://wikitech.wikimedia.org/wiki/User_talk:Matanya?action=edit§ion=new&preload=Template:ToolsGranted link: https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=addmember&projectname=tools [17:43:06] Coren: Any idea why my "empty" table is throwing a duplicate error? [17:43:22] a930913: Need moar context!1!! [17:43:43] Coren: Scrollback? [17:44:10] Coren: I have a table, select * returns nothing. [17:44:13] Yeah, that's still not enough context. What DB, what is the table schema? Etc. [17:44:24] tools-db [17:44:29] kk [17:44:32] p50380g50493__scores [17:44:39] Table scores [17:45:10] InnoDB [17:45:19] * Coren looks at it. [17:45:24] What's the insert that fails"? [17:46:47] Ok, this is weird. [17:47:00] In the SQL, I can insert. [17:47:09] So it's only the python that's failing somewhere. [17:48:23] I wonder if it's a global collision... [17:56:58] Warning: There is 1 user waiting for shell: Koavf (waiting 0 minutes) [17:58:02] omp [18:10:27] Warning: There is 1 user waiting for shell: Koavf (waiting 13 minutes) [18:11:55] a930913: Perhaps there is a way to turn on debugging so that you see what your python code is trying to do exactly? [18:13:39] Coren: I just found the problem. [18:13:53] The default wasn't to autocommit for some reason. [18:47:24] If I want to join to the repdb, I need my db on the enwiki server, don't I..? [18:50:06] a930913: Yep. [18:55:28] Coren, the exception it's throwing is "You do not have sufficient privileges to perform an unindexed search." Are you sure that's a problem with too many entries and not the result of a security patch or something? [18:56:45] andrewbogott: "By default, the OpenDS does not allow search with more than [18:56:45] 4000 candidates" [18:56:54] https://blogs.oracle.com/kanthi/entry/ldap_paged_results_more [18:57:19] Coren: Can I create a trigger in my database? [18:57:32] The unindexed-search privilege is what overrides this [18:57:55] a930913: You have GRANT ALL PRIVILEGES ... WITH GRANT OPTION on your DBs, so you should be able to. [18:58:10] hm, ok [18:58:25] Coren: "ERROR 1419 (HY000): You do not have the SUPER privilege and binary logging is enabled" :/ [18:59:05] Hm. [18:59:41] a930913: That will probably require the brain of someone who is mysql-attuned. I'm postgres-attuned myself, I didn't do the instance to get mysql yet. :-) [19:00:43] Coren: Quick google suggests the --log_bin_trust_function_creators flag. [19:01:13] Coren: Because at the moment I have a table growing per edit :p [19:01:27] And I want to trigger removal over an hour. [19:01:50] a930913: Yeah, we were probably hitting the same search results. :-) I'll have to check with Asher for this. [19:02:08] Coren: Alternatively you could add it for me? [19:02:45] a930913: I'm not touching system settings on that DB without Asher's blessing. :-) You'll have to be a little bit more patient, I'm afraid. [19:02:55] Coren: No, as in add the trigger for me. [19:03:48] That I could do. What is it? [19:05:00] I am here [19:05:07] everything ok? [19:06:21] petan: THE WORLD EXPLODED while you were away. [19:06:29] Coren: http://pastebin.com/yDBGXvP2 [19:06:55] Coren: On tools-db -> p50380g50493__scores [19:07:16] petan: Did you miss it? [19:08:25] a930913: ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'begin [19:08:49] Coren: Woops, pastbinned it wrong. [19:09:00] s/begin/for each row begin/ [19:09:33] a930913: added [19:09:59] Coren: Yeah, I can see the error message :/ [19:11:39] Oh, fooble. "MySQL triggers can't manipulate the table they are assigned to. All other major DBMS support this feature so hopefully MySQL will add this support soon." [19:11:55] Ah. [19:12:17] drop trigger? :-) [19:12:32] Coren: Yup :p [19:12:34] You're stuck having to push this to application logic. [19:12:49] "drop trigger crop;" [19:13:06] Yeah, I may not be a mysql guru but that much I know. :-P [19:13:07] Coren: Sucks, because it shouldn't really be applogic. [19:13:24] Coren: On the offchance it saves you typing it ;) [19:13:34] a930913: You'll have to end your session, you seem to have a lock on the table atm. [19:13:55] Lol, it's probably DoSing it. [19:14:09] trigger dropped. [19:14:42] C^a:kill = my new way of killing processes. :D [19:56:21] Coren, can't you put in a MySQL feature request to allow Wikimedia to remove the requirement of being able to SELECT on the underlying table? [19:57:07] Krenair: You mean upstream? They already closed a request like this WONTFIX from what I've seen, it's 'by design' [19:57:22] Yes, reopen as upstream [19:57:24] Ugh wtf? [19:57:47] Can I see that wontfix'd 'by design' request? [19:59:37] We can't really run a patched version of MySQL/MariaDB can we? [20:00:41] Krenair: I'd have to hunt it down, I haven't found the request itself, only grumbling about it on some mailing list. It's related to the non-public http://dev.mysql.com/worklog/task/?id=1806 which is a requirement of "[their] agreement with SAP" [20:01:03] SAP? [20:02:00] Heh. We are /capable/ of running one; I expect the chances of convincing ops to do so to be marginally less than epsilon. :-) [20:02:24] Yeah, SAP. Beats me. [20:03:11] I'm not too familiar with the history of this myself... [20:03:37] But if this change came along after MariaDB forked, why is MariaDB affected? [20:05:27] Backport would be my guess. Although you have a point that we might bug /MariaDB/ for this. [20:09:44] Coren, where on WMF's cluster is MariaDB used and where is MySQL used? [20:10:22] Krenair: about 75% of prod databases now use MariaDB, with the rest slated for a switch. [20:10:47] Mysql is used, basically, everywhere MariaDB isn't yet used. :-) [20:11:40] I'm going to reopen suggesting we bug upstream (MariaDB) to fix this then [20:13:43] Coren, guess this is SAP: http://www.sap.com/corporate-en/news.epx?PressID=2208 [20:15:28] Krenair: I expect you are correct. [21:01:52] Coren: do you know why ~/.sge_request is not used? [21:04:32] Not offhand; that's not a feature I've ever used myself. Often, however, dotfiles need to have fairly restricted permissions to be used -- 640 or even 600 [21:07:03] i am using it to change default dir for out and err files [21:07:18] i don't like to have them in home root [21:09:29] ah execution bit for others is needed [21:17:22] .sge_request works with qsub but not with jsub [21:17:30] What resolves from /cgi-bin/? [21:17:45] index.py doesn't work. [21:27:03] has sb. already developed a solution how to create full links (=including namespace prefix) from wiki db? [22:14:31] a930913: /cgi-bin/ is for directly exectuable files, not scripts invoked through a language. It's rarely of genuine use unless you write CGIs in shell scripts of C. :-) [22:48:32] Bah, developing on the labs is not particularly easy :( I might start nesting screens soon... [23:44:24] is it intentional that the exec servers don;t have qstat on them? [23:59:35] while i am running queries on s5 replication seems to stop completely (240 s replag while running first query group, 90s replag on second query group)