[00:13:39] <^d> !log integration scratch that about integration-slave1001, will finish later [00:13:42] Logged the message, Master [00:39:23] !log wikimania-support Deleted scholarship-alpha.pmtpa.wmflabs instance [00:39:25] Logged the message, Master [00:40:50] !log wikimania-support Deleted wikimania-scholarship.wmflabs.org instance proxy [00:40:51] Logged the message, Master [08:33:48] andrewbogott_afk: it still doesn't work [10:51:15] petan: wm-logs are broken [10:51:22] e.g. http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-labs/ [10:53:06] matanya: know issue use http://tools.wmflabs.org/wm-bot/logs/ [10:54:18] matanya: http://lists.wikimedia.org/pipermail/wikitech-l/2014-March/075102.html [10:54:27] thanks [12:37:52] hmmm, I I wanted to add something linke /mnt/jenkins-jobs /var/lib/jenkins/jobs none bind 0 0 to /etc/fstab through puppet whats the best way? :) is there a good way? ;p [13:06:08] Hi , Is there any other ssh, I can try other than tools.wmflabs? I cant access sql from it [13:21:46] tuxnani: ssh bastion.wmflabs.org [13:24:05] Coren: is the migration over? [13:48:57] how to change ownership of a file back to my ssh account instead of tool account? [13:49:08] I need to change something which is obviously not working [13:54:39] TBloemink: chown user file [13:55:02] you need root, or to be the owner [13:55:19] matanya, well the point is the owner of the files I need to change is my tool account [13:55:25] "operation not permitted" [13:55:31] become tool [13:55:37] then chown [13:55:47] then ctrl-d [13:55:49] let me try that [13:57:35] matanya, still operation not permitted [13:57:42] chown tbloemink [13:57:50] whoami [13:58:03] tools.tbloemink [13:58:14] and ls -la file ? [13:58:38] -rw-r--r-- 1 tools.tbloemink tools.tbloemink 225 Mar 12 13:00 file [13:59:35] you can chmod it [13:59:40] so you can access [13:59:58] do you need to execute? [14:00:16] I need to change it, it's a text file [14:00:34] but I cannot as I don't have permission [14:01:02] can you chmod 0755 file ? [14:01:49] Permission denied [14:01:54] well chmod worked but when editing it [14:05:10] TBloemink: just wondering [14:05:19] try chmod 777 file [14:05:21] :) [14:05:49] and then? edit it? [14:05:52] editing does not work [14:05:53] :S [14:05:55] Not 777! [14:05:58] Never 777 [14:06:34] see, it worked [14:06:45] ? [14:06:50] just said 777 and someone that can help is here [14:07:00] heh xD [14:07:01] TBloemink: if you chmod it to 664, you'll be able to edit it with your user account (because you are in the tools.tbloemink group) [14:07:34] Coren: any docs and the group|user parts of tools? [14:07:40] matanya: If you say chmod 777 in a channel where there are sysadmins, it's like waving a red flag at a bull run. You'll get attention, but not positive. :-) [14:07:57] i know [14:08:07] matanya: Not really, that's "normal unixy stuff". I'm sure there are good tutorials around the 'net though. [14:08:09] hence the smile [14:08:22] Coren: not really [14:08:29] Really? Huh. [14:08:57] i can't guess the tools membership [14:09:04] and ownership [14:09:56] What do you mean, guess? [14:10:17] tool groups' members are the tools' maintainers. [14:10:19] he had an issue he wasn't able to edit files owned by his tool [14:10:27] that was the bit i was missing [14:10:34] thanks! [14:11:07] Heh. That's part of the "so obvious [to me] there's no need to document it" category, I suppose. :-) [14:11:32] Although I'm pretty sure I say something about it /somewhere/ in the documentation. [14:11:47] yeah, well. next time [14:12:08] btw, if you are already here Coren can you tell me the status of migration IRC? [14:12:19] "migration IRC"? [14:12:19] i.e. https://rt.wikimedia.org/Ticket/Display.html?id=4784 [14:12:37] * Coren reads the ticket. [14:14:04] Yeah, I'll get to start working on this ~2 weeks from now. Maybe a bit earlier if the final migration stage goes well early next week. [14:14:16] thanks for this too [14:14:45] matanya: Thankfully, many users have self-migrated, this means that the next phase is all that much easier. [14:14:46] * matanya must rephrase the questions better next time [14:15:00] yeah, i noticed it [14:15:17] that is a good sign, and the best part is you made it so easy [14:15:37] That's the upside of the migration having been delayed; we had more time to prepare. [14:19:29] TBloemink: Don't know if it has already been mentioned, but you can "take" files as your tool account if they are in your tool account's directory; cf. https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Using_.27take.27_to_transfer_ownership_of_uploaded_files [14:19:43] I knew, thanks [14:20:17] Is shared storagein eqiad still gluster? [14:20:46] * Nemo_bis doesn't see gluster running [14:22:35] Hi. I have a question about using pywikipedia through jsub. The proper way to login is to use manually "python login.py"? [14:23:49] Nemo_bis: AFAIK, there's no Gluster in eqiad at all. [14:26:52] ok [14:27:42] scfc_de: is any mount point faster than the others? I'm constantly bottlenecked by disk [14:28:45] ooh, we got dumps? :) [14:29:34] hm, some [14:33:58] Nemo_bis: (a) No gluster (b) they're in the process of being copied. [14:34:32] does anyone know whether our IRC bots have some specific flag on freenode to let them flood channels? [14:35:09] hashar: they don't but registering helps IIRC [14:35:18] ok C. [14:35:28] thanks [14:35:31] curious, nslcd takes almost 500 MB virtual memory [14:39:21] Nemo_bis: That RSS or VMEM size? [14:39:45] Nemo_bis: Because I think it mmaps a couple things, so large vmem wouldn't be to scary so long as RSS stays low. [14:44:20] sure, actual memory is very low [14:45:13] less than 5 kB for me; that was just a curiosity :) [14:48:45] Nemo_bis: Also, filesystem is a bit slower atm because of the large about of data being moved around for migration. That said, /data/scratch should always a bit faster with a couple caveats: (a) it's shared cross-project so put nothing there you wouldn't want random roots to be able to see and (b) that filesystem has no redundancy, so no promises about how long data lasts there. [14:49:00] So it's great for large temporary files. [14:49:27] Best way to think of /data/scratch is as a big /tmp that's shared. [14:51:35] (03PS1) 10Alexandros Kosiaris: Adding akosiaris' key at root's [labs/private] - 10https://gerrit.wikimedia.org/r/118286 [14:53:30] That's useful, thanks [15:06:31] Coren: bonjour! I have followed up on l10nupdate user creation for labs. [15:06:34] Coren: https://gerrit.wikimedia.org/r/#/c/118071/ :D [15:07:20] Coren: I have created a l10nupdate user on wikitech which received UID 4716. That should let /home/l10nupdate to belong to the same uid on all instances :] [15:08:10] BTW, wikitech is awfully slow ATM. Like really, really slow. [15:08:29] scfc_de: wm-bot complains about it too [15:08:39] scfc_de: It's being hammered by a distributed spambot atm. [15:08:55] That's just spinning around in circles getting and failing capchas. [15:08:56] wm-bot is innocent :o [15:09:48] hashar: If you created the user on wikitech, that gives it an ldap entry so you don't need the generic::systemuser at all. [15:13:21] Coren: though l10nupdate has GID 500 and I need GID 10002 (l10nupdate) [15:13:30] Coren: so I am creating a local user with the same id as the one in LDAP [15:13:33] that is all too jacky :-( [15:13:37] jacky -> hacky [15:14:09] It's just not needed. The user exists in LDAP already, you can use it. :-) [15:14:31] No... wait. You misunderstood me. [15:15:50] The solution isn't to have a user that matches the hardcoded gid, it's not not hardcode a gid in the first place. The number '10002' should not appear in puppet at all. Ever. :-) [15:16:29] If you have a group named l10nupdate, then you set group => 'l10nupdate'. This way the gid is correct everywhere. :-) [15:17:48] yeah that part I fixed it up [15:18:08] generic::systemuser() was passed default_group => 10002 [15:18:14] it is now passing default_group => l10nupdate [15:18:23] Ah. [15:18:30] the GID is still set in groups::l10nupdate though [15:19:21] Right, but you're not /including/ groups::l10nupdate in labs. [15:19:33] At least, you shouldn't be. :-) [15:19:40] You want to use the LDAP user and group. :-) [15:20:32] but then l10nupdate gidNumber in LDAP is 500 :/ [15:22:38] hashar: That's because you don't have a l10nupdate group yet -- only I can add that. [15:22:45] hashar: But why do you care what the gid is? [15:22:59] I have no idea, to match prod maybe ? [15:23:13] The only think you should care about is that the l10nupdate group exists and that the l10nupdate user is part of it. :-) [15:23:17] thing. :-) [15:23:51] Hardcoded uid/gid are bad in prod too, but beyond the scope of this patch. Lemme create the group for you. [15:24:10] (Also, I will renumber the l10nupdate user to a system uid range) [15:30:01] hashar: There, you now have a properly setup l10nupdate user and group in LDAP. :-) [15:30:17] uid=602(l10nupdate) gid=602(l10nupdate) groups=602(l10nupdate) [15:30:55] So chowns to l10nupdate:l10nupdate will work. [15:35:06] you are the best of us :-] [15:35:49] at least better than I [15:44:17] hashar: Labs has the advantage of not being burdened by as many hysterical raisins. [15:44:57] Hi, can someone explain to me how to get access to some wiki database? E.g. i need to view enwiki db and to run some queries to extract necessary information [15:48:08] Coren: so on labs I now skip l10nupdate user/group creation by puppet since they are in LDAP https://gerrit.wikimedia.org/r/118071 [15:48:17] Coren: I am not sure puppet will find them though [15:51:22] hashar: Yep. That is known to work, but will need a bit of tweaking. Lemme make a patch to that for you. [15:54:23] thx [16:35:41] can I ask for a problem with /share/pywikipedia installation? [16:37:54] rotpunkt: Yes. [16:39:26] I need to use archivebot.py. It uses /shared/pywikipedia/core/pywikibot/textlib.py: at line 1135 textlib.py uses variable ZERO that is undefined, so I can't use archivebot [16:41:04] Every time I run archivebot I get the error: [16:41:23] File "/shared/pywikipedia/core/pywikibot/textlib.py", line 1135, in dst [16:41:29] return ZERO [16:41:34] NameError: global name 'ZERO' is not defined [16:45:46] rotpunkt: Is this error specific to Tools' pywikibot source, or pywikibot in general? In the latter case, #pywikibot may be a better place to ask. [16:47:01] it's specific to /shared/pywikipedia installation, because when I use pywikibot locally it works [16:52:42] rotpunkt: I think /shared/pywikipedia is managed by valhallasw, but he isn't around at the moment. Anyone else online using pywikibot's archivebot on Tools? [16:54:15] can anyone help with a migration problem? [16:55:35] russblau: What's the problem? [16:57:36] scfc_de: I migrated my russbot tools to eqiad, apparently successfully; then tried to access the tool http://tools.wmflabs.org/russbot/cgi-bin/csd.py and got a "no web service" error. So I then issued the command "webservice start"; now that URL is giving me a 404 error even though the file does exit. [16:57:39] *exist [17:00:58] russblau: That works with the new web setup, which requires a couple changes for cgi-bin [17:01:05] !newweb [17:01:05] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help/NewWeb [17:01:36] russblau: Specifically, https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help/NewWeb#Apache-like_cgi-bin_directory [17:03:21] Coren: scfc_de: fiddled a bit https://tools.wmflabs.org/tools-info/migration-status.php [17:03:30] should update hourly [17:04:09] hedonil: Faancy. [17:04:32] yeah [17:05:18] Coren: thanks. I think I've solved the problem just by moving the script from cgi-bin to public_html [17:05:42] russblau: That'll work too. :-) [18:17:49] I deleted https://wikitech.wikimedia.org/wiki/Nova_Resource:I-00000912.pmtpa.wmflabs . [18:18:03] I think it gave an error 'DNS could not be deleted', and it still shows in the list. Is that expected? [18:27:18] most perplexing; Firefox seems to be ignoring the javascript for http://tools.wmflabs.org/url2commons/index.html entirely ... [18:28:23] * SamB tries in another profile ... [18:33:31] hmm, works there [18:33:37] must be an extension or setting or something ... [19:49:23] hi, does migrate-tool copy the subfolders of /data/project/toolname ? [19:52:05] rotpunkt: Yes, it does. [19:59:18] Coren: I created new account with different e-mail address and password in wiki-tech. [20:19:35] I trust you :) I have read /usr/local/bin/migrate-tool but I didn't found a tar/mv/cp or something similar, how does it work? just for curiosity. [20:45:40] rotpunkt: I believe the copy process runs directly on the file servers (or somewhere close to them). [20:49:12] @scfc_de, ok thanks, probably the script just marks the files to be moved [20:53:34] rotpunkt: That's my understanding.