[10:51:37] !ping [10:51:37] !pong [10:51:39] ok [14:50:45] yuvipanda: any idea off the top of your head what environment vars are deifned on tools labs instances? :P [14:50:59] i.e. I can make my script check if it isnt being run on labs or somewhere else? :P [14:51:10] hmm, not that I know of, addshore [14:51:23] hostname always starts with tools- [14:51:44] hehe :d [14:51:46] :D [14:52:00] addshore: :) [14:53:44] yuvipanda: jsub adds some environment variables [14:53:53] hehe yuvipanda it was you that poked https://github.com/addshore/LabsDumpScanner/commits/master with me for a bit :P [14:53:53] do you know what they are? [14:53:54] er, addshore [14:54:01] Ill have something to show you in a few mins probably :P [14:54:09] man qsub, and scroll down [14:54:09] addshore: :D from the looks of it [14:54:10] addshore: yay [14:54:12] should be there somewhere [14:54:23] addshore: oh wow, that was *8* months ago?! :O [14:54:24] SGE_EXEC_HOST et al [14:54:32] its okay, is_readable( '/public/datasets/public/' ) is sufficient [14:54:44] indeed :P [14:55:23] ...why the fuck is there a directory /gerrit-patch-uploader [14:55:52] heh [14:56:27] Coren, there is a directory /gerrit-patch-uploader on tools-login. Is that the result of a fluke during project creation? [14:57:07] valhallasw: That looks like crumbs; it's certainly not by design. I dislike poluting / [14:57:18] Hm, no, must be something I did [14:57:21] looks like a virtualenv [14:57:31] Tsk, tsk. [14:57:59] I've moved the contents to the project home [14:58:04] but I cannot rmdir the directory :/ [14:58:17] (which is what I expect for a root directory) [14:58:27] addshore: If you don't restrict yourself to environment variables, you can check if /etc/wmflabs-project is readable and = "tools". [15:18:44] anyone got an idea why '/public/datasets/public' would appear readable by CLI php but not by web php? [15:20:08] addshore: lighttpd? Which tool? [15:20:23] dumpscan tool [15:20:30] not using lighttpd [15:21:30] maybe mounts are missing on the webserver? [15:21:38] Coren: Can't log into tools-webserver-03 where dumpscan is running. Reboot? [15:21:40] ssh tools-webserver-01 and see if /public/datasets/public exists [15:21:45] oh, -03 [15:22:06] hehe :P [15:22:08] scfc_de: That'd probably work. [15:22:13] k [15:22:49] valhallasw: you also poked this tool a bit right? :P I can tell as you and yuvipanda are also members :P [15:23:08] I remember something like that yes [15:23:26] well, it works locally with a small mock dump :> [15:23:34] in theroy it should work perfectly on labs :P [15:23:57] once it can actually find the dump files :) [15:24:07] !log tools tools-webserver-03: Rebooted, wasn't accessible by ssh and apparently no access to /public/datasets either [15:24:10] Logged the message, Master [15:24:37] addshore: Is http://tools.wmflabs.org/dumpscan/ supposed to work? [15:24:49] hehe the page is at http://tools.wmflabs.org/dumpscan/create.php currently [15:25:47] scfc_de: looks like you fixed it :) [15:25:52] cheers! [15:27:24] addshore: Hope that tool doesn't allow GET parameters :-). [15:28:09] haha :P what are you worried about? ;p [15:36:22] ahhh! they are all stored ziped! [15:36:24] hmph :P [15:42:47] addshore: What are you using? PHP? [15:42:52] yup :P [15:44:55] If possible of course I would want to avoid unziping it to a tmp folder before reading but Im not sure thats possible [15:45:07] Well, there's apparently bzopen(). But you might want to contact gwicke. He developed a dumpscanner in - JavaScript? [15:47:30] indeed bzopen but unfortunatly the XmlReader class requires a uri to the file and I gather a file pointer is useless there [15:55:25] addshore: http://forums.phpfreaks.com/topic/236888-tip-needed-how-to-stream-a-compressed-bz2bzip2gzip-file-through-xmlreader/ suggests "$reader->open("compress.bzip2://$planet_file");". Don't know if that would work. [15:56:09] hmmm :P [15:56:11] worth a try! [16:05:31] heh, nice there are possbile 4289 pages-current-meta dumps :P [16:14:46] PHP Fatal error: Interface 'JsonSerializable' not found in /data/project/dumpscan/public_html/vendor/addwiki/mediawiki-dump/src/DumpQuery.php on line 9 [16:14:48] woo! [16:15:23] guessing thats not in our php version :< [16:15:37] nope, okay, time to make some changes... [16:26:52] hmm, I remember having this issue before .. libgcc_s.so.1 must be installed for pthread_cancel to work when submiting a job with jsub [16:27:05] addshore: increase the memory limit [16:27:11] thats the one :) [16:29:50] lovely :) now its running, lets see how long it takes and if the output is any good at the end :P [16:29:54] php5.4 [16:58:31] Coren: I'm going to be working on redis driver again [16:58:38] so keystone may be randomly broken [16:58:41] andrewbogott_afk: ^^ [16:58:53] I approve of your plan. [16:59:01] I'm working on the DBs today, so no worries there. [16:59:19] FYI, the bastion-eqiad is working fine if you need to work from an instance. [17:09:00] nah, I just need to test glance [17:09:07] for the issue you had [17:13:48] Coren: did glance fail for all commands, or just adding an image [17:14:18] Ryan_Lane2: I don't know; since I was in the middle of adding images, I reverted the change and did not test further. [17:14:25] heh [17:14:26] ok [17:14:44] Oh, wait, I know index at least worked okay. [17:15:13] The error message was a 500 about the PIPE method not being supported. [17:15:52] yeah, it seems the author of the keystone redis backend was using a newer version of the redis driver that handled pipelining commands differentl [17:16:02] so I needed to change that to the old format [17:16:11] working perfectly fine now [17:16:29] I'll push my changes up to my github fork and make a new deb [17:16:36] I think this is now in a fully working state [17:16:53] We'll know soon enough. :-) [17:22:29] Coren: also dont seem to be able to access the dumps in /public/datasets on tools-dev, could you give it a poke? [17:23:04] or scfc_de :) whoever is around :) [17:28:44] addshore: Looking into it. [17:28:50] cheers :) [17:32:58] !log tools tools-dev: mount -t nfs -o nfsvers=3,ro labstore1.pmtpa.wmnet:/publicdata-project /public/datasets; automount seems to have been stuck [17:33:00] Logged the message, Master [17:35:14] cheers scfc_de :) [17:35:51] hey folks, can we fix the virt0/virt1000 Certificate expiration check? it's been in a WARNING "Traceback" state for a month now [17:36:38] andrewbogott_afk / Ryan_Lane2 / Coren ^ [17:36:58] in which way is it broken? [17:40:07] ssl.SSLError: [Errno 1] _ssl.c:504: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed [17:40:10] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=virt0&service=Certificate+expiration [17:41:11] I'll let andrew/coren handle that :|) [17:41:16] err :) [17:41:49] fair enough ;) [17:44:17] do we have a place to build packages now that build-precise1 was deleted? [17:49:28] Ryan_Lane2: I build mine on my own box as a rule; but barring that you can always use tools-dev [17:49:45] It's got the full toolchain. [17:49:51] meh, I'm setting up one of the vmbuilder nodes to do it [17:50:01] That also works. :-) [17:59:08] yuvipanda: my prototype code works :P [18:07:47] hello [18:08:13] have a question about user groups in the database [18:14:18] I'm getting "Database connection error: Can't connect to MySQL server on 'enwiki.labsdb' (110)" [18:15:07] russblau: are you on MySQL Workbench? [18:15:49] no, just trying to access a tool via the Web [18:17:04] just logged into my acct on tools-login and had no trouble connecting via mysql... odd [18:17:47] russblau: maybe try from the webservers? e.g. tools-webserver-01 [18:22:10] valhallasw: can't ssh to either tools-webserver-01 or tools-webserver-02 (Permission denied (publickey)) - but I can ssh to tools-login, so I know I'm doing it right [18:26:26] russblau: you should be able to ssh there from tools-login [18:26:32] I think... [18:26:52] hm, nope [18:34:04] russblau: Uh, as I rebooted tools-webserver-03, the iproutes aren't there. One moment, please. [18:34:36] scfc_de: you rebooted server and didn't log it to sal? :o [18:34:57] 16:24 < scfc_de> !log tools tools-webserver-03: Rebooted, wasn't accessible by ssh and apparently no access to /public/datasets either [18:35:02] petan: ^ [18:35:10] russblau: Try again? [18:35:15] aha... long time [18:35:53] Permission denied (publickey). Doesn't matter which tools-webserver-0? I try [18:36:24] It seems the webservers don't allow login, while the webgrid servers do (hostbased) [18:37:32] but the webtools are now working, so the reboot must have fixed the problem; thanks scfc_de [18:37:55] russblau: No, the reboot caused the problem :-). "sudo /sbin/iptables-restore /data/project/.system/iptables.conf" fixed it. [19:15:22] valhallasw: the dump scanner works :) [19:15:33] now I just need someone that cares about making it nice to use xD [19:16:49] yuvipanda: ^^ [19:18:17] * addshore is happy :) [19:18:43] addshore: :D [19:18:45] meeting, brb [19:42:05] !log deployment-prep Adjusted read privs on /home/wikipedia/syslog/apache.log to allow fatalmonitor to work [19:42:07] Logged the message, Master [19:51:23] hmm, why can't I log into deployment-cache-mobile01? [20:18:06] addshore: now just !log local-dumpscanner Deployed working version yadayada it ;-)