[00:05:15] !log ptwikis test [00:05:16] ptwikis is not a valid project. [00:05:49] !log Tools test [00:05:50] Tools is not a valid project. [00:41:12] !log tools test [00:41:13] Logged the message, Master [00:41:15] helderwiki: ^ [00:42:55] !log tools it works! :-) [00:42:57] Logged the message, Master [00:43:05] thank you legoktm [00:43:13] :) [00:43:33] legoktm: where can I see the log? [00:43:43] (I forgot the link) [00:44:17] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:44:43] great! :-) [00:48:57] !log is You're not my master... Take your own notes! [00:48:57] is is not a valid project. [00:49:24] Oh... it's on the ignore list. Lol dang.. [01:21:01] scfc_de`: ping [01:34:23] legoktm: pong [01:34:37] hey. what's the status on dbreps moving to labs? [01:34:47] should i be running new reports on labs or? [01:34:55] i'm mainly concerned with the wikidata ones right now [01:36:14] legoktm: I migrated some reports (cf. crontab.tools); I found that the Wikidata ones don't fit the "distributor" model, so I need to rethink how we can refactor "reports". [01:38:06] hm. how do they not fit the distributor model? [01:44:16] legoktm: IIRC they posted their results to a different wiki than they query or not all reports were under a common root page or something like that. But it's been some weeks so maybe I'm mixing something up. [01:44:47] well i did write all the reports, so we can easily change stuff :P [01:44:54] everything should be under WD:Database reports/ [01:45:23] [bz] (8NEW - created by: 2Chris Steipp, priority: 4Unprioritized - 6normal) [Bug 51622] Add loginwiki to beta - https://bugzilla.wikimedia.org/show_bug.cgi?id=51622 [01:45:31] Some reports do require joins of xxwiki_p vs wikidatawiki_p though [01:47:42] legoktm: It's not just Wikidata; in some other areas we hit limitations as well. I think MZMcBride has some other reports that do not follow a root page/heading/table/footer model. But I'll look at the Wikidata ones again and check whether and what I thought was a blocker. I'll get back to you tomorrow. [01:47:53] ok, thanks [01:51:40] legoktm: np [02:20:01] Hi Elsie [02:20:02] !logs [02:20:02] http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-labs/ [02:20:06] Hi. [02:21:20] http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-labs/20130719.txt [02:21:24] Okay, I'm caught up. [02:21:42] legoktm: If you have some time tomorrow, perhaps you can help me get set up on Labs. [04:41:09] [bz] (8NEW - created by: 2Yuvi Panda, priority: 4Normal - 6enhancement) [Bug 50422] Replicate the Gerrit mysql database to labsdb - https://bugzilla.wikimedia.org/show_bug.cgi?id=50422 [04:41:47] Hm. [04:41:56] petan: wm-bot shows all changes even if I just cc'd myself? [06:54:55] legoktm: it shows all changes that bugzilla shows [06:55:01] that's where it get it from [06:55:19] ok [07:05:24] !sal [07:05:24] https://wikitech.wikimedia.org/wiki/Labs_Server_Admin_Log [07:06:00] why the hell were instances rebooted? [07:06:12] why there is no record in SAL? [07:06:17] Coren|Away: ping [07:06:30] !log tools instances were rebooted for unknown reasons [07:06:32] Logged the message, Master [08:38:18] heh [08:38:40] petan: web tools cant access / have permission to read replica.my.cnf by default? :P [08:47:36] sort of [08:47:54] I guess they can't read anything what www-data can't read [08:48:09] addshore ^ [08:48:34] addshore: petan aren't web tools run as your tool user, and so can read it? [08:48:45] AFAIK they should [08:48:57] but Coren|Away configured the servers I don't know details, this isn't documented yet [08:49:04] !toolsadmin [08:49:04] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Documentation/Admin [08:49:32] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Documentation/Admin#Resource_limits [08:51:27] !tools-help [08:51:27] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [08:52:05] 'All CGI scripts must be marked executable, and are run with the permissions of the user account that owns the script. In almost all cases, you want to make certain that they are owned by the tool account. ' [08:52:58] YuviPanda: but that doesn't explain how is this achieve [08:53:00] d [08:53:06] like no configuration details etc [08:53:09] *shrug* it is documented though [08:53:22] no, the expected behaviour is documented, configuration is not [08:53:26] so yes, addshore, your web tools should be ablet o read replica.my.cnf [08:53:39] configuration is what matters here, I have no idea how it works [08:57:34] :) ask for it to be puppetized, then [08:57:46] I know that it will be ventually, once the NFS stuff is fixed [09:26:17] I don't care about puppet I want solid documentation [09:27:09] Puppet *is* documentation, for sysadmins at least [09:27:29] User documentation says what it is. if you want to know *how* it is, puppet. [09:27:36] but that's just me, I guess. [09:27:41] this conversation is mostly pointless :) [09:27:44] * YuviPanda goes back to writing code [09:57:26] !ping [09:57:26] pong [09:57:28] ok [10:00:04] [bz] (8RESOLVED - created by: 2Michelle Grover, priority: 4Unprioritized - 6major) [Bug 51635] Beta labs is not loading editor.js though the file exist - https://bugzilla.wikimedia.org/show_bug.cgi?id=51635 [10:01:18] annoying question, is there a backup of the things in /data/projects on toollabs? [10:02:36] henna: there is, I think [10:02:39] !tools-help [10:02:39] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [10:02:53] henna: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Backups [10:11:03] YuviPanda: thx, do you happen to understand how to format the timestamp that it wants? [10:12:08] henna: I *think* it is yearmonthdate.hourminute [10:13:31] mm, no that fails :( [10:29:22] try 14 digit [10:29:31] yyyymmddhhmmss [10:41:43] Damianz: you restarted cluebot archiving correct? [10:42:59] it needs another kick [11:01:27] who needs @kick [11:01:36] @kick ClueBot [11:01:36] Sorry but I don't see this user in a channel [11:04:26] doesn't do it either :( I'll just email to see if anybody knows how to get at them :( [12:41:40] henna: I responded on labs-l re snapshots. [12:44:23] o/ Coren [12:56:23] Coren|Away: so the current snapshot should be at cd /data/project/.snapshot/20130719123517 [12:56:26] ? [12:57:26] ah no I get it, snaplist is a file [13:11:49] Coren|Away how did you create these backups? is it documented? [13:25:50] petan: Not really atm. [14:41:38] aude, I'm about to merge a patch that will adjust the sites_available file on your wikidata hosts. I am /pretty sure/ that it won't break anything, but if it does you know who to blame :) [14:44:44] andrewbogott: ok [15:19:46] hey Coren [15:20:01] can I get a new public IP in our analytics project on labs? [15:20:12] milimetric: Sure. You're at quota already? [15:20:19] we only have one [15:20:34] Have you tried adding one yourself? [15:20:36] yeah [15:20:41] so I assume the quota is one [15:20:44] kk. Gimme a minute. [15:20:46] it says " failed to create " [15:21:04] no prob, thank you! [15:21:23] Should work now. Please to be trying? [15:26:08] ok [15:27:06] woo hoo thanks Coren [15:39:24] anyone know that accessing gitblit's https addresses is not working at the moment? [15:39:30] i imagine Ryan isn't in yet [15:39:36] or chad [15:47:34] Is that the same thing as git.wm.org? [16:03:28] though i can login... [16:04:06] Doesn't look like. [16:04:08] !ping [16:04:09] pong [16:04:32] Ah, yes. It just wedged again. Should be back in a minute or two. [16:04:32] * Coren grumbles. [16:04:32] At least it doesn't occur as often as it used to with the new setting. [16:04:32] ummkay [16:18:22] i don't quite understand the nfs problems. nfs should be quite old, well-tested and stable, no? [16:25:34] Hi. Two simple questions. The first: I have a simple PHP web tool here on labs, do I need to create any instances? [16:25:59] Second: I try to access the itwiki replicated database, but I cannot select the revision table. Why? [16:26:16] Error: "SELECT command denied to user 'p50380g50557'@'10.4.0.128' for table 'revision'" [16:27:02] pietrodn: accessing 'itwiki' or 'itwiki_p? [16:27:05] +' [16:27:27] I'm accessing "itwiki" on itwiki.labsdb, is there any difference? [16:28:28] yes, 'itwiki' isn't one we have access to, 'itwiki_p' is [16:29:03] Nettrom: thank you, I think that this issue is solved now! :) Any clues on the instance question? [16:30:46] since I'm just a user, I don't know for certain, but for simple web-based stuff I would think having a Tool Labs account and using their webserver would be the easiest/best solution [16:32:25] which means you're not creating any instances of your own [16:32:50] Ok. I also need to know: where I can find a complete table of all Wikimedia projects replicated by Tool Labs containing the domain (e.g. it.wikipedia.com) and the database name (itwiki_p)? [16:33:14] I just copied /etc/hosts for a complete list of databases... [16:34:22] I would have to refer you to Coren or petan or one of the other admins for an answer to that, as I don't know, and I don't know if it's documented anywhere [16:34:36] my continous job stopped automatically again [16:34:41] can someone have a look? [16:34:49] Coren: ^ [16:40:50] I also need a namespace table in the replicated database, with all the namespace names: is it possibile? [16:41:12] I could get it via HTTP from MediaWiki API, but it's slower. [16:47:38] pietrodn: Those two topics are covered by https://bugzilla.wikimedia.org/48626 and https://bugzilla.wikimedia.org/48625 which haven't been resolved yet. [16:49:44] Perfect. Thanks! [16:49:56] scfc_de: I guess we can simply make a clone of `toolserver` first, but with no further maintenance in the future [16:50:11] then consider our own good design [16:54:22] [bz] (8NEW - created by: 2Tim Landscheidt, priority: 4Unprioritized - 6trivial) [Bug 48625] Provide namespace IDs and names in the databases similar to toolserver.namespace - https://bugzilla.wikimedia.org/show_bug.cgi?id=48625 [16:54:23] [bz] (8NEW - created by: 2Tim Landscheidt, priority: 4Normal - 6normal) [Bug 48626] Provide wiki metadata in the databases similar to toolserver.wiki - https://bugzilla.wikimedia.org/show_bug.cgi?id=48626 [16:55:05] Anyone know if it's possible to send email from a default labs MediaWiki install? Like for confirming email addresses on the wiki? [17:02:18] Yep, it does to @wikimedia.org email addresses [17:29:10] http://tools.wmflabs.org/ offline? [17:33:19] hey Coren, any news on when arwiki will be added to labsdb? [17:33:44] pietrodn: Works for me. [17:33:59] milimetric: Hmmm. There should be no missing wikis atm. Lemme check. [17:34:15] well, there's an arwiki_p database [17:34:21] but select * from user; gives 0 records [17:34:27] and tables like revision aren't there [17:35:28] Ah. That's one of those. There are some databases which exists twice, and old version and a new version. Apparently, we're currently pointing at the old one. [17:35:44] eswiki was the same, annoyingly enough. [17:35:45] Coren: now works, my fault :) [17:36:20] milimetric: Now pointing at the correct one. [17:39:15] cool Coren, but does it take a while to propagate? [17:39:24] i'm still seeing the old one I think [17:39:43] just connecting to arwiki.labsdb with my credentials [17:40:23] It shouldn't. It works for me right now. [17:40:45] Did you start a new connection after I told you? [17:40:48] yea [17:40:52] ... odd. [17:40:58] Where are you doing it from? [17:41:04] i'll try from tool labs, maybe there's a problem with doing it from my labs instance [17:41:23] Oh, yeah, you'll have to copy tool labs' /etc/hosts file to resync yourself! [17:41:32] ok, cool [17:41:32] (I thought you were from tools) [17:42:09] This really need to go into DNS. I wish I hadn't wasted a week on that [bleep] controller problem. [17:42:43] is it ok if I update https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Production_replicas to say that arwiki and eswiki are in now? [17:44:23] anyone seen cobi? his archive bot needs a kick [17:48:43] Ryan_Lane: What would the impact be if I used cachefs on NFS clients to "local" storage, in your opinion? [17:49:04] milimetric: Actually, that doc should probably say that all the production databases are available, nominally. [17:49:11] milimetric: Barring bugs, they should all be there. [17:49:17] yep, changed to something along those lines [17:49:27] but left the examples so people know it's enwiki and not en [17:51:43] Betacommand: Not in a while. [17:58:16] Coren: I created a new tool called lolrrit-wm, but can't seem to become it [17:58:23] tried logging in and out several times [17:58:57] You're definitely in its group. [17:59:01] yeah [17:59:14] Coren: is having a dash in its name problematic? [17:59:14] (local-lolrrit-wm) NOPASSWD: ALL [17:59:22] And you're definitely allowed to sudo to it. [17:59:31] yuvipanda@tools-login:~$ become lolrrit-wm [17:59:34] become: no such tool 'lolrrit-wm' [17:59:35] Try: sudo -iu local-lolrrit-wm [17:59:48] sudo: unable to change directory to /data/project/lolrrit-wm: No such file or directory [17:59:51] sudo: unable to execute /bin/bash: No such file or directory [18:00:29] Huh. Interesting. The dash shouldn't have been a problem, but your project home isn't there. [18:00:31] * Coren checks why. [18:00:58] The toolwatcher wasn't up is why. [18:01:13] It should be up now. [18:01:17] let me try [18:01:24] Coren: works now. ty [18:01:37] np [18:01:44] kma500: hi there [18:03:05] hi [18:03:32] kma500: how's it going? any questions you want to highlight? [18:04:44] At the moment, I'm a bit baffled by this: https://wikitech.wikimedia.org/wiki/Nova_Resource:Bots [18:04:55] kma500: please elaborate :) [18:05:08] I thought bots was gone, it was now toolsbeta [18:05:16] but this looks like an active part of tool server [18:05:33] kma500: you mean an active part of Tool Labs, right? [18:05:35] (that has always confused me too) [18:05:38] yes! [18:05:44] you want to be careful there :) [18:05:45] Coren & petan - want to explain? [18:05:53] re the current status of https://wikitech.wikimedia.org/wiki/Nova_Resource:Bots ? [18:06:30] I'm putting together the etherpad -- I would love to get feedback before it gets shared more widely [18:06:48] ok. link? [18:08:16] For now, here: http://etherpad.wmflabs.org/pad/p/KirstenTest. Was planning to create a better name before monday [18:10:16] yooo doodles, [18:10:24] is instance-proxy working for others right now? [18:10:55] not sure, i moved to a real ip [18:10:57] i'll try [18:11:14] heh, i'm actually killing the server atm [18:11:19] with a GIANT cohort [18:11:55] * sumanah reads. back in 10 min kma500 [18:12:16] okay. thanks [18:14:09] Coren: hm [18:14:17] Coren: on every client? [18:14:38] it has the potential to eat all the local disk space [18:14:44] and likely would [18:15:02] qcow2 will grow but never shrinks [18:15:54] ottomata: instance proxy is working for me [18:16:04] ottomata: I had a bone to pick with you, but now I can't remember what it was [18:16:10] so I guess you're off the hook [18:16:13] oh wait [18:16:19] haha [18:16:20] uh oh! [18:16:59] not a bone to pick, but I tried using the new puppetmaster::self stuff with a centralized master [18:17:08] ooo ok, no worky? [18:17:18] well, it did work, but the docs aren't amazingly clear [18:17:21] hmm ah ok [18:17:29] and it took me about an hour and reading through the puppet code to get it working [18:17:40] hmm ok yeah not good [18:17:42] then I should fix [18:17:48] what did you have trouble with? was i just too wordy? [18:17:52] you have to run puppet on all nodes, then need to change the master on all nodes and run it again [18:18:03] and it doesn't tell you that the master needs to list itself [18:18:22] and it doesn't say you need to use the short dns name rather than the fqdn [18:18:26] which is weird, btw [18:18:39] it should use fqdn [18:18:42] hm, ok [18:18:43] i'm fine with that [18:18:46] or maybe take either [18:18:54] and figure out whether it needs to apply domain [18:19:09] but consider multi-site, when we have eqiad + pmtpa's replacement [18:19:22] aye, but you think we'll use a cross cluster puppetmaster? [18:19:30] it's per-project, right? :) [18:19:32] so, yes [18:19:43] hmm, ok [18:19:44] a project can span zones [18:20:09] aye, ok i'll see if I can make the instructions more explicit [18:20:17] thanks :) [18:20:21] otherwise it's working well [18:20:25] cool, great [18:20:36] yeah its def more complicated to set up than single node self hosted [18:20:39] kma500: sorry, got pulled into a meeting, will be back with feedback -- overall right now I am happy with it [18:20:39] mainly due to certs [18:20:55] I can tell, though, that it's going to mean those instances basically need to be deleted when people stop using the centralized master [18:21:18] yeah, its kinda a one time change, we could fix it to change back i suppose [18:21:22] but it would be including a different class probably [18:21:31] but yeah [18:21:33] excellent. I'll carry on, thanks. [18:21:36] puppetmaster::self has always had this problem [18:21:40] it's not your cause :) [18:22:08] ha, aye [18:22:37] Ryan_Lane: I think i'll just force you to set fqdn rather than add fancy logic [18:23:58] * Ryan_Lane nods [18:29:03] hm, Ryan_Lane, so instance proxy [18:29:13] it's working for me [18:29:19] is your backend responding? [18:29:19] its mostly working for me too [18:29:22] i have a service on port 8888 on kraken-namenode [18:29:26] on another node in my project [18:29:27] i do [18:29:32] curl http://kraken-namenode.pmtpa.wmflabs:8888 [18:29:33] fine [18:29:35] but if I do [18:29:40] curl http://8888.kraken-namenode.instance-proxy.wmflabs.org [18:29:42] from the same node [18:29:43] there's some way to make it use different ports [18:29:44] it times out [18:29:46] oh [18:29:55] are you doing that from within a labs instance? [18:29:57] yes [18:30:04] that's why [18:30:06] (its also not working from browser, that's why i'm debugging here) [18:30:09] it times out from browser too [18:30:12] works on port 80 though [18:30:16] can't access public IPs from within labs [18:30:27] hm [18:30:34] oh instance-proxy is public [18:30:35] right [18:30:38] of course [18:30:42] andrewbogott: ^^ any idea what's up with different ports for instance proxy? [18:30:43] ok so that wont' help me debug [18:30:49] that link isn't working for me in the office [18:32:20] Ryan_Lane, I'm not sure it's made to work with anything besides 80. Lemme check [18:34:58] docs say it is [18:35:03] https://wikitech.wikimedia.org/wiki/Help:Proxy [18:36:47] ottomata, does it? I only see it mentioning 80 and http [18:37:13] HTTP access to instance-name.pmtpa.wmflabs is available atinstance-name.instance-proxy.wmflabs.org for default port, and port.instance-name.instance-proxy.wmflabs.org for a customized port. [18:37:38] (this is http traffic) [18:38:03] hm, yes, I see that now. And see the config to support it as well... [18:45:12] ottomata, try pmtpa-proxy instead of instance-proxy [18:45:21] um… try both ports, I'm curious about either [18:46:08] http://8888.kraken-namenode.pmtpa-proxy.wmflabs.org/ [18:46:10] says 404 i think [18:46:11] not found [18:46:27] [bz] (8NEW - created by: 2Michelle Grover, priority: 4Unprioritized - 6major) [Bug 51694] Beta labs is down - https://bugzilla.wikimedia.org/show_bug.cgi?id=51694 [18:48:05] Is that the same as instance-proxy or different? [18:51:19] eh? [18:51:23] i dunno what pmtpa-proxy is [18:51:25] hah [18:51:31] oh [18:51:32] no [18:51:35] instance-proxy times out [18:51:41] pmtpa-proxy 404s [18:52:09] Does pmtpa-proxy work for normal port-80 access? [18:52:23] no, also 404s [18:52:49] andrewbogott: i'm moving to a cafe and grabbing some food, back in a bit [18:53:15] ok [18:55:54] hey kma500 - I am back :) [18:57:27] kma500: so it sounds like you think there should be 2 main documents: a Tool Labs guide, and a guide to moving from Toolserver to Tool Labs. Am I right? [19:02:32] sumanah: bots project = obsolete, still around while some old stuff lingers. Its death warrant has already been signed. [19:04:04] kma500: ^ you see that? I am going to go ahead and update the https://wikitech.wikimedia.org/wiki/Nova_Resource:Bots page to reflect that (cc Coren) [19:06:43] ok, done and moved information to https://wikitech.wikimedia.org/wiki/Obsolete:Bots_project_documentation [19:16:41] sumanah not sure where this needs to go but gmail's been delivering the labs-l and analytics mailinglists to my spam folder, could affect others too [19:17:12] (included both the original subscribe confirmation message and 50% of subsequent mails [19:17:41] henna: crap. I assume you've used the "not spam" button in GMail to tell GMail that it ... is not spam? [19:17:46] blergh, frustrating all around [19:18:39] I set up my Gmail filters to never mark list mail as spam for exactly that reason [19:19:48] [bz] (8NEW - created by: 2spage, priority: 4Unprioritized - 6normal) [Bug 51580] configure beta labs for SUL2 - https://bugzilla.wikimedia.org/show_bug.cgi?id=51580 [19:21:34] andrewbogott: i'm back [19:23:35] ottomata: OK. While I'm watching the logs, can you make a port 80 access via pmtpa-proxy? [19:23:59] ok ready? [19:24:08] ok [19:24:11] going [19:24:34] instance-proxy on port 80 works, pmpta-proxy on port 80 404s [19:24:42] oh [19:24:42] ! [19:24:43] There are multiple keys, refine your input: !log, $realm, $site, *, :), ?, account, account-questions, accountreq, add, addresses, addshore, afk, airport-centre, alert, amend, ask, bang, bastion, beta, bible, blehlogging, blueprint-dns, bot, bots, botsdocs, broken, bug, bz, chmod, cmds, console, cookies, coren, Coren, credentials, cs, Cyberpower678, damianz, damianz's-reset, db, del, delete, demon, deployment-beta-docs-1, deployment-prep, doc, docs, domain, enwp, epad, etherpad, evil, extension, failure, flow, forwarding, gerrit, gerritsearch, gerrit-wm, ghsh, git, git-puppet, gitweb, google, group, hashar, help, helpmebot, hexmode, home, htmllogs, hyperon, info, initial-login, instance, instance-json, instancelist, instanceproject, ip, keys, labs, labsconf, labsconsole, labsconsole.wiki, labs-home-wm, labs-l, labs-morebots, labs-nagios-wm, labs-project, labstore3, labswiki, leslie's-reset, link, linux, load, load-all, log, logs, logsearch, mac, magic, mäh, mail, manage-projects, meh, mobile-cache, monitor, morebots, msys-git, nagios, nagios.wmflabs.org, nagios-fix, nc, newgrp, new-labsuser, new-ldapuser, nova-resource, op_on_duty, openstack-manager, origin/test, os-change, osm-bug, pageant, password, pastebin, pathconflict, petan, petan..., petan-build, petan-forgot, ping, pl, pong, port-forwarding, project-access, project-discuss, projects, proxy, puppet, puppetmaster::self, puppetmasterself, puppet-variables, putty, pxe, pypi, python, pythonguy, pythonwalkthrough, queue, quilt, rb, remove, replicateddb, report, requests, resource, revision, rights, rq, rt, rules, Ryan, Ryan_Lane, ryanland, sal, SAL, say, screenfix, search, searchlog, security, security-groups, seen, sexytime, shellrequests, single-node-mediawiki, smb, snapshits, socks-proxy, ssh, sshkey, start, stats, status, StoneB, stucked, sudo, sudo-policies, sudo-policy, svn, taskinfo, terminology, test, Thehelpfulone, tooldocs, tools-admin, tools-bug, tools-help, tools-request, tools-web, trout, tunnel, tygs, unicorn, venue, vim, vmem, whatIwant, whitespace, wiki, wikitech, wikiversity-sandbox, windows, wl, wm-bot, wm-bot2, wm-bot3, wmflabs, zhuyifei1999, [19:24:56] andrewbogott: if i manually prepend 80,. [19:24:57] to the url [19:25:01] it works at pmtpa proy [19:25:04] pmtpa-proxy [19:25:25] but not if you don't specify a port at all? [19:25:43] psh, its working now [19:26:06] everything on port 80 is working now [19:26:16] ok. [19:26:29] So it works if you prepend it or if you don't specify? [19:26:36] both for port 80, yes [19:26:52] ok. Try with 8888 now? [19:28:04] andrewbogott: slightly related, have you looked at hipcache? [19:28:05] ok i started up a simple nginx server to make sure thi sproblem isn't caused by my app [19:28:08] i'm running on 8881 [19:28:24] YuviPanda, never heard of it [19:28:25] http://8881.kraken-namenode.pmtpa-proxy.wmflabs.org/ 404 not found [19:28:25] http://8881.kraken-namenode.instance-proxy.wmflabs.org/ 504 timeout [19:28:25] andrewbogott: Ryan_Lane wanted to replace instance proxy with that [19:28:47] ottomata, instance-proxy is a relic developed by someone else, I'm not going to debug that one [19:29:26] oh ok [19:29:27] hm [19:29:42] then 8881 is 404ing [19:29:44] on pmpta-proxy [19:30:04] andrewbogott: https://github.com/dotcloud/hipache [19:30:07] (just a FYI) [19:30:12] I see lots of 8888s in the log for pmtpa-proxy but no 8881s. Hm [19:31:47] here are some more [19:31:54] anything? [19:32:03] should I be able to wget kraken-namenode:8881? [19:32:20] should be [19:32:22] lemme make sure I can [19:32:57] yeah works fine for me [19:32:57] * Coren is probably about to drop off the 'net as power flickers and fails intermitently. [19:32:57] from another node in my project [19:33:21] for me it hangs [19:33:25] hi [19:33:33] Did you open that port in the firewall? [19:34:00] [@kraken-datanode:~] $ curl --head http://kraken-namenode:8881 [19:34:00] HTTP/1.1 200 OK [19:36:01] from an instance in another project (in this case pmtpa-proxy)… I can ping [19:36:13] port 80 can't connect to host, port 8881 hangs [19:36:27] is 8881 open in the firewall? [19:37:16] kma500: ok, just sent a mail to the labs-l list announcing the sprint :) [19:37:24]