[06:22:58] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/441331 (owner: 10L10n-bot) [13:18:55] !log tools tools-bastion-03:~# bash -x /data/project/paws/paws-userhomes-hack.bash [13:18:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [19:52:27] !log tools.paws deploying jupyterhub 0.9 through deploy hook [19:52:29] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.paws/SAL [21:28:14] hey all! I've setup a wmflabs instance with the wikidata role but I can't seem to get it to work from http://wikidata-reading-web-staging.wmflabs.org/ [21:28:30] anyone able to help me troubleshoot? I've setup proxies but https://wikitech.wikimedia.org/wiki/Help:MediaWiki-Vagrant_in_Cloud_VPS#Run_a_wikifarm isn't helping me [21:28:39] http://en-reading-web-staging.wmflabs.org/ also not working [21:36:35] jdlrobson: does `curl` from the VM to the LXC container work? [21:37:13] bd808: yup wget http://wikidata.wiki.local.wmftest.net:8080/ returns the page i want [21:37:33] it's just not publicly visible. I figured I could just add a dns to wikidata-reading-web-staging but it didn't work [21:37:40] is it possible the other '-' in the url are causing issues? [21:38:32] hmmm... that sounds like the hieradata isn't taking effect. I would expect a wiki.local.wmftest.net request to return you the "choose a wiki" page [21:39:45] bd808: you mean if I went to reading-web-staging.eqiad.wmflabs you'd expect a "choose a wiki" page? [21:39:54] sorry reading-web-staging.wmflabs.org [21:40:25] Should I try the /srv/mediawiki-vagrant/puppet/hieradata/local.yaml approach? [21:40:28] I mean that the wget should do that too if the farm name suffix is being applied in the config [21:41:17] jdlrobson: what is the instance name? [21:41:29] readingwebstaging.eqiad.wmflabs [21:42:09] ok. that should make your default wmv::tld value "-readingwebstaging.wmflabs.org" [21:42:20] I did wonder if that was problematic - but http://wikidata-readingwebstaging.wmflabs.org/ doesn't work either. [21:42:24] oops "mwv::tld" [21:42:30] (even though proxy setup) [21:42:52] I see a wiki there... [21:43:14] oh, but it is not the wikibase/wikidata wiki I guess? [21:44:04] jdlrobson: so first thing is that yes you need a custom /srv/mediawiki-vagrant/puppet/hieradata/local.yaml if you are not using the instance name as the base tld [21:44:27] bd808: you see a wiki on what url? [21:45:15] I guess I see a wiki on both urls which is confusing if the MediaWiki-Vagrant multiwiki code is actually active [21:46:01] the wikidata-reading-web-staging.wmflabs.org should show the "No wiki found" page I would think [21:46:30] because that vhost name should not exist in the config unless you have setup the local.yaml file for it [21:46:48] http://wikidata-reading-web-staging.wmflabs.org/ gives me "wikidata-reading-web-staging.wmflabs.org’s server IP address could not be found." [21:47:17] jdlrobson: I think that's your local DNS cache [21:48:22] dig +short wikidata-reading-web-staging.wmflabs.org -- 208.80.155.156 [21:48:45] that's from my local laptop [21:49:57] Huh. I get a 404 if I visit 208.80.155.156 [21:50:17] but http://wikidata-reading-web-staging.wmflabs.org/ not resolving. Is there a delay on the dns configuration? [21:51:01] going direct to the proxy is expected to 404 unless you pass a "Host: ...." header for a configured backend [21:52:24] the DNS is live for me from my home internet connection. My guess is you did hit it before the dns server was ready and now you have a local cache (or upstream resolver cache) of the missing result [21:54:30] doh [21:55:42] something did not work quite as I would expect for provisioning. I see `$wgConf->settings['wgServer']['wikidatawiki'] = '//wikidata.wiki.local.wmftest.net';` in /srv/mediawiki-vagrant/settings.d/wikis/wikidatawiki/wgConf.php [21:56:04] so if i change that..? [21:56:46] yeah, but it really needs to be managed by hiera and puppet [21:56:58] which is the https://wikitech.wikimedia.org/wiki/Help:MediaWiki-Vagrant_in_Cloud_VPS#Run_a_wikifarm stuff [22:00:21] ok ill see what happens when i vagrant provision.. [22:01:08] jdlrobson: in your local.yaml, make mwv::tld start with the "-" [22:01:59] and change "readingwebstaging" to "reading-web-staging" if you want all those hyphens [22:06:38] https://www.irccloud.com/pastebin/6hm26DQj/ [22:09:17] and now i've set: [22:09:21] https://www.irccloud.com/pastebin/0oGHXwtz/ [22:09:32] and even though seeing $wgConf->settings['wgServer']['wikidatawiki'] = '//wikidata-reading-web-staging.wmflabs.org'; still no luck [22:11:41] but it works on my phone.. [22:11:50] so guessing this is dns cache crap like you said [22:12:15] and wikidata-reading-web-staging.wmflabs.org does not look like a wikidata instance.. [22:12:42] https://wikidata-reading-web-staging.wmflabs.org/wiki/Special:Version works for me and shows that "Wikibase Repository" is installed [22:13:28] wtf lol [22:13:59] jdlrobson: I think its actually working now, but you may have some weird DNS problem [22:14:21] the wikidata role doesn't setup any useful content though, so you have to build out your Ps and Qs [22:14:22] yeh and flushing dns cache not helping [22:14:35] does http://reading-web-staging.wmflabs.org/ work for you? [22:15:03] yes [22:15:35] jdlrobson: what do you get if you run `dig wikidata-reading-web-staging.wmflabs.org`? [22:16:40] also try `dig @labs-ns0.wikimedia.org wikidata-reading-web-staging.wmflabs.org` and `dig @labs-ns1.wikimedia.org wikidata-reading-web-staging.wmflabs.org` [22:17:15] it works (finally)! [22:17:17] if the latter 2 queries work and the first does not then something is caching between you and the authoritative DNS [22:18:11] cool. I've tripped on that DNS cache problem myself before [22:19:54] thanks bd808 lemme see if it's all working as expected [22:21:50] labs-ns0 and labs-ns1 often take a while to agree about newly added names [22:22:32] think I have a ticket about it somewhere