[07:35:54] hmm, I have no idea what I'm doing wrong [07:36:23] I have my packagist-mirror1 instance (debian stretch), installed apache2, and verified that curl localhost works [07:36:57] I set up a proxy for https://packagist-mirror.wmflabs.org/ double checked that 80 is open in security groups [07:37:01] aaand it still only times out [07:53:58] legoktm: could be some security group or ferm rule? [07:54:25] I can have a look if you want :-) [07:54:46] arturo: my suspicion is that I set up the security groups wrong...if you could take a look I would very much appreciate it [07:55:18] ok, do you have a phab task or something? [07:55:40] uh I've been using https://phabricator.wikimedia.org/T203529 [07:55:48] legoktm@packagist-mirror1:~$ dpkg -l | grep ferm [07:55:53] ferm isn't installed apparently [07:56:24] if I try $ curl packagist-mirror1.eqiad.wmflabs from within toolforge, it times out, but ping works [07:56:29] so I suspect something wrong with security groups [07:56:53] yes, is the usual suspect [07:57:48] I will take a look later and let you know in the phab taks in case you arent around by then [07:59:03] thanks :) [09:41:48] legoktm: you are all set :-) [09:50:14] arturo, for future reference it's probably worth testing this stuff from novaproxy-01.project-proxy.eqiad.wmflabs instead of tools-bastion-03.tools.eqiad.wmflabs [09:50:48] ack, toolforge was the thing mentioned by legoktm [14:08:06] !log admin running dns leaks cleanup `root@cloudcontrol1003:~# /root/novastats/dnsleaks.py --delete` [14:08:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:50:15] jaufrecht: My calendar says I'm moving phlogiston-2 and phlogiston-3 to the new region today, but I can just ignore them if you're going to delete them soon anyway. (It looks like you have a replacement in progress already.) [14:50:21] Is that right? Or should I move one or both anyway? [14:52:40] SMalyshev: I am still hoping for a response on T210772 — it's the last VM on a server that I'd like to rebuild. [14:52:40] T210772: wdqs-test.wikidata-query.eqiad.wmflabs is of unknown flavor, needs migrating - https://phabricator.wikimedia.org/T210772 [15:59:33] andrewbogott: I've migrated phlog 2; starting phlog 3 today [16:00:02] Phlog2 can be dropped [16:00:17] jaufrecht: great! want me to go ahead and delete -2 or leave it to you? [16:00:37] Go ahead [16:01:47] !log phlogiston deleting phlogiston-2 on joel's say-so [16:01:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Phlogiston/SAL [18:15:09] !log tools shutdown tools-exec-gift-trusty-01 instance (T194615) [18:15:14] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [18:15:15] T194615: Delete tools-exec-gift-trusty-01.tools.eqiad.wmflabs and giftbot queue - https://phabricator.wikimedia.org/T194615 [18:44:50] what is the difference between eqiad-r and eqiad? [18:47:37] cdanis eqiad-r is the new network [18:47:41] eqiad is the old one [18:47:58] eqiad-r is neutron, i forgot what network is in use in eqiad. [18:48:01] cdanis: I think eqiad-r is eqiad1-r and eqiad is really eqiad0 where eqiad1 is a deployment of openstack based on neutron and eqiad0 is the way old deployment based on nova-network :) [18:48:19] cdanis: https://wikitech.wikimedia.org/wiki/Infrastructure_naming_conventions#OpenStack_deployments [18:50:51] ah okay, ty :) [18:50:53] are there openstack instances that have some access to prod? i have an instance that i'd like to be able to query prometheus (to test upgrading grafana) [18:55:49] cdanis: thats a loaded question :) the short answer is instances in cloud can access some endpoints in public prod VLAN but not private (which is not even true but the few in private are whitelisted and anitpatterns) [18:56:36] cdanis: I think the prometheus api is open? I know that's how it is w/ graphite and grafana [18:58:14] Hi [18:58:37] Trying to start migration to new OS because of https://phabricator.wikimedia.org/T204515 [18:58:59] 5 VMs https://tools.wmflabs.org/openstack-browser/project/mwoffliner [18:59:13] But https://horizon.wikimedia.org/project/instances/ list is empty [19:00:15] Kelson42: perhaps the wrong region or project is selected in the dropdown at the upper left? [19:00:44] cdanis: well done :) thx [19:04:09] chasemp: do you know how to figure out which VLAN a service is on? prometheus has some internal-facing LVS in front of it [19:05:59] cdanis: I would look at what endpoint grafana hits and do the same I think? [19:06:24] yeah, it hits e.g. prometheus.svc.eqiad.wmnet, but that seems firewalled off from my instance [19:06:29] ah [19:08:32] then I don't think what you want is possible unless grafana exposes that itself [19:10:15] ah, you mean unless grafana.wikimedia.org can serve as a proxy for my new grafana instance, or something? [19:10:29] * chasemp nods [19:10:43] hm okay [19:11:01] cdanis: prometheus is a bit of a change in model then bc graphite had a public endpoint https://graphite.wikimedia.org/render?from=-2hours&until=now&width=800&height=500&target=logstash.rate.mediawiki.badpass.INFO.count&_uniq=0.9259289370548927&title=logstash.rate.mediawiki.badpass.INFO.count&from=-72h [19:11:34] cdanis: I would ask godog if side effect or intention [19:11:58] yeah, I'll have to talk to him Monday :) [19:36:35] !log deep-learning-services deleting VMs and project — project is abandoned according to https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#SHUTDOWN_deep-learning-services [19:36:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deep-learning-services/SAL [19:43:16] !log services-testbed deleting project. Abandoned as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge [19:43:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Services-testbed/SAL [20:09:35] !log mediahandler-tests deleting project based on communication from Rainer Rillke [20:09:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Mediahandler-tests/SAL [22:18:04] !log tools Pushed new jdk8 docker image based on stretch (T205774) [22:18:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [22:18:10] T205774: Java 7 in Kubernetes jdk8 "server" - https://phabricator.wikimedia.org/T205774 [22:18:31] gtirloni: thanks for picking up that ball that I dropped [22:18:50] no worries! [23:13:18] !log tools moving tools-worker-1009 and tools-worker-1019 to different labvirts [23:13:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL