[00:54:40] bd808 you can decline those OAuth Consumer requests.. I figured out what my problem was on localhost. :) [10:31:57] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/440316 (owner: 10L10n-bot) [11:25:16] (03PS1) 10MarcoAurelio: rightstool: this tool is not ours [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440329 [11:26:39] (03PS2) 10MarcoAurelio: rightstool: this tool is not ours [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440329 [11:26:58] (03PS1) 10MarcoAurelio: Better wording [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440330 [11:33:13] (03PS2) 10MarcoAurelio: Better wording [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440330 [11:34:35] (03CR) 10MarcoAurelio: [C: 032] Better wording [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440330 (owner: 10MarcoAurelio) [11:35:02] (03Merged) 10jenkins-bot: Better wording [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440330 (owner: 10MarcoAurelio) [11:45:00] (03CR) 10MarcoAurelio: "I'm not sure whether to remove it from the main page or add it in a specific section telling that it's not ours but that we 'advertise' it" [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440329 (owner: 10MarcoAurelio) [13:30:15] hello, i seen some traffic recently from instance-tools-exec-1404.tools.wmflabs.org .. im not worried about it at all, it didn't do anything of concern. it is purely interest from an academic, what bot was interested in their site? is there anyway of telling? [13:31:13] it is completely feasible it might just have been a link validator :-) [14:20:19] !log tools timeout 180s bash -x /data/project/paws/paws-userhomes-hack.bash [14:20:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [14:20:51] znx: I'm not sure what bot that was because we have many many running. If you had the UA that would provide us a clue. Link validators due indeed run in this env though. [14:26:49] chasemp: unfortunately not logged, though it is something i could alter and do. i do get the feeling that most of it was link validation as most of the requests are just HEAD, though there is a couple of GET's in there. many thanks for the info, i will look to log the UA, see if it assists. [17:25:22] (03PS1) 10Ottomata: Properly name dummy kafka_main-eqiad_broker certificate files [labs/private] - 10https://gerrit.wikimedia.org/r/440373 [17:26:10] (03CR) 10Ottomata: [V: 032 C: 032] Properly name dummy kafka_main-eqiad_broker certificate files [labs/private] - 10https://gerrit.wikimedia.org/r/440373 (owner: 10Ottomata) [17:34:21] quiddity: do you remember if there is a phab project for "tools that I would like someone to write"? I was thinking that I had seen something like that, but can not find it now. [17:34:37] ya, a few, 2 secs [17:34:50] I know there is WP:BOTREQ and similar things on some other wikis [17:35:44] https://phabricator.wikimedia.org/project/profile/1042/ [17:38:18] quiddity: thank you for being my librarian yet again :) [17:39:35] bd808, Ah, here's the other one https://phabricator.wikimedia.org/project/profile/2235/ [17:39:48] which links to the 3rd [17:40:25] (as my grandad said, "Why be difficult, when with a little more effort you can be impossible!") [17:41:42] (03PS1) 10Ottomata: Add kafka_main-codfw_broker dummy certs for PCC [labs/private] - 10https://gerrit.wikimedia.org/r/440379 [17:41:55] (03CR) 10Ottomata: [V: 032 C: 032] Add kafka_main-codfw_broker dummy certs for PCC [labs/private] - 10https://gerrit.wikimedia.org/r/440379 (owner: 10Ottomata) [18:26:34] bd808: the problem of organizing "tools I want someone to write" is something I tried tackling with Andre and Srishti a few months ago [18:26:41] In summary, Phabricator is messy, what else is new [18:35:19] is there any way to check if the `elasticsearch::version: 2` setting that labs defaults to is used by anything? I would like to stop supporting 2 before we add 6 [18:35:27] (in puppet/hieradata) [18:36:02] well [18:36:08] hiera data can come from a ton of places [18:36:12] the puppet repo itself [18:36:18] wikitech Hiera: pages [18:36:24] and the service that horizon talks to [18:36:24] right, so ignore all of that [18:36:32] ideal solution: somehow ask puppet on all the machines [18:36:51] I don't think we have any way to check this stuff across absolutely all labs machines [18:37:12] even with cumin, some projects use their own cumin masters [18:37:18] i could try complaint driven development, remove it and see who speaks up :) [18:37:28] I call that the scream test [18:37:49] I have definitely done that before. "Does this server do anything? Well, let's turn it off and see if anyone complains." [18:38:06] I normally use that before permanently deleting instances [18:38:11] anyway [18:38:34] at some point I should probably make a tool that gets hiera data for all instances to give you insight into what keys are used where, set to what, etc. [18:44:34] it wouldn't be great, but is there a host i could scan port 9200 across the cloud network from? [18:44:44] port 9200? [18:45:02] and unlikely, security groups would most normally block that kind of thing [18:45:23] i'm trying to check is anything in labs uses the hieradata `elasticsearch::version: 2` key, it has no support for changing ports so a mediocre way to check is to get the version number from the server [18:46:08] oh, that's the port that elasticsearch listens on? [18:46:26] Krenair: yes [18:46:50] I think it'll only work with the assumption that everyone who is using elasticsearch has opened the port up to the entire labs network, instead of just their desired client hosts [18:47:40] yea the security groups separating things will make it a pain.. [18:48:34] people are not normally nearly this careful about breaking stuff in labs [18:49:23] ebernhardson, I found one instance of elasticsearch::version: 2 [18:49:25] https://wikitech.wikimedia.org/wiki/Hiera:Wikifactmine [18:50:01] ebernhardson, oh hold on, you're talking about labs *defaulting* to it. dammit [18:51:26] Krenair: yea, thats the problem. Have to find anything that enabled the elasticsearch module. It's perhaps just not worth figuring out. But puppet wil fail and i don't know how many people even notice [18:51:28] so anything that uses the elasticsearch module or anything that includes it without providing version: 5 [18:52:06] modules/profile/manifests/elasticsearch.pp: class { '::elasticsearch': [18:52:15] modules/role/manifests/logstash/elasticsearch.pp: class { '::elasticsearch': [18:52:33] modules/role/manifests/toollabs/elasticsearch.pp: include ::elasticsearch [18:52:36] Krenair: right, the ones explicitly in puppet i can take care of, and should all be running 5 [18:52:53] Krenair: because those in puppet are basically exclusively deployment-prep, which needed es 5 anyways [18:54:13] I wonder where role::toollabs::elasticsearch is used [18:54:50] Krenair: bd.808 used it for a few things, i think there was an irc search or something? [18:55:01] it's generally available to tools though is my understanding [18:55:38] yep hang on [18:55:52] there it is [18:55:54] tools-elastic hosts [18:56:28] tools-elastic-01, tools-elastic-02, tools-elastic-03 [18:57:27] krenair@tools-elastic-01:~$ curl -s http://localhost:9200 | jq .version.number [18:57:27] "5.5.2" [18:59:21] ebernhardson, I suggest for now you just change the default [19:08:52] ebernhardson: https://tools.wmflabs.org/openstack-browser/puppetclass/role::toollabs::elasticsearch https://tools.wmflabs.org/openstack-browser/puppetclass/role::elasticsearch::beta [19:09:33] so deployment-prep, toolforge, and wikifactmine look to be the only things using roles that include "elasticsearch" in the name [19:10:12] deployment-prep has its single node ELK cluster too [19:13:30] bd808, what is that tool querying? [19:14:37] Krenair: the api that Horizon talks to on ... the puppetmaster? The code for it should be in the tool's repo [19:14:47] cool [19:14:54] https://phabricator.wikimedia.org/source/tool-keystone-browser/browse/master/keystone_browser/puppetclasses.py [20:02:23] bd808: thanks! So looks like only wikifactmine will need to be helped [20:16:08] (03CR) 10Krinkle: [C: 031] rightstool: this tool is not ours (031 comment) [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440329 (owner: 10MarcoAurelio) [20:24:23] (03PS3) 10MarcoAurelio: index: rightstool is not ours [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440329 [20:26:11] (03CR) 10MarcoAurelio: index: rightstool is not ours (031 comment) [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/440329 (owner: 10MarcoAurelio) [21:22:37] !log redirects Fixed broken puppet agent configuration and forced puppet run [21:22:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Redirects/SAL [21:23:32] !log redirects Added living-style-guide.wmflabs.org and livingstyleguide.wmflabs.org support (T192128, T192129) [21:23:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Redirects/SAL [21:23:35] T192128: Redirect livingstyleguide.wmflabs.org to design.wikimedia.org/style-guide - https://phabricator.wikimedia.org/T192128 [21:23:35] T192129: Redirect living-style-guide.wmflabs.org to design.wikimedia.org/style-guide - https://phabricator.wikimedia.org/T192129 [21:26:50] !log design Added BryanDavis (self) as admin to complete T192128 & T192129 [21:26:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Design/SAL [21:30:16] !log design Removed BryanDavis (self) from project [21:30:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Design/SAL