[05:03:11] hello, where was that file again in the repo where you add SSH keys with root access to cloud VPS instances [05:03:26] can't see to find it as authorized_keys [06:03:29] mutante: https://gerrit.wikimedia.org/r/plugins/gitiles/labs/private/+/refs/heads/master/modules/passwords/templates/root-authorized-keys.erb [06:08:56] zhuyifei1999_: thanks! i was in the wrong repo to begin with :) : [06:09:11] np [14:01:09] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @bd808 - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [14:34:02] mutante: this one? https://gerrit.wikimedia.org/r/plugins/gitiles/labs/private/+/refs/heads/master/modules/passwords/templates/ [14:50:47] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @bd808 - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:28:12] do you have any objections to me going ahead and upgrade grafana to 5 on labmon ? [15:28:45] not sure if it was discussed at the meeting yesterday (?) [15:30:33] godog: we talked a little about that. It sounds good, the only thing to note is these servers are still on jessie and I think grafana 5 is currently only in our stretch repos [15:30:38] not a show stopper :) just a note [15:32:02] jeh: thanks for the jessie reminder! yeah I'll install the deb manually [15:32:23] did the same thing on grafana1001 since the internal repo is already on grafana 6 [15:32:43] and upstream afaics doesn't provide distinct repos anyways [15:33:32] !log ores ran "sudo service nginx restart" on ores-lb-03 [15:33:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [15:35:23] godog: thanks, let me know if there's anything I can help with [15:36:06] thanks jeh ! will do [15:40:53] ok upgraded, looks like we're back [15:42:31] let me know if you get any errors or reports of errors! [15:43:49] great! thank you [15:45:21] Deploy latest from Git master: 9b1d32b (T232001) [15:45:22] T232001: Missing country - https://phabricator.wikimedia.org/T232001 [15:45:48] !log tools.wikiloves Deploy latest from Git master: 9b1d32b (T232001) [15:45:51] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikiloves/SAL [15:54:01] Hey folks. I'm looking for docs on the host/port of the statsd server for labs. [15:54:13] We're failing to connect to it (have been for a while) [15:54:45] Looks like we are using: [15:54:51] host: labmon1001.eqiad.wmnet port: 8125 [16:15:50] halfak: I'm not sure if we have any docs, it looks like only UDP is open to port 8125 on that host. [16:16:00] https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/refs/heads/production/modules/profile/manifests/wmcs/graphite.pp#39 [16:17:33] looks like the TCP block `statsite_tcp` might have been a copy paste error, but that was back in 2016. (not sure how long ago it stopped working for you) [16:18:48] could you open a phab task for this? [20:09:50] !log ores restarting all labs VPN nodes. [20:09:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [20:10:16] Thanks jeh [20:10:37] see https://phabricator.wikimedia.org/T231222 [20:10:47] I'm investigating something that might be related. [20:20:57] !log ores ran "flushall" on both redis instances (ports 6379 and 6380) [20:20:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL