[08:19:17] hi! I'm looking into completing T187987 and specifically migrating netmon hosts to prometheus v2, are those in an active/standby pair or what's the setup ? [08:19:18] T187987: 100% of Prometheus traffic served by Prometheus v2 - https://phabricator.wikimedia.org/T187987 [09:19:22] godog: not sure which hosts are you referring to [09:32:31] arturo: gah, I meant labmon! not labmon [09:32:42] * godog sighs [09:32:47] labmon, not netmon [09:33:03] ok, so we have labmon1001 and labmon1002. The 1001 is the active one, 1002 is cold standby doing just rsync from 1001 [09:33:59] ack, rsync of graphite I take it, not prometheus or everything? [09:36:50] Hi! I need a 2FA reset (stolen phone). How can I proceed? [09:52:35] godog: not sure. They store metrics and the collect prometheus metrics too. Not sure if this answers your question [09:53:32] arturo: ok thanks! I'll check what gets copied and update the task / let you know [09:54:55] CristianCantoro: please read https://wikitech.wikimedia.org/wiki/Password_reset and open a phabricator task [09:55:53] arturo: Thanks! Just opened! https://phabricator.wikimedia.org/T222151 [09:56:45] The problem I had with https://wikitech.wikimedia.org/wiki/Password_reset is that it is written from an admin's standpoint, they are not really the instructions for a user, or am I missing them? [09:58:15] you may be right [09:58:40] CristianCantoro: probably we won't be able to handle your request in real time [09:59:57] arturo: not a problem, just knowing that I made the request in the right place is enough. I am not in a hurry [10:00:12] cool thanks [10:56:32] !log tools T221225 create tools-sgebastion-0test for more sssd tests [10:56:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [10:56:35] T221225: sssd integration needs to be updated to include sudo config from LDAP support - https://phabricator.wikimedia.org/T221225 [11:07:19] !log tools T221225 disable puppet in toolforge [11:07:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:07:22] T221225: sssd integration needs to be updated to include sudo config from LDAP support - https://phabricator.wikimedia.org/T221225 [12:08:00] Eugene233: you around? [12:08:33] any toolforge user around would like to help me testing some sssd things? [12:08:47] * Lucas_WMDE is here [12:09:17] Lucas_WMDE: mind jumping to `tools-sgebastion-0test` and becoming your tool? [12:09:23] I can try [12:09:27] `tools-sgebastion-0test.eqiad.wmflabs` [12:10:02] seems to be working [12:10:18] file permissions are ok? [12:10:18] though tab completion for `become` doesn’t suggest my tools [12:10:36] that's the case in the other bastions? tab completition [12:10:45] usually yes [12:10:50] I can test if it’s still working there [12:11:00] editing a file in public_html worked [12:11:17] yeah tab completion on sgebastion-07 is still working [12:11:24] but perhaps it’s just not set up on 0test [12:11:35] mmm [12:11:41] I see [12:11:55] bash says “no completion specification” [12:12:14] perhaps the completition was for sudo-ldap [12:12:20] and we are now using sudo instead [12:12:36] if I manually copy the completion setup into the 0test shell, it still works [12:12:47] so I think the bashrc snippet (or whatever) might just be missing [12:13:33] not sure where it’s set up [12:13:44] but `groups` still prints all my tool groups [12:16:20] thanks Lucas_WMDE ! [12:17:19] no problem [12:25:56] arturo: Yes [12:27:29] Eugene233: would you mind jumping via ssh to `tools-sgebastion-09.eqiad.wmflabs` and trying to become your tool? [12:33:24] Ok doing that now [12:33:36] @arturo: it works just fine [12:33:45] thanks Eugene233 ! [12:34:08] arturo: Anytime! [12:45:01] !log tools adding `sudo_flavor: sudo` hiera config to all puppet prefixes with sssd [12:45:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:45:11] !log tools adding `sudo_flavor: sudo` hiera config to all puppet prefixes with sssd (T221225) [12:45:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:45:14] T221225: sssd integration needs to be updated to include sudo config from LDAP support - https://phabricator.wikimedia.org/T221225 [12:50:43] !log tools enable puppet in all servers T221225 [12:50:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:50:47] T221225: sssd integration needs to be updated to include sudo config from LDAP support - https://phabricator.wikimedia.org/T221225 [13:11:56] arturo hi, im getting "Error: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Resource Statement, Duplicate declaration: Package[sudo] is already declared in file /etc/puppet/modules/ldap/manifests/client/nosssd.pp:13; cannot redeclare at /etc/puppet/modules/sudo/manifests/init.pp:2 at [13:11:57] /etc/puppet/modules/sudo/manifests/init.pp:2:5 at /etc/puppet/modules/raid/manifests/init.pp:43 on node puppet-paladox.git.eqiad.wmflabs" [13:12:06] yes, I'm aware [13:12:16] ah ok [13:12:29] paladox: its related to t221225 i think [13:13:15] oh, i know :) [13:15:30] I'm reverting my patch [13:17:30] arturo: i love how the revert got v-1 [13:17:41] :-P [13:17:53] arturo: guess jenkins is sentimental [13:17:56] because my patch fixed stuff [13:20:13] paladox: patch reverted [13:20:19] thanks arturo [13:21:43] the sudo/sssd issue keeps growing bigger... I will have to reconsider my approach [13:22:11] Use a hammer? [13:23:23] arturo: http://i.imgur.com/0ZnyYEx.jpg [13:24:21] xd [15:53:10] FYI re: labmon1002 prometheus 2 migration, see https://phabricator.wikimedia.org/T187987#5147514 [15:58:09] godog you put march instead of may :P [16:05:36] doh, thanks paladox, fixed! [16:05:44] your welcome :) [23:10:51] !log tools.quickcategories deployed ce83ffb040 [23:10:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL