[14:13:01] !log rcm Xenon: Running update [14:13:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL [14:13:42] !log rcm Xenon: Investigating: "The last Puppet run was at Wed Jan 17 16:40:46 UTC 2018 (15692 minutes ago)." [14:13:44] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL [14:16:02] can somebody help me with the puppet problem above? When I do puppet agent -tv I get: [14:16:02] Error: Could not initialize global default settings: Cannot set modulepath settings in puppet.conf [14:18:23] !log rcm CAC: Running vagrant git-update [14:18:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL [14:21:05] !log rcm Neon: Running update [14:21:05] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Rcm/SAL [15:16:21] Sagan: did it run? [15:16:34] chicocvenancio: no, it failed with that error [15:16:43] it returned only that line [15:27:33] Sagan hi [15:27:37] is this a puppetmaster? [15:27:47] and could you paste your puppet.conf please. [15:28:05] paladox: no, it isn't. I think we had this already once this month, and I replaced that conf with the one you purposed, and that worked for a few days [15:28:28] Sagan what puppet class is applied to this istance? [15:28:38] paladox: no class [15:28:43] ok hmm [15:28:59] paladox: conf is https://pastebin.com/Y8qY3K6v [15:29:39] Sagan apt-get --purge remove puppetmaster* [15:30:38] Sagan https://phabricator.wikimedia.org/P6637 [15:30:39] paladox: done. and now? [15:31:18] paladox: you mean I should replace my puppet.conf with that paste? [15:31:28] Yep [15:31:34] Sagan also which host is this for [15:31:52] xenon.rcm.eqiad.wmflabs [15:32:17] paladox: ok, and when I've done this, just puppet agent -tv or still something else to do? [15:32:26] yep puppet agent -tv [15:33:02] that was successful now, thx [15:33:24] Your welcome :) [15:33:31] huh [15:33:39] I logged out and in again, and get still: [15:33:43] The last Puppet run was at Wed Jan 17 16:40:46 UTC 2018 (15692 minutes ago). [15:33:50] Sagan which puppet version? [15:33:56] then I've tried to run it again manually, and got: Error: Could not initialize global default settings: Cannot set modulepath settings in puppet.conf [15:34:15] paladox: how can I get the version, which command is that? [15:34:15] did you save puppet.conf as root? [15:34:20] puppet -v [15:34:37] IIRC I did [15:34:42] puppet --version [15:34:53] root@xenon:/etc/puppet# puppet --version [15:34:53] Error: Could not initialize global default settings: Cannot set modulepath settings in puppet.conf [15:35:04] oh [15:35:21] try replacing the file again. [15:36:34] hm, now it worked. strange [15:36:42] also The last Puppet run was at Sun Jan 28 15:32:50 UTC 2018 (0 minutes ago). is ok now [16:55:54] !help hi does anyone know how to find the page id of an article in any language from the user's interface? [16:55:54] tomthirteen: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [16:56:48] tomthirteen: there's a link in the sidebar called "page information" [16:57:49] adding ?action=info to the URL gives you the same result [16:57:57] * Hauskatze departs now [16:58:48] hauskatze: you're the best. thanks! have a good day [16:59:09] that's the nicest thing I've been told :) [22:48:39] !log tools killed miner processes in tools-bastion-03 [22:48:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [22:49:10] !log tools killed compromised session generating miner processes [22:49:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [22:51:05] somebody used bastion for mining? [22:51:53] Sagan: probably a compromised account [22:51:54] Interesting [22:52:19] * chicocvenancio looks at Zppix [22:52:25] I wouldnt be shocked if it wasnt though, cryptocurrency seems to be a new craze [22:52:39] chicocvenancio: i havent done anything (yet) jk [22:53:44] chicocvenancio: did you checked if that account has access to other project? (and what he is doing on the normal bastion?) [22:53:54] the fact that it went all out on the CPUs tells me it probably was a compromised account, but who knows [22:54:10] Sagan: normal bastion? [22:54:15] chicocvenancio: i mean tbh its not hard to get bastion access [22:54:23] chicocvenancio: bastion-01 and bastion-02 [22:54:38] (bastion-01.bastion.eqiad.wmflabs) [22:54:40] Sagan: bastion-03 for tools isnt restricted [22:54:45] Oh i see [22:54:58] He means cloud vps's bastions chicocvenancio [22:55:00] I kind of think of bastion-03 as normal bastion, since it is login.tools.wmflabs.org [22:55:02] for me the "normal" bastions are those small ones outside of tools, since I mostly use them [22:55:12] chicocvenancio: that's the *tools*-bastion in my language [22:55:44] Yeah, we're having problems giving me basic access to these bastions [22:56:22] chicocvenancio: if you PM me the user name of the compromised user account, I can take a look what last shows concerning his last logins [22:56:30] if you are actually not able to [22:56:33] chicocvenancio: hey even i have access to those lol [22:56:55] bastion-02 is clean as usual anyway [22:57:29] chicocvenancio https://gerrit.wikimedia.org/r/#/c/405376/ [22:57:33] Sagan: andrewbogott has removed the accounts from its projects [22:57:50] chicocvenancio: ah, ok. guess then it's solved [22:58:02] :) [22:58:18] chicocvenancio i think you need https://gerrit.wikimedia.org/r/#/c/405376/ to access most of the cloud. [22:58:58] at least "normal" access to the bastions should be possible if you are added to the project [22:59:04] and project admins get root so... [22:59:12] paladox: yes, that'll probably happen at some point. Until them I was added to the bastion project to get basic access but apparently there is a bug about some accounts [22:59:14] at least for the bastions it's easy to do that fast [22:59:21] meh... [22:59:30] yep [22:59:39] since it was Allhands this week it was delayed until next week [22:59:47] yep