[00:03:48] !log tools tools-paws-worker-1002, tools-paws-worker-1003 to eqiad1-r [00:03:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [00:04:26] * chicocvenancio peeks, goes back to other stuff [00:05:58] chicocvenancio: looks like paws is already running in both regions, so I'm figuring the firewall stuff is already squared away. We'll see how those three do when they finish copying. [00:09:04] yeah, I vaguely remember something to that effect [01:07:58] !help I have a bit of a problem......I can't reset my LDAP password, can't ssh into my account, and am somehow blocked on wiki tech as a sock? https://wikitech.wikimedia.org/wiki/Special:Contributions/TheSandDoctor [01:07:58] TheSandDoctor: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [01:13:34] Amir1, ^ [01:17:43] looks like there were a lot of range blocks going on around that time, maybe you got caught up in some range: https://wikitech.wikimedia.org/w/index.php?title=Special:Log/block/Ladsgroup&offset=20190320100004&type=block&user=Ladsgroup [01:22:06] I can verify their identity if needed. [01:23:04] So could Cam11598, Alexz, and Mz7. Quiddity is, however, the only one to meet me in person, though they all know my face [01:34:26] you've also got an IRC cloak pointing to an account with 25k edits and an enwiki sysop flag [01:34:54] probably not a sockpuppeteer [01:51:12] and global renamer [01:51:27] that is another reason why I am confused. @Krenair [01:52:02] not according to CA [01:52:13] oh right, there it is [01:52:22] global-renamer is confusingly not a global right [01:52:27] it is local to meta [01:52:33] https://meta.wikimedia.org/w/index.php?title=Special:ListUsers&limit=1&username=TheSandDoctor ? [01:52:39] yeah [01:52:42] odd one [02:33:38] !log tools tools-paws-worker-1005, tools-paws-worker-1006 to eqiad1-r [02:33:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [03:40:36] @Krenair I potentially figured out why I have been unable to log in. Essentially logins are aborted now when blocked https://phabricator.wikimedia.org/T219277#5080247 [03:41:00] yes, it is a BlockDisablesLogin wiki now [03:41:45] I was confused as I was confident I had the right password [03:41:58] makes a bit more sense now haha [11:54:34] !log tools disable puppet in all hosts to deploy oidentd [11:54:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:00:22] !log admin T151704 deploying oidentd to cloudnet1xxx servers [12:00:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [12:00:34] T151704: Freenode sometimes throttles bot connections from tools - https://phabricator.wikimedia.org/T151704 [12:01:44] !log tools T151704 deploying oidentd [12:01:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [13:52:09] !log tools moving tools-prometheus-01 and tools-elastic-01 to eqiad1-r [13:52:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [14:35:18] @Amir1 are you around? [14:35:30] Yup [14:36:36] @Amir1 can you see the channel history? [14:36:46] This channel? [14:36:49] yes [14:38:05] TheSandDoctor: This would help http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-cloud/ [14:38:31] (Hotword removed as to not ping everyone again, timestamps in my timezone) [14:38:31] @Amir1 [14:38:31] == [14:38:31] 6:07 PM help I have a bit of a problem......I can't reset my LDAP password, can't ssh into my account, and am somehow blocked on wiki tech as a sock? https://wikitech.wikimedia.org/wiki/Special:Contributions/TheSandDoctor [14:38:31] 6:07 PM <+wm-bot> TheSandDoctor: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [14:38:31] 6:13 PM Amir1, ^ [14:38:31] 6:17 PM looks like there were a lot of range blocks going on around that time, maybe you got caught up in some range: https://wikitech.wikimedia.org/w/index.php?title=Special:Log/block/Ladsgroup&offset=20190320100004&type=block&user=Ladsgroup [14:38:32] 6:22 PM I can verify their identity if needed. [14:39:16] 6:34 PM you've also got an IRC cloak pointing to an account with 25k edits and an enwiki sysop flag [14:39:17] 6:34 PM probably not a sockpuppeteer [14:39:17] 6:44 PM ⇐ ebernhardson quit (~guy@unaffiliated/ebernhardson) Ping timeout: 245 seconds [14:39:17] 6:51 PM and global renamer [14:39:17] 6:51 PM that is another reason why I am confused. @Krenair [14:39:17] 6:52 PM not according to CA [14:39:17] 6:52 PM oh right, there it is [14:39:18] 6:52 PM global-renamer is confusingly not a global right [14:39:18] 6:52 PM it is local to meta [14:39:19] 6:52 PM https://meta.wikimedia.org/w/index.php?title=Special:ListUsers&limit=1&username=TheSandDoctor ? [14:39:22] == [14:39:23] I see [14:39:26] okay [14:39:41] sorry for this. I'm basically mirroring global blocks [14:39:53] plus some other IPs [14:40:16] oh I blocked your username [14:40:22] let me check why [14:40:58] It's okay. Would it be possible to unblock me @Amir1? I would've alerted to this sooner, but I only learned because I tried to get on last night. I don't log into wikitech or tools much [14:41:03] or at least not lately [14:41:15] sure. on it already [14:41:36] thanks! :) [14:42:14] * TheSandDoctor was rather confused when he couldnt log in, reset password, and then discovered he was blocked and that was probably why he couldnt log in... [14:42:35] (reset password because couldnt log in, so logically thought I had it wrong) [14:49:09] It's for bd808 to decide. Sorry :( [14:49:55] Amir1: It's for me to decide to reverse your unexplained block? [14:50:12] I can explain more [14:50:40] !log tools moving tools-elastic-02 to eqiad1-r [15:02:18] TheSandDoctor: I'll see what I can do to help you out. [15:03:37] quiddity: can you reach out to TheSandDoctor and verify their identity related to this unblock request? If we can get that part established I think I rollback the block [15:09:45] I can additionally solve my enwiki hash to @quiddity to prove my identity if you want @bd808. He will find a decent chunk of it he already knows. [15:24:30] TheSandDoctor: Reedy and I cross checked your account info on wikitech with your main SUL account. You should be able to login to wikitech now [15:38:52] !log tools moving tools-redis-1002 to eqiad1-r [15:40:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [15:48:00] Thanks @bd808! [16:51:31] SAL is missing for mw on https://tools.wmflabs.org/versions/ … and at https://tools.wmflabs.org/sal/ as well [19:24:51] !log tools moving tools-puppetmaster-01 to eqiad1-r [19:33:27] !log tools moving tools-puppetmaster-01 to eqiad1-r [19:34:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [19:34:28] !log shinken disabling shinken service and puppet on shinken-02 to keep things quiet while the tools puppetmaster moves [19:35:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Shinken/SAL [19:44:13] !log tools Disabled puppet on tools-elastic-02 and set to 1-node master [19:44:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [19:54:47] !log shinken re-enabling puppet and the shinken service [19:55:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Shinken/SAL [20:56:03] !log tools shutting down tools-logs-02 — seems unused [20:56:05] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [21:44:06] !log tools moving tools-mail-02 to eqiad1-r [21:44:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [21:49:17] !log tools Re-enabled puppet on tools-elastic-02 and forced puppet run [21:49:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [22:11:09] s [22:11:11] hejk [22:38:53] !log tools moving tools-paws-worker-1005 to cloudvirt1009 to make spreadcheck happier [22:38:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [23:38:37] !log lta-tracker setup standalone puppet master on puppet-lta; install NGNIX on tracker1; setup track-lta.wmflabs.org web proxy [23:38:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Lta-tracker/SAL