[15:53:31] <dcaro>	 !log admin Created private flavor g2.cores8.ram16.disk1120 for wikidumpparse (T268190)
[15:53:34] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL
[15:53:35] <stashbot>	 T268190: Custom Flavour for Wikidumpparse Cloud VPS project - https://phabricator.wikimedia.org/T268190
[15:53:48] <dcaro>	 !log wikidumpparse Created private flavor g2.cores8.ram16.disk1120 (T268190)
[15:53:50] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikidumpparse/SAL
[16:27:06] <acagastya>	 Hi, it looks like I can't access https://quarry.wmflabs.org/ or https://time-convertor.toolforge.org or ssh into toolserver bastion.  I can however, access the first two using Tor.  What could be the reason, or where to ask, any idea?
[16:28:33] <arturo>	 hi acagastya both work for me
[16:29:26] <acagastya>	 Seems like my IP is banned for some reason -- since I can access the first two using Tor.
[16:29:53] <acagastya>	 I tried sshing to toolforge via my rpi and that too timed out.
[16:30:29] <arturo>	 acagastya: are you trying `ssh login.toolforge.org`?
[16:32:12] <acagastya>	 I tried opening quarry.wmflabs.org in browser -- takes forever to load in FF.  I tried opening time-convertor.toolforge.org in FF -- takes forever to load.  They open up in Tor.  Then I tried `ssh USER@tools-dev.wmflabs.org` and connection timed out.  Then I ssh'd into my raspberry pi to then ssh into `tools-dev.wmflabs.org` and that too timed out.
[16:32:37] <acagastya>	 Since Tor is working, I think my public IP is banned.
[16:32:51] <dcaro>	 can you try running mtr quarry.wmflabs.org on a console? you should be able to get to the actual host and back
[16:32:59] <acagastya>	 Unless there is yet another unknown reason why I can't access those.
[16:34:16] <arturo>	 acagastya: can you privately share your IP address with me?
[16:34:22] <dcaro>	 specifically this should give the most accurate result (on linux): mtr -T -P 443 quarry.wmflabs.org
[16:34:57] <acagastya>	 Just did, arturo.
[16:36:08] <arturo>	 acagastya: I'm staring at the logs, can you try ssh again?
[16:36:50] <acagastya>	 I am trying -- this is the part where I will get a connection timeout.
[16:37:11] <arturo>	 I see packets here, but the TCP handshake never completes
[16:38:25] <arturo>	 I mean, your connection reaches the toolforge bastion, but apparently you never get the reply
[16:38:52] <acagastya>	 Hm, that means at least my ISP did not block toolforge.
[16:39:38] <acagastya>	 Should I restart my router and check?
[16:39:51] <acagastya>	 Because Tor let's me access those two sites.
[16:40:09] <arturo>	 acagastya: why not, let's try that
[16:46:24] <acagastya>	 arturo: no luck even after doing that.
[16:47:30] <arturo>	 :-/
[16:47:39] <arturo>	 I think I've seen this before
[16:48:23] <acagastya>	 All I had done was to delete a bunch of broken redirects before this anomaly took place.
[16:48:38] <arturo>	 broken redirects, in-wiki?
[16:50:00] <acagastya>	 Yes, on enwn.  But even then, that does not explain why I will lose access to toolforge and wmflabs.
[16:50:34] <arturo>	 I don't think you should be concerned with a ban or a block because that
[16:50:49] <arturo>	 BTW, you access enwn?
[16:50:55] <arturo>	 I mean, RW?
[16:51:21] <acagastya>	 Had been blocked for time being -- let me check again.
[16:51:48] <acagastya>	 Yeah, it works.
[16:52:28] <arturo>	 can you try your tool once again? I'm staring at the server now https://time-convertor.toolforge.org/
[16:53:21] <arturo>	 sorry wrong server, give me a minute
[16:53:41] <acagastya>	 I tried opening the URL -- it is still loading.  I also tried SSHing, and it is still waiting.
[16:54:07] <acagastya>	 (Same behaviour across multiple browsers and devices on the same network.  :/ )
[16:54:35] <arturo>	 in the toolforge front proxy I see the same behavior
[16:55:04] <arturo>	 I see the original package `youraddress --> proxy` and the reply `proxy --> youraddress` but that's it
[16:55:10] <arturo>	 original packet*
[16:56:06] <arturo>	 I'm afraid there is not much we can do in our side. I would suggest contacting your ISP
[16:57:29] <acagastya>	 Sigh.
[16:58:00] <acagastya>	 Should I tell them "Hey, look at this URL -- this seems to be blocked -- can you please see why and fix it?"
[17:00:20] <arturo>	 I would bet they are having troubles with the CGNAT or something
[17:06:05] <acagastya>	 That thing will take more than 12 hours.  Till then all I can do is browse via Tor.
[17:06:13] <acagastya>	 Thanks for the help, arturo.
[17:06:33] <arturo>	 you are welcome
[22:58:05] <andrewbogott>	 !log admin deleting /var/log/haproxy logs older than 7 days in cloudcontrol100x.  We need log rotation here it seems.
[22:58:08] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL