[02:50:47] 10Phabricator, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): setup/install phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T163938#3499665 (10Dzahn) [03:04:58] 10Phabricator, 10Operations, 10netops: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499702 (10mmodell) [03:05:12] 10Phabricator, 10Operations, 10netops: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499689 (10mmodell) [03:06:01] 10Phabricator, 10Operations, 10netops: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499689 (10mmodell) p:05Triage>03High [03:08:47] 10Phabricator, 10Operations, 10netops: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499709 (10mmodell) Note that this is high priority but not UBN, simply because git-ssh is barely used currently. Phabricator supports git over https which is... [03:21:31] 10Phabricator, 10Operations, 10netops: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499712 (10ayounsi) a:03ayounsi [03:32:19] 10Phabricator, 10Operations, 10netops: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499734 (10bd808) Diffusion is the master repo for some sub-set of #toolforge projects. Its not a huge number of people impacted, but it is certainly non-zero.... [04:23:09] 10Phabricator, 10Operations, 10netops: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499771 (10mmodell) ok so that takes care of the smtp/ipv6 issue, however, git-ssh still doesn't work. So I guess I was wrong about them being related. [04:24:12] 10Phabricator, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): setup/install phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T163938#3499773 (10mmodell) [04:24:17] 10Phabricator, 10Operations, 10netops: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499772 (10mmodell) 05Resolved>03Open [04:27:33] 10Phabricator, 10Operations, 10netops, 10Patch-For-Review: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499790 (10mmodell) We can revert the hard-coded smtp server IPs now: cd461e5cf761f053d453528cd26331c80ba66f17 [04:29:32] 10Phabricator, 10Operations, 10netops, 10Patch-For-Review: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499792 (10Dzahn) That IP that was removed also existed on iridium before, on eth0, were i removed it: 00:23 mutante: iridium sudo ip a... [04:56:28] 10Phabricator, 10Operations, 10netops, 10Patch-For-Review: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499806 (10ayounsi) the git-ssh issue is due to LVS not knowing where to forward the packets. ``` ayounsi@lvs1002:~$ sudo ipvsadm -Ln TC... [05:07:02] 10Phabricator, 10Operations, 10netops, 10Patch-For-Review: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499811 (10Dzahn) picked a new IP in the 10.64.16.0/22 network (row B) and used that instead [06:12:01] 10Phabricator, 10Operations, 10netops, 10Patch-For-Review: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499869 (10Dzahn) Xionox restarted pybal after this .. and then: 23:04 <+icinga-wm> RECOVERY - PyBal backends health check on lvs1005 is... [06:21:21] 10Phabricator, 10Operations, 10netops, 10Patch-For-Review: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499870 (10Dzahn) We can now talk to the ssh. Tested from external, IPv4 and IPv6. There is apparently another issue with Phabricator its... [07:23:17] 10Phabricator, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): setup/install phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T163938#3499923 (10Dzahn) [07:23:22] 10Phabricator, 10Operations, 10netops, 10Patch-For-Review: git-ssh.wikimedia.org and IPv6 are broken after switch to phab1001 - https://phabricator.wikimedia.org/T172478#3499921 (10Dzahn) 05Open>03Resolved 00:21 < mutante> twentyafterfour: try again 00:22 < twentyafterfour> mutante: works!!! [07:28:00] 10Phabricator, 10Operations, 10Release-Engineering-Team (Kanban): reinstall iridium (phabricator) as phab1001 with jessie - https://phabricator.wikimedia.org/T152129#3499927 (10mmodell) 05Open>03Resolved [07:28:32] 10Phabricator, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): setup/install phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T163938#3499928 (10Dzahn) [07:30:18] 10Phabricator, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): setup/install phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T163938#3273664 (10Dzahn) T152129 has been resolved [07:30:41] 10Phabricator, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): Switch phabricator production to codfw - https://phabricator.wikimedia.org/T164810#3499934 (10mmodell) [07:37:46] 10Phabricator, 10Scap: scap should provide a way to skip symlink-swapping in promote - https://phabricator.wikimedia.org/T172486#3499941 (10mmodell) [07:45:34] 10Phabricator, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): setup/install phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T163938#3499968 (10Dzahn) [07:45:55] 10Phabricator, 10Operations, 10Release-Engineering-Team, 10hardware-requests, 10ops-eqiad: replacement hardware for iridium (phabricator) - https://phabricator.wikimedia.org/T156970#3499972 (10Dzahn) [07:46:00] 10Phabricator, 10Operations, 10Patch-For-Review, 10Release-Engineering-Team (Kanban): setup/install phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T163938#3273670 (10Dzahn) 05Open>03Resolved [10:41:32] 10Phabricator, 10Wikimedia-Site-requests, 10Wikimedia-Incident: Cleanup phabricator.wikimedia.org uploaded files, WP zero abuse - https://phabricator.wikimedia.org/T168142#3500482 (10Aklapper) To quote Keegan, note that the uploads of IP protected media are not necessarily coming from WP0, but it is large gr... [11:40:31] 10Gitblit-Deprecate, 10Epic, 10MW-1.30-release-notes (WMF-deploy-2017-07-18_(1.30.0-wmf.10)), 10Patch-For-Review: Fix references to git.wikimedia.org in all repos - https://phabricator.wikimedia.org/T139089#3500582 (10Aklapper) Well, https://github.com/search?p=2&q=org%3Awikimedia+%22git.wikimedia.org%22&t... [12:52:37] 10Project-Admins, 10User-MarcoAurelio: Create #MetaWiki-Gadgets - https://phabricator.wikimedia.org/T167983#3500741 (10MarcoAurelio) After nearly a month of having placed the question up for the community there has been no opposition to the idea. I'll let @Aklapper decide if that's okay or he still has concern... [12:54:30] 10Project-Admins, 10User-MarcoAurelio: Create #MetaWiki-Gadgets - https://phabricator.wikimedia.org/T167983#3500750 (10Aklapper) Would you (or anyone else) be point of contact (see T167983#3388870)? No feedback from any gadget maintainers at all (see T167983#3374375)? :( Or are there no gadget maintainers on... [12:57:51] 10Project-Admins, 10User-MarcoAurelio: Create #MetaWiki-Gadgets - https://phabricator.wikimedia.org/T167983#3500754 (10MarcoAurelio) >>! In T167983#3500750, @Aklapper wrote: > Would you (or anyone else) be point of contact (see T167983#3388870)? I have no problems with being a contact. > No feedback from any... [13:05:27] 10Project-Admins, 10User-MarcoAurelio: Create #MetaWiki-Gadgets - https://phabricator.wikimedia.org/T167983#3500766 (10Aklapper) I'm slightly positive on giving this a shot, however my question still stands: Where are gadget issues on meta currently discussed / reported and how will folks on meta find out abou... [13:16:27] 10Project-Admins, 10User-MarcoAurelio: Create #MetaWiki-Gadgets - https://phabricator.wikimedia.org/T167983#3500815 (10MarcoAurelio) >>! In T167983#3500766, @Aklapper wrote: > I'm slightly positive on giving this a shot, however my question still stands: Where are gadget issues on meta currently discussed / re... [17:44:53] 10Project-Admins, 10Discovery, 10Interactive-Sprint: Archive maps sprint project - https://phabricator.wikimedia.org/T172515#3501831 (10Aklapper) [18:21:12] 10Phabricator: Create personal tag User-Smalyshev - https://phabricator.wikimedia.org/T172552#3501902 (10Smalyshev) [20:33:27] 10Phabricator, 10User-bd808: Create personal tag User-Smalyshev - https://phabricator.wikimedia.org/T172552#3502253 (10bd808) 05Open>03Resolved a:03bd808 https://phabricator.wikimedia.org/project/profile/2921/ [20:33:36] 10Phabricator, 10User-bd808: Create personal tag User-Smalyshev - https://phabricator.wikimedia.org/T172552#3502257 (10bd808) [20:35:53] 10Project-Admins, 10Discovery, 10Interactive-Sprint: Archive maps sprint project - https://phabricator.wikimedia.org/T172515#3500875 (10debt) I'm wondering why you think it needs to be archived? We're still using it on a daily basis. [22:33:10] 10Project-Admins, 10Discovery, 10Interactive-Sprint: Archive maps sprint project - https://phabricator.wikimedia.org/T172515#3500875 (10Luke081515) I guess because there is > Sprint End Date Dec 31 2015, 18:00 at the project page? Probably just needs an update? [22:42:46] 10Project-Admins, 10Discovery, 10Interactive-Sprint: Archive maps sprint project - https://phabricator.wikimedia.org/T172515#3500875 (10Pnorman) We don't run multiple sprints, so there's no real need for an end date at all.