[05:49:09] 10serviceops, 10Developer-Advocacy, 10Gerrit, 10Operations: Remove port 29418 from cloning process - https://phabricator.wikimedia.org/T37611 (10jijiki) p:05Normal→03Low [06:45:36] 10serviceops, 10Operations, 10media-storage, 10Patch-For-Review: Swift object servers become briefly unresponsive on a regular basis - https://phabricator.wikimedia.org/T226373 (10jijiki) [06:53:05] <_joe_> jijiki: are you really doing T37611? [06:53:17] <_joe_> I think that should be closed as decline FWIW [06:54:05] <_joe_> oh it was erroneously moved to the doing column [06:58:06] _joe_: oh it is just a commit [06:58:09] I will merge it later [06:58:44] gille.s is working on it [07:04:43] oh no, I am doing T226373 [07:48:28] fsero: could you please add instructions for restarting/rebooting the new registry* hosts to https://wikitech.wikimedia.org/wiki/Service_restarts ? (if it boils down to simply depooling/repooling, it's fine to just mention that in a oneliner as we do for other clustered services) [07:49:03] Sure [07:49:11] thx [07:59:59] <_joe_> moritzm: oh btw [08:00:11] <_joe_> there is a new script on some servers, including the registry ones [08:00:25] <_joe_> that does depool/restart/repool in the right way [08:00:45] <_joe_> I am in the process of doing so for all services under load-balancing [08:00:56] <_joe_> should I just update that wiki page? [08:03:39] 10serviceops, 10Continuous-Integration-Infrastructure, 10Operations, 10Release-Engineering-Team (Kanban): contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10hashar) I had a quick chat this morning with various SRE people. Theoretically disk setup is... [08:05:11] _joe_: ack, please do [09:37:09] 10serviceops, 10Operations, 10Continuous-Integration-Infrastructure (phase-out-jessie): Upload docker-ce 18.06.3 upstream package for Stretch - https://phabricator.wikimedia.org/T226236 (10hashar) Adding @MoritzMuehlenhoff since he seems to knows best about the `reprepro` config in `modules/aptrepo/files/upd... [10:12:48] 10serviceops, 10DNS, 10Matrix, 10Operations, and 3 others: Configure wikimedia.org to enable *:wikimedia.org Matrix user IDs - https://phabricator.wikimedia.org/T223835 (10Joe) a:03Joe [10:19:03] 10serviceops, 10DNS, 10Matrix, 10Operations, and 3 others: Configure wikimedia.org to enable *:wikimedia.org Matrix user IDs - https://phabricator.wikimedia.org/T223835 (10Joe) 05Open→03Resolved Using curl I can confirm the header is now added. I fear you might need to force-reload in your browser as I... [11:31:16] 10serviceops, 10Release-Engineering-Team-TODO, 10Scap, 10PHP 7.2 support, and 3 others: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10mmodell) We could kick off a rolling restart also at the end of each SWAT window, just for good measure. Of course, that... [12:34:17] 10serviceops, 10Operations, 10WMDE-QWERTY-Team, 10wikidiff2, and 3 others: Deploy Wikidiff2 version 1.8.2 with the timeout issue fixed - https://phabricator.wikimedia.org/T223391 (10WMDE-Fisch) [14:29:05] 10serviceops: create a public docker-registry lvs endpoint for being used behind varnish - https://phabricator.wikimedia.org/T226642 (10fsero) [14:42:54] 10serviceops, 10Operations, 10WMDE-QWERTY-Team, 10wikidiff2, and 3 others: Deploy Wikidiff2 version 1.8.2 with the timeout issue fixed - https://phabricator.wikimedia.org/T223391 (10awight) Confirmed that the old version of wikidiff2 will fall back to not computing moved lines with more than 30 moves: htt... [14:44:02] we can manage the calico configmap through helmfile.. trying again https://gerrit.wikimedia.org/r/c/operations/puppet/+/517888 [14:44:02] i think i've addressed nits [14:44:02] let me know if its good to go or if need more work [14:48:45] <_joe_> fsero: when I'm done writing this cron-restart for php I'm all yours [14:48:59] <_joe_> well not really I have plenty of meetings now [14:49:22] i have a coredns repo on gerrit and half package [14:49:30] having helmfile in place would help me a lot to deploying it [14:49:36] but no pressure :P [14:49:48] <_joe_> eheheh ok [16:11:14] 10serviceops, 10Release-Engineering-Team-TODO, 10Scap, 10PHP 7.2 support, and 3 others: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10mmodell) Note: we should think about how this affects canary tests in scap. [17:01:27] 10serviceops, 10Continuous-Integration-Infrastructure, 10Continuous-Integration-Config, 10Kubernetes, 10User-fsero: add CI job into operations/deployments-charts repo that helm lint packages and perform the helm index after merge. - https://phabricator.wikimedia.org/T216049 (10Jdforrester-WMF) [22:39:16] 10serviceops, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Undeploy electron service from WMF production - https://phabricator.wikimedia.org/T226675 (10Pchelolo)