[08:03:13] fsero: good to go for merging 490073 ! [08:04:38] Give me 5 mins [08:07:08] sure, disabling puppet on swift in the meantime [08:10:11] ok, ready [08:11:06] ok! I'll merge, not sure what's needed on the docker registry side tho? [08:12:04] just a puppet run should do it [08:12:35] ack, I'm adding the replication keys to private.git too [08:20:40] fsero: ok running puppet on swift servers then I'll roll-restart the frontends [08:21:51] ack im adding passwords on the registry side and will do a puppet run on the registry and it should work [08:23:27] kk, will ping you when puppet has ran [08:33:48] 10serviceops, 10Core Platform Team Backlog, 10MediaWiki-General-or-Unknown, 10Operations, and 3 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Joe) >>! In T219279#5098646, @Esanders wrote: >> @Esanders is it a hu... [08:59:38] fsero: ok! we should be set on the swift side [09:02:02] great! [09:15:32] 10serviceops, 10Operations, 10Prod-Kubernetes, 10Kubernetes, and 2 others: Package envoy 1.9.X for stretch and use it as redis proxy on docker registry - https://phabricator.wikimedia.org/T215810 (10MoritzMuehlenhoff) >>! In T215810#5092693, @fsero wrote: > Building 1.9.1 due to CVE Adding CVE 2019-9900 a... [10:44:59] akosiaris: _joe_ upgrading a kubernetes cluster is a good cookbook to write [10:45:24] indeed. Let's see If I can get that done [10:45:28] first upgrade masters, then cordon node -> upgrade -> uncordon [10:46:05] if you dont do it quickly ill do it later im in a spiral of packaging and severe yak shaving [10:46:07] if you create a task use T203943 as parent ;) [11:02:34] <_joe_> ok! [11:02:44] <_joe_> I am working on a cookbook myself [11:02:54] <_joe_> I'll create a task for it :D [13:24:44] akosiaris: so ...T220401, I'm about to go into a check-in meeting, do you have any idea yet (even a vague one) about timeline for this? [13:26:09] akosiaris: the answer here could be something as simple as (one of): 'days', 'weeks', or 'months' :) [13:27:38] urandom: weeks [13:27:46] akosiaris: roger that. [13:27:47] end of april to be more precise [13:27:54] maybe even sooner [13:27:54] oh, so specific! [13:27:56] :) [13:28:03] akosiaris: thanks! [13:31:02] 10serviceops, 10Core Platform Team Backlog, 10MediaWiki-General-or-Unknown, 10Operations, and 3 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Esanders) Sounds good to me. [15:14:48] 10serviceops, 10Operations, 10Thumbor: Export useful metrics from haproxy logs for Thumbor - https://phabricator.wikimedia.org/T220499 (10Gilles) p:05Triage→03Normal a:03Gilles [18:26:12] back in US now [18:26:33] wb! [18:30:43] welcome back! [18:38:11] 10serviceops, 10Operations, 10Core Platform Team Backlog (Watching / External), 10Patch-For-Review, and 2 others: Use PHP7 to run all async jobs - https://phabricator.wikimedia.org/T219148 (10Krinkle) @Pchelolo I think it may be better to wait with actual switching of prod jobs until T219279 and T218005 ar... [18:38:36] 10serviceops, 10Operations, 10cloud-services-team, 10Core Platform Team Backlog (Watching / External), and 3 others: Switch cronjobs on maintenance hosts to PHP7 - https://phabricator.wikimedia.org/T195392 (10Krinkle) [18:40:08] 10serviceops, 10Operations, 10Core Platform Team Backlog (Watching / External), 10Patch-For-Review, and 2 others: Use PHP7 to run all async jobs - https://phabricator.wikimedia.org/T219148 (10jijiki) @Krinkle yeah we will wait for sure, meanwhile, we are exploring:) [18:40:36] thanks shdubsh & apergos :) [18:40:55] 10serviceops, 10Operations, 10Core Platform Team Backlog (Watching / External), 10Patch-For-Review, and 2 others: Use PHP7 to run all async jobs - https://phabricator.wikimedia.org/T219148 (10jijiki) [18:42:38] 10serviceops, 10Operations, 10Core Platform Team Backlog (Watching / External), 10Patch-For-Review, and 2 others: Use PHP7 to run all async jobs - https://phabricator.wikimedia.org/T219148 (10Pchelolo) > A job doesn't offer a way with retrying when they fail. Actually, it does. We do retry jobs unless it... [18:46:04] 10serviceops, 10Operations, 10Core Platform Team Backlog (Watching / External), 10Patch-For-Review, and 2 others: Use PHP7 to run all async jobs - https://phabricator.wikimedia.org/T219148 (10Pchelolo) However, I agree that enabling jobs in production might be premature, we can probably start experimenting... [19:03:53] 10serviceops, 10Operations, 10Core Platform Team Backlog (Watching / External), 10Patch-For-Review, and 2 others: Use PHP7 to run all async jobs - https://phabricator.wikimedia.org/T219148 (10jijiki)