[06:20:44] the mcrouter's TKO graph for the past 12h seems flat zero, let's see how it goes over the weekend [06:22:21] <_joe_> good! [10:39:04] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10akosiaris) @tarrow, @WMDE-leszek Hi, sorry for taking so long to answer to this, it's been really busy. >>! In T220402#5214... [11:41:34] akosiaris: Thanks! We've put together a fix for the healthcheck thing which is now merged [11:42:59] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10Tarrow) @akosiaris Thanks! Now https://gerrit.wikimedia.org/r/c/wikibase/termbox/+/515040 is merged the Healthcheck query sho... [12:13:45] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10akosiaris) Indeed this was fixed. However another regression has crept up it's head Doing a `curl 'http://192.168.99.100:187... [12:23:55] akosiaris: Hi! That regression is because it relies on something in master from the wikidata.org response. Obviously it's not been deployed yet [12:24:32] i.e. a week on wednesday after the train it should be good [12:26:02] How do you handle these cases for other services? [12:27:35] we don't deploy the dependent change until the parent has been merged [12:27:58] so effectively this is going to block deployment for a week? [12:28:39] I think it would be better for us to remove the dependency on that message [12:28:52] I was about to suggest that [12:28:58] cause the train is going to be on pause next week [12:29:04] then you can make progress and we can reapply it after the train [12:29:09] (or swat it in or something) [12:29:16] tarrow: +1 [13:28:29] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce kask session storage service to kubernetes - https://phabricator.wikimedia.org/T220401 (10akosiaris) `sessionstore.discovery.wmnet` is now around and should be the canonical DNS used to address the service. [14:19:29] <_joe_> tarrow: or you can change the code to allow for both types of messages, if it makes sense [14:56:34] 10serviceops, 10Release-Engineering-Team, 10Scap, 10PHP 7.2 support, 10User-jijiki: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10Joe) A small comment about what has been done and what needs to be done: - We upped opcache to 1 GB. By my evaluations, th... [15:07:04] akosiaris: Sorry, I had to nip out but hopefully our manual removal has worked [15:38:25] 10serviceops, 10Thumbor, 10observability, 10User-jijiki: thumbor haproxy trying to send syslog on wrong port - https://phabricator.wikimedia.org/T225284 (10jijiki) [15:47:15] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10Tarrow) >>! In T220402#5242902, @akosiaris wrote: > Indeed this was fixed. However another regression has crept up it's head... [19:31:52] 10serviceops, 10Operations, 10Release Pipeline, 10Release-Engineering-Team, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10akosiaris) >>! In T220402#5243209, @Tarrow wrote: > This should now be fixed. Sadly this was due to a mismatch between the co...