[01:35:25] 10serviceops, 10RESTBase, 10CPT Initiatives (RESTBase Split (CDP2)), 10Core Platform Team Workboards (Initiatives), and 2 others: Split RESTBase in two services: storage service and API router/proxy - https://phabricator.wikimedia.org/T220449 (10CCicalese_WMF) [07:11:29] 10serviceops, 10Analytics, 10Event-Platform, 10Patch-For-Review, 10Wikimedia-production-error: Lots of "EventBus: Unable to deliver all events" - https://phabricator.wikimedia.org/T247484 (10Joe) After one day, what we found is that errors we see now are of the "UF" (upstream failed) type, which seems to... [14:09:32] 10serviceops, 10Operations: Renew certs for mcrouter on all application servers. - https://phabricator.wikimedia.org/T248093 (10fgiunchedi) [14:10:20] FYI I'll be using ^ to ack the related flood of warnings in icinga [14:18:47] ok [14:27:38] <_joe_> oh did they show up today? [14:31:10] <_joe_> we need someone to work on making new certs [14:31:24] <_joe_> maybe making the CA last 5 years? [15:58:43] <_joe_> ottomata: we'll need your guidance [16:00:08] 10serviceops, 10Operations, 10Wikimedia-Apache-configuration, 10Patch-For-Review: Build a black-box httpd testing framework - https://phabricator.wikimedia.org/T236699 (10RLazarus) 05Open→03Resolved Marking this done: https://gerrit.wikimedia.org/r/581616 deleted apache-fast-test, as httpbb is now comp... [16:01:07] <_joe_> \o/ [16:01:15] <_joe_> gj rlazarus [16:01:17] \o/ [16:03:13] cool, rlazarus ! [16:03:31] <_joe_> now hold my mcrouter please [16:03:43] <_joe_> :P [16:17:15] _joe_: in standup but how can I help? [16:17:26] <_joe_> in meeting too [16:17:27] <_joe_> :D [17:02:49] 10serviceops, 10Operations: Renew certs for mcrouter on all application servers. - https://phabricator.wikimedia.org/T248093 (10Joe) The procedure to do this is described here: https://wikitech.wikimedia.org/wiki/Mcrouter#Renew_CA_and_certificates it would be nice to make this a script so we don't need to pa... [17:18:00] 10serviceops, 10Operations, 10service-runner, 10CPT Initiatives (RESTBase Split (CDP2)), and 5 others: RESTBase/RESTRouter/service-runner rate limiting plans - https://phabricator.wikimedia.org/T235437 (10WDoranWMF) p:05High→03Low [18:47:52] 10serviceops, 10Operations: Renew certs for mcrouter on all application servers. - https://phabricator.wikimedia.org/T248093 (10RLazarus) a:03RLazarus