[11:53:10] <wikibugs>	 10serviceops, 10Operations: Increased latency in CODFW API and APP monitoring urls (~07:20 UTC 19 Jan 2020) - https://phabricator.wikimedia.org/T243149 (10jijiki)
[15:20:10] <wikibugs>	 10serviceops, 10Operations: Increased latency in CODFW API and APP monitoring urls (~07:20 UTC 19 Jan 2020) - https://phabricator.wikimedia.org/T243149 (10elukey) This seems to be related to T243148, db2085 was overwhelmed and this explains the high latency (Special:Blank page health checks were taking ages to...
[17:40:20] <wikibugs>	 10serviceops, 10Operations: Increased latency in CODFW API and APP monitoring urls (~07:20 UTC 19 Jan 2020) - https://phabricator.wikimedia.org/T243149 (10Marostegui) db2085 is a s1 and s8 codfw slave (multi instance). We don't have read traffic on codfw databases, how could it cause those latency issues?
[19:27:33] <wikibugs>	 10serviceops, 10Operations: Increased latency in CODFW API and APP monitoring urls (~07:20 UTC 19 Jan 2020) - https://phabricator.wikimedia.org/T243149 (10Marostegui) And according to the graph the latency increase indeed starts when db2085 went down ` Jan 19 07:19:49 icinga1001 icinga: SERVICE ALERT: db2085;p...
[23:45:52] <wikibugs>	 10serviceops, 10Recommendation-API, 10Release-Engineering-Team, 10Services, 10Patch-For-Review: Migrate  recommendation-api to kubernetes - https://phabricator.wikimedia.org/T241230 (10bmansurov)