[16:31:56] Anyone any ideas about how to fix https://phabricator.wikimedia.org/T235554 ? It feels like quite a big regression in 1.35 :/ [17:06:23] not aware of a 1.35 connection [17:26:32] Krinkle: I believe it all comes down the the commit I link to in https://phabricator.wikimedia.org/T235554#6620757 [20:45:51] Krinkle: what's the status of https://gerrit.wikimedia.org/r/c/mediawiki/core/+/640868 ? [20:46:48] AaronSchulz: nothing blocking, but I think we can do slightly stricter on the test. I really don't want us to have to deal with this again :) [20:47:16] I can merge it now if you'd like to do that later, so that we're not blocking the next branch cut [20:47:19] * AaronSchulz still doesn't see where the EditPage flame graphs went [20:47:31] AaronSchulz: they're there, the link you used is for log files not graphs [20:47:35] Krinkle: ah, I missed the one inline comment [20:47:37] we use the same log file for both [20:49:00] I thought I clicked the svg one [20:49:11] Krinkle: yes, index.all, I wrote that bit ;) [20:49:33] https://performance.wikimedia.org/arclamp/svgs/daily/ [20:49:37] fn-EditAction [20:49:52] Is it not there for you? [21:29:05] Krinkle: oh, I found it, I was just sure I clicked the right link [21:29:15] Krinkle: anyway, any reason why "Direct link rendered image" doesn't work in grafana ? [21:29:24] the images always say "do data" [21:42:25] that probably requires a service or package that we haven't installed, afaik that never worked. in Grafana what that would basically do is spin up headless firefox and take a screen grab and serve that up as PNG [21:42:44] the other permalinks do work, but I usually take a partial screenshot directly with OS tooling [21:43:09] e.g. https://grafana.wikimedia.org/dashboard/snapshot/aub7twxi6nuhdR9sGZTzDBExkq2VSav4 [21:43:22] is an immutable snapshot of 1 panel with 1 timerange of data [21:56:28] ugh, some weirdness in wfArrayDiff2() at https://performance.wikimedia.org/arclamp/svgs/daily/2020-11-04.excimer.all.fn-EditAction.svgz ; must be the strcmp() on a Message or something triggering __toString() [21:56:46] * AaronSchulz stares at EditPage::getEditPermissionErrors [21:58:42] what led you there? a particular regression? [22:00:45] just more time spent there (by comparison of two graphs) [22:00:53] * AaronSchulz goes afk [22:01:44] ah week over week? [22:01:46] nice [22:53:41] one of the grafana 7.x releases removed the phantomjs binary it was using for the screenshots [22:53:47] * mszabo tries to find the notes [22:54:23] https://community.grafana.com/t/release-notes-v7-0-x/29381 [22:54:31] yeah, looks like there's a plugin now instead [23:38:42] they should probably make it not show the link if that's not installed. [23:38:53] or maybe we have the plugin installed but its broken? [23:39:03] given that it does get back a PNG with grafana's panel UI rendered [23:39:10] it just syas "no data" where the line graph would be [23:55:16] huh, strange