[00:00:28] I was able to debug this a bit on the client site. Namely, I saw that WikiMiniAtlas is making XHR requests such as https://wma.wmflabs.org/label.php?l=en&a=2368&b=39&z=10&g=Earth, which just returns a page containing the comment "" [00:02:16] label.php used to return a JSON list of articles within a specified coordinate range, e.g. https://web.archive.org/web/20170914030231/https://wma.wmflabs.org/label.php?l=en&a=1023&b=266&z=9&g=Earth [00:03:00] If someone could determine why this is broken now and how to fix it, that would be great [00:03:20] "There was a database restructuring on the WMF cloud services that - besides reliability improvements - broke a ton of stuff. I'll work on this tomorrow and see how much can be salvaged :-/" [00:05:02] Is that last message quoting someone? [00:05:38] Yeah, it's from the author of the script (from the GitHub issue) [00:07:16] Here is the code for label.php where it tries to connect to SQL and execute the query, but returns the "error: Too many database connections" [00:07:18] https://github.com/dschwen/wikiminiatlas/blob/117560cf74661966b1555532c1c3efaf52aad758/label.php#L82 [00:08:51] huh_: if there are active members of the project, it is better to ask them for support [00:09:11] how can I see the list of members? [00:13:32] I guess it's somewhere on wikitech.wikimedia.org but I don't know where to look. chicocvenancio, any clue? [00:16:39] Okay, found it: https://tools.wmflabs.org/openstack-browser/project/maps [00:20:26] sorry I was on mobile. good you found it [00:25:40] huh_: looking at the code you pointed to, it'll take some work to get this working [00:27:22] Darn, I was hoping it was going to be a simple fix. What makes this it seem difficult to fix? [00:32:06] s/this it/it/ [00:32:48] well, in the past the database server for wiki replicas and for user databases were the same [00:32:55] now they are separate [00:33:50] so things like https://github.com/dschwen/wikiminiatlas/blob/117560cf74661966b1555532c1c3efaf52aad758/label.php#L141 are not possible in sql [00:34:13] Oh dang [00:34:24] tools need to open separate connections to the servers and join with application logic [00:38:42] Thank you for explaining the issue! I wasn't aware of that [00:39:27] there is documentation for this on wikitech somewhere... and there were a few emails on the cloud mailing lists as well [00:43:18] Looks like this is the thread: https://lists.wikimedia.org/pipermail/cloud/2017-December/thread.html#112 [00:44:50] "Death blow for GHEL coordinate extraction and WikiMiniAtlas. 🙁" -dschwen (WMA author), cf https://phabricator.wikimedia.org/T142807#3836361 [00:48:08] Daniel also has a couple comments on that mailing list thread, both pretty pessimistic about porting WMA to use application logic joins [00:48:17] it sounds like you might need to convince another developer to do this [00:53:41] Yeah, it sounds like Daniel just gave up [00:54:23] because he has a limited time budget, and also because application joins would likely be very slow [00:54:49] I guess I'll just post a link to this log on the Wikimedia Forum thread and ping some of the administrators of the project. [00:55:19] well, there are technical solutions, but yeah, volunteers choose on what they work [00:55:23] Also here is the wikitech article about the change: https://wikitech.wikimedia.org/wiki/News/Wiki_Replica_c1_and_c3_shutdown [00:56:32] Thanks, you've been extremely helpful [00:56:48] you're welcome [01:48:37] chicocvenancio, I responded at https://meta.wikimedia.org/wiki/Wikimedia_Forum#WikiMiniAtlas [01:51:20] Wouldn't the complexity of an application logic join be O(M * N)? [01:55:41] Ideally the complexity should be the same as the original join, IMHO. [01:56:13] The db side join doesn't magically do away with complexity [01:57:52] Coding it in a sane way is not trivial, but not impossible. It is an app with two data sources. [01:59:22] So you'd end up rewriting an SQL join operation from scratch in PHP? [01:59:50] huh_: sometimes that's faster - yes. [01:59:57] relevant username [02:00:04] lol [02:00:11] Yeah, you've pinged me a few times now lol [02:00:21] Sorry about that. [02:00:26] nbd [02:00:52] There have been times tho that I've found it quicker to do the processing / filtering in a scripting language [02:00:55] than in a query [02:02:42] huh_: *I'd* end up writing the whole thing from scratch in python. But yeah, any language will do [02:08:10] * chicocvenancio has a bad history with php [02:15:03] * huh_ strongly prefers python as well [12:45:20] (03PS1) 10D3r1ck01: Add few more channels to #wikimedia-dev-africa [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/451852 [12:47:37] (03PS2) 10D3r1ck01: Add few more gerrit projects to #wikimedia-dev-africa [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/451852 [19:01:52] (03CR) 10Merlijn van Deen: [C: 032] Add few more gerrit projects to #wikimedia-dev-africa [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/451852 (owner: 10D3r1ck01) [19:02:21] (03Merged) 10jenkins-bot: Add few more gerrit projects to #wikimedia-dev-africa [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/451852 (owner: 10D3r1ck01) [19:02:32] (03CR) 10jenkins-bot: Add few more gerrit projects to #wikimedia-dev-africa [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/451852 (owner: 10D3r1ck01) [20:40:04] (03PS1) 10MarcoAurelio: Remove #Anti-Harassment notifications from #wikimedia-commtech [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/452000 (https://phabricator.wikimedia.org/T201714) [20:41:36] (03PS2) 10MarcoAurelio: Remove #Anti-Harassment notifications from #wikimedia-commtech [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/452000 (https://phabricator.wikimedia.org/T201714) [21:45:37] (03CR) 10Merlijn van Deen: [C: 032] Remove #Anti-Harassment notifications from #wikimedia-commtech [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/452000 (https://phabricator.wikimedia.org/T201714) (owner: 10MarcoAurelio) [21:46:07] (03Merged) 10jenkins-bot: Remove #Anti-Harassment notifications from #wikimedia-commtech [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/452000 (https://phabricator.wikimedia.org/T201714) (owner: 10MarcoAurelio) [21:46:15] (03CR) 10jenkins-bot: Remove #Anti-Harassment notifications from #wikimedia-commtech [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/452000 (https://phabricator.wikimedia.org/T201714) (owner: 10MarcoAurelio) [21:51:09] !log tools.wikibugs Updated channels.yaml to: 181a9422666bbb5d8ad2c25253909aabe44dddec Merge branch 'master' of https://gerrit.wikimedia.org/r/labs/tools/wikibugs2 [21:51:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL