[04:29:58] !help how can I diagnose "MySQL server has gone away" errors? According to this page (https://dev.mysql.com/doc/refman/8.0/en/gone-away.html) it is most likely the query being killed. Are there logs of this anywhere? [04:29:58] audiodude: If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-team [04:38:18] audiodude: sometimes that happens when your query runs for a long time [04:38:28] can you try optimizing it? [04:41:15] zhuyifei1999_: I'm not what there is to optimize: https://gist.github.com/audiodude/28ea35e9657b5ff4d5f7c6e887d9f345 [04:43:18] audiodude: so you are trying to find the latest revision id of a certain page? have you considered https://www.mediawiki.org/wiki/Manual:Page_table#page_latest ? [04:45:49] oh wait not latest, but latest before a certain timestamp [04:46:49] zhuyifei1999_: yes I think that's right [04:47:43] We know on or about when something changed, and we want to link to the revision that we suspect is where it occurred [04:50:21] do you have an example of some query parameters that makes it time out? [04:51:05] running on enwiki with timestamp of 99999999999999 gave me the results in 0.27 secs [04:51:17] (on enwiki main page) [04:53:03] looking at https://tools.wmflabs.org/sql-optimizer with the query the only thing that looks suspicious is 'using filesort', but that shouldn't go too bad with just a few thousand revisions [04:55:03] audiodude: just to make sure, you aren't pooling connections and 'MySQL server has gone away' happens during a query right? [04:56:55] zhuyifei1999_: I don't think I'm pooling connections no [04:57:32] do you have an example of the query parameters that causes this? or does it happen randomly? [04:57:36] and I think it happens during a query, because it says it happens on line X, and that line is `$sth->execute($ns, $page, $timestamp);` [04:57:41] ok [04:58:01] (I can't really debug if it happens randomly though) [04:58:03] I'm trying to run it again with debug logging to capture the values that produce it [04:58:07] ok [04:58:34] It definitely succeeds sometimes, or maybe "most" of the time, because the bot only chokes on certain days [04:59:33] that's weird. I personally never heard of this issue apart from some bad queries running too long [05:01:12] okay it got through it that time without failing [05:04:22] it says for revids, it processed: `I: rev ids : 1002 in 17.0689613819122 sec` [05:06:45] zhuyifei1999_: thanks for your help, I guess I'll focus on making sure the whole program doesn't die when one record fails like this [05:13:39] audiodude: ok [14:00:50] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @CFisch_WMDE & @amir1 - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [14:50:44] Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @CFisch_WMDE & @amir1 - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [15:00:39] (03CR) 10Nikerabbit: [V: 032] Localisation updates from https://translatewiki.net. [labs/tools/crosswatch] - 10https://gerrit.wikimedia.org/r/464402 (owner: 10L10n-bot) [15:09:24] hello! anyone familiar with how sendmail works? I'm getting a "550 Relay not permitted" error when attempting to use it on a new VPS instance that I created. The instance is in the new equiad1-r region, maybe that has something to do with it? [15:10:24] sendmail works fine from the old VPS instance in the equiad region [15:10:31] both have the same security groups [15:15:39] the log output shows it's going through mx1001.wikimedia.org, what I'm guessing is the mail server. Maybe the new VPS region's IPs have not been added yet? [15:23:41] musikanimal: that’s a known issue from eqiad-r. We are working on setting up new MX relays that will work there [15:25:12] Got it. Not a big deal, I use it only to see the output of cronjobs, but I can redirect that to a log file and use that for the time being [15:25:15] thanks! [16:56:07] (03PS1) 10Framawiki: Store and show query execution time [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/465659 (https://phabricator.wikimedia.org/T126888) [17:02:40] (03CR) 10Zhuyifei1999: "Patch LGTM. The template needs to be compiled." [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/465659 (https://phabricator.wikimedia.org/T126888) (owner: 10Framawiki) [17:04:42] (03CR) 10Zhuyifei1999: Store and show query execution time (032 comments) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/465659 (https://phabricator.wikimedia.org/T126888) (owner: 10Framawiki) [23:25:40] (03PS1) 10Legoktm: More fully validate npm audit fix output [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465793 [23:25:42] (03PS1) 10Legoktm: Fix running npm-audit-fix for multiple repos [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465794 [23:26:33] (03CR) 10jerkins-bot: [V: 04-1] More fully validate npm audit fix output [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465793 (owner: 10Legoktm) [23:26:35] (03CR) 10jerkins-bot: [V: 04-1] Fix running npm-audit-fix for multiple repos [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465794 (owner: 10Legoktm) [23:27:54] (03PS2) 10Legoktm: More fully validate npm audit fix output [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465793 [23:27:56] (03PS2) 10Legoktm: Fix running npm-audit-fix for multiple repos [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465794 [23:36:31] (03CR) 10Legoktm: [C: 032] More fully validate npm audit fix output [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465793 (owner: 10Legoktm) [23:36:57] (03Merged) 10jenkins-bot: More fully validate npm audit fix output [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465793 (owner: 10Legoktm) [23:46:02] (03PS1) 10Legoktm: Only fix dev deps for now [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465796 [23:46:04] (03PS1) 10Legoktm: Include CVEs in commit message if available [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465797 [23:46:33] (03CR) 10Legoktm: [C: 032] Fix running npm-audit-fix for multiple repos [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465794 (owner: 10Legoktm) [23:46:40] (03CR) 10Legoktm: [C: 032] Only fix dev deps for now [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465796 (owner: 10Legoktm) [23:46:46] (03CR) 10Legoktm: [C: 032] Include CVEs in commit message if available [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465797 (owner: 10Legoktm) [23:47:13] (03Merged) 10jenkins-bot: Fix running npm-audit-fix for multiple repos [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465794 (owner: 10Legoktm) [23:47:15] (03Merged) 10jenkins-bot: Only fix dev deps for now [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465796 (owner: 10Legoktm) [23:47:21] (03Merged) 10jenkins-bot: Include CVEs in commit message if available [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465797 (owner: 10Legoktm) [23:50:57] (03PS1) 10Legoktm: Fix spacing [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465799 [23:51:13] (03CR) 10Legoktm: [C: 032] Fix spacing [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465799 (owner: 10Legoktm) [23:51:47] (03Merged) 10jenkins-bot: Fix spacing [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/465799 (owner: 10Legoktm)