[08:46:33] (03CR) 10Jean-Frédéric: "recheck" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/466994 (owner: 10Jean-Frédéric) [08:46:51] (03CR) 10Jean-Frédéric: [C: 032] "Submit again!" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/465007 (owner: 10Lokal Profil) [08:49:03] (03Merged) 10jenkins-bot: Capture task id even if first line [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/465007 (owner: 10Lokal Profil) [08:51:10] (03CR) 10jenkins-bot: Capture task id even if first line [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/465007 (owner: 10Lokal Profil) [10:40:19] (03CR) 10D3r1ck01: [C: 031] [fix] .gitignore: Add directory to be ignored by git. [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/466784 (owner: 10D3r1ck01) [10:40:46] (03CR) 10D3r1ck01: [C: 031] [IMPR][cleanup] Date picker, UI/UX improvements plus cleanup [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/465038 (owner: 10D3r1ck01) [12:50:03] (03PS1) 10D3r1ck01: [fix] Update requirements for the tool [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/467676 [12:50:34] (03CR) 10jerkins-bot: [V: 04-1] [fix] Update requirements for the tool [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/467676 (owner: 10D3r1ck01) [12:52:08] !log T186571 removed legofan4000 user from project-tools group (leftover from T165624 legofan4000->macfan4000 rename) [12:52:09] gtirloni: Unknown project "T186571" [12:52:10] T165624: Request to rename LegoFan4000 to MacFan4000 on WikiTech - https://phabricator.wikimedia.org/T165624 [12:52:10] T186571: Toolforge search results does not show all maintainers - https://phabricator.wikimedia.org/T186571 [12:57:31] (03PS2) 10D3r1ck01: [fix] Update requirements for the tool [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/467676 [13:12:03] (03CR) 10D3r1ck01: [C: 031] [fix] Update requirements for the tool [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/467676 (owner: 10D3r1ck01) [13:20:11] (03PS1) 10D3r1ck01: [IMPR] Change Python shibang to #!/usr/bin/env python3 [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/467681 [13:27:47] (03CR) 10D3r1ck01: [C: 031] [IMPR] Change Python shibang to #!/usr/bin/env python3 [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/467681 (owner: 10D3r1ck01) [14:13:40] bstorm_: FYI, T189158 is unblocked. [14:13:40] T189158: Change `image` view to properly expose the new `img_description_id` field - https://phabricator.wikimedia.org/T189158 [14:14:30] Thx [15:06:24] (03CR) 10Lokal Profil: [C: 032] Rename methods for clarity in database_statistics [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/466994 (owner: 10Jean-Frédéric) [15:09:37] (03Merged) 10jenkins-bot: Rename methods for clarity in database_statistics [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/466994 (owner: 10Jean-Frédéric) [15:11:08] (03CR) 10jenkins-bot: Rename methods for clarity in database_statistics [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/466994 (owner: 10Jean-Frédéric) [15:13:54] !log tools (repost for gtirloni) T186571 removed legofan4000 user from project-tools group (leftover from T165624 legofan4000->macfan4000 rename) [15:13:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [15:13:59] T165624: Request to rename LegoFan4000 to MacFan4000 on WikiTech - https://phabricator.wikimedia.org/T165624 [15:13:59] T186571: Toolforge search results does not show all maintainers - https://phabricator.wikimedia.org/T186571 [15:15:15] bd808: ah just "tools", got it, thanks! [15:15:59] gtirloni: yeah, in this channel the first word needs to be a Cloud VPS project name (like tools) or a Toolforge tool name (like tools.admin) [15:16:14] that tells the bot which SAL to add the message to [15:17:13] cool [15:17:26] You can see a big list at https://tools.wmflabs.org/sal/projects of projects that have some SAL data recorded [15:18:56] In the #wikimedia-operations channel everything gets added to the "production" SAL. In #wikimedia-releng everything gets added to the "releng" SAL [15:20:13] 👍 [17:43:56] (03PS1) 10D3r1ck01: [IMPR] Use #!/usr/bin/env bash for setup script [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/467739 [17:46:18] (03CR) 10D3r1ck01: [C: 031] [IMPR] Use #!/usr/bin/env bash for setup script [labs/tools/awmd-stats] - 10https://gerrit.wikimedia.org/r/467739 (owner: 10D3r1ck01) [17:57:32] (03PS4) 10Jean-Frédéric: Compute statistics per adm division for every country/lang [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/466995 (https://phabricator.wikimedia.org/T206885) [19:41:37] bd808: I think you said that a mail server hasn't yet been set up for the eqiadr-1 region? is there a phab task for that? if not I'll create one :) [19:42:13] eqiad1-r [19:43:25] doh, it must be https://phabricator.wikimedia.org/T205158 , didn't find it because I was searching for `eqiadr-1` and not `eqiad1-r` ! [19:43:41] https://phabricator.wikimedia.org/T41785 [19:43:43] and that yeah [19:45:23] thanks [19:46:23] Krenair: do you think there is a hacky workaround for apps already running on eqiad1-r ? [19:46:58] well if you have your own puppetmaster you might be able to point your instances at the new MXes and see if they work [19:47:44] hmm no I'm no puppetmaster, hehe [19:48:16] how hacky are you willing to go? [19:48:22] I still have the old VMs in eqiad running, so I was hoping I could do some sort of port forwarding to go through those instances? [19:49:00] ew [19:49:07] like, make sendmail use IP x instead of IP y [19:49:36] haha I don't know, just trying to find a workaround. I'm not that bright with the networking things [19:50:00] yeah I was gonna say disable puppet (if you're able, understand the consequences, etc.) and change your exim config to point at the new hosts [19:51:29] see if it works [19:51:46] eh it's alright. I wanted to email fatal exceptions, since my email client could sort of organize them by subject and hence I could see which exceptions are most often thrown [19:52:07] but I'll just make it write fatal exceptions to a dedicated log file [19:52:56] at least then it won't be buried in with the countless notices and warnings [19:53:41] ops were talking about sorting out the eqiad1-r mail stuff just now in -operations [20:53:07] (03PS1) 10Urbanecm: [bugfix] Anything than WD item based search didn't work [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467817 [20:53:37] (03CR) 10Urbanecm: [C: 032] [bugfix] Anything than WD item based search didn't work [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467817 (owner: 10Urbanecm) [20:53:54] (03Merged) 10jenkins-bot: [bugfix] Anything than WD item based search didn't work [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467817 (owner: 10Urbanecm) [20:55:22] andrewbogott: bstorm_: Do you know if the changes from https://phabricator.wikimedia.org/T195515#4630067 are now live on all replicas? Checking GUC, it seems the queries are much faster now, except for s7 tables, which still take 20-80s. [20:55:30] Does toolforge have a read only replica of the gerrit repos somewhere? I thought it did but now I can't find it / any mention of it [20:56:51] Krinkle: I don't know, will defer to bstorm_ [20:56:53] Krinkle: they are live. I have one last set to push, though. [20:56:59] :) [20:57:16] It is only on scwiki just now [20:57:20] That set [20:58:29] k, also, I misread the profile again, it's s3 that slow on the three sample I ran, not s7. [20:58:44] tarrow: we do not have a replica of the gerrit data (as far as I know). [20:58:56] so I guess that matches potentially, given scwiki is s3, right? [20:59:08] bd808: thanks, just my memory playing tricks on me then :P [21:00:14] tarrow: the github mirrors are maybe the same idea? Review data is not there, but the git repo data is [21:00:35] not sure what sort of data you are looking for [21:03:01] I was looking to be able to do things like: given a commit see which branches that commit is in but for any arbitrary repo without having to bother to fetch it. It might be that what I actually want is the gerrit api [21:03:25] so not actual review data, just the git repo [21:03:46] Krinkle: Maybe? The replicas put all the dbs on the same replica servers, so it can be tricky to parse out. Basically, there is still one more change, though, that I think should be a big improvement. That is staged for deploy to all replicas soon, but I put it out on scwiki as a test after testing locally. [21:04:14] There will still be a revision temp table joined in, but that cannot be avoided for a while. [21:04:31] Ah, I see. I'll wait until that's ready then. I've tried benchmarking on one wiki, but it's hard to be sure, it's usually fast enough on one wiki to be within the margin of error. [21:05:02] Ah ok. [21:05:18] the s3 (slice? shard? segment?) has numerically the most wikis so it would not surprise me that s3 is the slowest of all [21:05:32] [ slice :-) ] [21:05:58] bd808: Yeah, that's fair. [21:06:03] Looking back at the specific comment there, I see that you are referencing the comment join removal, and I was wrong. *THAT* one is the one I have only on scwiki. I am pushing it out to all starting tomorrow. In fact, I need to prep to depool one for it. [21:06:30] k, I'll check back in a few days. Thanks for everything so far :) [21:06:35] I was responding on my phone and thought it was a different comment 😜 [21:06:43] Ok, np [21:26:06] (03PS1) 10Urbanecm: [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 [21:26:50] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 (owner: 10Urbanecm) [21:31:23] (03PS2) 10Urbanecm: [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 [21:31:59] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 (owner: 10Urbanecm) [22:25:48] (03PS3) 10Urbanecm: [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 [22:26:30] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 (owner: 10Urbanecm) [22:27:01] (03PS4) 10Urbanecm: [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 [22:27:37] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 (owner: 10Urbanecm) [22:28:28] (03PS5) 10Urbanecm: [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 [22:29:04] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Add basic tests to Wikinity [labs/tools/wikinity] - 10https://gerrit.wikimedia.org/r/467823 (owner: 10Urbanecm)