[00:09:30] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Audit file size - https://phabricator.wikimedia.org/T418967 (10Eileenmcnaughton) 03NEW [00:14:54] (03PS2) 10Eileen: Gzip ignored files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247663 (https://phabricator.wikimedia.org/T418967) [00:14:54] (03PS1) 10Eileen: Start ignoring one of the adyen audit files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247710 (https://phabricator.wikimedia.org/T418967) [01:04:18] (03PS1) 10Ejegg: Vipps needs to be captured [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1247720 (https://phabricator.wikimedia.org/T339937) [01:04:44] (03CR) 10Ejegg: [C:03+2] Notice fix [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247705 (owner: 10Eileen) [01:05:28] fr-tech can anyone review a couple of Vipps patches for me? I'd love to be able to send them up for another test tomorrow [01:05:36] again, no way to test in sandbox [01:06:16] https://gerrit.wikimedia.org/r/1247720 and parent patch https://gerrit.wikimedia.org/r/1247701 [01:07:28] If no one gets to it ejegg I can in like 30 mins just started making dinner [01:07:35] thanks cstone [01:07:49] lars was there something more to do with those double opt-in patches? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1240016 [01:27:26] (03Merged) 10jenkins-bot: Notice fix [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247705 (owner: 10Eileen) [01:36:03] (03CR) 10CI reject: [V:04-1] build: Updating dependencies [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1246163 (owner: 10Libraryupgrader) [01:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [02:48:48] (03PS2) 10Ejegg: Stop sending pending messages with adyen capture ID [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240376 (https://phabricator.wikimedia.org/T416404) [02:51:01] (03CR) 10Ejegg: "PS2 does work in local smoke testing" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240376 (https://phabricator.wikimedia.org/T416404) (owner: 10Ejegg) [02:53:58] (03CR) 10Cstone: [C:03+2] Drop AVS/CVV scores for Vipps payments [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1247701 (https://phabricator.wikimedia.org/T339937) (owner: 10Ejegg) [02:54:30] (03Merged) 10jenkins-bot: Drop AVS/CVV scores for Vipps payments [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1247701 (https://phabricator.wikimedia.org/T339937) (owner: 10Ejegg) [02:55:00] (03CR) 10Cstone: [C:03+2] Vipps needs to be captured [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1247720 (https://phabricator.wikimedia.org/T339937) (owner: 10Ejegg) [02:55:31] (03Merged) 10jenkins-bot: Vipps needs to be captured [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1247720 (https://phabricator.wikimedia.org/T339937) (owner: 10Ejegg) [02:55:52] thanks cstone! [02:58:02] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1247727 [02:58:06] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1247727 (owner: 10Ejegg) [02:58:31] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1247727 (owner: 10Ejegg) [02:59:13] (03PS1) 10Ejegg: Update SmashPig [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1247728 [03:00:49] (03CR) 10Ejegg: [C:03+2] Update SmashPig [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1247728 (owner: 10Ejegg) [03:02:26] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1247729 [03:02:28] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1247729 (owner: 10Ejegg) [03:03:10] (03Merged) 10jenkins-bot: Update SmashPig [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1247728 (owner: 10Ejegg) [03:04:05] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1247729 (owner: 10Ejegg) [03:13:40] (03PS1) 10Ejegg: Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1247730 [03:13:42] (03CR) 10Ejegg: [C:03+2] Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1247730 (owner: 10Ejegg) [03:15:53] (03CR) 10CI reject: [V:04-1] Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1247730 (owner: 10Ejegg) [03:18:48] (03PS2) 10Ejegg: Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1247730 [03:18:51] (03CR) 10Ejegg: Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1247730 (owner: 10Ejegg) [03:20:38] !log standalone (IPN listener) SmashPig upgraded from 78960c68 to 217fc7fc [03:20:39] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [03:21:48] !log payments-wiki upgraded from 5e4939a3 to 9ae5bf60 [03:21:49] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [03:23:10] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 182.30, 115.48, 57.71 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [03:25:18] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 145.00, 99.18, 54.72 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [03:26:47] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Adyen, 07fr-current-sprint, and 2 others: Enable Vipps through Adyen - https://phabricator.wikimedia.org/T339937#11671660 (10Ejegg) Hi @RKumar_WMF, while I wait for an answer from Adyen support, I've just deployed a couple of changes that mig... [03:28:12] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 105.44, 122.08, 78.00 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [03:30:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 85.94, 98.20, 67.18 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [03:31:15] (03Merged) 10jenkins-bot: Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1247730 (owner: 10Ejegg) [03:32:55] hmm, is that payments-init damaged from the vipps link I just hit? [03:33:12] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 105.06, 110.38, 84.93 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [03:33:45] ugh, yep, need to handle the cancel flow [03:35:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 101.48, 104.39, 78.09 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [03:38:10] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 76.45, 100.85, 88.70 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [03:40:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 115.24, 108.26, 87.41 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [03:42:26] cstone: I guess we need a new status normalizer, as it can be 'Cancelled' too [03:42:50] Ahh [03:42:52] hmm, but I see no problem adding that to the ApprovalNeeded one [03:42:59] (03PS1) 10Eileen: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) [03:43:14] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 84.42, 104.64, 94.83 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [03:45:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 123.12, 118.95, 97.70 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [03:45:41] (03PS1) 10Ejegg: Add 'Cancelled' status to mapper [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1247734 (https://phabricator.wikimedia.org/T339937) [03:46:03] ehh, I need to get to sleep now, but ^^^ might be all that's needed [03:46:20] I /think/ the code I just deployed should at least get something captured in the happy path at least [03:46:23] night all [03:48:12] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 85.09, 96.68, 94.20 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [03:50:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 62.35, 95.23, 94.45 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [03:51:52] (03PS2) 10Eileen: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) [03:51:52] (03PS1) 10Eileen: Remove 'extra' setUp from test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247736 [03:53:10] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 84.35, 97.05, 95.91 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [03:53:41] (03PS1) 10Eileen: Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) [03:55:12] (03PS1) 10Eileen: Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) [03:55:18] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 24.71, 58.08, 79.41 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [03:58:12] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 70.56, 82.60, 90.74 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [03:58:53] (03PS1) 10Eileen: Add missing field from 'clear settlement fields' [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247739 [04:00:16] PROBLEM - check_load on frban2002 is CRITICAL: LOAD CRITICAL - total load average: 10.86, 32.25, 62.65 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [04:03:12] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 24.79, 49.41, 74.58 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [04:08:10] PROBLEM - check_load on frban1002 is CRITICAL: LOAD CRITICAL - total load average: 4.00, 22.82, 56.38 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [04:10:20] (03CR) 10CI reject: [V:04-1] Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [04:10:27] (03CR) 10CI reject: [V:04-1] Remove 'extra' setUp from test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247736 (owner: 10Eileen) [04:14:25] (03CR) 10CI reject: [V:04-1] Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [04:16:09] (03CR) 10Cstone: [C:03+2] Add 'Cancelled' status to mapper [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1247734 (https://phabricator.wikimedia.org/T339937) (owner: 10Ejegg) [04:16:26] (03CR) 10Cstone: [C:03+2] Add missing field from 'clear settlement fields' [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247739 (owner: 10Eileen) [04:16:53] (03Merged) 10jenkins-bot: Add 'Cancelled' status to mapper [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1247734 (https://phabricator.wikimedia.org/T339937) (owner: 10Ejegg) [04:17:37] (03PS2) 10Eileen: Remove 'extra' setUp from test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247736 [04:17:38] (03PS3) 10Eileen: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) [04:18:26] (03CR) 10CI reject: [V:04-1] Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [04:19:04] 14Fundraising Sprint Michelin Star, 03Fundraising Sprint: Dami's Crib πŸ˜€, 14Fundraising Sprint: Vixen, 06Fundraising-Backlog, and 2 others: 2nd Recurring Failure Email in Civi - https://phabricator.wikimedia.org/T365488#11671688 (10Cstone) @NNgu-WMF It's configurable once we set it up, its a parameter we pa... [04:20:18] RECOVERY - check_load on frban2002 is OK: LOAD OK - total load average: 3.25, 4.55, 19.87 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2002&service=check_load [04:23:12] RECOVERY - check_load on frban1002 is OK: LOAD OK - total load average: 2.86, 4.93, 24.39 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1002&service=check_load [04:24:40] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Content update for 1st? and 2nd recurring failure email - https://phabricator.wikimedia.org/T416435#11671689 (10Cstone) @NNgu-WMF @krobinson @AMJohnson is the English version done with testing? [04:26:01] (03PS3) 10Eileen: Remove 'extra' setUp from test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247736 [04:26:01] (03PS4) 10Eileen: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) [04:26:01] (03PS2) 10Eileen: Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) [04:26:01] (03PS2) 10Eileen: Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) [04:31:56] (03PS5) 10Eileen: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) [04:31:56] (03PS3) 10Eileen: Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) [04:31:56] (03PS3) 10Eileen: Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) [04:33:59] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Venmo issues from first round of testing - https://phabricator.wikimedia.org/T409599#11671696 (10Cstone) @AMJohnson gravy has added the customer block to transaction on their end so it will show up in the Braintree console. Could yo... [04:40:32] (03Merged) 10jenkins-bot: Add missing field from 'clear settlement fields' [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247739 (owner: 10Eileen) [04:42:10] (03PS8) 10Ejegg: Add API4 MatchingGiftPolicies.fetch and .sync [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1204993 (https://phabricator.wikimedia.org/T410052) [04:48:22] (03CR) 10CI reject: [V:04-1] Remove 'extra' setUp from test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247736 (owner: 10Eileen) [04:49:34] (03CR) 10CI reject: [V:04-1] Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [04:50:28] (03CR) 10CI reject: [V:04-1] Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [04:51:42] (03CR) 10CI reject: [V:04-1] Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [04:55:03] (03CR) 10CI reject: [V:04-1] Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [04:58:15] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_44) - 10https://gerrit.wikimedia.org/r/1247774 (owner: 10L10n-bot) [05:56:31] (03PS4) 10Eileen: Remove 'extra' setUp from test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247736 [05:56:31] (03PS6) 10Eileen: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) [05:56:31] (03PS4) 10Eileen: Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) [05:56:31] (03PS4) 10Eileen: Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) [05:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [06:11:39] (03CR) 10Cstone: [C:03+2] "Adding on to Eileen's +1, let's test it!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1204993 (https://phabricator.wikimedia.org/T410052) (owner: 10Ejegg) [06:15:53] (03CR) 10CI reject: [V:04-1] Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [06:16:02] (03CR) 10CI reject: [V:04-1] Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [06:16:34] (03CR) 10CI reject: [V:04-1] Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [06:21:14] PROBLEM - check_memory on fransw2003 is CRITICAL: CRIT Memory 96% used. Largest process: trino-server-co (2772858) = 95.1% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_memory [06:29:30] (03Merged) 10jenkins-bot: Add API4 MatchingGiftPolicies.fetch and .sync [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1204993 (https://phabricator.wikimedia.org/T410052) (owner: 10Ejegg) [06:33:02] (03CR) 10Cstone: [C:03+2] Remove 'extra' setUp from test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247736 (owner: 10Eileen) [06:36:14] RECOVERY - check_memory on fransw2003 is OK: OK Memory 87% used https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_memory [06:40:53] (03PS7) 10Eileen: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) [06:40:53] (03PS5) 10Eileen: Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) [06:40:53] (03PS5) 10Eileen: Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) [06:55:29] (03Merged) 10jenkins-bot: Remove 'extra' setUp from test [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247736 (owner: 10Eileen) [07:42:02] 10Fundraising analytics stack, 10fundraising-tech-ops: SurveyMonkey load data into platform - https://phabricator.wikimedia.org/T385743#11671862 (10NNgu-WMF) Thanks all! Adding @MSuijkerbuijk_WMF as a subscriber here. [09:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [10:38:33] (03PS4) 10Jgleeson: Add silverpop data freshness check to mediawiki export job [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/1247609 (https://phabricator.wikimedia.org/T416948) [10:38:49] ok that fixes those broken tests from yesterday and coding style failures [10:39:52] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint: Payments-wiki Gravy card donation & webhook processing UML sequence diagram (full picture) - https://phabricator.wikimedia.org/T418251#11672494 (10jgleeson) >>! In T418251#11655445, @Ejegg wrote: > Pretty thorough! The gravy ada... [12:25:05] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_44) - 10https://gerrit.wikimedia.org/r/1247774 (owner: 10L10n-bot) [12:25:25] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_43) - 10https://gerrit.wikimedia.org/r/1247280 (owner: 10L10n-bot) [12:36:07] 06Fundraising-Backlog: UNHANDLED EXCEPTION SENDING THANK YOU MESSAGE - https://phabricator.wikimedia.org/T419003 (10jgleeson) 03NEW [12:36:18] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: UNHANDLED EXCEPTION SENDING THANK YOU MESSAGE - https://phabricator.wikimedia.org/T419003#11672950 (10jgleeson) [12:46:24] 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Filtering banners on campaign page resets "Limit traffic" checkbox and "Campaign type" - https://phabricator.wikimedia.org/T182343#11672970 (10Pcoombe) [12:49:46] 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Filtering banners on campaign page resets "Limit traffic" checkbox and "Campaign type" - https://phabricator.wikimedia.org/T182343#11672979 (10Pcoombe) Can someone look into this? It's very annoying for both fundraising and community users [13:28:30] (03CR) 10Jgleeson: "Thanks Eileen. I left some questions inline" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [13:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [14:15:36] (03CR) 10Jgleeson: Gzip ignored files (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247663 (https://phabricator.wikimedia.org/T418967) (owner: 10Eileen) [14:38:16] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Adyen, 07fr-current-sprint, 05MW-1.46-notes (1.46.0-wmf.16; 2026-02-17): Enable Vipps through Adyen - https://phabricator.wikimedia.org/T339937#11673528 (10RKumar_WMF) I have reached out to user to check if he can do more test. Ty. [14:46:02] (03PS1) 10Jgleeson: Add --limit option to mediawiki donor export [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/1248017 (https://phabricator.wikimedia.org/T416948) [14:46:54] (03CR) 10Jgleeson: "I tested this locally and I get:" [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/1248017 (https://phabricator.wikimedia.org/T416948) (owner: 10Jgleeson) [14:51:27] larssandergreen: I just pushed up a tweak to the donor id export to allow us to pass a '--limit' flag so that we can test it in production on a handful of records in advance of running the full job https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/tools/+/1248017 [14:52:46] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07payments-orchestration: Adyen chargebacks not at Gravy, listener sends to queue with gateway=adyen - https://phabricator.wikimedia.org/T419020 (10Ejegg) 03NEW [14:56:15] (03CR) 10Jgleeson: [V:03+2 C:03+2] Allow test suite to be passed when running python tools unit tests [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1247614 (https://phabricator.wikimedia.org/T416948) (owner: 10Jgleeson) [15:33:38] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Venmo issues from first round of testing - https://phabricator.wikimedia.org/T409599#11673810 (10AMJohnson) Hey @cstone! Of course! Just did two tests. First attempt did a one-time via desktop > a43ace28-1678-4682-bfc0-857b1f2cec... [15:55:33] (03PS1) 10Ejegg: WIP record gravy chargebacks from Adyen IPN listener [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248032 (https://phabricator.wikimedia.org/T419020) [15:56:06] (03CR) 10CI reject: [V:04-1] WIP record gravy chargebacks from Adyen IPN listener [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248032 (https://phabricator.wikimedia.org/T419020) (owner: 10Ejegg) [16:11:20] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog: Priorities: Sprint D - https://phabricator.wikimedia.org/T418798#11674016 (10AKanji-WMF) [16:23:24] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint: Scoping Donor Portal Operational Emails - https://phabricator.wikimedia.org/T416600#11674069 (10SBurnett-WMF) [16:31:07] (03CR) 10Lars SG: [C:03+2] Add silverpop data freshness check to mediawiki export job [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/1247609 (https://phabricator.wikimedia.org/T416948) (owner: 10Jgleeson) [16:33:09] (03Merged) 10jenkins-bot: Add silverpop data freshness check to mediawiki export job [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/1247609 (https://phabricator.wikimedia.org/T416948) (owner: 10Jgleeson) [16:46:19] (03CR) 10Lars SG: [C:03+2] Add --limit option to mediawiki donor export [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/1248017 (https://phabricator.wikimedia.org/T416948) (owner: 10Jgleeson) [16:47:53] (03Merged) 10jenkins-bot: Add --limit option to mediawiki donor export [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/1248017 (https://phabricator.wikimedia.org/T416948) (owner: 10Jgleeson) [16:56:56] (03PS1) 10Wfan: Add recurring cash in br test link - pix [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1248049 (https://phabricator.wikimedia.org/T389865) [16:58:10] (03PS1) 10Wfan: Add connection options for pix recurring [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248050 (https://phabricator.wikimedia.org/T389865) [16:58:43] (03PS1) 10Wfan: Enable pix recurring [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248051 (https://phabricator.wikimedia.org/T389865) [16:58:49] (03CR) 10CI reject: [V:04-1] Add connection options for pix recurring [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248050 (https://phabricator.wikimedia.org/T389865) (owner: 10Wfan) [17:00:21] thanks larssandergreen ! [17:04:26] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 05FY25-26 WE3.5 Donor Identification and recognition, 13Patch-For-Review: CiviCRM should export a CSV that can be used in a MediaWiki maintenance script - https://phabricator.wikimedia.org/T416948#11674227 (10Lars) @jgleeson... [17:08:34] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog: Priorities: Sprint D - https://phabricator.wikimedia.org/T418798#11674279 (10AKanji-WMF) [17:09:20] (03PS2) 10Wfan: Add connection options for pix recurring [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248050 (https://phabricator.wikimedia.org/T389865) [17:48:48] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Spike: We could add specific info about matching in the thank you email for contacts who have previously provided employer - https://phabricator.wikimedia.org/T419042 (10Lars) 03NEW [17:54:51] 06Fundraising-Backlog: Integrate Chariot to Civi for automated payment info updates - https://phabricator.wikimedia.org/T419044 (10EMartin) 03NEW [17:57:04] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Add token for recurring donation failure link - https://phabricator.wikimedia.org/T419046 (10Lars) 03NEW [17:58:06] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations, 07fr-current-sprint: Add token for recurring donation failure link - https://phabricator.wikimedia.org/T419046#11674645 (10Lars) [17:58:18] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations, 07fr-current-sprint: Add token for recurring donation failure link - https://phabricator.wikimedia.org/T419046#11674648 (10Lars) a:05AKanji-WMFβ†’03None [17:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [18:11:05] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 13Patch-For-Review, 07payments-orchestration: Investigate Pix AutomΓ‘tico - https://phabricator.wikimedia.org/T389865#11674684 (10AnnWF) [18:48:22] (03PS1) 10Jgleeson: Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - 10https://gerrit.wikimedia.org/r/1248078 [18:51:11] (03CR) 10Jgleeson: [C:03+2] Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - 10https://gerrit.wikimedia.org/r/1248078 (owner: 10Jgleeson) [18:51:45] (03Merged) 10jenkins-bot: Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - 10https://gerrit.wikimedia.org/r/1248078 (owner: 10Jgleeson) [18:52:42] !log tools upgraded from a3568ffc to e60f63b3 [18:52:43] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [18:58:09] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 05FY25-26 WE3.5 Donor Identification and recognition: CiviCRM should export a CSV that can be used in a MediaWiki maintenance script - https://phabricator.wikimedia.org/T416948#11674946 (10Lars) @Dwisehaupt, we need to do the... [18:58:54] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint: Donor Portal Operational Emails - https://phabricator.wikimedia.org/T416600#11674955 (10Ejegg) [19:05:16] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 07fr-current-sprint, 05FY25-26 WE3.5 Donor Identification and recognition: CiviCRM should export a CSV that can be used in a MediaWiki maintenance script - https://phabricator.wikimedia.org/T416948#11674974 (10Dwisehaupt) @Lars alter complete: ` M... [19:53:55] 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Filtering banners on campaign page resets "Limit traffic" checkbox and "Campaign type" - https://phabricator.wikimedia.org/T182343#11675119 (10DerHexer) Quoting my comment from the other ticket: > Volunteer CentralNotice admins like me even introduc... [20:17:38] (03CR) 10Eileen: Fix confusing merge_data function (033 comments) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [20:21:25] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Email pref center: "No" link in email change confirmation email is non-functional - https://phabricator.wikimedia.org/T419061 (10Lars) 03NEW [20:42:49] (03CR) 10Lars SG: [C:03+2] Send double opt-in email on email prefs opt-in [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240016 (https://phabricator.wikimedia.org/T407442) (owner: 10Ejegg) [20:58:03] (03Merged) 10jenkins-bot: Send double opt-in email on email prefs opt-in [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240016 (https://phabricator.wikimedia.org/T407442) (owner: 10Ejegg) [20:58:36] 06Fundraising-Backlog: Integrate Chariot to Civi for automated payment info updates - https://phabricator.wikimedia.org/T419044#11675328 (10MDemosWMF) Related: https://phabricator.wikimedia.org/T415825 [21:00:09] 14Fundraising Sprint: Vixen, 03Fundraising Sprint: Yabba Dabba Stew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 3 others: Implement recurring donation monthly-to-annual conversion - https://phabricator.wikimedia.org/T388753#11675338 (10AKanji-WMF) 05Resolvedβ†’03Open @CHudson-WMF - based... [21:01:55] (03PS8) 10Ejegg: Add double opt-in activity from email change [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240025 (https://phabricator.wikimedia.org/T407442) [21:02:49] 10Fundraising analytics stack: ingest P&T data into data lake or connect it to trino - https://phabricator.wikimedia.org/T412846#11675360 (10IAckerman-WMF) https://docs.google.com/spreadsheets/d/1ZYIXcgPJOyH62PSnCmXeWudq9CMzXs6rDMCz4eMvsWE/edit?gid=0#gid=0 [21:15:42] wfan: thank you for always keeping the tech-talk doc updated and full of useful links ! [21:17:29] haha np~ [21:26:20] (03PS8) 10Eileen: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) [21:26:20] (03PS6) 10Eileen: Fix dlocal grabbing the wrong donation in the series [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247737 (https://phabricator.wikimedia.org/T414531) [21:26:20] (03PS6) 10Eileen: Try order ID first, not last [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247738 (https://phabricator.wikimedia.org/T414531) [21:26:28] ejegg: I updated that docblock comment ^^ [21:40:58] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Hide cancel link for Paypal recurrings that cannot be cancelled - https://phabricator.wikimedia.org/T418406#11675592 (10MBeat33) I got one of these "Error sending cancel request to processor: 11552... [21:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [22:01:56] (03PS1) 10Ejegg: WIP generic WorkflowMessage\Send action [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248114 (https://phabricator.wikimedia.org/T416600) [22:02:12] (03PS1) 10Ejegg: WIP Send Donor Portal email on annual conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248115 (https://phabricator.wikimedia.org/T416600) [22:51:05] 06Fundraising-Backlog, 10fundraising-tech-ops, 10Observability-Alerting: Shift frack alerting to use prometheus-alertmanager instead of icinga - https://phabricator.wikimedia.org/T367370#11675909 (10Dwisehaupt) [22:53:01] 06Fundraising-Backlog, 10fundraising-tech-ops, 10Observability-Alerting: Shift frack alerting to use prometheus-alertmanager instead of icinga - https://phabricator.wikimedia.org/T367370#11675919 (10Dwisehaupt) [23:03:15] (03CR) 10Eileen: "I would note this is a one-by-one queued add-to-group - if we grow out of that we can probably do as an upload" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247699 (owner: 10Eileen) [23:35:23] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, 10FR-MGFE, 0725 Dec Q3 Planning: Share address and email between DAF and DAF owner when importing donations - https://phabricator.wikimedia.org/T411639#11676044 (10Lars) 05Openβ†’03Declined Closing this as we will res... [23:38:10] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, 0725 Dec Q3 Planning: New batch data entry update: Vague error description - https://phabricator.wikimedia.org/T404644#11676063 (10Lars) @MDemosWMF FYI, this is in the list of work that the CiviC... [23:57:19] (03CR) 10Lars SG: "See comments" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244856 (https://phabricator.wikimedia.org/T416052) (owner: 10Wfan) [23:58:49] ok will do the update thanks lars