[00:00:03] thanks wfan, maybe even add a test case to make sure we get the best match? [00:00:19] sure~ [00:08:49] (03CR) 10Lars SG: [C:03+2] Add double opt-in activity from email change [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240025 (https://phabricator.wikimedia.org/T407442) (owner: 10Ejegg) [00:33:21] (03Merged) 10jenkins-bot: Add double opt-in activity from email change [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240025 (https://phabricator.wikimedia.org/T407442) (owner: 10Ejegg) [01:44:23] (03PS8) 10Wfan: Update lowconfiedence logic to check current primary location [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244856 (https://phabricator.wikimedia.org/T416052) [01:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [02:01:11] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Finance batch uploads - what to do when not valid upstream - https://phabricator.wikimedia.org/T419097 (10Eileenmcnaughton) 03NEW [02:03:09] (03CR) 10CI reject: [V:04-1] Update lowconfiedence logic to check current primary location [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1244856 (https://phabricator.wikimedia.org/T416052) (owner: 10Wfan) [02:50:59] (03PS2) 10Ejegg: Generic WorkflowMessage send actions [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248114 (https://phabricator.wikimedia.org/T416600) [02:50:59] (03PS2) 10Ejegg: Send Donor Portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248115 (https://phabricator.wikimedia.org/T416600) [02:53:02] (03CR) 10Eileen: [C:03+2] "ejegg - do you want to create an upstream PR to add these to Civi -not sure it will be merged but got to have the conversation - +2 for no" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248114 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [02:53:50] (03PS2) 10Ejegg: Delete XML test data [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1240424 [02:53:50] (03PS2) 10Ejegg: Add Gravy-related properties to AdyenMessage [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1240394 (https://phabricator.wikimedia.org/T415824) [02:53:51] (03PS2) 10Ejegg: WIP record gravy chargebacks from Adyen IPN listener [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248032 (https://phabricator.wikimedia.org/T419020) [02:53:51] (03PS1) 10Ejegg: Rename trait, drop 'Drop' [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248167 (https://phabricator.wikimedia.org/T415824) [02:54:37] (03CR) 10CI reject: [V:04-1] WIP record gravy chargebacks from Adyen IPN listener [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248032 (https://phabricator.wikimedia.org/T419020) (owner: 10Ejegg) [02:54:46] (03CR) 10CI reject: [V:04-1] Rename trait, drop 'Drop' [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248167 (https://phabricator.wikimedia.org/T415824) (owner: 10Ejegg) [02:58:51] (03CR) 10Ejegg: [C:04-1] "Currently thinking we won't need the trait at all - just use the gateway from the base AdyenMessage class" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248167 (https://phabricator.wikimedia.org/T415824) (owner: 10Ejegg) [03:08:01] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations, 07fr-current-sprint: Add Searchkit with daily email notifications / dashlet for donations missing required details - https://phabricator.wikimedia.org/T412463#11676332 (10Lars) We can use https:/... [03:11:19] (03Merged) 10jenkins-bot: Generic WorkflowMessage send actions [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248114 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [03:14:55] (03CR) 10CI reject: [V:04-1] Send Donor Portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248115 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [03:15:45] (03CR) 10Ejegg: "Thanks, Eileen!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248114 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [03:17:52] oh jeez it got late. Gonna have to review your stuff in the morning eileen, sorry! [03:26:40] (03PS1) 10Eileen: Improve calculation of batch date description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248168 (https://phabricator.wikimedia.org/T415626) [03:49:56] (03CR) 10CI reject: [V:04-1] Improve calculation of batch date description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248168 (https://phabricator.wikimedia.org/T415626) (owner: 10Eileen) [04:04:36] (03PS1) 10Eileen: Shorten braintree chargeback batch name [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248170 (https://phabricator.wikimedia.org/T415746) [04:04:42] one tiny one ... ^^ [04:16:43] (03CR) 10CI reject: [V:04-1] build: Updating dependencies [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1246163 (owner: 10Libraryupgrader) [04:22:03] (03PS1) 10Eileen: Add extension with local dev test data [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248174 [04:23:06] (03CR) 10CI reject: [V:04-1] Add extension with local dev test data [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248174 (owner: 10Eileen) [04:23:47] (03CR) 10Cstone: [C:03+2] Shorten braintree chargeback batch name [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248170 (https://phabricator.wikimedia.org/T415746) (owner: 10Eileen) [04:23:55] character limits? this is 2026! :P [04:24:18] (03Merged) 10jenkins-bot: Shorten braintree chargeback batch name [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248170 (https://phabricator.wikimedia.org/T415746) (owner: 10Eileen) [04:24:18] :-) [04:24:27] well it does have a place in the UI [04:25:05] if that + the dlocal ones in review work I'll be down to 1 issue on the audit side [04:25:11] niceeeee [04:25:25] looking over this completed batch email too just like all your hard work! and it mathces up! [04:26:14] my brain is more dead than I thought it was going to be tonight though :( [04:28:55] (03CR) 10Lars SG: "I hope I've explained what I'm concerned about with these. If you prefer to talk it over, we can do that tomorrow for sure." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1237617 (https://phabricator.wikimedia.org/T416052) (owner: 10Wfan) [04:29:40] lol [04:35:34] (03PS2) 10Eileen: Improve calculation of batch date description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248168 (https://phabricator.wikimedia.org/T415626) [04:38:35] (03PS1) 10Eileen: Upgrading wikimedia/smash-pig (v1.2.2.13 => v1.2.2.15) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248179 [04:38:49] (03CR) 10Eileen: [C:03+2] Upgrading wikimedia/smash-pig (v1.2.2.13 => v1.2.2.15) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248179 (owner: 10Eileen) [04:53:04] (03CR) 10CI reject: [V:04-1] Improve calculation of batch date description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248168 (https://phabricator.wikimedia.org/T415626) (owner: 10Eileen) [04:56:40] (03Merged) 10jenkins-bot: Upgrading wikimedia/smash-pig (v1.2.2.13 => v1.2.2.15) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248179 (owner: 10Eileen) [05:00:00] (03PS3) 10Eileen: Improve calculation of batch date description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248168 (https://phabricator.wikimedia.org/T415626) [05:04:21] (03PS1) 10Eileen: Upgrading wikimedia/smash-pig (v1.2.2.13 => v1.2.2.15) [wikimedia/fundraising/crm/vendor] - 10https://gerrit.wikimedia.org/r/1248220 [05:04:35] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1248226 [05:04:51] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1248226 (owner: 10Eileen) [05:05:50] (03Merged) 10jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1248226 (owner: 10Eileen) [05:06:34] (03CR) 10Eileen: [C:03+2] Upgrading wikimedia/smash-pig (v1.2.2.13 => v1.2.2.15) [wikimedia/fundraising/crm/vendor] - 10https://gerrit.wikimedia.org/r/1248220 (owner: 10Eileen) [05:08:31] !log * civicrm upgraded from 8bdce85f to 11e5a5d8 [05:08:31] * config revision changed from 0a095ef9 to f792d67d [05:08:32] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [05:11:13] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_45) - 10https://gerrit.wikimedia.org/r/1248213 (owner: 10L10n-bot) [05:26:13] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Venmo issues from first round of testing - https://phabricator.wikimedia.org/T409599#11676435 (10Cstone) thanks for the testing @AMJohnson ! When you tested on mobile did it open up the venmo app to pay? I'm not seeing that in my t... [05:29:38] (03Merged) 10jenkins-bot: Upgrading wikimedia/smash-pig (v1.2.2.13 => v1.2.2.15) [wikimedia/fundraising/crm/vendor] - 10https://gerrit.wikimedia.org/r/1248220 (owner: 10Eileen) [05:35:12] (03CR) 10Cstone: [C:03+2] Improve calculation of batch date description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248168 (https://phabricator.wikimedia.org/T415626) (owner: 10Eileen) [05:53:53] (03Merged) 10jenkins-bot: Improve calculation of batch date description [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248168 (https://phabricator.wikimedia.org/T415626) (owner: 10Eileen) [05:57:45] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1248306 [05:58:01] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1248306 (owner: 10Eileen) [05:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [05:59:25] !log ivicrm upgraded from 11e5a5d8 to fbac3ce7 [05:59:26] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [06:16:14] PROBLEM - check_memory on fransw2003 is CRITICAL: CRIT Memory 99% used. Largest process: trino-server-co (2772858) = 98.4% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_memory [06:21:16] PROBLEM - check_memory on fransw2003 is CRITICAL: CRIT Memory 99% used. Largest process: trino-server-co (2772858) = 98.4% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_memory [06:26:14] PROBLEM - check_memory on fransw2003 is CRITICAL: CRIT Memory 99% used. Largest process: trino-server-co (2772858) = 98.4% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_memory [06:29:58] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_45) - 10https://gerrit.wikimedia.org/r/1248213 (owner: 10L10n-bot) [06:31:14] PROBLEM - check_memory on fransw2003 is CRITICAL: CRIT Memory 99% used. Largest process: trino-server-co (2772858) = 98.4% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_memory [06:36:14] PROBLEM - check_memory on fransw2003 is CRITICAL: CRIT Memory 99% used. Largest process: trino-server-co (2772858) = 98.4% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_memory [06:41:14] RECOVERY - check_memory on fransw2003 is OK: OK Memory 89% used https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_memory [08:12:48] (03CR) 10CI reject: [V:04-1] build: Updating dependencies [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1246240 (owner: 10Libraryupgrader) [09:52:17] 06Fundraising-Backlog: Delay cancelling monthly recurring until month 3 - https://phabricator.wikimedia.org/T419112 (10MSuijkerbuijk_WMF) 03NEW [09:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [10:03:14] 06Fundraising-Backlog: Delay cancelling monthly recurring until month 3 - https://phabricator.wikimedia.org/T419112#11676926 (10krobinson) Thanks for the add @MSuijkerbuijk_WMF - I think this is a great change. QQ - how will this impact the recurring failure emails? Will they both deploy in month 1 or will the... [12:00:37] https://usercontent.irccloud-cdn.com/file/E2GWeEJt/image.png [13:59:13] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [13:59:42] (03CR) 10Jgleeson: [C:03+2] Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [14:00:42] (03CR) 10Jgleeson: [C:03+2] Gzip ignored files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247663 (https://phabricator.wikimedia.org/T418967) (owner: 10Eileen) [14:04:22] 06Fundraising-Backlog: Delay cancelling monthly recurring until month 3 - https://phabricator.wikimedia.org/T419112#11677578 (10MSuijkerbuijk_WMF) To me (open to discuss) the failure emails can remain as they are for now to let the donor know - this is more of a technical shift on our end. Later on, we can expl... [14:21:08] (03Merged) 10jenkins-bot: Fix confusing merge_data function [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247733 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [14:27:06] (03Merged) 10jenkins-bot: Gzip ignored files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247663 (https://phabricator.wikimedia.org/T418967) (owner: 10Eileen) [14:50:43] 06Fundraising-Backlog: Delay cancelling monthly recurring until month 3 - https://phabricator.wikimedia.org/T419112#11677744 (10Ejegg) So instead of attempting to charge again the following day, we would attempt to charge again the following month? [15:28:56] looks like we are losing the session on DP, causing api request to fail with error: donorportal-no-session [15:34:06] 06Fundraising-Backlog, 10FR-Donor-portal: DonorPortal donation modification requests failing - https://phabricator.wikimedia.org/T419139 (10Damilare) 03NEW [15:35:01] (03PS3) 10Ejegg: Delete XML test data [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1240424 [15:35:01] (03PS3) 10Ejegg: Add Gravy-related properties to AdyenMessage [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1240394 (https://phabricator.wikimedia.org/T415824) [15:35:01] (03PS2) 10Ejegg: Drop 'DropGravyInitiatedMessageTrait' [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248167 (https://phabricator.wikimedia.org/T415824) [15:35:01] (03PS1) 10Ejegg: Tag Adyen/Gravy messages by merchant reference [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248510 (https://phabricator.wikimedia.org/T415824) [15:35:30] damilare: oh, is that happening often? [15:36:25] probably ejegg. I'm unable to do any action locally because of the error and I confirmed it happens on production as well. [15:36:32] oh dang! [15:36:50] I was able to test locally just last night [15:37:54] hmm, it just worked for me [15:38:02] in FF [15:38:06] in production [15:38:09] let me try in chrome [15:38:57] ok, broken in chrome [15:39:06] so did it not send the cookies? [15:39:36] ohh interesting, I'm on chrome [15:41:06] huh, right, I don't see chrome sending the cookie with the API request [15:41:23] let's see, does it have the cookie stored at all? [15:42:12] mine isn't saving any at all too [15:42:14] and FF [15:42:36] I mean FF failed for me and also isn't saving the cookie [15:43:27] Oh, I wonder if I had a cookie already. Let's see if it gives me a new one when I erase it [15:44:58] right, if I erase and reload I don't see any set-cookie header [15:46:33] let's add ->persist() [15:47:37] (03PS1) 10Ejegg: Persist session on donor portal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248516 (https://phabricator.wikimedia.org/T419139) [15:49:09] damilare: with ^^^ I get the set-cookie header [15:49:41] thanks, looking! [15:50:48] sorry for creating the bug in the first place! I should have remembered how sessions work in mediawiki [15:51:13] (03PS1) 10Damilare Adedoyin: Add manage donations view [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248518 [15:51:43] (03PS2) 10Damilare Adedoyin: Add manage donations view [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248518 [15:54:03] (03CR) 10CI reject: [V:04-1] Add manage donations view [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248518 (owner: 10Damilare Adedoyin) [15:55:43] (03CR) 10Damilare Adedoyin: [C:03+2] "Thanks for the quick fix ejegg, tested and I'm able to see the cookies and modify donations now. LGTM" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248516 (https://phabricator.wikimedia.org/T419139) (owner: 10Ejegg) [15:58:05] (03Merged) 10jenkins-bot: Persist session on donor portal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248516 (https://phabricator.wikimedia.org/T419139) (owner: 10Ejegg) [16:13:05] (03CR) 10Lars SG: [C:03+2] Add action to push Group to Acoustic [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247699 (owner: 10Eileen) [16:15:40] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Email, and 4 others: Civi Searchkit should allow user to export list to acoustic - https://phabricator.wikimedia.org/T301514#11678186 (10Lars) We now have https://gerrit.wikimedia.org/r/c/wikimedia/fundraising... [16:17:26] ty dami, I'll deploy it [16:17:52] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248525 [16:18:12] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248525 (owner: 10Ejegg) [16:18:43] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Email, and 4 others: Civi Searchkit should allow user to export list to acoustic - https://phabricator.wikimedia.org/T301514#11678199 (10Lars) @Eileenmcnaughton I think the next step here is to make this work... [16:30:08] 14Fundraising Sprint Cheese String Theory, 14Fundraising Sprint Discworld reformatted as ntfs, 14Fundraising Sprint e^πŸ₯§πŸ‘€=yum, 06Fundraising-Backlog, and 2 others: Figure out how to move batch processing to a background task - https://phabricator.wikimedia.org/T305516#11678241 (10Lars) @Eileenmcnaughton Is... [16:31:13] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248525 (owner: 10Ejegg) [16:34:07] (03Merged) 10jenkins-bot: Add action to push Group to Acoustic [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1247699 (owner: 10Eileen) [16:44:04] (03PS3) 10Damilare Adedoyin: Add manage donations view [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248518 [16:46:11] 10fundraising-tech-ops: Fundraising access request for Guilherme GonΓ§alves - https://phabricator.wikimedia.org/T418871#11678314 (10AStein-WMF) sent access request to Lisa [16:46:40] (03CR) 10CI reject: [V:04-1] Add manage donations view [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248518 (owner: 10Damilare Adedoyin) [16:55:51] (03PS4) 10Damilare Adedoyin: Add manage donations view [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248518 [17:10:51] FIRING: SwitchCoreInterfaceDown: Switch core interface down - fasw2-c8a-codfw:ge-0/0/0 (Core: fmsw-c8-codfw) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Switch_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=fasw2-c8a-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DSwitchCoreInterfaceDown [17:25:51] RESOLVED: SwitchCoreInterfaceDown: Switch core interface down - fasw2-c8a-codfw:ge-0/0/0 (Core: fmsw-c8-codfw) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Switch_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=fasw2-c8a-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DSwitchCoreInterfaceDown [17:32:36] ejegg: pcoombe: Do you know what it would take for something like https://donate.wikimedia.org/w/index.php?title=MediaWiki:DonationForm.js&action=raw&ctype=text/javascript to be loaded via ResourceLoader? E.g. Common.js (site module), or a gadget, or in an extension. [17:32:54] not sure how widespread its use and indirect use may be [17:33:19] it's only loaded in common.js [17:33:35] so a [default] gadget, might do it. [17:34:42] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Adyen, 07fr-current-sprint, 05MW-1.46-notes (1.46.0-wmf.16; 2026-02-17): Enable Vipps through Adyen - https://phabricator.wikimedia.org/T339937#11678453 (10RKumar_WMF) The donation shows settled now. I also refunded it and it completed and... [17:34:42] would that be better for performance? [17:36:23] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Adyen, 07fr-current-sprint, 05MW-1.46-notes (1.46.0-wmf.16; 2026-02-17): Enable Vipps through Adyen - https://phabricator.wikimedia.org/T339937#11678461 (10RKumar_WMF) However, previous two donations show completed in Civi although they hav... [17:43:21] FIRING: SwitchCoreInterfaceDown: Switch core interface down - fasw2-c8a-codfw:ge-0/0/0 (Core: fmsw-c8-codfw) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Switch_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=fasw2-c8a-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DSwitchCoreInterfaceDown [17:43:54] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [17:44:19] pcoombe: yeah, beter caching, but also, higher trust level, and so won't get blocked in interventiosn like it did today [17:44:43] we briefly broke donations for 20min or so past hour [17:44:55] 06Fundraising-Backlog: Recurring charge job not getting through that days charges in 24 hours (February 28 and future problem) - https://phabricator.wikimedia.org/T418824#11678481 (10Cstone) [17:48:21] RESOLVED: SwitchCoreInterfaceDown: Switch core interface down - fasw2-c8a-codfw:ge-0/0/0 (Core: fmsw-c8-codfw) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Switch_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=fasw2-c8a-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DSwitchCoreInterfaceDown [17:49:36] Krinkle: okay, I can look into it [17:51:14] (03CR) 10Damilare Adedoyin: [C:03+2] Internationalize Donor Portal tab headers [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1245471 (owner: 10Ejegg) [17:51:24] fr-tech, if someone has time, please take a quick peek at these high-level Gravy UML diagrams, before I drop them into our docs? Thanks in advance! https://phabricator.wikimedia.org/T418251 [17:53:33] (03Merged) 10jenkins-bot: Internationalize Donor Portal tab headers [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1245471 (owner: 10Ejegg) [17:53:42] !log donorwiki upgraded from 7329b41d to 4c09db39 [17:53:43] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [17:53:44] (03Merged) 10jenkins-bot: Delete unused DonorPortal messages [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1245478 (https://phabricator.wikimedia.org/T111677) (owner: 10Ejegg) [17:55:51] FIRING: InboundInterfaceErrors: Inbound errors on interface pfw1-codfw:reth1 () - https://wikitech.wikimedia.org/wiki/Network_monitoring#Inbound/outbound_interface_errors - https://grafana.wikimedia.org/d/5p97dAASz/queue-and-error-stats-by-network-device?var-site=codfw+prometheus%2Fops&var-device=pfw1-codfw&var-interface=reth1 - https://alerts.wikimedia.org/?q=alertname%3DInboundInterfaceErrors [18:00:51] FIRING: [3x] InboundInterfaceErrors: Inbound errors on interface pfw1-codfw:reth1 () - https://wikitech.wikimedia.org/wiki/Network_monitoring#Inbound/outbound_interface_errors - https://alerts.wikimedia.org/?q=alertname%3DInboundInterfaceErrors [18:06:05] thanks for following up Krinkle and pcoombe ! [18:11:10] PROBLEM - check_nginx on payments1006 is CRITICAL: PROCS CRITICAL: 105 processes with command name nginx https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments1006&service=check_nginx [18:16:08] RECOVERY - check_nginx on payments1006 is OK: PROCS OK: 58 processes with command name nginx https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments1006&service=check_nginx [18:16:52] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Add filters to All / My Imports reports in core - https://phabricator.wikimedia.org/T416040#11678603 (10Lars) [[ https://github.com/civicrm/civicrm-core/pull/35022 | Upstream PR ]] [18:17:52] (03PS4) 10Ejegg: Add Gravy-related properties to AdyenMessage [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1240394 (https://phabricator.wikimedia.org/T415824) [18:17:53] (03PS3) 10Ejegg: Drop 'DropGravyInitiatedMessageTrait' [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248167 (https://phabricator.wikimedia.org/T415824) [18:17:53] (03PS2) 10Ejegg: Tag Adyen/Gravy messages by merchant reference [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248510 (https://phabricator.wikimedia.org/T415824) [18:17:53] (03PS3) 10Ejegg: Record gravy refunds/chargebacks from Adyen IPN listener [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248032 (https://phabricator.wikimedia.org/T419020) [18:17:54] (03PS1) 10Ejegg: Remove shadowed merchantReference properties [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248555 [18:28:56] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review, 07payments-orchestration: Adyen chargebacks not at Gravy, listener sends to queue with gateway=adyen - https://phabricator.wikimedia.org/T419020#11678637 (10Ejegg) [18:29:41] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review, 07payments-orchestration: Adyen chargebacks not at Gravy, listener sends to queue with gateway=adyen - https://phabricator.wikimedia.org/T419020#11678642 (10Ejegg) Related ticket: {T415824} [18:30:54] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-techtalk, 13Patch-For-Review: Do we / could we process Gravy transactions from gateway IPNS - https://phabricator.wikimedia.org/T415824#11678650 (10Ejegg) Patch chain in review should at least get gravy Char... [18:41:48] (03PS1) 10Eileen: AuthRate entity shell [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248560 [18:41:48] (03PS1) 10Eileen: With friends's bells [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248561 [18:41:48] (03PS1) 10Eileen: WIP / POC - harvest auth rates from payments files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248562 [18:43:07] (03CR) 10CI reject: [V:04-1] With friends's bells [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248561 (owner: 10Eileen) [18:56:51] FIRING: SwitchCoreInterfaceDown: Switch core interface down - fasw2-c8a-codfw:ge-0/0/0 (Core: fmsw-c8-codfw) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Switch_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=fasw2-c8a-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DSwitchCoreInterfaceDown [19:01:51] RESOLVED: SwitchCoreInterfaceDown: Switch core interface down - fasw2-c8a-codfw:ge-0/0/0 (Core: fmsw-c8-codfw) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Switch_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=fasw2-c8a-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DSwitchCoreInterfaceDown [19:15:29] (03PS3) 10Ejegg: Send Donor Portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248115 (https://phabricator.wikimedia.org/T416600) [19:15:29] (03PS1) 10Ejegg: Updated content for donor portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248575 (https://phabricator.wikimedia.org/T416600) [19:32:37] (03CR) 10CI reject: [V:04-1] Send Donor Portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248115 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [20:12:42] (03PS2) 10Ejegg: Updated content for donor portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248575 (https://phabricator.wikimedia.org/T416600) [20:12:42] (03PS4) 10Ejegg: Send Donor Portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248115 (https://phabricator.wikimedia.org/T416600) [20:12:42] (03PS1) 10Ejegg: Fix typo in WorkflowMessage\SendViaQueue [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248594 [20:13:18] classic, missing ->execute() [20:15:03] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Donor-portal, 07fr-current-sprint, 13Patch-For-Review: Donor Portal Operational Emails - https://phabricator.wikimedia.org/T416600#11679030 (10Ejegg) Patch chain in review will send the messages [20:15:52] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06Wikipedia-iOS-App-Backlog, 06Wikipedia-Android-App-Backlog (Android Release - FY2025-26): Apps Big EN 2025 Banner Name and Impression data /campaign_id mismatch - to be investigated - https://phabricator.wikimedia.org/T415692#11679033 (10SNowick_... [20:35:36] (03CR) 10Ejegg: [C:04-1] "Looks pretty good, maybe just fix the frequency_unit mapping?" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1248050 (https://phabricator.wikimedia.org/T389865) (owner: 10Wfan) [20:44:31] ok fr-tech, two chains of patches ready for review, https://gerrit.wikimedia.org/r/1248115 to send donor portal emails and https://gerrit.wikimedia.org/r/1248032 to get Adyen/gravy chargebacks into Civi [20:51:28] (03CR) 10Lars SG: [C:03+2] Fix typo in WorkflowMessage\SendViaQueue [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248594 (owner: 10Ejegg) [20:51:59] (03CR) 10Lars SG: [C:03+2] Updated content for donor portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248575 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [20:52:00] thanks lars [21:05:56] larssandergreen: I just pushed up the Mediawiki Donor Export job to process-control. When you get a chance could you review it and then we can push it out and test it in the wild [21:06:13] I've set the slow-start command to limit to 50 records [21:07:28] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10FR-Adyen, 07fr-current-sprint, 05MW-1.46-notes (1.46.0-wmf.16; 2026-02-17): Enable Vipps through Adyen - https://phabricator.wikimedia.org/T339937#11679188 (10Ejegg) @RKumar_WMF I can manually correct those two in CiviCRM. We basically just i... [21:14:19] (03PS1) 10Ejegg: Update SmashPig [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248608 [21:14:21] (03CR) 10Ejegg: [C:03+2] Update SmashPig [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248608 (owner: 10Ejegg) [21:14:41] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248609 [21:15:18] (03Merged) 10jenkins-bot: Fix typo in WorkflowMessage\SendViaQueue [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248594 (owner: 10Ejegg) [21:15:19] (03Merged) 10jenkins-bot: Updated content for donor portal emails [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248575 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [21:15:55] (03PS5) 10Damilare Adedoyin: Add manage donations view [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248518 [21:22:17] (03Merged) 10jenkins-bot: Update SmashPig [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1248608 (owner: 10Ejegg) [21:27:12] 14Fundraising Sprint Cheese String Theory, 14Fundraising Sprint Discworld reformatted as ntfs, 14Fundraising Sprint e^πŸ₯§πŸ‘€=yum, 06Fundraising-Backlog, and 2 others: Figure out how to move batch processing to a background task - https://phabricator.wikimedia.org/T305516#11679252 (10Eileenmcnaughton) 05Op... [21:28:17] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Email, and 4 others: Civi Searchkit should allow user to export list to acoustic - https://phabricator.wikimedia.org/T301514#11679256 (10Eileenmcnaughton) @Lars Yeah that could work - to be honest there is pro... [21:28:41] (03CR) 10Damilare Adedoyin: [C:03+2] Stop sending pending messages with adyen capture ID [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240376 (https://phabricator.wikimedia.org/T416404) (owner: 10Ejegg) [21:30:59] (03Merged) 10jenkins-bot: Stop sending pending messages with adyen capture ID [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1240376 (https://phabricator.wikimedia.org/T416404) (owner: 10Ejegg) [21:31:54] thanks damilare ! [21:32:05] np [21:33:30] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248619 [21:33:33] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248619 (owner: 10Ejegg) [21:34:10] (03PS1) 10Ejegg: Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1248621 [21:34:13] (03CR) 10Ejegg: [C:03+2] Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1248621 (owner: 10Ejegg) [21:40:51] RESOLVED: [3x] InboundInterfaceErrors: Inbound errors on interface pfw1-codfw:reth1 () - https://wikitech.wikimedia.org/wiki/Network_monitoring#Inbound/outbound_interface_errors - https://alerts.wikimedia.org/?q=alertname%3DInboundInterfaceErrors [21:42:53] (03PS1) 10Lars SG: Add filters and delete button to import reports [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248623 [21:43:54] FIRING: CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [21:43:57] (03PS2) 10Lars SG: Add filters and delete button to import reports [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248623 (https://phabricator.wikimedia.org/T416040) [21:47:07] (03CR) 10CI reject: [V:04-1] Update composer.lock for new SmashPig [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1248621 (owner: 10Ejegg) [22:01:36] (03PS2) 10Eileen: WIP / POC - harvest auth rates from payments files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248562 [22:20:49] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248609 (owner: 10Ejegg) [22:22:01] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248609 (owner: 10Ejegg) [22:22:12] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1248619 (owner: 10Ejegg) [22:41:50] (03PS3) 10Eileen: WIP / POC - harvest auth rates from payments files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248562 [22:46:34] jgleeson: donor export job on process-control looks good. days=1 is fine for testing, but we'll need 2 at a minimum for actual use [22:48:49] 10fundraising-tech-ops, 06DC-Ops, 10ops-eqiad, 06SRE: Q3:rack/setup/install frdev1003 - https://phabricator.wikimedia.org/T418928#11679677 (10Jgreen) [22:49:27] 10fundraising-tech-ops, 06DC-Ops, 10ops-eqiad, 06SRE: Q3:rack/setup/install frdev1003 - https://phabricator.wikimedia.org/T418928#11679680 (10Jgreen) >>! In T418928#11670501, @RobH wrote: > Jeff, > > I made assumptions on this since we didn't have racking details on the parent ordering task. Please doubl... [23:01:12] 03Fundraising Sprint: Dami's Crib πŸ˜€, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint, 13Patch-For-Review: Add filters to All / My Imports reports in core - https://phabricator.wikimedia.org/T416040#11679707 (10Lars) a:03Lars [23:10:01] (03CR) 10Lars SG: [C:03+1] "This looks good, but I want to give it a run through - and I need to get my civiproxy working properly to do that. But just want to say th" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248115 (https://phabricator.wikimedia.org/T416600) (owner: 10Ejegg) [23:47:24] (03PS4) 10Eileen: WIP / POC - harvest auth rates from payments files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248562 [23:47:47] (03Abandoned) 10Eileen: With friends's bells [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248561 (owner: 10Eileen) [23:47:56] (03Abandoned) 10Eileen: AuthRate entity shell [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1248560 (owner: 10Eileen)