[00:18:08] PROBLEM - check_load on franio2001 is CRITICAL: LOAD CRITICAL - total load average: 19.58, 53.93, 31.03 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2001&service=check_load [00:23:08] PROBLEM - check_load on franio2001 is CRITICAL: LOAD CRITICAL - total load average: 14.18, 38.33, 31.23 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2001&service=check_load [00:28:08] PROBLEM - check_load on franio2001 is CRITICAL: LOAD CRITICAL - total load average: 3.75, 17.23, 24.09 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2001&service=check_load [00:33:10] PROBLEM - check_load on franio2001 is CRITICAL: LOAD CRITICAL - total load average: 2.58, 8.82, 18.64 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2001&service=check_load [00:48:10] RECOVERY - check_load on franio2001 is OK: LOAD OK - total load average: 1.43, 2.60, 8.55 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2001&service=check_load [01:35:06] PROBLEM - check_load on franio2003 is CRITICAL: LOAD CRITICAL - total load average: 19.18, 52.70, 35.32 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2003&service=check_load [01:40:08] PROBLEM - check_load on franio2003 is CRITICAL: LOAD CRITICAL - total load average: 2.79, 22.60, 27.11 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2003&service=check_load [01:40:47] (03PS1) 10Eileen: Debug fix - make logging error work [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1232851 [01:43:14] !log config revision changed from 2f71107f to ed0808a9 switch to php dlocal downloader (now weekend is mostly over) - [01:43:15] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [01:45:06] PROBLEM - check_load on franio2003 is CRITICAL: LOAD CRITICAL - total load average: 2.05, 9.65, 20.24 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2003&service=check_load [01:48:24] (03PS1) 10Eileen: Fix sort_key to cope with new filename syntax [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1232854 [01:53:08] PROBLEM - check_load on franio2002 is CRITICAL: LOAD CRITICAL - total load average: 5.99, 29.62, 22.89 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2002&service=check_load [01:58:08] PROBLEM - check_load on franio2002 is CRITICAL: LOAD CRITICAL - total load average: 6.13, 13.18, 17.47 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2002&service=check_load [02:00:06] RECOVERY - check_load on franio2003 is OK: LOAD OK - total load average: 1.67, 2.55, 8.86 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2003&service=check_load [02:13:08] RECOVERY - check_load on franio2002 is OK: LOAD OK - total load average: 5.85, 3.73, 8.32 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=franio2002&service=check_load [10:02:37] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 07fr-payments-ACH: Recurring ACH looks like a success but then is actually failed - https://phabricator.wikimedia.org/T409471#11552963 (10RLewis) @MBeat33 - thanks just to confirm, this donation should not be showing in Civi? [14:09:56] (03PS2) 10Esanders: eslint: Fix max-len warnings [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219567 [14:10:19] (03PS2) 10Esanders: eslint: Fix no-done-fail warnings [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219568 [14:10:24] (03PS2) 10Esanders: eslint: Fix some remaining warnings [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219569 [14:13:31] (03CR) 10CI reject: [V:04-1] eslint: Fix some remaining warnings [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219569 (owner: 10Esanders) [14:14:00] (03CR) 10CI reject: [V:04-1] eslint: Fix no-done-fail warnings [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1219568 (owner: 10Esanders) [15:49:47] (03PS3) 10Ejegg: Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) [16:06:21] (03PS8) 10Ejegg: Add API4 MatchingGiftPolicies.export [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1204920 (https://phabricator.wikimedia.org/T410052) [16:06:21] (03PS6) 10Ejegg: More type hints for matching gifts classes [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1204925 (https://phabricator.wikimedia.org/T410052) [16:06:21] (03PS6) 10Ejegg: Add API4 MatchingGiftPolicies.fetch and .sync [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1204993 (https://phabricator.wikimedia.org/T410052) [16:06:51] (03PS4) 10Ejegg: FailureEmail::send can send first or second [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230968 (https://phabricator.wikimedia.org/T365488) [16:07:58] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 07fr-payments-ACH: Recurring ACH looks like a success but then is actually failed - https://phabricator.wikimedia.org/T409471#11554302 (10MBeat33) @RLewis yeah, this transaction stopped at Gravy at //Declined: suspected_fraud//, so we never received the... [16:08:02] (03CR) 10CI reject: [V:04-1] Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) (owner: 10Ejegg) [16:16:17] (03PS4) 10Ejegg: Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) [16:21:22] (03PS1) 10Lars SG: Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - 10https://gerrit.wikimedia.org/r/1233209 [16:24:52] (03PS2) 10Lars SG: Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - 10https://gerrit.wikimedia.org/r/1233209 [16:26:57] (03CR) 10Lars SG: [C:03+2] Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - 10https://gerrit.wikimedia.org/r/1233209 (owner: 10Lars SG) [16:27:30] (03Merged) 10jenkins-bot: Merge branch 'master' into deploy [wikimedia/fundraising/tools] (deploy) - 10https://gerrit.wikimedia.org/r/1233209 (owner: 10Lars SG) [16:31:42] reverting the reverted trustly smashpig and crm patches. I think the friday failures were because of the standalone deploy [16:32:29] !log tools upgraded from c75f7625 to 84323460 [16:32:30] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [16:34:24] damilare: we didnt deploy it though? or did we [16:35:04] yh that's why it was failed, I should have deployed those first [16:35:17] failing* [16:36:13] i guess i didnt see any deployment patches in the gerrit log [16:36:25] (03CR) 10CI reject: [V:04-1] Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) (owner: 10Ejegg) [16:36:58] nah it was not deployed, I'd do that now [16:38:27] (03PS1) 10Wfan: update container id name to make it clearer [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1233212 [16:38:41] ooh okay that makes sense now [16:47:39] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07Epic, 07fr-current-sprint: Show which contacts have double opted in / still need double opt in in Acoustic - https://phabricator.wikimedia.org/T413812#11554535 (10Lars) @NNgu-WMF Cutting this one a bit close as it t... [16:49:49] (03PS1) 10Damilare Adedoyin: Revert^2 "Specify the type of trustly transactions to send chargeback messages for." [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1233215 [16:58:20] (03PS4) 10Wfan: Apple session already exist issue [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1222510 (https://phabricator.wikimedia.org/T407584) [17:02:20] gonna go shovel more [17:02:37] (03CR) 10Damilare Adedoyin: [C:03+2] Revert^2 "Specify the type of trustly transactions to send chargeback messages for." [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1233215 (owner: 10Damilare Adedoyin) [17:03:49] (03Merged) 10jenkins-bot: Revert^2 "Specify the type of trustly transactions to send chargeback messages for." [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1233215 (owner: 10Damilare Adedoyin) [17:06:16] 10fundraising-tech-ops, 06DC-Ops, 10ops-codfw, 06SRE: Q2:install (1) SSD each into franio200[1-3] - https://phabricator.wikimedia.org/T405982#11554629 (10Dwisehaupt) a:03Jhancock.wm Forgot to assign @Jhancock.wm after mentioning. Doing so to bubble it up. Thanks. [17:07:11] (03PS1) 10Damilare Adedoyin: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1233220 [17:07:49] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for mduseja - https://phabricator.wikimedia.org/T415569 (10Dwisehaupt) 03NEW [17:07:51] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for ejohnston - https://phabricator.wikimedia.org/T415570 (10Dwisehaupt) 03NEW [17:07:53] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for cvirtue - https://phabricator.wikimedia.org/T415571 (10Dwisehaupt) 03NEW [17:07:56] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for khansen - https://phabricator.wikimedia.org/T415572 (10Dwisehaupt) 03NEW [17:07:58] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for iackerman - https://phabricator.wikimedia.org/T415573 (10Dwisehaupt) 03NEW [17:09:38] (03PS2) 10Damilare Adedoyin: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1233220 [17:12:20] (03CR) 10Damilare Adedoyin: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1233220 (owner: 10Damilare Adedoyin) [17:13:10] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1233220 (owner: 10Damilare Adedoyin) [17:15:04] !log smashpig upgraded from 8b4ebf34 to 96a6224d [17:15:04] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [17:32:53] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07Epic, 07fr-current-sprint: Show which contacts have double opted in / still need double opt in in Acoustic - https://phabricator.wikimedia.org/T413812#11554834 (10NNgu-WMF) Thanks Lars! Will the field say "true" or... [17:34:53] (03PS5) 10Wfan: Apple session already exist issue [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1222510 (https://phabricator.wikimedia.org/T407584) [17:46:44] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07Epic, 07fr-current-sprint: Show which contacts have double opted in / still need double opt in in Acoustic - https://phabricator.wikimedia.org/T413812#11554905 (10Lars) @NNgu-WMF It's Yes/No same as is_orphan, AF_ha... [18:18:56] (03PS6) 10Wfan: Apple session already exist issue [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1222510 (https://phabricator.wikimedia.org/T407584) [18:25:32] (03CR) 10Cstone: [C:03+2] "thanks for this, i see it on the queue!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1224231 (https://phabricator.wikimedia.org/T400765) (owner: 10Wfan) [18:25:56] Thanks cstone! [18:50:24] (03Merged) 10jenkins-bot: Add payer id to message queue as external_identifier [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1224231 (https://phabricator.wikimedia.org/T400765) (owner: 10Wfan) [19:01:15] 06Fundraising-Backlog: Experiment: On-wiki donations using native HTML5 Payment Request API - https://phabricator.wikimedia.org/T415586 (10jgleeson) 03NEW [19:04:58] wfan: is there a patch where we get the gravy paypal payer id on the queue? [19:05:28] https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/SmashPig/+/1222300 [19:07:25] (03PS7) 10Wfan: Apple session already exist issue [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1222510 (https://phabricator.wikimedia.org/T407584) [19:09:00] (03PS8) 10Wfan: Apple session already exist issue [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1222510 (https://phabricator.wikimedia.org/T407584) [19:11:06] but like from the front end wfan like the paypal patch? [19:22:54] (03PS1) 10Cstone: Revert^2 "Do not skip Trustly refund when Contribution is not found." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233251 [19:26:05] oh we do not have that since the frontend one, since gravy had that handled before for gravy id [19:26:43] src/payments/extensions/DonationInterface/gravy_gateway/gravy.adapter.php line 611 [19:27:31] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add set modified date to now SearchKit task - https://phabricator.wikimedia.org/T415397#11555269 (10Lars) a:03Lars [19:28:53] (03PS1) 10Wfan: Update wording to indicate the external_identifier used for venmo and paypal payer id [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1233252 (https://phabricator.wikimedia.org/T400765) [19:29:15] cstone: so it shared the function, which we actually no longer pass gravy buyer id, so I updated the wording here https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/1233252 [19:29:50] we would expect to see it on the queue though? i just wasnt seeing it from the front end [19:29:56] or is tht a sandbox issue [19:33:58] So the new patch I had will cover the frontend part. Combined with the smashpig one you can see it in the queue [19:36:37] hmm maybe i am missing something then [19:44:25] (03CR) 10Cstone: [C:03+2] Dial back noise on PayPal TRR processing [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1231030 (owner: 10Eileen) [19:45:47] (03Merged) 10jenkins-bot: Dial back noise on PayPal TRR processing [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1231030 (owner: 10Eileen) [20:01:11] (03PS1) 10Eileen: Slightly more progress info on audit [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233256 [20:09:45] (03PS5) 10Ejegg: Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) [20:14:46] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Contribution imported to trashed contact because the contact was merged after data entered in batch - https://phabricator.wikimedia.org/T415327#11555377 (10Lars) a:03Lars [20:21:44] (03CR) 10CI reject: [V:04-1] Slightly more progress info on audit [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233256 (owner: 10Eileen) [20:28:21] (03CR) 10CI reject: [V:04-1] Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) (owner: 10Ejegg) [20:28:26] (03PS1) 10Pcoombe: Add SEPA in Bulgaria [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1233260 [20:32:52] can someone review the above and let me know once it's deployed so I can enable on donatewiki? no rush at all on this though [20:34:16] 06Fundraising-Backlog, 10fundraising-tech-ops: Repeat sql queries created giant sort indexes and needed to be terminated - https://phabricator.wikimedia.org/T415392#11555426 (10Lars) @Damilare It looks like the issue might be sorting by so many columns (`ORDER BY a.id ASC, a.tracking_date ASC, a.amount ASC, a.... [20:47:43] (03PS6) 10Ejegg: Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) [20:49:44] 03Fundraising Sprint: ARMchair, 14Fundraising Sprint: Vixen, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Determine final exchange rate for Adyen settlements in non-USD - https://phabricator.wikimedia.org/T409249#11555458 (10Eileenmcnaughton) [20:49:46] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add set modified date to now SearchKit task - https://phabricator.wikimedia.org/T415397#11555459 (10Damilare) 05Open→03Resolved [20:49:57] 03Fundraising Sprint: ARMchair, 14Fundraising Sprint: Vixen, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Determine final exchange rate for Adyen settlements in non-USD - https://phabricator.wikimedia.org/T409249#11555462 (10Eileenmcnaughton) Getting these from Intacct now [20:50:07] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donor-portal, 07fr-current-sprint: Add checksum invalidation API action to CiviCRM - https://phabricator.wikimedia.org/T412429#11555463 (10Damilare) 05Open→03Resolved [20:50:38] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07Epic, 07fr-current-sprint: Show which contacts have double opted in / still need double opt in in Acoustic - https://phabricator.wikimedia.org/T413812#11555466 (10Damilare) 05Open→03Resolved [20:51:12] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Show last donor portal login date in CiviCRM - https://phabricator.wikimedia.org/T413112#11555470 (10Damilare) 05Open→03Resolved [20:51:23] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 07fr-current-sprint: CentralNotice config changes to show a banner to a reader with the 'waitdate: close' status - https://phabricator.wikimedia.org/T411800#11555472 (10Damilare) 05Open→03Resolved [20:51:31] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10fundraising-tech-ops: Get Trustly Reconciliation reports downloading - https://phabricator.wikimedia.org/T415135#11555475 (10Cstone) a:03Cstone got config today, need to decide where to put it [20:51:39] 03Fundraising Sprint: ARMchair, 14Fundraising Sprint: Vixen, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Determine final exchange rate for Adyen settlements in non-USD - https://phabricator.wikimedia.org/T409249#11555477 (10Damilare) 05Open→03Resolved [20:54:10] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 06FR-donorrelations, 07fr-current-sprint: Suppress recurrings with only one charge from the recurring email receipt - https://phabricator.wikimedia.org/T413907#11555481 (10Damilare) 05Open→03Resolved [20:54:34] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit, 07fr-current-sprint: Add process to upload the Intact files - https://phabricator.wikimedia.org/T410101#11555484 (10Damilare) 05Open→03Resolved [20:55:12] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, 07fr-current-sprint: Add soft credit search action to CiviCRM - https://phabricator.wikimedia.org/T413822#11555486 (10Damilare) 05Open→03Resolved [20:55:25] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Add Double Opt-in email template to Civi - https://phabricator.wikimedia.org/T414387#11555489 (10Damilare) 05Open→03Resolved [20:56:47] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, 13Patch-For-Review: Date format isn't saved on import form for contacts if starting from Import Templates - https://phabricator.wikimedia.org/T415314#11555492 (10Damilare) 05Open→03Re... [20:56:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Delete all dedupe exceptions for Japan - https://phabricator.wikimedia.org/T415331#11555494 (10Damilare) 05Open→03Resolved [20:57:06] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Donor portal: Only show donations from donors with same email if it is primary - https://phabricator.wikimedia.org/T415225#11555496 (10Damilare) 05Open→03Resolved [20:57:30] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Thank you email fails to send but reports success - https://phabricator.wikimedia.org/T414250#11555499 (10Damilare) 05Open→03Resolved [20:57:55] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Direct Mail Activity Import File - December 2025 List - https://phabricator.wikimedia.org/T414391#11555501 (10Damilare) 05Open→03Resolved [20:58:01] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Contributions imported from gravy audit are in CiviCRM in non-USD currencies - https://phabricator.wikimedia.org/T405765#11555503 (10Ejegg) a:03Ejegg [20:58:16] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 07Wikimedia-production-error: BannerExistenceException: Banner by that name already exists! - https://phabricator.wikimedia.org/T286673#11555504 (10Ejegg) a:03Ejegg [20:58:21] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Large file to import - January DM Activities - https://phabricator.wikimedia.org/T414709#11555505 (10Damilare) 05Open→03Resolved [21:00:06] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 07Wikimedia-production-error: BannerExistenceException: Banner by that name already exists! - https://phabricator.wikimedia.org/T286673#11555513 (10Damilare) 05Open→03Resolved p:05Triage→03Medium [21:00:23] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: {wmf_url.unsubscribe} has "invalidChecksum" - https://phabricator.wikimedia.org/T415097#11555516 (10Damilare) [21:00:32] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: {wmf_url.unsubscribe} has "invalidChecksum" - https://phabricator.wikimedia.org/T415097#11555517 (10Damilare) 05Open→03Resolved [21:00:47] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Unable to complete cash donation on Uruguay donation form - https://phabricator.wikimedia.org/T412064#11555521 (10Damilare) 05Open→03Resolved [21:02:20] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Duplicate donations made via Apple Pay and Google Pay from the WP app - https://phabricator.wikimedia.org/T407383#11555523 (10Damilare) 05Open→03Resolved [21:02:53] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Contributions imported from gravy audit are in CiviCRM in non-USD currencies - https://phabricator.wikimedia.org/T405765#11555528 (10Damilare) 05Open→03Resolved [21:03:21] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Provide checksum_value token (which doesn't include cs=) - https://phabricator.wikimedia.org/T415092#11555530 (10Damilare) 05Open→03Resolved [21:03:59] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, 13Patch-For-Review: NCOA Update import not working - https://phabricator.wikimedia.org/T410574#11555532 (10Damilare) 05Open→03Resolved [21:04:21] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Creation of new anonymous records on donation import - https://phabricator.wikimedia.org/T394731#11555534 (10Damilare) 05Open→03Resolved [21:04:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: contact_id in email link having contact_id=%%CONTACTID%% instead of contact_id=1234 is breaking the queues - https://phabricator.wikimedia.org/T413452#11555538 (10Damilare) 05Open→03Resolved [21:05:11] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Snooze activities when DR snooze a contact look like they are created by the contact - https://phabricator.wikimedia.org/T412564#11555540 (10Damilare) 05Open→03Resolved [21:05:33] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10fundraising-tech-ops: Thank you email metrics causing occasional prometheus parsing errors due to lack of value - https://phabricator.wikimedia.org/T411439#11555542 (10Damilare) 05Open→03Resolved [21:06:12] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Pending Transaction Resolver: Payment is not awaiting approval - current status: pending / timeout - https://phabricator.wikimedia.org/T403958#11555544 (10Damilare) 05Open→03Resolved [21:06:30] (03CR) 10CI reject: [V:04-1] Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) (owner: 10Ejegg) [21:22:01] (03PS7) 10Ejegg: Map IDs for merged contacts in omnirecipient load [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1230940 (https://phabricator.wikimedia.org/T404404) [22:05:09] 06Fundraising-Backlog, 10fundraising-tech-ops: Repeat sql queries created giant sort indexes and needed to be terminated - https://phabricator.wikimedia.org/T415392#11555725 (10Damilare) That's interesting @Lars. I don't think I specified the order in Searchkit, at least not intentionally. I certainly don't ne... [22:08:47] 06Fundraising-Backlog, 10fundraising-tech-ops: Repeat sql queries created giant sort indexes and needed to be terminated - https://phabricator.wikimedia.org/T415392#11555734 (10Lars) @Damilare You're right, it looks like SK is adding those. Did you change the SK already? I just tried it and it returned results... [22:10:12] 06Fundraising-Backlog, 10fundraising-tech-ops: Repeat sql queries created giant sort indexes and needed to be terminated - https://phabricator.wikimedia.org/T415392#11555737 (10Damilare) No I haven't used it today. If you ran it earlier, it could have cached the results. [22:17:36] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Chariot import fails when there is no exact match found for organization name - https://phabricator.wikimedia.org/T415295#11555752 (10Lars) @MDemosWMF Is that error message "Did not find exact... [22:18:56] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for ewilfong - https://phabricator.wikimedia.org/T415124#11555754 (10EWilfong_WMF) Confirming receipt and installation. Thanks! [22:23:26] (03PS2) 10Eileen: Slightly more progress info on audit [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233256 [22:42:59] lars this is finally passing tests: https://gerrit.wikimedia.org/r/1230940 [22:44:52] 10fundraising-tech-ops: create cli tooling to handle alert/silence management for frack prometheus based alerts - https://phabricator.wikimedia.org/T415604 (10Dwisehaupt) 03NEW [22:45:14] 10fundraising-tech-ops: create cli tooling to handle alert/silence management for frack prometheus based alerts - https://phabricator.wikimedia.org/T415604#11555864 (10Dwisehaupt) [22:45:15] 06Fundraising-Backlog, 10fundraising-tech-ops, 10Observability-Alerting: Shift frack alerting to use prometheus-alertmanager instead of icinga - https://phabricator.wikimedia.org/T367370#11555865 (10Dwisehaupt) [22:51:30] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit, 07fr-current-sprint: Handle paypal recurrings coming in through audit with no transactionLog data - https://phabricator.wikimedia.org/T415606 (10Eileenmcnaughton) 03NEW [22:57:57] (03PS1) 10Eileen: Handle Paypal recurrings where the only data we have is subscr_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233305 (https://phabricator.wikimedia.org/T415606) [23:03:28] (03CR) 10Cstone: [C:03+2] Revert^2 "Do not skip Trustly refund when Contribution is not found." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233251 (owner: 10Cstone) [23:03:51] lol that one keeps bouncing back and forth [23:06:53] (03CR) 10CI reject: [V:04-1] Handle Paypal recurrings where the only data we have is subscr_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233305 (https://phabricator.wikimedia.org/T415606) (owner: 10Eileen) [23:09:23] (03PS2) 10Eileen: Handle Paypal recurrings where the only data we have is subscr_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233305 (https://phabricator.wikimedia.org/T415606) [23:10:13] (03PS1) 10Lars SG: Only sort contribution trackings by id by default [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233306 (https://phabricator.wikimedia.org/T415392) [23:13:07] 06Fundraising-Backlog, 10fundraising-tech-ops, 13Patch-For-Review: Repeat sql queries created giant sort indexes and needed to be terminated - https://phabricator.wikimedia.org/T415392#11555960 (10Lars) Oh, I see that those are the default orderby added by the API, which it turns out uses the @searchFields a... [23:22:18] (03CR) 10CI reject: [V:04-1] Handle Paypal recurrings where the only data we have is subscr_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233305 (https://phabricator.wikimedia.org/T415606) (owner: 10Eileen) [23:23:29] (03CR) 10Eileen: "recheck" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233305 (https://phabricator.wikimedia.org/T415606) (owner: 10Eileen) [23:26:02] (03Merged) 10jenkins-bot: Revert^2 "Do not skip Trustly refund when Contribution is not found." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233251 (owner: 10Cstone) [23:27:55] 10fundraising-tech-ops: create cli tooling to handle alert/silence management for frack prometheus based alerts - https://phabricator.wikimedia.org/T415604#11555983 (10Dwisehaupt) [23:29:11] (03PS1) 10Cstone: Update smash-pig to v1.1.1.4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233307 [23:31:45] (03CR) 10Cstone: [C:03+2] Update smash-pig to v1.1.1.4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233307 (owner: 10Cstone) [23:45:50] 10Fundraising analytics stack, 10fundraising-tech-ops: reconfigure codfw minio cluster after additional devices added - https://phabricator.wikimedia.org/T415609 (10Dwisehaupt) 03NEW [23:46:32] 06Fundraising-Backlog, 10fundraising-tech-ops: FR-Tech FY2526Q3 maintenance window - https://phabricator.wikimedia.org/T364185#11556032 (10Dwisehaupt) [23:48:52] (03Merged) 10jenkins-bot: Update smash-pig to v1.1.1.4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1233307 (owner: 10Cstone)