[07:00:25] <wikibugs>	 06Machine-Learning-Team, 06Language and Product Localization: Host sentence-transformers/LaBSE model in LiftWing - https://phabricator.wikimedia.org/T416659 (10santhosh) 03NEW
[09:02:56] <wikibugs>	 (03PS1) 10Santhosh: embeddings: Remove unused dependency: ctranslate2 [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1237449
[10:27:32] <wikibugs>	 (03CR) 10Kevin Bazira: [C:03+2] "Thanks for the patch :)" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1237449 (owner: 10Santhosh)
[10:28:56] <wikibugs>	 (03Merged) 10jenkins-bot: embeddings: Remove unused dependency: ctranslate2 [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1237449 (owner: 10Santhosh)
[11:46:44] <jinxer-wm>	 FIRING: LiftWingServiceErrorRate: ...
[11:46:44] <jinxer-wm>	 LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=revscoring-editquality-damaging&var-backend=svwiki-damaging-predictor-default.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate
[12:14:46] <kevinbazira>	 looking --^
[12:43:03] <wikibugs>	 06Machine-Learning-Team, 06Data-Engineering, 10Event-Platform: Add Multilingual RevertRisk predictions to mediawiki.page_revert_risk_prediction_change - https://phabricator.wikimedia.org/T415892#11591172 (10gkyziridis) Hey, I am working on this, I think that I have finished the implementation for publishing...
[12:56:44] <jinxer-wm>	 RESOLVED: LiftWingServiceErrorRate: ...
[12:56:44] <jinxer-wm>	 LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=revscoring-editquality-damaging&var-backend=svwiki-damaging-predictor-default.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate
[12:58:34] <kevinbazira>	 \o/
[13:06:04] <wikibugs>	 06Machine-Learning-Team, 06Data-Platform-SRE (2026.01.23 - 2026.02.13), 06Editing-team (Tracking), 07Essential-Work: Build model training pipeline for tone check using WMF ML Airflow instance - https://phabricator.wikimedia.org/T396495#11591229 (10gkyziridis) 05Open→03Resolved
[13:07:29] <wikibugs>	 06Machine-Learning-Team, 13Patch-For-Review: Export retrained Tone-check model to an S3 bucket - https://phabricator.wikimedia.org/T406217#11591235 (10gkyziridis) 05Open→03Resolved
[13:13:43] <wikibugs>	 06Machine-Learning-Team, 05Goal: Q1 FY2025-26 Goal: Airflow training pipeline for Tone check model - https://phabricator.wikimedia.org/T398970#11591246 (10gkyziridis) === Update === Since T406217 is completed and deployed, the tone-check retraining pipeline is in place. The current airflow pipeline for tone-ch...
[13:18:28] <wikibugs>	 06Machine-Learning-Team, 06Data-Platform-SRE (2026.01.23 - 2026.02.13), 06Editing-team (Tracking), 07Essential-Work: Build model training pipeline for tone check using WMF ML Airflow instance - https://phabricator.wikimedia.org/T396495#11591265 (10gkyziridis) === Update === Since the task: T406217 is f...
[13:38:38] <wikibugs>	 10Lift-Wing, 06Machine-Learning-Team, 10Wikidata, 06Wikimedia Enterprise, and 3 others: Q2 FY2025-26 Goal: Host Wikidata Revert Risk model on LiftWing - https://phabricator.wikimedia.org/T406179#11591382 (10kevinbazira) **Weekly Update:** - Investigated server-side errors thrown in rr-wikidata (T414060#115...