[11:36:36] !log jeanfred@tools-bastion-15 tools.integraality Deploy d2cdb4d (Pass explicit endpoint to SparqlQuery to avoid Site creation) [11:36:36] !log jeanfred@tools-bastion-15 tools.integraality Deploy a8dd1ed (Remove unused self.repo from PagesProcessor) [11:36:36] !log jeanfred@tools-bastion-15 tools.integraality Deploy c7f3a04 (Make pywikibot.Site creation lazy in PagesProcessor) [11:36:36] !log jeanfred@tools-bastion-15 tools.integraality Deploy 35b1283 (Derive cache key from URL to avoid triggering pywikibot Site creation) [11:36:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL [11:36:39] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL [11:36:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL [11:36:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL [11:59:26] !log draining tools-k8s-worker-106 to investigate T425172 [11:59:28] taavi: Unknown project "draining" [11:59:29] T425172: Toolforge web egress with Istio/Envoy seems slow - https://phabricator.wikimedia.org/T425172 [12:02:53] !log tools draining tools-k8s-worker-106 to investigate T425172 [12:02:55] bah [12:02:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:19:07] Do you know if there is any more extended documentation to change-prop. I am facing problems with deadlocks as jobs that write on the database block eachother. On the other hand I don't want to limit the concurency for all jobs as the load caused by the opensearch updates is high and can only be settled with a high degree of parallelism. this is not a problem as [12:19:07] those jobs don't [12:19:08] seem to write to the database. Our changeprop config looks like this https://github.com/MaRDI4NFDI/portal-k8s/blob/main/charts/change-propagation/templates/configmap.yaml and I would like to split the template that processes mediawiki.job.* in two seperate templates. One default template and one template that is only for the job that writes to the db extensively by [12:19:08] moving pages [12:54:17] !log jeanfred@tools-bastion-15 tools.integraality Deploy 6f644fd (Add --warm-cache-only option to populate Redis without running queries) [12:54:19] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL [13:25:08] codesearch has been down for at least an hour. Is anyone on it? [13:28:18] yes, admins have been pinged and are looking into it. see also T425650 [13:28:18] T425650: Codesearch is down (2026-05-07) - https://phabricator.wikimedia.org/T425650 [13:34:31] aputhin: thanks! [13:47:47] cluebotng has failed to schedule for 1 hour due to insufficient memory, are there some nodes out of the cluster currently? [13:59:23] Damianz: I don't think so, RAM usage is quite high but I'm surprised it's high enough to prevent scheduling [13:59:35] how much RAM is your pod requesting? [14:12:35] 2Gi - that's been the same for about 7 months. I can try clearing and re-deploying the job in a min, it just alerted for not editing so noticed. [15:34:24] seems cpu is the bigger issue, made T425696 [15:34:25] T425696: restarted pod failed to schedule due to resource constraints - https://phabricator.wikimedia.org/T425696 [15:54:08] Damianz: weird, in theory cpu requests are only at 57% overall https://grafana.wmcloud.org/d/8GiwHDL4k/infra-kubernetes-cluster-overview [15:54:21] thanks for opening the phab [15:57:03] it seems a bit odd, on a course this week so don't have a lot of time to dig... got to run now, will update the ticket if it alerts as down again [16:21:27] !log gergesshamon@tools-bastion-15 tools.wikimonitor [DEPLOY] Starting deployment | ref=v1.5.5 [16:21:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikimonitor/SAL [16:23:10] !log gergesshamon@tools-bastion-15 tools.wikimonitor [DEPLOY] Build triggered successfully | ref=v1.5.5 [16:23:10] !log gergesshamon@tools-bastion-15 tools.wikimonitor [DEPLOY] Restarting buildservice | ref=v1.5.5 [16:23:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikimonitor/SAL [16:23:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikimonitor/SAL [21:29:43] !log paws rebooting all worker nodes to pick up modprobe changes [21:29:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL