Id: arxiv/2602.10838 Url: https://arxiv.org/abs/2602.10838 Tags: math.OC Score: 0 Title: Mirror descent actor-critic methods for entropy regularised MDPs in general spaces: stability and convergence Domain: math.OC Source: arxiv Authors: Denis Zorba, David Šiška, Lukasz Szpruch Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-11 Page: https://delphi.science/r/arxiv/2602.10838 We provide theoretical guarantees for convergence of discrete-time policy mirror descent with inexact advantage functions updated using temporal difference (TD) learning for entropy regularised MDPs in Polish state and action spaces. We rigorously derive sufficient conditions under which the single-loop actor-critic scheme is stable and convergent. To weaken these conditions, we introduce a variant that performs multiple TD steps per policy update and derive an explicit lower bound on the number of TD steps required to ensure stability. Finally, we establish sub-linear convergence when the…