Id: arxiv/2602.18003 Url: https://arxiv.org/abs/2602.18003 Tags: math.OC, cs.CC Score: 0 Title: Policy Gradient Algorithms in Average-Reward Multichain MDPs Domain: math.OC Source: arxiv Authors: Jongmin Lee, Ernest K. Ryu Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-20 Page: https://delphi.science/r/arxiv/2602.18003 While there is an extensive body of research analyzing policy gradient methods for discounted cumulative-reward MDPs, prior work on policy gradient methods for average-reward MDPs has been limited, with most existing results restricted to ergodic or unichain settings. In this work, we first establish a policy gradient theorem for average-reward multichain MDPs based on the invariance of the classification of recurrent and transient states. Building on this foundation, we develop refined analyses and obtain a collection of convergence and sample-complexity results that advance the…