{"id":"arxiv/2611.05869","url":"https://arxiv.org/abs/2611.05869","tags":["cs.LG","math.OC"],"score":0,"title":"On Convergence of Gradient Temporal-Difference Learning with Regularized Corrections and Eligibility Traces","domain":"cs.LG","source":"arxiv","authors":["Jingyi Jin","Martha White","Hao Wang"],"reviews":0,"subject":"cs.LG","summary":"Temporal-difference (TD) learning underlies many prediction and control algorithms, but can diverge when combined with off-policy learning, bootstrapping, and function approximation. TD with Regularized Corrections (TDRC) is theoretically sound and practically simple, but existing convergence theory covers only the one-step case under i.i.d. sampling, while the Huber Bellman-error formulation has not been extended to TDRC or eligibility traces. In this work, we establish convergence of constrained TDRC($λ$) with diminishing stepsizes and non-i.i.d. off-policy data, for state-dependent and…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-04","reactions":{}}