{"id":"arxiv/2611.23596","url":"https://arxiv.org/abs/2611.23596","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Efficient Variance-Aware Reinforcement Learning in Time-Inhomogeneous Linear MDPs","domain":"cs.LG","source":"arxiv","authors":["Qingyue Zhao","Qiwei Di","Jiafan He","Heyang Zhao","Kaixuan Ji","Quanquan Gu"],"reviews":0,"subject":"cs.LG","summary":"We study variance-dependent reinforcement learning in episodic time-inhomogeneous linear Markov decision processes (MDPs) with feature dimension $d$, horizon $H$, and $K$ episodes. While recent works have established variance-dependent regret with $\\tilde{O}(1)$ deterministic-regime overhead for linear mixture MDPs (Zhao et al., 2023) and worst-case nearly minimax optimal regret $\\tilde{O}(d\\sqrt{H^3 K} + d^7 H^8)$ for linear MDPs (He et al., 2023),, existing variance-aware analyses for linear MDPs (Li and Sun, 2023; Huang et al., 2023) rely on a coarse concentration step whose resulting…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-17","reactions":{}}