Id: arxiv/2611.22198 Url: https://arxiv.org/abs/2611.22198 Tags: math.ST, stat.ML Score: 0 Title: Training Neural Networks to be Locally Adaptive Domain: math.ST Source: arxiv Authors: Bilol Banerjee, Soham Sarkar Reviews: 0 Subject: math.ST Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-11-17 Page: https://delphi.science/r/arxiv/2611.22198 Deep neural networks fitted by global empirical risk minimization commit to a single model for the entire covariate space. In a regression problem, if the regression function $f_0$ is inhomogeneous --- varying rapidly in one region, while being nearly flat in another --- no single model can be appropriate everywhere, and the fit degrades where the function varies most rapidly. Here we study an alternative in which, instead of fitting the network globally, we fit it locally. For each query point $x$, a \emph{local neural network} is trained on the $k$ nearest-neighbours of $x$ alone, making…