paper-with-me

홈 › Papers

Statistical Inference on Gradient Flows

2026-05-31 · Tongyu Li, Alexander Giessing arxiv

Gradient-based algorithms are central to modern statistical estimation, yet their statistical analysis is often restricted to fixed-time behavior, such as convergence to a population target or fluctuations at a prescribed iteration. In many applications, however, uncertainty quantification is needed along the entire optimization path, especially when the stopping time is data-dependent or divergent. In this paper, we develop a theory for time-uniform statistical inference on gradient flows arising from empirical risk minimization. We prove a uniform central limit theorem that characterizes the deviation between empirical and population gradient flows as a continuous-time Gaussian process over the entire nonnegative real line. Building on this result, we introduce an algorithm-aware covariance estimator that evolves jointly with the gradient flow and avoids matrix inversion, resampling, or sample splitting. We show that the covariance estimator is uniformly consistent over time and use it to construct confidence intervals for the target parameter with asymptotically valid coverage. Our results connect optimization dynamics with statistical inference and provide practical tools for uncertainty quantification in gradient-based methods.

📄 PDF Abstract BibTeX arXiv:2606.01257

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Geometry-Aware Normalizing Wasserstein Flows for Optimal Causal Inference

2023-11-30 · Kaiwen Hou

This paper presents a groundbreaking approach to causal inference by integrating continuous normalizing flows (CNFs) with parametric submodels, enhancing their geometric sensitivity and improving upon traditional Targete…

Causal Inferenceparameter estimation

Hellinger-Kantorovich Gradient Flows: Global Exponential Decay of Entropy Functionals

2025-01-28 · Alexander Mielke, Jia-Jie Zhu

We investigate a family of gradient flows of positive and probability measures, focusing on the Hellinger-Kantorovich (HK) geometry, which unifies transport mechanism of Otto-Wasserstein, and the birth-death mechanism of…

Inference Optimization

On the Convergence of Gradient Descent in GANs: MMD GAN As a Gradient Flow

2020-11-04 · Youssef Mroueh, Truyen Nguyen

We consider the maximum mean discrepancy ($\mathrm{MMD}$) GAN problem and propose a parametric kernelized gradient flow that mimics the min-max game in gradient regularized $\mathrm{MMD}$ GAN. We show that this flow prov…

Leveraging Gauge Freedom for Learning Non-Gradient Population Dynamics of Stochastic Systems

2026-05-24 · Jules Berman, Tobias Blickhan, Benjamin Peherstorfer arxiv

Existing work on population dynamics inference often focuses on flows arising from vector fields that are the gradients of scalar potentials. Among all admissible flows that are compatible with the population dynamics, g…

Approximate inference with Wasserstein gradient flows

2018-06-12 · Charlie Frogner, Tomaso Poggio

We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as…