paper-with-me

Papers

Stochastic approximation in infinite dimensions

2024-02-27 · Rajeeva Laxman Karandikar, Bhamidi V Rao

Stochastic Approximation (SA) was introduced in the early 1950's and has been an active area of research for several decades. While the initial focus was on statistical questions, it was seen to have applications to signal processing, convex optimisation. %Over the last decade, there has been a revival of interest in SA as In later years SA has found application in Reinforced Learning (RL) and led to revival of interest. While bulk of the literature is on SA for the case when the observations are from a finite dimensional Euclidian space, there has been interest in extending the same to infinite dimension. Extension to Hilbert spaces is relatively easier to do, but this is not so when we come to a Banach space - since in the case of a Banach space, even {\em law of large numbers} is not true in general. We consider some cases where approximation works in a Banach space. Our framework includes case when the Banach space $\Bb$ is $\Cb([0,1],\R^d)$, as well as $\L^1([0,1],\R^d)$, the two cases which do not even have the Radon-Nikodym property.

📄 PDF Abstract BibTeX arXiv:2402.17258

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Conditioning non-linear and infinite-dimensional diffusion processes

2024-02-02 · Elizabeth Louise Baker, Gefan Yang, Michael L. Severinsen, Christy Anna Hipsley 외

Generative diffusion models and many stochastic models in science and engineering naturally live in infinite dimensions before discretisation. To incorporate observed data for statistical and learning tasks, one needs to…

Time SeriesTime Series Analysis

A Study of Bayesian Neural Network Surrogates for Bayesian Optimization

2023-05-31 · Yucen Lily Li, Tim G. J. Rudner, Andrew Gordon Wilson

Bayesian optimization is a highly efficient approach to optimizing objective functions which are expensive to query. These objectives are typically represented by Gaussian process (GP) surrogate models which are easy to …

Bayesian Optimization

Deep Hilbert--Galerkin Methods for Infinite-Dimensional PDEs and Optimal Control

2026-03-19 · Samuel N. Cohen, Filippo de Feo, Jackson Hebner, Justin Sirignano arxiv

We develop deep learning-based approximation methods for fully nonlinear second-order PDEs on separable Hilbert spaces, such as HJB equations for infinite-dimensional control, by parameterizing solutions via Hilbert--Gal…

Reinforcement Learning

A Higher-Order Swiss Army Infinitesimal Jackknife

2019-07-28 · Ryan Giordano, Michael. I. Jordan, Tamara Broderick

Cross validation (CV) and the bootstrap are ubiquitous model-agnostic tools for assessing the error or variability of machine learning and statistical estimators. However, these methods require repeatedly re-fitting the …

BIG-bench Machine Learning

Uniform-in-Time Weak Error Analysis for Stochastic Gradient Descent Algorithms via Diffusion Approximation

2019-02-02 · Yuanyuan Feng, Tingran Gao, Lei LI, Jian-Guo Liu 외

Diffusion approximation provides weak approximation for stochastic gradient descent algorithms in a finite time horizon. In this paper, we introduce new tools motivated by the backward error analysis of numerical stochas…

Stochastic Optimization