Resolution-Consistent Greedy Neural Approximation on Infinite-Dimensional Spaces
We develop constructive approximation and learning guarantees for shallow neural models with infinite-dimensional inputs observed through finitely many coordinates. The analysis is based on a parameter-normalized neural dictionary and its associated weighted variation class. Within this class, the approximation error separates into a distribution-dependent coordinate-truncation term and a greedy finite-width term. For empirical regression, a fully-corrective greedy procedure yields population guarantees whose statistical complexity is uniform in the retained input resolution. The same framework extends to Hilbert-valued responses without an explicit dependence on the output dimension. The dimension-free statements are statistical, not computational: selecting a new neuron still requires solving a nonconvex parameter-search problem. The quasi-Polish construction underlying recent infinite-dimensional universal approximation results provides a motivating example, and synthetic experiments illustrate the predicted resolution, width, and sample-size regimes.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation
Score-based diffusion models (SBDM) have recently emerged as state-of-the-art approaches for image generation. Existing SBDMs are typically formulated in a finite-dimensional setting, where images are considered as tenso…
Image GenerationNeural Operator: Graph Kernel Network for Partial Differential Equations
The classical development of neural networks has been primarily for mappings between a finite-dimensional Euclidean space and a set of classes, or between two finite-dimensional Euclidean spaces. The purpose of this work…
On solving infinite-dimensional Toeplitz Block LMIs
This paper focuses on the resolution of infinite-dimensional Toeplitz Block LMIs, which are frequently encountered in the context of stability analysis and control design problems formulated in the harmonic framework. We…
On Universal Approximation by Neural Networks with Uniform Guarantees on Approximation of Infinite Dimensional Maps
The study of universal approximation of arbitrary functions $f: \mathcal{X} \to \mathcal{Y}$ by neural networks has a rich and thorough history dating back to Kolmogorov (1957). In the case of learning finite dimensional…
Open-Ended Question AnsweringObserver-based boundary control of distributed port-Hamiltonian systems
An observer-based boundary controller for infinite-dimensional port-Hamiltonian systems defined on 1D spatial domains is proposed. The design is based on an early-lumping approach in which a finite-dimensional approximat…