paper-with-me

Papers

On best approximation by multivariate ridge functions with applications to generalized translation networks

2024-12-11 · Paul Geuchen, Palina Salanevich, Olov Schavemaker, Felix Voigtlaender

We prove sharp upper and lower bounds for the approximation of Sobolev functions by sums of multivariate ridge functions, i.e., functions of the form $\mathbb{R}^d \ni x \mapsto \sum_{k=1}^n h_k(A_k x) \in \mathbb{R}$ with $h_k : \mathbb{R}^\ell \to \mathbb{R}$ and $A_k \in \mathbb{R}^{\ell \times d}$. We show that the order of approximation asymptotically behaves as $n^{-r/(d-\ell)}$, where $r$ is the regularity of the Sobolev functions to be approximated. Our lower bound even holds when approximating $L^\infty$-Sobolev functions of regularity $r$ with error measured in $L^1$, while our upper bound applies to the approximation of $L^p$-Sobolev functions in $L^p$ for any $1 \leq p \leq \infty$. These bounds generalize well-known results about the approximation properties of univariate ridge functions to the multivariate case. Moreover, we use these bounds to obtain sharp asymptotic bounds for the approximation of Sobolev functions using generalized translation networks and complex-valued neural networks.

📄 PDF Abstract BibTeX arXiv:2412.08453

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On Sharpness of Error Bounds for Multivariate Neural Network Approximation

2020-04-05 · Steffen Goebbels

Single hidden layer feedforward neural networks can represent multivariate functions that are sums of ridge functions. These ridge functions are defined via an activation function and customizable weights. The paper deal…

Math

The Matrix Ridge Approximation: Algorithms and Applications

2013-12-17 · Zhihua Zhang

We are concerned with an approximation problem for a symmetric positive semidefinite matrix due to motivation from a class of nonlinear machine learning methods. We discuss an approximation approach that we call {matrix …

Clustering

Neural Approximation and Its Applications

2026-03-04 · Wei-Hao Wu, Ting-Zhu Huang, Xi-Le Zhao, Yisi Luo 외 arxiv

Multivariate function approximation is a fundamental problem in machine learning. Classic multivariate function approximations rely on hand-crafted basis functions (e.g., polynomial basis and Fourier basis), which limits…

Nonlinear tensor product approximation of functions

2014-09-04 · D. Bazarkhanov, V. Temlyakov

We are interested in approximation of a multivariate function $f(x_1,\dots,x_d)$ by linear combinations of products $u^1(x_1)\cdots u^d(x_d)$ of univariate functions $u^i(x_i)$, $i=1,\dots,d$. In the case $d=2$ it is a c…

Max-Min Neural Network Operators For Approximation of Multivariate Functions

2026-01-12 · Abhishek Yadav, Uaday Singh, Feng Dai arxiv

In this paper, we develop a multivariate framework for approximation by max-min neural network operators. Building on the recent advances in approximation theory by neural network operators, particularly, the univariate …