paper-with-me

Papers

Error bounds for approximations with deep ReLU neural networks in $W^{s,p}$ norms

2019-02-21 · Ingo Gühring, Gitta Kutyniok, Philipp Petersen

We analyze approximation rates of deep ReLU neural networks for Sobolev-regular functions with respect to weaker Sobolev norms. First, we construct, based on a calculus of ReLU networks, artificial neural networks with ReLU activation functions that achieve certain approximation rates. Second, we establish lower bounds for the approximation by ReLU neural networks for classes of Sobolev-regular functions. Our results extend recent advances in the approximation theory of ReLU networks to the regime that is most relevant for applications in the numerical analysis of partial differential equations.

📄 PDF Abstract BibTeX arXiv:1902.07896

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Deep ReLU networks and high-order finite element methods II: Chebyshev emulation

2023-10-11 · Joost A. A. Opschoor, Christoph Schwab

We show expression rates and stability in Sobolev norms of deep feedforward ReLU neural networks (NNs) in terms of the number of parameters defining the NN for continuous, piecewise polynomial functions, on arbitrary, fi…

Error bounds for approximations with deep ReLU networks

2016-10-03 · Dmitry Yarotsky

We study expressive power of shallow and deep neural networks with piece-wise linear activation functions. We establish new rigorous upper and lower bounds for the network complexity in the setting of approximations in S…

Optimal Function Approximation with Relu Neural Networks

2019-09-09 · Bo Liu, Yi Liang

We consider in this paper the optimal approximations of convex univariate functions with feed-forward Relu neural networks. We are interested in the following question: what is the minimal approximation error given the n…

Architecture independent generalization bounds for overparametrized deep ReLU networks

2025-04-08 · Thomas Chen, Chun-Kai Kevin Chien, Patricia Muñoz Ewald, Andrew G. Moore

We prove that overparametrized neural networks are able to generalize with a test error that is independent of the level of overparametrization, and independent of the Vapnik-Chervonenkis (VC) dimension. We prove explici…

Generalization Bounds

Tighter Sparse Approximation Bounds for ReLU Neural Networks

2021-10-07 · ICLR 2022 4 · Carles Domingo-Enrich, Youssef Mroueh

A well-known line of work (Barron, 1993; Breiman, 1993; Klusowski & Barron, 2018) provides bounds on the width $n$ of a ReLU two-layer neural network needed to approximate a function $f$ over the ball $\mathcal{B}_R(\mat…