paper-with-me

Papers

Multilevel Picard approximations and deep neural networks with ReLU, leaky ReLU, and softplus activation overcome the curse of dimensionality when approximating semilinear parabolic partial differential equations in $L^p$-sense

2024-09-30 · Ariel Neufeld, Tuan Anh Nguyen

We prove that multilevel Picard approximations and deep neural networks with ReLU, leaky ReLU, and softplus activation are capable of approximating solutions of semilinear Kolmogorov PDEs in $L^\mathfrak{p}$-sense, $\mathfrak{p}\in [2,\infty)$, in the case of gradient-independent, Lipschitz-continuous nonlinearities, while the computational effort of the multilevel Picard approximations and the required number of parameters in the neural networks grow at most polynomially in both dimension $d\in \mathbb{N}$ and reciprocal of the prescribed accuracy $\epsilon$.

📄 PDF Abstract BibTeX arXiv:2409.20431

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

(TravEL!!Guide)How Do I File a Claim with Expedia? How Do I File a Claim with Expedia? Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Fast Help & Exclusive Travel Discounts!Need to file a claim with…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
PICARD 설명 없음

Similar Papers 제목 키워드 기반

SAU: Smooth activation function using convolution with approximate identities

2021-09-27 · Koushik Biswas, Sandeep Kumar, Shilpak Banerjee, Ashish Kumar Pandey

Well-known activation functions like ReLU or Leaky ReLU are non-differentiable at the origin. Over the years, many smooth approximations of ReLU have been proposed using various smoothing techniques. We propose new smoot…

ALReLU: A different approach on Leaky ReLU activation function to improve Neural Networks Performance

2020-12-11 · Stamatis Mastromichalakis

Despite the unresolved 'dying ReLU problem', the classical ReLU activation function (AF) has been extensively applied in Deep Neural Networks (DNN), in particular Convolutional Neural Networks (CNN), for image classifica…

ClassificationGeneral Classificationimage-classificationImage Classification

Parametric Leaky Tanh: A New Hybrid Activation Function for Deep Learning

2023-08-11 · Stamatis Mastromichalakis

Activation functions (AFs) are crucial components of deep neural networks (DNNs), having a significant impact on their performance. An activation function in a DNN is typically a smooth, nonlinear function that transform…

Implicit Bias of Gradient Descent for Two-layer ReLU and Leaky ReLU Networks on Nearly-orthogonal Data

2023-10-29 · NeurIPS 2023 11

The implicit bias towards solutions with favorable properties is believed to be a key reason why neural networks trained by gradient-based optimization can generalize well. While the implicit bias of gradient flow has be…

Empirical Evaluation of Rectified Activations in Convolutional Network

2015-05-05 · Bing Xu, Naiyan Wang, Tianqi Chen, Mu Li

In this paper we investigate the performance of different types of rectified activation functions in convolutional neural network: standard rectified linear unit (ReLU), leaky rectified linear unit (Leaky ReLU), parametr…

General Classificationimage-classificationImage Classification