Negative results for approximation using single layer and multilayer feedforward neural networks
We prove a negative result for the approximation of functions defined on compact subsets of $\mathbb{R}^d$ (where $d \geq 2$) using feedforward neural networks with one hidden layer and arbitrary continuous activation function. In a nutshell, this result claims the existence of target functions that are as difficult to approximate using these neural networks as one may want. We also demonstrate an analogous result (for general $d \in \mathbb{N}$) for neural networks with an \emph{arbitrary} number of hidden layers, for activation functions that are either rational functions or continuous splines with finitely many pieces.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Controllability of Multilayer Networked Sampled-data Systems
This paper explores the state controllability of multilayer networked sampled-data systems with inter-layer couplings, where zero-order holders (ZOHs) are on the control and transmission channels. The effects of both sin…
Multilayer Correlation Clustering
In this paper, we establish Multilayer Correlation Clustering, a novel generalization of Correlation Clustering (Bansal et al., FOCS '02) to the multilayer setting. In this model, we are given a series of inputs of Corre…
ClusteringEpidemic spreading and bond percolation in multilayer networks
The Susceptible-Infected-Recovered (SIR) model is studied in multilayer networks with arbitrary number of links across the layers. By following the mapping to bond percolation we give the analytical expression for the ep…
An Approximate Backpropagation Learning Rule for Memristor Based Neural Networks Using Synaptic Plasticity
We describe an approximation to backpropagation algorithm for training deep neural networks, which is designed to work with synapses implemented with memristors. The key idea is to represent the values of both the input …
Localization of multilayer networks by the optimized single-layer rewiring
We study localization properties of principal eigenvector (PEV) of multilayer networks. Starting with a multilayer network corresponding to a delocalized PEV, we rewire the network edges using an optimization technique s…