Universal Approximation Using Shuffled Linear Models
This paper proposes a specific type of Local Linear Model, the Shuffled Linear Model (SLM), that can be used as a universal approximator. Local operating points are chosen randomly and linear models are used to approximate a function or system around these points. The model can also be interpreted as an extension to Extreme Learning Machines with Radial Basis Function nodes, or as a specific way of using Takagi-Sugeno fuzzy models. Using the available theory of Extreme Learning Machines, universal approximation of the SLM and an upper bound on the number of models are proved mathematically, and an efficient algorithm is proposed.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Global universal approximation with Brownian signatures
We establish $L^p$-universal approximation theorems for general path-dependent and non-anticipative functionals on suitable rough path spaces, showing that linear functionals acting on signatures of time-extended rough p…
Gaussian ProcessesShuffled Linear Regression via Spectral Matching
Shuffled linear regression (SLR) seeks to estimate latent features through a linear transformation, complicated by unknown permutations in the measurement dimensions. This problem extends traditional least-squares (LS) a…
Image RegistrationregressionWeighted universal approximation of differentiable maps on infinite-dimensional manifolds
We generalize the universal approximation theorem for functional input neural networks (FNN) to differentiable maps by including the approximation of the derivatives. A FNN maps the input from a possibly infinite-dimensi…
Universal Approximation of Continuous Functionals on Compact Subsets via Linear Measurements and Scalar Nonlinearities
We study universal approximation of continuous functionals on compact subsets of products of Hilbert spaces. We prove that any such functional can be uniformly approximated by models that first take finitely many continu…
Projection Methods for Operator Learning and Universal Approximation
We obtain a new universal approximation theorem for continuous (possibly nonlinear) operators on arbitrary Banach spaces using the Leray-Schauder mapping. Moreover, we introduce and study a method for operator learning i…
Operator learning