Deep-RLS: A Model-Inspired Deep Learning Approach to Nonlinear PCA
In this work, we consider the application of model-based deep learning in nonlinear principal component analysis (PCA). Inspired by the deep unfolding methodology, we propose a task-based deep learning approach, referred to as Deep-RLS, that unfolds the iterations of the well-known recursive least squares (RLS) algorithm into the layers of a deep neural network in order to perform nonlinear PCA. In particular, we formulate the nonlinear PCA for the blind source separation (BSS) problem and show through numerical analysis that Deep-RLS results in a significant improvement in the accuracy of recovering the source signals in BSS when compared to the traditional RLS algorithm.
Code (0)
등록된 구현이 없습니다.
Tasks
blind source separationDeep LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Physical Reservoir Computing Enabled by Solitary Waves and Biologically-Inspired Nonlinear Transformation of Input Data
Reservoir computing (RC) systems can efficiently forecast chaotic time series using nonlinear dynamical properties of an artificial neural network of random connections. The versatility of RC systems has motivated furthe…
Time SeriesTransformer as a hippocampal memory consolidation model based on NMDAR-inspired nonlinearity
The hippocampus plays a critical role in learning, memory, and spatial representation, processes that depend on the NMDA receptor (NMDAR). Inspired by recent findings that compare deep learning models to the hippocampus,…
Nature-Inspired Optimization Algorithms: Challenges and Open Problems
Many problems in science and engineering can be formulated as optimization problems, subject to complex nonlinear constraints. The solutions of highly nonlinear problems usually require sophisticated optimization algorit…
BenchmarkingCausality-Inspired Robustness for Nonlinear Models via Representation Learning
Distributional robustness is a central goal of prediction algorithms due to the prevalent distribution shifts in real-world data. The prediction model aims to minimize the worst-case risk among a class of distributions, …
Representation LearningApproximation-free control based on the bioinspired reference model for suspension systems with uncertainty and unknown nonlinearity
Uncertainty and unknown nonlinearity are often inevitable in the suspension systems, which were often solved using fuzzy logic system (FLS) or neural networks (NNs). However, these methods are restricted by the structura…