paper-with-me

홈 › Papers

Nonlinear Independent Component Analysis for Discrete-Time and Continuous-Time Signals

2021-02-04 · Alexander Schell, Harald Oberhauser

We study the classical problem of recovering a multidimensional source signal from observations of nonlinear mixtures of this signal. We show that this recovery is possible (up to a permutation and monotone scaling of the source's original component signals) if the mixture is due to a sufficiently differentiable and invertible but otherwise arbitrarily nonlinear function and the component signals of the source are statistically independent with 'non-degenerate' second-order statistics. The latter assumption requires the source signal to meet one of three regularity conditions which essentially ensure that the source is sufficiently far away from the non-recoverable extremes of being deterministic or constant in time. These assumptions, which cover many popular time series models and stochastic processes, allow us to reformulate the initial problem of nonlinear blind source separation as a simple-to-state problem of optimisation-based function approximation. We propose to solve this approximation problem by minimizing a novel type of objective function that efficiently quantifies the mutual statistical dependence between multiple stochastic processes via cumulant-like statistics. This yields a scalable and direct new method for nonlinear Independent Component Analysis with widely applicable theoretical guarantees and for which our experiments indicate good performance.

📄 PDF Abstract BibTeX arXiv:2102.02876

Code (1)

alexander-schell/SigNICA 공식 구현 pytorch

Tasks

blind source separationContrastive LearningTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
ICA _Independent component analysis (ICA) is a statistical and computational technique for revealing hidden factors that underlie sets of random variables, measurements, or…

Similar Papers 제목 키워드 기반

Discrete Independent Component Analysis (DICA) with Belief Propagation

2015-05-26 · Francesco A. N. Palmieri, Amedeo Buonanno

We apply belief propagation to a Bayesian bipartite graph composed of discrete independent hidden variables and discrete visible variables. The network is the Discrete counterpart of Independent Component Analysis (DICA)…

Nonlinear Independent Component Analysis for Principled Disentanglement in Unsupervised Deep Learning

2023-03-29 · Aapo Hyvarinen, Ilyes Khemakhem, Hiroshi Morioka

A central problem in unsupervised deep learning is how to find useful representations of high-dimensional data, sometimes called "disentanglement". Most approaches are heuristic and lack a proper theoretical foundation. …

Deep LearningDisentanglementRepresentation Learning

On the Identifiability of Nonlinear ICA: Sparsity and Beyond

2022-06-15 · Yujia Zheng, Ignavier Ng, Kun Zhang

Nonlinear independent component analysis (ICA) aims to recover the underlying independent latent sources from their observable nonlinear mixtures. How to make the nonlinear ICA model identifiable up to certain trivial in…

Inductive Bias

On Finite-Sample Identifiability of Contrastive Learning-Based Nonlinear Independent Component Analysis

2022-06-14 · Qi Lyu, Xiao Fu

Nonlinear independent component analysis (nICA) aims at recovering statistically independent latent components that are mixed by unknown nonlinear functions. Central to nICA is the identifiability of the latent component…

Contrastive LearningDisentanglementRepresentation LearningSelf-Supervised Learning

WICA: nonlinear weighted ICA

2020-01-13 · Andrzej Bedychaj, Przemysław Spurek, Aleksandra Nowak, Jacek Tabor

Independent Component Analysis (ICA) aims to find a coordinate system in which the components of the data are independent. In this paper we construct a new nonlinear ICA model, called WICA, which obtains better and more …