paper-with-me

홈 › Papers

Beyond independent component analysis: identifiability and algorithms

2025-10-08 · Alvaro Ribot, Anna Seigal, Piotr Zwiernik arxiv

Independent Component Analysis (ICA) is a classical method for recovering latent variables with useful identifiability properties. For independent variables, cumulant tensors are diagonal; relaxing independence yields tensors whose zero structure generalizes diagonality. These models have been the subject of recent work in non-independent component analysis. We show that pairwise mean independence answers the question of how much one can relax independence: it is identifiable, any weaker notion is non-identifiable, and it contains the models previously studied as special cases. Our results apply to distributions with the required zero pattern at any cumulant tensor. We propose an algebraic recovery algorithm based on least-squares optimization over the orthogonal group. Simulations highlight robustness: enforcing full independence can harm estimation, while pairwise mean independence enables more stable recovery. These findings extend the classical ICA framework and provide a rigorous basis for blind source separation beyond independence.

📄 PDF Abstract BibTeX arXiv:2510.07525

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beyond CCA: Moment Matching for Multi-View Models

2016-02-29 · Anastasia Podosinnikova, Francis Bach, Simon Lacoste-Julien

We introduce three novel semi-parametric extensions of probabilistic canonical correlation analysis with identifiability guarantees. We consider moment matching techniques for estimation in these models. For that, by dra…

On Finite-Sample Identifiability of Contrastive Learning-Based Nonlinear Independent Component Analysis

2022-06-14 · Qi Lyu, Xiao Fu

Nonlinear independent component analysis (nICA) aims at recovering statistically independent latent components that are mixed by unknown nonlinear functions. Central to nICA is the identifiability of the latent component…

Contrastive LearningDisentanglementRepresentation LearningSelf-Supervised Learning

Diverse Influence Component Analysis: A Geometric Approach to Nonlinear Mixture Identifiability

2025-10-19 · Hoang-Son Nguyen, Xiao Fu arxiv

Latent component identification from unknown nonlinear mixtures is a foundational challenge in machine learning, with applications in tasks such as disentangled representation learning and causal inference. Prior work in…

Representation LearningCausal Inference

On the Identifiability of Nonlinear ICA: Sparsity and Beyond

2022-06-15 · Yujia Zheng, Ignavier Ng, Kun Zhang

Nonlinear independent component analysis (ICA) aims to recover the underlying independent latent sources from their observable nonlinear mixtures. How to make the nonlinear ICA model identifiable up to certain trivial in…

Inductive Bias

Generalizing Nonlinear ICA Beyond Structural Sparsity

2023-11-01 · NeurIPS 2023 11

Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible wi…