paper-with-me

홈 › Papers

Learning Nonlinear Mixtures: Identifiability and Algorithm

2019-01-06 · Bo Yang, Xiao Fu, Nicholas D. Sidiropoulos, Kejun Huang

Linear mixture models have proven very useful in a plethora of applications, e.g., topic modeling, clustering, and source separation. As a critical aspect of the linear mixture models, identifiability of the model parameters is well-studied, under frameworks such as independent component analysis and constrained matrix factorization. Nevertheless, when the linear mixtures are distorted by an unknown nonlinear functions -- which is well-motivated and more realistic in many cases -- the identifiability issues are much less studied. This work proposes an identification criterion for a nonlinear mixture model that is well grounded in many real-world applications, and offers identifiability guarantees. A practical implementation based on a judiciously designed neural network is proposed to realize the criterion, and an effective learning algorithm is proposed. Numerical results on synthetic and real-data corroborate effectiveness of the proposed method.

📄 PDF Abstract BibTeX arXiv:1901.01568

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

On the Identifiability of Nonlinear ICA: Sparsity and Beyond

2022-06-15 · Yujia Zheng, Ignavier Ng, Kun Zhang

Nonlinear independent component analysis (ICA) aims to recover the underlying independent latent sources from their observable nonlinear mixtures. How to make the nonlinear ICA model identifiable up to certain trivial in…

Inductive Bias

Generalizing Nonlinear ICA Beyond Structural Sparsity

2023-11-01 · NeurIPS 2023 11

Nonlinear independent component analysis (ICA) aims to uncover the true latent sources from their observable nonlinear mixtures. Despite its significance, the identifiability of nonlinear ICA is known to be impossible wi…

Diverse Influence Component Analysis: A Geometric Approach to Nonlinear Mixture Identifiability

2025-10-19 · Hoang-Son Nguyen, Xiao Fu arxiv

Latent component identification from unknown nonlinear mixtures is a foundational challenge in machine learning, with applications in tasks such as disentangled representation learning and causal inference. Prior work in…

Representation LearningCausal Inference

Independent Mechanism Analysis and the Manifold Hypothesis

2023-12-20 · Shubhangi Ghosh, Luigi Gresele, Julius von Kügelgen, Michel Besserve 외

Independent Mechanism Analysis (IMA) seeks to address non-identifiability in nonlinear Independent Component Analysis (ICA) by assuming that the Jacobian of the mixing function has orthogonal columns. As typical in ICA, …

Representation Learning

Independent mechanism analysis, a new concept?

2021-06-09 · NeurIPS 2021 12 · Luigi Gresele, Julius von Kügelgen, Vincent Stimper, Bernhard Schölkopf 외

Independent component analysis provides a principled framework for unsupervised representation learning, with solid theory on the identifiability of the latent code that generated the data, given only observations of mix…

blind source separationRepresentation Learning