paper-with-me

Papers

Disentangling Identifiable Features from Noisy Data with Structured Nonlinear ICA

2021-06-17 · NeurIPS 2021 12 · Hermanni Hälvä, Sylvain Le Corff, Luc Lehéricy, Jonathan So, Yongjie Zhu, Elisabeth Gassiat, Aapo Hyvarinen

We introduce a new general identifiable framework for principled disentanglement referred to as Structured Nonlinear Independent Component Analysis (SNICA). Our contribution is to extend the identifiability theory of deep generative models for a very broad class of structured models. While previous works have shown identifiability for specific classes of time-series models, our theorems extend this to more general temporal structures as well as to models with more complex structures such as spatial dependencies. In particular, we establish the major result that identifiability for this framework holds even in the presence of noise of unknown distribution. Finally, as an example of our framework's flexibility, we introduce the first nonlinear ICA model for time-series that combines the following very useful properties: it accounts for both nonstationarity and autocorrelation in a fully unsupervised setting; performs dimensionality reduction; models hidden states; and enables principled estimation and inference by variational maximum-likelihood.

📄 PDF Abstract BibTeX arXiv:2106.09620

Code (1)

HHalva/snica 공식 구현 jax

Tasks

Dimensionality ReductionDisentanglementTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

ICA _Independent component analysis (ICA) is a statistical and computational technique for revealing hidden factors that underlie sets of random variables, measurements, or…

Similar Papers 제목 키워드 기반

Robust estimation of tree structured Gaussian Graphical Model

2019-01-25 · Ashish Katiyar, Jessica Hoffmann, Constantine Caramanis

Consider jointly Gaussian random variables whose conditional independence structure is specified by a graphical model. If we observe realizations of the variables, we can compute the covariance matrix, and it is well kno…

model

Geometric analysis enables biological insight from complex non-identifiable models using simple surrogates

2022-08-03 · Alexander P Browning, Matthew J Simpson

An enduring challenge in computational biology is to balance data quality and quantity with model complexity. Tools such as identifiability analysis and information criterion have been developed to harmonise this juxtapo…

Learning Disentangling and Fusing Networks for Face Completion Under Structured Occlusions

2017-12-13 · Zhihang Li, Yibo Hu, Ran He

Face completion aims to generate semantically new pixels for missing facial components. It is a challenging generative task due to large variations of face appearance. This paper studies generative face completion under …

DecoderFacial InpaintingGenerative Adversarial Network

Encoding Domain Knowledge in Multi-view Latent Variable Models: A Bayesian Approach with Structured Sparsity

2022-04-13 · Arber Qoku, Florian Buettner

Many real-world systems are described not only by data from a single source but via multiple data views. In genomic medicine, for instance, patients can be characterized by data from different molecular layers. Latent va…

Towards the Identifiability in Noisy Label Learning: A Multinomial Mixture Approach

2023-01-04 · Cuong Nguyen, Thanh-Toan Do, Gustavo Carneiro

Learning from noisy labels (LNL) plays a crucial role in deep learning. The most promising LNL methods rely on identifying clean-label samples from a dataset with noisy annotations. Such an identification is challenging …