Discrete Independent Component Analysis (DICA) with Belief Propagation
We apply belief propagation to a Bayesian bipartite graph composed of discrete independent hidden variables and discrete visible variables. The network is the Discrete counterpart of Independent Component Analysis (DICA) and it is manipulated in a factor graph form for inference and learning. A full set of simulations is reported for character images from the MNIST dataset. The results show that the factorial code implemented by the sources contributes to build a good generative model for the data that can be used in various inference modes.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Beyond CCA: Moment Matching for Multi-View Models
We introduce three novel semi-parametric extensions of probabilistic canonical correlation analysis with identifiability guarantees. We consider moment matching techniques for estimation in these models. For that, by dra…
Asymptotic Eigenvalue Distribution of Wishart Matrices whose Components are not Independently and Identically Distributed
In the present work, eigenvalue distributions defined by a random rectangular matrix whose components are neither independently nor identically distributed are analyzed using replica analysis and belief propagation. In p…
Model Validation of Agentic AI Systems: A POMDP-Based Framework for Belief-State, Forecast, and Policy Validation
Agentic artificial intelligence systems introduce a new class of model risk. Unlike traditional predictive models, autonomous agents continuously acquire information, form beliefs regarding latent states of the environme…
Decision MakingDiscrete Speech Unit Extraction via Independent Component Analysis
Self-supervised speech models (S3Ms) have become a common tool for the speech processing community, leveraging representations for downstream tasks. Clustering S3M representations yields discrete speech units (DSUs), whi…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Clusteringspeech-recognition+1Nonlinear Independent Component Analysis for Discrete-Time and Continuous-Time Signals
We study the classical problem of recovering a multidimensional source signal from observations of nonlinear mixtures of this signal. We show that this recovery is possible (up to a permutation and monotone scaling of th…
blind source separationContrastive LearningTime SeriesTime Series Analysis