A Bayesian Approach to Multimodal Visual Dictionary Learning
nary learning methods rely on image descriptors alone or together with class labels. However, Web images are often associated with text data which may carry substantial information regarding image semantics, and may be exploited for visual dictionary learning. This paper explores this idea by leveraging relational information between image descriptors and textual words via co-clustering, in addition to information of image descriptors. Existing co-clustering methods are not optimal for this problem because they ignore the structure of image descriptors in the continuous space, which is crucial for capturing visual characteristics of images. We propose a novel Bayesian co-clustering model to jointly estimate the underlying distributions of the continuous image descriptors as well as the relationship between such distributions and the textual words through a unified Bayesian inference. Extensive experiments on image categorization and retrieval have validated the substantial value of the proposed joint modeling in improving visual dictionary learning, where our model shows superior performance over several recent methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceClusteringDictionary LearningImage CategorizationRetrievalSimilar Papers 제목 키워드 기반
Multimodal Sparse Bayesian Dictionary Learning
This paper addresses the problem of learning dictionaries for multimodal datasets, i.e. datasets collected from multiple data sources. We present an algorithm called multimodal sparse Bayesian dictionary learning (MSBDL)…
Dictionary LearningSparse Bayesian Dictionary Learning with a Gaussian Hierarchical Model
We consider a dictionary learning problem whose objective is to design a dictionary such that the signals admits a sparse or an approximate sparse representation over the learned dictionary. Such a problem finds a variet…
Bayesian InferenceDenoisingDictionary LearningImage DenoisingBayesian sparsity and class sparsity priors for dictionary learning and coding
Dictionary learning methods continue to gain popularity for the solution of challenging inverse problems. In the dictionary learning approach, the computational forward model is replaced by a large dictionary of possible…
Dictionary LearningDiscriminative Bayesian Dictionary Learning for Classification
We propose a Bayesian approach to learn discriminative dictionaries for sparse representation of data. The proposed approach infers probability distributions over the atoms of a discriminative dictionary using a Beta Pro…
Action RecognitionClassificationDictionary LearningGeneral Classification+1Bayesian Nonparametric Dictionary Learning for Compressed Sensing MRI
We develop a Bayesian nonparametric model for reconstructing magnetic resonance images (MRI) from highly undersampled k-space data. We perform dictionary learning as part of the image reconstruction process. To this end,…
compressed sensingDenoisingDictionary LearningImage Reconstruction+1