paper-with-me

홈 › Papers

A Discriminative Gaussian Mixture Model with Sparsity

2019-11-14 · ICLR 2021 1 · Hideaki Hayashi, Seiichi Uchida

In probabilistic classification, a discriminative model based on the softmax function has a potential limitation in that it assumes unimodality for each class in the feature space. The mixture model can address this issue, although it leads to an increase in the number of parameters. We propose a sparse classifier based on a discriminative GMM, referred to as a sparse discriminative Gaussian mixture (SDGM). In the SDGM, a GMM-based discriminative model is trained via sparse Bayesian learning. Using this sparse learning framework, we can simultaneously remove redundant Gaussian components and reduce the number of parameters used in the remaining components during learning; this learning method reduces the model complexity, thereby improving the generalization capability. Furthermore, the SDGM can be embedded into neural networks (NNs), such as convolutional NNs, and can be trained in an end-to-end manner. Experimental results demonstrated that the proposed method outperformed the existing softmax-based discriminative models.

📄 PDF Abstract BibTeX arXiv:1911.06028

Code (0)

등록된 구현이 없습니다.

Tasks

modelSparse Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

SDGM: Sparse Bayesian Classifier Based on a Discriminative Gaussian Mixture Model

2019-09-25 · Hideaki Hayashi, Seiichi Uchida

In probabilistic classification, a discriminative model based on Gaussian mixture exhibits flexible fitting capability. Nevertheless, it is difficult to determine the number of components. We propose a sparse classifier …

Learning a Gaussian Mixture for Sparsity Regularization in Inverse Problems

2024-01-29 · Giovanni S. Alberti, Luca Ratti, Matteo Santacesaria, Silvia Sciutto

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropr…

Dictionary Learning

Weakly Supervised Fine-Grained Image Classification via Guassian Mixture Model Oriented Discriminative Learning

2020-06-01 · CVPR 2020 6 · Zhihui Wang, Shijie Wang, Shuhui Yang, Haojie Li 외

Existing weakly supervised fine-grained image recognition (WFGIR) methods usually pick out the discriminative regions from the high-level feature maps directly. We discover that due to the operation of stacking local rec…

Fine-Grained Image ClassificationFine-Grained Image RecognitionGeneral Classificationimage-classification+1

Support Recovery in Mixture Models with Sparse Parameters

2022-02-24 · Arya Mazumdar, Soumyabrata Pal

Mixture models are widely used to fit complex and multimodal datasets. In this paper we study mixtures with high dimensional sparse latent parameter vectors and consider the problem of support recovery of those vectors. …

parameter estimation

Effective Learning of a GMRF Mixture Model

2020-05-18 · Shahaf E. Finder, Eran Treister, Oren Freifeld

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (…

model