paper-with-me

홈 › Papers

Variational Mixture Models with Gamma or inverse-Gamma components

2016-07-26 · A. Llera, D. Vidaurre, R. H. R. Pruim, C. F. Beckmann

Mixture models with Gamma and or inverse-Gamma distributed mixture components are useful for medical image tissue segmentation or as post-hoc models for regression coefficients obtained from linear regression within a Generalised Linear Modeling framework (GLM), used in this case to separate stochastic (Gaussian) noise from some kind of positive or negative "activation" (modeled as Gamma or inverse-Gamma distributed). To date, the most common choice in this context it is Gaussian/Gamma mixture models learned through a maximum likelihood (ML) approach; we recently extended such algorithm for mixture models with inverse-Gamma components. Here, we introduce a fully analytical Variational Bayes (VB) learning framework for both Gamma and/or inverse-Gamma components. We use synthetic and resting state fMRI data to compare the performance of the ML and VB algorithms in terms of area under the curve and computational cost. We observed that the ML Gaussian/Gamma model is very expensive specially when considering high resolution images; furthermore, these solutions are highly variable and they occasionally can overestimate the activations severely. The Bayesian Gauss-Gamma is in general the fastest algorithm but provides too dense solutions. The maximum likelihood Gaussian/inverse-Gamma is also very fast but provides in general very sparse solutions. The variational Gaussian/inverse-Gamma mixture model is the most robust and its cost is acceptable even for high resolution images. Further, the presented methodology represents an essential building block that can be directly used in more complex inference tasks, specially designed to analyse MRI-fMRI data; such models include for example analytical variational mixture models with adaptive spatial regularization or better source models for new spatial blind source separation approaches.

📄 PDF Abstract BibTeX arXiv:1607.07573

Code (1)

allera/One_Dim_Mixture_Models

Tasks

blind source separationregression

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Unsupervised Classification for Polarimetric SAR Data Using Variational Bayesian Wishart Mixture Model with Inverse Gamma-Gamma Prior

2021-04-04 · Shijie Ren, Feng Zhou, Changlong Wang

Although various clustering methods have been successfully applied to polarimetric synthetic aperture radar (PolSAR) image clustering tasks, most of the available approaches fail to realize automatic determination of clu…

ClusteringImage Clustering

Data Augementation with Polya Inverse Gamma

2019-05-29 · Jingyu He, Nicholas G. Polson, Jianeng Xu

We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Mu…

Bayesian InferenceData Augmentationregression

A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

2021-11-26 · Shiv Agrawal, Hwanwoo Kim, Daniel Sanz-Alonso, Alexander Strang

Hierarchical models with gamma hyperpriors provide a flexible, sparse-promoting framework to bridge $L^1$ and $L^2$ regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these …

Model SelectionTime SeriesTime Series AnalysisUncertainty Quantification+1

Gamma Mixture Modeling for Cosine Similarity in Small Language Models

2025-10-06 · Kevin Player arxiv

We study the cosine similarity of sentence transformer embeddings and observe that they are well modeled by gamma mixtures. From a fixed corpus, we measure similarities between all document embeddings and a reference que…

Linear Time Clustering for High Dimensional Mixtures of Gaussian Clouds

2017-12-19 · Dan Kushnir, Shirin Jalali, Iraj Saniee

Clustering mixtures of Gaussian distributions is a fundamental and challenging problem that is ubiquitous in various high-dimensional data processing tasks. While state-of-the-art work on learning Gaussian mixture models…

ClusteringComputational EfficiencyVocal Bursts Intensity Prediction