paper-with-me

Papers

Dendrogram of mixing measures: Hierarchical clustering and model selection for finite mixture models

2024-03-04 · Dat Do, Linh Do, Scott A. McKinley, Jonathan Terhorst, XuanLong Nguyen

We present a new way to summarize and select mixture models via the hierarchical clustering tree (dendrogram) constructed from an overfitted latent mixing measure. Our proposed method bridges agglomerative hierarchical clustering and mixture modeling. The dendrogram's construction is derived from the theory of convergence of the mixing measures, and as a result, we can both consistently select the true number of mixing components and obtain the pointwise optimal convergence rate for parameter estimation from the tree, even when the model parameters are only weakly identifiable. In theory, it explicates the choice of the optimal number of clusters in hierarchical clustering. In practice, the dendrogram reveals more information on the hierarchy of subpopulations compared to traditional ways of summarizing mixture models. Several simulation studies are carried out to support our theory. We also illustrate the methodology with an application to single-cell RNA sequence analysis.

📄 PDF Abstract BibTeX arXiv:2403.01684

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringModel Selectionparameter estimation

Similar Papers 제목 키워드 기반

mdendro: An R package for extended agglomerative hierarchical clustering

2023-09-23 · Alberto Fernández, Sergio Gómez

"mdendro" is an R package that provides a comprehensive collection of linkage methods for agglomerative hierarchical clustering on a matrix of proximity data (distances or similarities), returning a multifurcated dendrog…

ClusteringDescriptive

Hierarchical clustering: visualization, feature importance and model selection

2021-11-30 · Luben M. C. Cabezas, Rafael Izbicki, Rafael B. Stern

We propose methods for the analysis of hierarchical clustering that fully use the multi-resolution structure provided by a dendrogram. Specifically, we propose a loss for choosing between clustering methods, a feature im…

ClusteringFeature ImportancemodelModel Selection

Dendrograms of Mixing Measures for Softmax-Gated Gaussian Mixture of Experts: Consistency Without Model Sweeps

2025-10-14 · Do Tien Hai, Trung Nguyen Mai, TrungTin Nguyen, Nhat Ho 외 arxiv

We develop a unified statistical framework for softmax-gated Gaussian mixture of experts (SGMoE) that addresses three long-standing obstacles in parameter estimation and model selection: (i) non-identifiability of gating…

MultiDendrograms: Variable-Group Agglomerative Hierarchical Clusterings

2012-01-08 · Sergio Gomez, Justo Montiel, David Torres, Alberto Fernandez

MultiDendrograms is a Java-written application that computes agglomerative hierarchical clusterings of data. Starting from a distances (or weights) matrix, MultiDendrograms is able to calculate its dendrograms using the …

Clustering

Learning Representations from Dendrograms

2018-12-21 · Morteza Haghir Chehreghani, Mostafa Haghir Chehreghani

We propose unsupervised representation learning and feature extraction from dendrograms. The commonly used Minimax distance measures correspond to building a dendrogram with single linkage criterion, with defining specif…

ClusteringModel SelectionRepresentation Learning