paper-with-me

홈 › Papers

Latent Simplex Position Model: High Dimensional Multi-view Clustering with Uncertainty Quantification

2019-03-21 · Leo L. Duan

High dimensional data often contain multiple facets, and several clustering patterns can co-exist under different variable subspaces, also known as the views. While multi-view clustering algorithms were proposed, the uncertainty quantification remains difficult --- a particular challenge is in the high complexity of estimating the cluster assignment probability under each view, and sharing information among views. In this article, we propose an approximate Bayes approach --- treating the similarity matrices generated over the views as rough first-stage estimates for the co-assignment probabilities; in its Kullback-Leibler neighborhood, we obtain a refined low-rank matrix, formed by the pairwise product of simplex coordinates. Interestingly, each simplex coordinate directly encodes the cluster assignment uncertainty. For multi-view clustering, we let each view draw a parameterization from a few candidates, leading to dimension reduction. With high model flexibility, the estimation can be efficiently carried out as a continuous optimization problem, hence enjoys gradient-based computation. The theory establishes the connection of this model to a random partition distribution under multiple views. Compared to single-view clustering approaches, substantially more interpretable results are obtained when clustering brains from a human traumatic brain injury study, using high-dimensional gene expression data. KEY WORDS: Co-regularized Clustering, Consensus, PAC-Bayes, Random Cluster Graph, Variable Selection

📄 PDF Abstract BibTeX arXiv:1903.09029

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDimensionality ReductionPositionUncertainty QuantificationVariable Selection

Similar Papers 제목 키워드 기반

Explaining Latent Representations with a Corpus of Examples

2021-10-28 · NeurIPS 2021 12 · Jonathan Crabbé, Zhaozhi Qian, Fergus Imrie, Mihaela van der Schaar

Modern machine learning models are complicated. Most of them rely on convoluted latent representations of their input to issue a prediction. To achieve greater transparency than a black-box that connects inputs to predic…

image-classificationImage ClassificationMortality Prediction

Explaining a probabilistic prediction on the simplex with Shapley compositions

2024-08-02 · Paul-Gauthier Noé, Miquel Perelló-Nieto, Jean-François Bonastre, Peter Flach

Originating in game theory, Shapley values are widely used for explaining a machine learning model's prediction by quantifying the contribution of each feature's value to the prediction. This requires a scalar prediction…

Binary ClassificationPrediction

What Weights Work for You? Adapting Weights for Any Pareto Front Shape in Decomposition-based Evolutionary Multi-Objective Optimisation

2017-09-08 · Miqing Li, Xin Yao

The quality of solution sets generated by decomposition-based evolutionary multiobjective optimisation (EMO) algorithms depends heavily on the consistency between a given problem's Pareto front shape and the specified we…

Convex optimization over a probability simplex

2023-05-15 · James Chok, Geoffrey M. Vasil

We propose a new iteration scheme, the Cauchy-Simplex, to optimize convex problems over the probability simplex $\{w\in\mathbb{R}^n\ |\ \sum_i w_i=1\ \textrm{and}\ w_i\geq0\}$. Specifically, we map the simplex to the pos…

Geometry-preserving and interpretable dimension reduction for compositional data

2025-09-06 · Junyoung Park, Cheolwoo Park, Jeongyoun Ahn arxiv

High-dimensional compositional data pose unique statistical challenges due to the simplex constraint and excess zeros. While dimension reduction is indispensable for analyzing such data, conventional approaches often rel…