paper-with-me

홈 › Papers

Optimal Clustering of Discrete Mixtures: Binomial, Poisson, Block Models, and Multi-layer Networks

2023-11-27 · Zhongyuan Lyu, Ting Li, Dong Xia

In this paper, we first study the fundamental limit of clustering networks when a multi-layer network is present. Under the mixture multi-layer stochastic block model (MMSBM), we show that the minimax optimal network clustering error rate, which takes an exponential form and is characterized by the Renyi divergence between the edge probability distributions of the component networks. We propose a novel two-stage network clustering method including a tensor-based initialization algorithm involving both node and sample splitting and a refinement procedure by likelihood-based Lloyd algorithm. Network clustering must be accompanied by node community detection. Our proposed algorithm achieves the minimax optimal network clustering error rate and allows extreme network sparsity under MMSBM. Numerical simulations and real data experiments both validate that our method outperforms existing methods. Oftentimes, the edges of networks carry count-type weights. We then extend our methodology and analysis framework to study the minimax optimal clustering error rate for mixture of discrete distributions including Binomial, Poisson, and multi-layer Poisson networks. The minimax optimal clustering error rates in these discrete mixtures all take the same exponential form characterized by the Renyi divergences. These optimal clustering error rates in discrete mixtures can also be achieved by our proposed two-stage clustering algorithm.

📄 PDF Abstract BibTeX arXiv:2311.15598

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringCommunity DetectionStochastic Block Model

Similar Papers 제목 키워드 기반

Universal Lower Bounds and Optimal Rates: Achieving Minimax Clustering Error in Sub-Exponential Mixture Models

2024-02-23 · Maximilien Dreveton, Alperen Gözeten, Matthias Grossglauser, Patrick Thiran

Clustering is a pivotal challenge in unsupervised machine learning and is often investigated through the lens of mixture models. The optimal error rate for recovering cluster labels in Gaussian and sub-Gaussian mixture m…

Clustering

Algebraic and Analytic Approaches for Parameter Learning in Mixture Models

2020-01-19 · Akshay Krishnamurthy, Arya Mazumdar, Andrew Mcgregor, Soumyabrata Pal

We present two different approaches for parameter learning in several mixture models in one dimension. Our first approach uses complex-analytic methods and applies to Gaussian mixtures with shared variance, binomial mixt…

parameter estimation

Variable subset selection via GA and information complexity in mixtures of Poisson and negative binomial regression models

2015-05-20 · T. J. Massaro, H. Bozdogan

Count data, for example the number of observed cases of a disease in a city, often arise in the fields of healthcare analytics and epidemiology. In this paper, we consider performing regression on multivariate data in wh…

Epidemiologyregression

Finite Mixtures of Multivariate Poisson-Log Normal Factor Analyzers for Clustering Count Data

2023-11-13 · Andrea Payne, Anjali Silva, Steven J. Rothstein, Paul D. McNicholas 외

A mixture of multivariate Poisson-log normal factor analyzers is introduced by imposing constraints on the covariance matrix, which resulted in flexible models for clustering purposes. In particular, a class of eight par…

ClusteringModel Selectionparameter estimation

Testing Poisson Binomial Distributions

2014-10-13 · Jayadev Acharya, Constantinos Daskalakis

A Poisson Binomial distribution over $n$ variables is the distribution of the sum of $n$ independent Bernoullis. We provide a sample near-optimal algorithm for testing whether a distribution $P$ supported on $\{0,...,n\}…