paper-with-me

홈 › Papers

Covariate-assisted Grade of Membership Models via Shared Latent Geometry

2026-01-24 · Zhiyu Xu, Yuqi Gu arxiv

The grade of membership model is a flexible latent variable model for analyzing multivariate categorical data through individual-level mixed membership scores. In many modern applications, auxiliary covariates are collected alongside responses and encode information about the same latent structure. Traditional approaches to incorporating such covariates typically rely on fully specified joint likelihoods, which are computationally intensive and sensitive to misspecification. We introduce a covariate-assisted grade of membership model that integrates response and covariate information by exploiting their shared low-rank simplex geometry, rather than modeling their joint distribution. We propose a likelihood-free spectral estimation procedure that combines heterogeneous data sources through a balance parameter controlling their relative contribution. To accommodate high-dimensional and heteroskedastic noise, we employ heteroskedastic principal component analysis before performing simplex-based geometric recovery. Our theoretical analysis establishes weaker identifiability conditions than those required in the covariate-free model, and further derives finite-sample, entrywise error bounds for both mixed membership scores and item parameters. These results demonstrate that auxiliary covariates can provably improve latent structure recovery, yielding faster convergence rates in high-dimensional regimes. Simulation studies and an application to educational assessment data illustrate the computational efficiency, statistical accuracy, and interpretability gains of the proposed method. The code for reproducing these results is open-source and available at \texttt{https://github.com/Toby-X/Covariate-Assisted-GoM}

📄 PDF Abstract BibTeX arXiv:2601.17265

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Covariate-assisted spectral clustering

2014-11-08 · Norbert Binkiewicz, Joshua T. Vogelstein, Karl Rohe

Biological and social systems consist of myriad interacting units. The interactions can be represented in the form of a graph or network. Measurements of these graphs can reveal the underlying structure of these interact…

ClusteringDiffusion MRI

Covariate-assisted Sparse Tensor Completion

2021-03-11 · Hilda S Ibriga, Will Wei Sun

We aim to provably complete a sparse and highly-missing tensor in the presence of covariate information along tensor modes. Our motivation comes from online advertising where users click-through-rates (CTR) on ads over v…

Testing for Association in Multi-View Network Data

2019-09-25 · Lucy L. Gao, Daniela Witten, Jacob Bien

In this paper, we consider data consisting of multiple networks, each comprised of a different edge set on a common set of nodes. Many models have been proposed for the analysis of such multi-view network data under the …

Stochastic Block Model

Covariates-Adjusted Mixed-Membership Estimation: A Novel Network Model with Optimal Guarantees

2025-02-10 · Jianqing Fan, Jiawei Ge, Jikai Hou

This paper addresses the problem of mixed-membership estimation in networks, where the goal is to efficiently estimate the latent mixed-membership structure from the observed network. Recognizing the widespread availabil…

Matrix Completion

A new LDA formulation with covariates

2022-02-18 · Gilson Shimizu, Rafael Izbicki, Denis Valle

The Latent Dirichlet Allocation (LDA) model is a popular method for creating mixed-membership clusters. Despite having been originally developed for text analysis, LDA has been used for a wide range of other applications…

ArticlesregressionTopic Models