paper-with-me

홈 › Papers

Minimax Quasi-Bayesian estimation in sparse canonical correlation analysis via a Rayleigh quotient function

2020-10-16 · Qiuyun Zhu, Yves Atchade

Canonical correlation analysis (CCA) is a popular statistical technique for exploring relationships between datasets. In recent years, the estimation of sparse canonical vectors has emerged as an important but challenging variant of the CCA problem, with widespread applications. Unfortunately, existing rate-optimal estimators for sparse canonical vectors have high computational cost. We propose a quasi-Bayesian estimation procedure that not only achieves the minimax estimation rate, but also is easy to compute by Markov Chain Monte Carlo (MCMC). The method builds on Tan et al. (2018) and uses a re-scaled Rayleigh quotient function as the quasi-log-likelihood. However, unlike Tan et al. (2018), we adopt a Bayesian framework that combines this quasi-log-likelihood with a spike-and-slab prior to regularize the inference and promote sparsity. We investigate the empirical behavior of the proposed method on both continuous and truncated data, and we demonstrate that it outperforms several state-of-the-art methods. As an application, we use the proposed methodology to maximally correlate clinical variables and proteomic data for better understanding the Covid-19 disease.

📄 PDF Abstract BibTeX arXiv:2010.08627

Code (1)

rachelwho/Sparse-CCA 공식 구현

Similar Papers 제목 키워드 기반

Optimal sparse phase retrieval via a quasi-Bayesian approach

2025-04-13 · The Tien Mai

This paper addresses the problem of sparse phase retrieval, a fundamental inverse problem in applied mathematics, physics, and engineering, where a signal need to be reconstructed using only the magnitude of its transfor…

Retrieval

A Quasi-Bayesian Perspective to Online Clustering

2016-02-01 · Le Li, Benjamin Guedj, Sébastien Loustau

When faced with high frequency streams of data, clustering raises theoretical and algorithmic pitfalls. We introduce a new and adaptive online clustering algorithm relying on a quasi-Bayesian approach, with a dynamic (i.…

ClusteringOnline Clustering

Communication-Efficient Distributed Statistical Inference

2016-05-25 · Michael. I. Jordan, Jason D. Lee, Yun Yang

We present a Communication-efficient Surrogate Likelihood (CSL) framework for solving distributed statistical inference problems. CSL provides a communication-efficient surrogate to the global likelihood that can be used…

Bayesian InferenceComputational Efficiency

Quasi-Bayesian Dual Instrumental Variable Regression

2021-06-16 · NeurIPS 2021 12 · Ziyu Wang, Yuhao Zhou, Tongzheng Ren, Jun Zhu

Recent years have witnessed an upsurge of interest in employing flexible machine learning models for instrumental variable (IV) regression, but the development of uncertainty quantification methodology is still lacking. …

Bayesian InferenceregressionUncertainty Quantification

Subspace Perspective on Canonical Correlation Analysis: Dimension Reduction and Minimax Rates

2016-05-12 · Zhuang Ma, Xiao-Dong Li

Canonical correlation analysis (CCA) is a fundamental statistical tool for exploring the correlation structure between two sets of random variables. In this paper, motivated by recent success of applying CCA to learn low…

Dimensionality ReductionPrediction