paper-with-me

Papers

Blockwise Principal Component Analysis for monotone missing data imputation and dimensionality reduction

2023-05-10 · Tu T. Do, Mai Anh Vu, Tuan L. Vo, Hoang Thien Ly, Thu Nguyen, Steven A. Hicks, Michael A. Riegler, Pål Halvorsen, Binh T. Nguyen

Monotone missing data is a common problem in data analysis. However, imputation combined with dimensionality reduction can be computationally expensive, especially with the increasing size of datasets. To address this issue, we propose a Blockwise principal component analysis Imputation (BPI) framework for dimensionality reduction and imputation of monotone missing data. The framework conducts Principal Component Analysis (PCA) on the observed part of each monotone block of the data and then imputes on merging the obtained principal components using a chosen imputation technique. BPI can work with various imputation techniques and can significantly reduce imputation time compared to conducting dimensionality reduction after imputation. This makes it a practical and efficient approach for large datasets with monotone missing data. Our experiments validate the improvement in speed. In addition, our experiments also show that while applying MICE imputation directly on missing data may not yield convergence, applying BPI with MICE for the data may lead to convergence.

📄 PDF Abstract BibTeX arXiv:2305.06042

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality ReductionImputation

Similar Papers 제목 키워드 기반

Blockwise Missingness meets AI: A Tractable Solution for Semiparametric Inference

2025-09-29 · Qi Xu, Lorenzo Testa, Jing Lei, Kathryn Roeder arxiv

We consider parameter estimation and inference when data feature blockwise, non-monotone missingness. Our approach, rooted in semiparametric theory and inspired by prediction-powered inference, leverages off-the-shelf AI…

Imputation-Powered Inference

2025-09-17 · Sarah Zhao, Emmanuel Candès arxiv

Modern multi-modal and multi-site data frequently suffer from blockwise missingness, where subsets of features are missing for groups of individuals, creating complex patterns that challenge standard inference methods. E…

Streaming Principal Component Analysis in Noisy Setting

2018-07-01 · ICML 2018 7 · Teodor Vanislavov Marinov, Poorya Mianjy, Raman Arora

We study streaming algorithms for principal component analysis (PCA) in noisy settings. We present computationally efficient algorithms with sub-linear regret bounds for PCA in the presence of noise, missing data, a…

High Dimensional Semiparametric Scale-Invariant Principal Component Analysis

2014-02-18 · Fang Han, Han Liu

We propose a new high dimensional semiparametric principal component analysis (PCA) method, named Copula Component Analysis (COCA). The semiparametric model assumes that, after unspecified marginally monotone transformat…

feature selectionVocal Bursts Intensity Prediction

Principal Component Analysis based frameworks for efficient missing data imputation algorithms

2022-05-30 · Thu Nguyen, Hoang Thien Ly, Michael Alexander Riegler, Pål Halvorsen 외

Missing data is a commonly occurring problem in practice. Many imputation methods have been developed to fill in the missing entries. However, not all of them can scale to high-dimensional data, especially the multiple i…

ClassificationDimensionality ReductionImputation