paper-with-me

홈 › Papers

XPCA: Extending PCA for a Combination of Discrete and Continuous Variables

2018-08-22 · Clifford Anderson-Bergman, Tamara G. Kolda, Kina Kincher-Winoto

Principal component analysis (PCA) is arguably the most popular tool in multivariate exploratory data analysis. In this paper, we consider the question of how to handle heterogeneous variables that include continuous, binary, and ordinal. In the probabilistic interpretation of low-rank PCA, the data has a normal multivariate distribution and, therefore, normal marginal distributions for each column. If some marginals are continuous but not normal, the semiparametric copula-based principal component analysis (COCA) method is an alternative to PCA that combines a Gaussian copula with nonparametric marginals. If some marginals are discrete or semi-continuous, we propose a new extended PCA (XPCA) method that also uses a Gaussian copula and nonparametric marginals and accounts for discrete variables in the likelihood calculation by integrating over appropriate intervals. Like PCA, the factors produced by XPCA can be used to find latent structure in data, build predictive models, and perform dimensionality reduction. We present the new model, its induced likelihood function, and a fitting algorithm which can be applied in the presence of missing data. We demonstrate how to use XPCA to produce an estimated full conditional distribution for each data point, and use this to produce to provide estimates for missing data that are automatically range respecting. We compare the methods as applied to simulated and real-world data sets that have a mixture of discrete and continuous variables.

📄 PDF Abstract BibTeX arXiv:1808.07510

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality Reduction

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Particle-based Variational Inference for Continuous Systems

2009-12-01 · NeurIPS 2009 12 · Andrew Frank, Padhraic Smyth, Alexander T. Ihler

Since the development of loopy belief propagation, there has been considerable work on advancing the state of the art for approximate inference over distributions defined on discrete random variables. Improvements includ…

Variational Inference

Incremental Learning of Discrete Planning Domains from Continuous Perceptions

2019-03-14 · Luciano Serafini, Paolo Traverso

We propose a framework for learning discrete deterministic planning domains. In this framework, an agent learns the domain by observing the action effects through continuous features that describe the state of the enviro…

Incremental Learning

Discrete-Continuous Smoothing and Mapping

2022-04-25 · Kevin J. Doherty, Ziqi Lu, Kurran Singh, John J. Leonard

We describe a general approach for maximum a posteriori (MAP) inference in a class of discrete-continuous factor graphs commonly encountered in robotics applications. While there are openly available tools providing flex…

Point Cloud Registration

Scalable Bayesian Network Structure Learning with Splines

2021-10-27 · Charupriya Sharma, Peter van Beek

The graph structure of a Bayesian network (BN) can be learned from data using the well-known score-and-search approach. Previous work has shown that incorporating structured representations of the conditional probability…

feature selectionregression

Stability Regularization for Discrete Representation Learning

2021-09-29 · ICLR 2022 4 · Adeel Pervez, Efstratios Gavves

We present a method for training neural network models with discrete stochastic variables. The core of the method is \emph{stability regularization}, which is a regularization procedure based on the idea of noise stabili…

Representation Learning