Supervised Dimensionality Reduction via Distance Correlation Maximization
In our work, we propose a novel formulation for supervised dimensionality reduction based on a nonlinear dependency criterion called Statistical Distance Correlation, Szekely et. al. (2007). We propose an objective which is free of distributional assumptions on regression variables and regression model assumptions. Our proposed formulation is based on learning a low-dimensional feature representation $\mathbf{z}$, which maximizes the squared sum of Distance Correlations between low dimensional features $\mathbf{z}$ and response $y$, and also between features $\mathbf{z}$ and covariates $\mathbf{x}$. We propose a novel algorithm to optimize our proposed objective using the Generalized Minimization Maximizaiton method of \Parizi et. al. (2015). We show superior empirical results on multiple datasets proving the effectiveness of our proposed approach over several relevant state-of-the-art supervised dimensionality reduction methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionregressionSupervised dimensionality reductionSimilar Papers 제목 키워드 기반
Supervised Quadratic Feature Analysis: Information Geometry Approach for Dimensionality Reduction
Supervised dimensionality reduction aims to map labeled data to a low-dimensional feature space while maximizing class discriminability. Directly computing discriminability is often impractical, so an alternative approac…
Dimensionality ReductionMetric LearningSupervised dimensionality reductionLatent Coincidence Analysis: A Hidden Variable Model for Distance Metric Learning
We describe a latent variable model for supervised dimensionality reduction and distance metric learning. The model discovers linear projections of high dimensional data that shrink the distance between similarly labeled…
Dimensionality ReductionMetric Learningparameter estimationSupervised dimensionality reductionSupervised Distributional Reduction via Optimal Transport and Dependence Maximization
Learning representations that capture both intrinsic data geometry and target-relevant structure remains a fundamental challenge, particularly in settings where data reduction must balance compression with predictive fid…
Dimensionality ReductionRepresentation LearningInvariant Representations via Wasserstein Correlation Maximization
This work investigates the use of Wasserstein correlation -- a normalized measure of statistical dependence based on the Wasserstein distance between a joint distribution and the product of its marginals -- for unsupervi…
Representation LearningHyperspectral Images Classification and Dimensionality Reduction using spectral interaction and SVM classifier
Over the past decades, the hyperspectral remote sensing technology development has attracted growing interest among scientists in various domains. The rich and detailed spectral information provided by the hyperspectral …
ClassificationDimensionality Reduction