Supervised Dimensionality Reduction and Visualization using Centroid-encoder
Visualizing high-dimensional data is an essential task in Data Science and Machine Learning. The Centroid-Encoder (CE) method is similar to the autoencoder but incorporates label information to keep objects of a class close together in the reduced visualization space. CE exploits nonlinearity and labels to encode high variance in low dimensions while capturing the global structure of the data. We present a detailed analysis of the method using a wide variety of data sets and compare it with other supervised dimension reduction techniques, including NCA, nonlinear NCA, t-distributed NCA, t-distributed MCML, supervised UMAP, supervised PCA, Colored Maximum Variance Unfolding, supervised Isomap, Parametric Embedding, supervised Neighbor Retrieval Visualizer, and Multiple Relational Embedding. We empirically show that centroid-encoder outperforms most of these techniques. We also show that when the data variance is spread across multiple modalities, centroid-encoder extracts a significant amount of information from the data in low dimensional space. This key feature establishes its value to use it as a tool for data visualization.
Code (0)
등록된 구현이 없습니다.
Tasks
Data VisualizationDimensionality ReductionRetrievalSupervised dimensionality reductionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Yet Another Algorithm for Supervised Principal Component Analysis: Supervised Linear Centroid-Encoder
We propose a new supervised dimensionality reduction technique called Supervised Linear Centroid-Encoder (SLCE), a linear counterpart of the nonlinear Centroid-Encoder (CE) \citep{ghosh2022supervised}. SLCE works by mapp…
Dimensionality ReductionSupervised dimensionality reductionSparse Centroid-Encoder: A Nonlinear Model for Feature Selection
Autoencoders have been widely used as a nonlinear tool for data dimensionality reduction. While autoencoders don't utilize the label information, Centroid-Encoders (CE)\cite{ghosh2022supervised} use the class label in th…
AttributeDimensionality Reductionfeature selectionEnhancing Supervised Visualization through Autoencoder and Random Forest Proximities for Out-of-Sample Extension
The value of supervised dimensionality reduction lies in its ability to uncover meaningful connections between data features and labels. Common dimensionality reduction methods embed a set of fixed, latent points, but ar…
Dimensionality ReductionSupervised dimensionality reductionScalable semi-supervised dimensionality reduction with GPU-accelerated EmbedSOM
Dimensionality reduction methods have found vast application as visualization tools in diverse areas of science. Although many different methods exist, their performance is often insufficient for providing quick insight …
Data VisualizationDimensionality ReductionGPUSupervised dimensionality reductionRandom Forest Autoencoders for Guided Representation Learning
Extensive research has produced robust methods for unsupervised data visualization. Yet supervised visualization$\unicode{x2013}$where expert labels guide representations$\unicode{x2013}$remains underexplored, as most su…
Data VisualizationDimensionality ReductionRepresentation Learning