paper-with-me

Papers

CBMAP: Clustering-based manifold approximation and projection for dimensionality reduction

2024-04-27 · Berat Dogan

Dimensionality reduction methods are employed to decrease data dimensionality, either to enhance machine learning performance or to facilitate data visualization in two or three-dimensional spaces. These methods typically fall into two categories: feature selection and feature transformation. Feature selection retains significant features, while feature transformation projects data into a lower-dimensional space, with linear and nonlinear methods. While nonlinear methods excel in preserving local structures and capturing nonlinear relationships, they may struggle with interpreting global structures and can be computationally intensive. Recent algorithms, such as the t-SNE, UMAP, TriMap, and PaCMAP prioritize preserving local structures, often at the expense of accurately representing global structures, leading to clusters being spread out more in lower-dimensional spaces. Moreover, these methods heavily rely on hyperparameters, making their results sensitive to parameter settings. To address these limitations, this study introduces a clustering-based approach, namely CBMAP (Clustering-Based Manifold Approximation and Projection), for dimensionality reduction. CBMAP aims to preserve both global and local structures, ensuring that clusters in lower-dimensional spaces closely resemble those in high-dimensional spaces. Experimental evaluations on benchmark datasets demonstrate CBMAP's efficacy, offering speed, scalability, and minimal reliance on hyperparameters. Importantly, CBMAP enables low-dimensional projection of test data, addressing a critical need in machine learning applications. CBMAP is made freely available at https://github.com/doganlab/cbmap and can be installed from the Python Package Directory (PyPI) software repository with the command pip install cbmap.

📄 PDF Abstract BibTeX arXiv:2404.17940

Code (1)

doganlab/cbmap 공식 구현 tf

Tasks

ClusteringData VisualizationDimensionality Reductionfeature selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Manifold Approximation by Moving Least-Squares Projection (MMLS)

2016-06-22 · Barak Sober, David Levin

In order to avoid the curse of dimensionality, frequently encountered in Big Data analysis, there was a vast development in the field of linear and nonlinear dimension reduction techniques in recent years. These techniqu…

Dimensionality Reduction

Discovering Behavioral Modes in Deep Reinforcement Learning Policies Using Trajectory Clustering in Latent Space

2024-02-20 · Sindre Benjamin Remman, Anastasios M. Lekkas

Understanding the behavior of deep reinforcement learning (DRL) agents is crucial for improving their performance and reliability. However, the complexity of their policies often makes them challenging to understand. In …

ClusteringDeep Reinforcement LearningDimensionality ReductionTrajectory Clustering

Optimized Kernel-based Projection Space of Riemannian Manifolds

2016-02-10 · Azadeh Alavi, Vishal M. Patel, Rama Chellappa

It is proven that encoding images and videos through Symmetric Positive Definite (SPD) matrices, and considering the Riemannian geometry of the resulting space, can lead to increased classification performance. Taking in…

ClassificationClusteringDictionary LearningGeneral Classification

A deep network construction that adapts to intrinsic dimensionality beyond the domain

2020-08-06 · Alexander Cloninger, Timo Klock

We study the approximation of two-layer compositions $f(x) = g(\phi(x))$ via deep networks with ReLU activation, where $\phi$ is a geometrically intuitive, dimensionality reducing feature map. We focus on two intuitive a…

Tangent Space Based Alternating Projections for Nonnegative Low Rank Matrix Approximation

2020-09-02 · Guangjing Song, Michael K. Ng, Tai-Xiang Jiang

In this paper, we develop a new alternating projection method to compute nonnegative low rank matrix approximation for nonnegative matrices. In the nonnegative low rank matrix approximation method, the projection onto th…

Clustering