paper-with-me

Papers

Learning Transformations for Clustering and Classification

2013-09-09 · Qiang Qiu, Guillermo Sapiro

A low-rank transformation learning framework for subspace clustering and classification is here proposed. Many high-dimensional data, such as face images and motion sequences, approximately lie in a union of low-dimensional subspaces. The corresponding subspace clustering problem has been extensively studied in the literature to partition such high-dimensional data into clusters corresponding to their underlying low-dimensional subspaces. However, low-dimensional intrinsic structures are often violated for real-world observations, as they can be corrupted by errors or deviate from ideal models. We propose to address this by learning a linear transformation on subspaces using matrix rank, via its convex surrogate nuclear norm, as the optimization criteria. The learned linear transformation restores a low-rank structure for data from the same subspace, and, at the same time, forces a a maximally separated structure for data from different subspaces. In this way, we reduce variations within subspaces, and increase separation between subspaces for a more robust subspace clustering. This proposed learned robust subspace clustering framework significantly enhances the performance of existing subspace clustering methods. Basic theoretical results here presented help to further support the underlying framework. To exploit the low-rank structures of the transformed subspaces, we further introduce a fast subspace clustering technique, which efficiently combines robust PCA with sparse modeling. When class labels are present at the training stage, we show this low-rank transformation framework also significantly enhances classification performance. Extensive experiments using public datasets are presented, showing that the proposed approach significantly outperforms state-of-the-art methods for subspace clustering and classification.

📄 PDF Abstract BibTeX arXiv:1309.2074

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationClusteringGeneral Classification

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Nonstationary Distance Metric Learning

2016-03-11 · Kristjan Greenewald, Stephen Kelley, Alfred Hero

Recent work in distance metric learning has focused on learning transformations of data that best align with provided sets of pairwise similarity and dissimilarity constraints. The learned transformations lead to improve…

ClusteringMetric LearningRetrieval

PointClustering: Unsupervised Point Cloud Pre-Training Using Transformation Invariance in Clustering

2023-01-01 · CVPR 2023 1 · Fuchen Long, Ting Yao, Zhaofan Qiu, Lusong Li 외

Feature invariance under different data transformations, i.e., transformation invariance, can be regarded as a type of self-supervision for representation learning. In this paper, we present PointClustering, a new un…

ClusteringDeep ClusteringInductive BiasPhilosophy+2

Data Transformation Insights in Self-supervision with Clustering Tasks

2020-02-18 · Abhimanu Kumar, Aniket Anand Deshmukh, Urun Dogan, Denis Charles 외

Self-supervision is key to extending use of deep learning for label scarce domains. For most of self-supervised approaches data transformations play an important role. However, up until now the impact of transformations …

Clusteringvalid

Diffeomorphic Transformations for Time Series Analysis: An Efficient Approach to Nonlinear Warping

2023-09-25 · Iñigo Martinez

The proliferation and ubiquity of temporal data across many disciplines has sparked interest for similarity, classification and clustering methods specifically designed to handle time series data. A core issue when deali…

ClusteringDynamic Time WarpingTime SeriesTime Series Alignment+3

Deep Subspace Clustering with Data Augmentation

2020-12-01 · NeurIPS 2020 12 · Mahdi Abavisani, Alireza Naghizadeh, Dimitris Metaxas, Vishal Patel

The idea behind data augmentation techniques is based on the fact that slight changes in the percept do not change the brain cognition. In classification, neural networks use this fact by applying transformations to the …

ClusteringData Augmentation