Randomized Nonlinear Component Analysis

2014-02-01 · David Lopez-Paz, Suvrit Sra, Alex Smola, Zoubin Ghahramani, Bernhard Schölkopf

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants of PCA and CCA have been proposed, these are computationally prohibitive in the large scale. In a separate strand of recent research, randomized methods have been proposed to construct features that help reveal nonlinear patterns in data. For basic tasks such as regression or classification, random features exhibit little or no loss in performance, while achieving drastic savings in computational requirements. In this paper we leverage randomness to design scalable new variants of nonlinear PCA and CCA; our ideas extend to key multivariate analysis tools such as spectral clustering or LDA. We demonstrate our algorithms through experiments on real-world data, on which we compare against the state-of-the-art. A simple R implementation of the presented algorithms is provided.

📄 PDF Abstract BibTeX arXiv:1402.0119

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Methods 이 논문이 사용한 방법론

Spectral Clustering Spectral clustering has attracted increasing attention due to the promising ability in dealing with nonlinearly separable datasets [15], [16]. In spectral clustering, the…

LDA Linear discriminant analysis (LDA), normal discriminant analysis (NDA), or discriminant function analysis is a generalization of Fisher's linear discriminant, a method used in…

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Randomized ICA and LDA Dimensionality Reduction Methods for Hyperspectral Image Classification

2018-04-19 · Chippy Jayaprakash, Bharath Bhushan Damodaran, Sowmya V, K. P. Soman

Dimensionality reduction is an important step in processing the hyperspectral images (HSI) to overcome the curse of dimensionality problem. Linear dimensionality reduction methods such as Independent component analysis (…

Dimensionality Reduction General Classification Hyperspectral Image Classification image-classification+1

Empirical Evaluation of Kernel PCA Approximation Methods in Classification Tasks

2017-12-12 · Deena P. Francis, Kumudha Raimond

Kernel Principal Component Analysis (KPCA) is a popular dimensionality reduction technique with a wide range of applications. However, it suffers from the problem of poor scalability. Various approximation methods have b…

Classification Dimensionality Reduction General Classification

Functional Principal Component Analysis and Randomized Sparse Clustering Algorithm for Medical Image Analysis

2014-08-01 · Nan Lin, Junhai Jiang, Shicheng Guo, Momiao Xiong

Due to advances in sensors, growing large and complex medical image data have the ability to visualize the pathological change in the cellular or even the molecular level or anatomical changes in tissues and organs. As a…

Clustering Disease Prediction feature selection Management+1

Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEs

2024-05-08 · Ariel Neufeld, Philipp Schmocker, Sizhou Wu

In this paper, we present a randomized extension of the deep splitting algorithm introduced in [Beck, Becker, Cheridito, Jentzen, and Neufeld (2021)] using random neural networks suitable to approximately solve both high…

Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learning

2018-05-22 · Aapo Hyvarinen, Hiroaki Sasaki, Richard E. Turner

Nonlinear ICA is a fundamental problem for unsupervised representation learning, emphasizing the capacity to recover the underlying latent variables generating the data (i.e., identifiability). Recently, the very first i…

Contrastive Learning Representation Learning Time Series Time Series Analysis