Randomized Independent Component Analysis

2016-09-22 · Matan Sela, Ron Kimmel

Independent component analysis (ICA) is a method for recovering statistically independent signals from observations of unknown linear combinations of the sources. Some of the most accurate ICA decomposition methods require searching for the inverse transformation which minimizes different approximations of the Mutual Information, a measure of statistical independence of random vectors. Two such approximations are the Kernel Generalized Variance or the Kernel Canonical Correlation which has been shown to reach the highest performance of ICA methods. However, the computational effort necessary just for computing these measures is cubic in the sample size. Hence, optimizing them becomes even more computationally demanding, in terms of both space and time. Here, we propose a couple of alternative novel measures based on randomized features of the samples - the Randomized Generalized Variance and the Randomized Canonical Correlation. The computational complexity of calculating the proposed alternatives is linear in the sample size and provide a controllable approximation of their Kernel-based non-random versions. We also show that optimization of the proposed statistical properties yields a comparable separation error at an order of magnitude faster compared to Kernel-based measures.

📄 PDF Abstract BibTeX arXiv:1609.06942

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

ICA _Independent component analysis (ICA) is a statistical and computational technique for revealing hidden factors that underlie sets of random variables, measurements, or…

Randomized Robust Subspace Recovery for High Dimensional Data Matrices

2015-05-21 · Mostafa Rahmani, George Atia

This paper explores and analyzes two randomized designs for robust Principal Component Analysis (PCA) employing low-dimensional data sketching. In one design, a data sketch is constructed using random column sampling fol…

Vocal Bursts Intensity Prediction

Functional Principal Component Analysis and Randomized Sparse Clustering Algorithm for Medical Image Analysis

2014-08-01 · Nan Lin, Junhai Jiang, Shicheng Guo, Momiao Xiong

Due to advances in sensors, growing large and complex medical image data have the ability to visualize the pathological change in the cellular or even the molecular level or anatomical changes in tissues and organs. As a…

Clustering Disease Prediction feature selection Management+1

Randomized ICA and LDA Dimensionality Reduction Methods for Hyperspectral Image Classification

2018-04-19 · Chippy Jayaprakash, Bharath Bhushan Damodaran, Sowmya V, K. P. Soman

Dimensionality reduction is an important step in processing the hyperspectral images (HSI) to overcome the curse of dimensionality problem. Linear dimensionality reduction methods such as Independent component analysis (…

Dimensionality Reduction General Classification Hyperspectral Image Classification image-classification+1

Almost-Optimal Local-Search Methods for Sparse Tensor PCA

2025-06-11 · Max Lovig, Conor Sheehan, Konstantinos Tsirkas, Ilias Zadik

Local-search methods are widely employed in statistical applications, yet interestingly, their theoretical foundations remain rather underexplored, compared to other classes of estimators such as low-degree polynomials a…

Generalized Inverses of Matrix Products: From Fundamental Subspaces to Randomized Decompositions

2026-01-30 · Michał P. Karpowicz, Gilbert Strang arxiv

We investigate the Moore-Penrose pseudoinverse and generalized inverse of a matrix product $A=CR$ to establish a unifying framework for generalized and randomized matrix inverses. This analysis is rooted in first princip…