paper-with-me

Papers

Optimizing Orthogonalized Tensor Deflation via Random Tensor Theory

2023-02-11 · Mohamed El Amine Seddik, Mohammed Mahfoud, Merouane Debbah

This paper tackles the problem of recovering a low-rank signal tensor with possibly correlated components from a random noisy tensor, or so-called spiked tensor model. When the underlying components are orthogonal, they can be recovered efficiently using tensor deflation which consists of successive rank-one approximations, while non-orthogonal components may alter the tensor deflation mechanism, thereby preventing efficient recovery. Relying on recently developed random tensor tools, this paper deals precisely with the non-orthogonal case by deriving an asymptotic analysis of a parameterized deflation procedure performed on an order-three and rank-two spiked tensor. Based on this analysis, an efficient tensor deflation algorithm is proposed by optimizing the parameter introduced in the deflation mechanism, which in turn is proven to be optimal by construction for the studied tensor model. The same ideas could be extended to more general low-rank tensor models, e.g., higher ranks and orders, leading to more efficient tensor methods with a broader impact on machine learning and beyond.

📄 PDF Abstract BibTeX arXiv:2302.05798

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On the Accuracy of Hotelling-Type Tensor Deflation: A Random Tensor Analysis

2022-11-16 · Mohamed El Amine Seddik, Maxime Guillaud, Alexis Decurninge

Leveraging on recent advances in random tensor theory, we consider in this paper a rank-$r$ asymmetric spiked tensor model of the form $\sum_{i=1}^r \beta_i A_i + W$ where $\beta_i\geq 0$ and the $A_i$'s are rank-one ten…

On the Accuracy of Hotelling-Type Asymmetric Tensor Deflation: A Random Tensor Analysis

2023-10-28 · Mohamed El Amine Seddik, Maxime Guillaud, Alexis Decurninge, José Henrique de Morais Goulart

This work introduces an asymptotic study of Hotelling-type tensor deflation in the presence of noise, in the regime of large tensor dimensions. Specifically, we consider a low-rank asymmetric tensor model of the form $\s…

Understanding Deflation Process in Over-parametrized Tensor Decomposition

2021-06-11 · NeurIPS 2021 12 · Rong Ge, Yunwei Ren, Xiang Wang, Mo Zhou

In this paper we study the training dynamics for gradient flow on over-parametrized tensor decomposition problems. Empirically, such training process often first fits larger components and then discovers smaller componen…

Tensor Decomposition

Orthogonalized ALS: A Theoretically Principled Tensor Decomposition Algorithm for Practical Use

2017-03-06 · ICML 2017 8 · Vatsal Sharan, Gregory Valiant

The popular Alternating Least Squares (ALS) algorithm for tensor decomposition is efficient and easy to implement, but often converges to poor local optima---particularly when the weights of the factors are non-uniform. …

Tensor DecompositionWord Embeddings

Hotelling Deflation on Large Symmetric Spiked Tensors

2023-04-20 · Mohamed El Amine Seddik, José Henrique de Morais Goulart, Maxime Guillaud

This paper studies the deflation algorithm when applied to estimate a low-rank symmetric spike contained in a large tensor corrupted by additive Gaussian noise. Specifically, we provide a precise characterization of the …