paper-with-me

Papers

Uniqueness of Tensor Decompositions with Applications to Polynomial Identifiability

2013-04-30 · Aditya Bhaskara, Moses Charikar, Aravindan Vijayaraghavan

We give a robust version of the celebrated result of Kruskal on the uniqueness of tensor decompositions: we prove that given a tensor whose decomposition satisfies a robust form of Kruskal's rank condition, it is possible to approximately recover the decomposition if the tensor is known up to a sufficiently small (inverse polynomial) error. Kruskal's theorem has found many applications in proving the identifiability of parameters for various latent variable models and mixture models such as Hidden Markov models, topic models etc. Our robust version immediately implies identifiability using only polynomially many samples in many of these settings. This polynomial identifiability is an essential first step towards efficient learning algorithms for these models. Recently, algorithms based on tensor decompositions have been used to estimate the parameters of various hidden variable models efficiently in special cases as long as they satisfy certain "non-degeneracy" properties. Our methods give a way to go beyond this non-degeneracy barrier, and establish polynomial identifiability of the parameters under much milder conditions. Given the importance of Kruskal's theorem in the tensor literature, we expect that this robust version will have several applications beyond the settings we explore in this work.

📄 PDF Abstract BibTeX arXiv:1304.8087

Code (0)

등록된 구현이 없습니다.

Tasks

Topic Models

Similar Papers 제목 키워드 기반

Identifiability of Nonnegative Tucker Decompositions -- Part I: Theory

2025-05-19 · Subhayan Saha, Giovanni Barbarino, Nicolas Gillis

Tensor decompositions have become a central tool in data science, with applications in areas such as data analysis, signal processing, and machine learning. A key property of many tensor decompositions, such as the canon…

Tensor Decomposition

Low-Rank Tensor Decompositions for the Theory of Neural Networks

2025-08-25 · Ricardo Borsoi, Konstantin Usevich, Marianne Clausel arxiv

The groundbreaking performance of deep neural networks (NNs) promoted a surge of interest in providing a mathematical basis to deep learning theory. Low-rank tensor decompositions are specially befitting for this task du…

Identifiability of Deep Polynomial Neural Networks

2025-06-20 · Konstantin Usevich, Clara Dérand, Ricardo Borsoi, Marianne Clausel

Polynomial Neural Networks (PNNs) possess a rich algebraic and geometric structure. However, their identifiability -- a key property for ensuring interpretability -- remains poorly understood. In this work, we present a …

DecoderPolynomial Neural Networks

When are Overcomplete Topic Models Identifiable? Uniqueness of Tensor Tucker Decompositions with Structured Sparsity

2013-08-13 · NeurIPS 2013 12 · Animashree Anandkumar, Daniel Hsu, Majid Janzamin, Sham Kakade

Overcomplete latent representations have been very popular for unsupervised feature learning in recent years. In this paper, we specify which overcomplete models can be identified given observable moments of a certain or…

Topic Models

Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyond

2022-12-07 · Nathaniel Johnston, Benjamin Lovitz, Aravindan Vijayaraghavan

We study the problem of finding elements in the intersection of an arbitrary conic variety in $\mathbb{F}^n$ with a given linear subspace (where $\mathbb{F}$ can be the real or complex field). This problem captures a ric…