paper-with-me

홈 › Papers

Stochastic trace estimation with tensor train random vectors

2026-06-14 · Zvonimir Bujanović, Daniel Kressner, Hrvoje Olić arxiv

Stochastic trace estimation is a standard tool for approximating the trace of a large-scale matrix available only through matrix-vector products. However, in tensor-structured settings, unstructured Gaussian or Rademacher test vectors may be prohibitively expensive to store and compute with, while cheaper rank-one tensor-product vectors can require sample complexities that grow exponentially with the tensor order. This work studies Gaussian random tensor train vectors as a structured alternative for stochastic trace estimation. We show that, with a suitable choice of the tensor train rank, random tensor train vectors recover dimension-independent guarantees for the Girard--Hutchinson estimator. In particular, a median-of-means variant with tensor train rank $r \geq d-1$ achieves the same dependence on the accuracy $\varepsilon$ and failure probability $δ$ as the classical estimator based on unstructured Gaussian vectors. We further prove an oblivious subspace injection result for sketches formed from independent Gaussian random tensor train vectors: tensor train rank $r\geq d-1$ and $\mathcal{O}(\varepsilon^{-2}(k+\log(1/δ)))$ samples suffice for a $k$-dimensional target subspace. Finally, we investigate the use of such sketches within the Nyström++ framework. We show that the resulting estimator can achieve the desired $\mathcal{O}(\varepsilon^{-1})$ sample complexity under an additional spectral-tail condition. These results provide clarififcation on both the potential and the limitations of random tensor train vectors in stochastic trace estimation.

📄 PDF Abstract BibTeX arXiv:2606.15679

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Low-memory stochastic backpropagation with multi-channel randomized trace estimation

2021-06-13 · Mathias Louboutin, Ali Siahkoohi, Rongrong Wang, Felix J. Herrmann

Thanks to the combination of state-of-the-art accelerators and highly optimized open software frameworks, there has been tremendous progress in the performance of deep neural networks. While these developments have been …

Semantic Segmentation

Stochastic Gradients for Large-Scale Tensor Decomposition

2019-06-04 · Tamara G. Kolda, David Hong

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tens…

Tensor Decomposition

Estimation of matrix trace using machine learning

2016-06-16 · Boram Yoon

We present a new trace estimator of the matrix whose explicit form is not given but its matrix multiplication to a vector is available. The form of the estimator is similar to the Hutchison stochastic trace estimator, bu…

BIG-bench Machine LearningForm

Parameter estimation and bifurcation analysis of stochastic models of gene regulatory networks: tensor-structured methods

2015-03-15

Stochastic modelling provides an indispensable tool for understanding how random events at the molecular level influence cellular functions. In practice, the common challenge is to calibrate a large number of model param…

parameter estimation

Entropic Trace Estimates for Log Determinants

2017-04-24 · Jack Fitzsimons, Diego Granziol, Kurt Cutajar, Michael Osborne 외

The scalable calculation of matrix determinants has been a bottleneck to the widespread application of many machine learning methods such as determinantal point processes, Gaussian processes, generalised Markov random fi…

Gaussian ProcessesPoint Processes