paper-with-me

Papers

Model Approximation Using Cascade of Tree Decompositions

2018-08-10 · Navid Tafaghodi Khajavi, Anthony Kuh

In this paper, we present a general, multistage framework for graphical model approximation using a cascade of models such as trees. In particular, we look at the problem of covariance matrix approximation for Gaussian distributions as linear transformations of tree models. This is a new way to decompose the covariance matrix. Here, we propose an algorithm which incorporates the Cholesky factorization method to compute the decomposition matrix and thus can approximate a simple graphical model using a cascade of the Cholesky factorization of the tree approximation transformations. The Cholesky decomposition enables us to achieve a tree structure factor graph at each cascade stage of the algorithm which facilitates the use of the message passing algorithm since the approximated graph has less loops compared to the original graph. The overall graph is a cascade of factor graphs with each factor graph being a tree. This is a different perspective on the approximation model, and algorithms such as Gaussian belief propagation can be used on this overall graph. Here, we present theoretical result that guarantees the convergence of the proposed model approximation using the cascade of tree decompositions. In the simulations, we look at synthetic and real data and measure the performance of the proposed framework by comparing the KL divergences.

📄 PDF Abstract BibTeX arXiv:1808.03504

Code (0)

등록된 구현이 없습니다.

Tasks

model

Similar Papers 제목 키워드 기반

Near-Linear Time and Fixed-Parameter Tractable Algorithms for Tensor Decompositions

2022-07-15 · Arvind V. Mahankali, David P. Woodruff, Ziyu Zhang

We study low rank approximation of tensors, focusing on the tensor train and Tucker decompositions, as well as approximations with tree tensor networks and more general tensor networks. For tensor train decomposition, we…

Dimensionality ReductionTensor DecompositionTensor Networks

Seeing the Forest from the Trees in Two Looks: Matrix Sketching by Cascaded Bilateral Sampling

2016-07-25 · Kai Zhang, Chuanren Liu, Jie Zhang, Hui Xiong 외

Matrix sketching is aimed at finding close approximations of a matrix by factors of much smaller dimensions, which has important applications in optimization and machine learning. Given a matrix A of size m by n, state-o…

Approximately Optimal Core Shapes for Tensor Decompositions

2023-02-08 · Mehrdad Ghadiri, Matthew Fahrbach, Gang Fu, Vahab Mirrokni

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximatio…

Combinatorial Optimization

A Backtracking-Based Algorithm for Computing Hypertree-Decompositions

2007-01-14 · Georg Gottlob, Marko Samer

Hypertree decompositions of hypergraphs are a generalization of tree decompositions of graphs. The corresponding hypertree-width is a measure for the cyclicity and therefore tractability of the encoded computation proble…

How Informative is the Approximation Error from Tensor Decomposition for Neural Network Compression?

2023-05-09 · Jetze T. Schuurmans, Kim Batselier, Julian F. P. Kooij

Tensor decompositions have been successfully applied to compress neural networks. The compression algorithms using tensor decompositions commonly minimize the approximation error on the weights. Recent work assumes the a…

Neural Network CompressionTensor Decomposition