paper-with-me

Papers

From probabilistic graphical models to generalized tensor networks for supervised learning

2018-06-15 · Ivan Glasser, Nicola Pancotti, J. Ignacio Cirac

Tensor networks have found a wide use in a variety of applications in physics and computer science, recently leading to both theoretical insights as well as practical algorithms in machine learning. In this work we explore the connection between tensor networks and probabilistic graphical models, and show that it motivates the definition of generalized tensor networks where information from a tensor can be copied and reused in other parts of the network. We discuss the relationship between generalized tensor network architectures used in quantum physics, such as string-bond states, and architectures commonly used in machine learning. We provide an algorithm to train these networks in a supervised-learning context and show that they overcome the limitations of regular tensor networks in higher dimensions, while keeping the computation efficient. A method to combine neural networks and tensor networks as part of a common deep learning architecture is also introduced. We benchmark our algorithm for several generalized tensor network architectures on the task of classifying images and sounds, and show that they outperform previously introduced tensor-network algorithms. The models we consider also have a natural implementation on a quantum computer and may guide the development of near-term quantum machine learning architectures.

📄 PDF Abstract BibTeX arXiv:1806.05964

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningQuantum Machine LearningTensor Networks

Similar Papers 제목 키워드 기반

Interpretable and Scalable Graphical Models for Complex Spatio-temporal Processes

2023-01-15 · Yu Wang

This thesis focuses on data that has complex spatio-temporal structure and on probabilistic graphical models that learn the structure in an interpretable and scalable manner. We target two research areas of interest: Gau…

EEGElectroencephalogram (EEG)Topic ModelsWeather Forecasting

Probabilistic Inference in the Era of Tensor Networks and Differential Programming

2024-05-22 · Martin Roa-Villescas, Xuanzhao Gao, Sander Stuijk, Henk Corporaal 외

Probabilistic inference is a fundamental task in modern machine learning. Recent advances in tensor network (TN) contraction algorithms have enabled the development of better exact inference methods. However, many common…

Tensor Networks

Kullback-Leibler Principal Component for Tensors is not NP-hard

2017-11-21 · Kejun Huang, Nicholas D. Sidiropoulos

We study the problem of nonnegative rank-one approximation of a nonnegative tensor, and show that the globally optimal solution that minimizes the generalized Kullback-Leibler divergence can be efficiently obtained, i.e.…

Deep Generalized Convolutional Sum-Product Networks

2019-02-16 · Jos van de Wolfshaar, Andrzej Pronobis

Sum-Product Networks (SPNs) are hierarchical, graphical models that combine benefits of deep learning and probabilistic modeling. SPNs offer unique advantages to applications demanding exact probabilistic inference over …

GPUImage ClassificationImage Inpainting

Probabilistic Graphical Models and Tensor Networks: A Hybrid Framework

2021-06-29 · Jacob Miller, Geoffrey Roeder, Tai-Danae Bradley

We investigate a correspondence between two formalisms for discrete probabilistic modeling: probabilistic graphical models (PGMs) and tensor networks (TNs), a powerful modeling framework for simulating complex quantum sy…

Tensor Networks