From probabilistic graphical models to generalized tensor networks for supervised learning
Tensor networks have found a wide use in a variety of applications in physics and computer science, recently leading to both theoretical insights as well as practical algorithms in machine learning. In this work we explore the connection between tensor networks and probabilistic graphical models, and show that it motivates the definition of generalized tensor networks where information from a tensor can be copied and reused in other parts of the network. We discuss the relationship between generalized tensor network architectures used in quantum physics, such as string-bond states, and architectures commonly used in machine learning. We provide an algorithm to train these networks in a supervised-learning context and show that they overcome the limitations of regular tensor networks in higher dimensions, while keeping the computation efficient. A method to combine neural networks and tensor networks as part of a common deep learning architecture is also introduced. We benchmark our algorithm for several generalized tensor network architectures on the task of classifying images and sounds, and show that they outperform previously introduced tensor-network algorithms. The models we consider also have a natural implementation on a quantum computer and may guide the development of near-term quantum machine learning architectures.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningQuantum Machine LearningTensor NetworksSimilar Papers 제목 키워드 기반
Interpretable and Scalable Graphical Models for Complex Spatio-temporal Processes
This thesis focuses on data that has complex spatio-temporal structure and on probabilistic graphical models that learn the structure in an interpretable and scalable manner. We target two research areas of interest: Gau…
EEGElectroencephalogram (EEG)Topic ModelsWeather ForecastingProbabilistic Inference in the Era of Tensor Networks and Differential Programming
Probabilistic inference is a fundamental task in modern machine learning. Recent advances in tensor network (TN) contraction algorithms have enabled the development of better exact inference methods. However, many common…
Tensor NetworksKullback-Leibler Principal Component for Tensors is not NP-hard
We study the problem of nonnegative rank-one approximation of a nonnegative tensor, and show that the globally optimal solution that minimizes the generalized Kullback-Leibler divergence can be efficiently obtained, i.e.…
Deep Generalized Convolutional Sum-Product Networks
Sum-Product Networks (SPNs) are hierarchical, graphical models that combine benefits of deep learning and probabilistic modeling. SPNs offer unique advantages to applications demanding exact probabilistic inference over …
GPUImage ClassificationImage InpaintingProbabilistic Graphical Models and Tensor Networks: A Hybrid Framework
We investigate a correspondence between two formalisms for discrete probabilistic modeling: probabilistic graphical models (PGMs) and tensor networks (TNs), a powerful modeling framework for simulating complex quantum sy…
Tensor Networks