paper-with-me

홈 › Papers

Composing graphical models with neural networks for structured representations and fast inference

2016-03-20 · NeurIPS 2016 12 · Matthew J. Johnson, David Duvenaud, Alexander B. Wiltschko, Sandeep R. Datta, Ryan P. Adams

We propose a general modeling and inference framework that composes probabilistic graphical models with deep learning methods and combines their respective strengths. Our model family augments graphical structure in latent variables with neural network observation models. For inference, we extend variational autoencoders to use graphical model approximating distributions with recognition networks that output conjugate potentials. All components of these models are learned simultaneously with a single objective, giving a scalable algorithm that leverages stochastic variational inference, natural gradients, graphical model message passing, and the reparameterization trick. We illustrate this framework with several example models and an application to mouse behavioral phenotyping.

📄 PDF Abstract BibTeX arXiv:1603.06277

Code (3)

mattjj/svae 공식 구현
EddieCunningham/GraphLSSM
JohanvandenHeuvel/SVAE pytorch

Tasks

Variational Inference

Similar Papers 제목 키워드 기반

Unbiased Learning of Deep Generative Models with Structured Discrete Representations

2023-06-14 · NeurIPS 2023 11 · Harry Bendekgey, Gabriel Hope, Erik B. Sudderth

By composing graphical models with deep learning architectures, we learn generative models with the strengths of both frameworks. The structured variational autoencoder (SVAE) inherits structure and interpretability from…

Time Series

Variational Message Passing with Structured Inference Networks

2018-03-15 · ICLR 2018 1 · Wu Lin, Nicolas Hubacher, Mohammad Emtiyaz Khan

Recent efforts on combining deep models with probabilistic graphical models are promising in providing flexible models that are also easy to interpret. We propose a variational message-passing algorithm for variational i…

Variational Inference

Bethe Projections for Non-Local Inference

2015-03-04 · Luke Vilnis, David Belanger, Daniel Sheldon, Andrew McCallum

Many inference problems in structured prediction are naturally solved by augmenting a tractable dependency structure with complex, non-local auxiliary objectives. This includes the mean field family of variational infere…

Handwriting RecognitionStructured PredictionVariational Inference

Hinge-loss Markov Random Fields: Convex Inference for Structured Prediction

2013-09-26 · Stephen Bach, Bert Huang, Ben London, Lise Getoor

Graphical models for structured domains are powerful tools, but the computational complexities of combinatorial prediction spaces can force restrictions on models, or require approximate inference in order to be tractabl…

Structured Prediction

Exact inference and learning for cumulative distribution functions on loopy graphs

2010-12-01 · NeurIPS 2010 12 · Nebojsa Jojic, Chris Meek, Jim C. Huang

Probabilistic graphical models use local factors to represent dependence among sets of variables. For many problem domains, for instance climatology and epidemiology, in addition to local dependencies, we may also wish t…

Epidemiology