paper-with-me

홈 › Papers

Learning Structured Output Representation using Deep Conditional Generative Models

2015-12-01 · NeurIPS 2015 12 · Kihyuk Sohn, Honglak Lee, Xinchen Yan

Supervised deep learning has been successfully applied for many recognition problems in machine learning and computer vision. Although it can approximate a complex many-to-one function very well when large number of training data is provided, the lack of probabilistic inference of the current supervised deep learning methods makes it difficult to model a complex structured output representations. In this work, we develop a scalable deep conditional generative model for structured output variables using Gaussian latent variables. The model is trained efficiently in the framework of stochastic gradient variational Bayes, and allows a fast prediction using stochastic feed-forward inference. In addition, we provide novel strategies to build a robust structured prediction algorithms, such as recurrent prediction network architecture, input noise-injection and multi-scale prediction training methods. In experiments, we demonstrate the effectiveness of our proposed algorithm in comparison to the deterministic deep neural network counterparts in generating diverse but realistic output representations using stochastic inference. Furthermore, the proposed schemes in training methods and architecture design were complimentary, which leads to achieve strong pixel-level object segmentation and semantic labeling performance on Caltech-UCSD Birds 200 and the subset of Labeled Faces in the Wild dataset.

📄 PDF Abstract BibTeX

Code (1)

ucals/cvae pytorch

Tasks

PredictionSemantic SegmentationStructured Prediction

Methods 이 논문이 사용한 방법론

cVAE 설명 없음
Stochastic Gradient Variational Bayes 설명 없음

Similar Papers 제목 키워드 기반

Learning Structured Output Representations from Attributes using Deep Conditional Generative Models

2023-04-30 · Mohamed Debbagh

Structured output representation is a generative task explored in computer vision that often times requires the mapping of low dimensional features to high dimensional structured outputs. Losses in complex spatial inform…

Image SegmentationSemantic Segmentation

Flow-based Spatio-Temporal Structured Prediction of Motion Dynamics

2021-04-09 · Mohsen Zand, Ali Etemad, Michael Greenspan

Conditional Normalizing Flows (CNFs) are flexible generative models capable of representing complicated distributions with high dimensionality and large interdimensional correlations, making them appealing for structured…

motion predictionPredictionStructured PredictionTime Series+3

Structured Output Learning with Conditional Generative Flows

2019-05-30 · You Lu, Bert Huang

Traditional structured prediction models try to learn the conditional likelihood, i.e., p(y|x), to capture the relationship between the structured output y and the input features x. For many models, computing the likelih…

PredictionStructured PredictionVariational Inference

Generative structured normalizing flow Gaussian processes applied to spectroscopic data

2022-12-14 · Natalie Klein, Nishant Panda, Patrick Gasda, Diane Oyen

In this work, we propose a novel generative model for mapping inputs to structured, high-dimensional outputs using structured conditional normalizing flows and Gaussian process regression. The model is motivated by the n…

Gaussian ProcessesUncertainty Quantification

Graph2Graph Learning with Conditional Autoregressive Models

2021-06-06 · Guan Wang, Francois Bernard Lauze, Aasa Feragen

We present a graph neural network model for solving graph-to-graph learning problems. Most deep learning on graphs considers ``simple'' problems such as graph classification or regressing real-valued graph properties. Fo…

Graph ClassificationGraph LearningGraph Neural Network