paper-with-me

홈 › Papers

Structured Output Learning with Conditional Generative Flows

2019-05-30 · You Lu, Bert Huang

Traditional structured prediction models try to learn the conditional likelihood, i.e., p(y|x), to capture the relationship between the structured output y and the input features x. For many models, computing the likelihood is intractable. These models are therefore hard to train, requiring the use of surrogate objectives or variational inference to approximate likelihood. In this paper, we propose conditional Glow (c-Glow), a conditional generative flow for structured output learning. C-Glow benefits from the ability of flow-based models to compute p(y|x) exactly and efficiently. Learning with c-Glow does not require a surrogate objective or performing inference during training. Once trained, we can directly and efficiently generate conditional samples. We develop a sample-based prediction method, which can use this advantage to do efficient and effective inference. In our experiments, we test c-Glow on five different tasks. C-Glow outperforms the state-of-the-art baselines in some tasks and predicts comparable outputs in the other tasks. The results show that c-Glow is versatile and is applicable to many different structured prediction problems.

📄 PDF Abstract BibTeX arXiv:1905.13288

Code (2)

yolu1055/conditional-glow 공식 구현 pytorch
MoeinSorkhei/glow2 pytorch

Tasks

PredictionStructured PredictionVariational Inference

Methods 이 논문이 사용한 방법론

Invertible 1x1 Convolution The Invertible 1x1 Convolution is a type of convolution used in flow-based generative models that reverses the ordering of…
Activation Normalization Activation Normalization is a type of normalization used for flow-based generative models; specifically it was introduced in the GLOW…
Affine Coupling 설명 없음
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
GLOW 설명 없음

Similar Papers 제목 키워드 기반

Flow-based Spatio-Temporal Structured Prediction of Motion Dynamics

2021-04-09 · Mohsen Zand, Ali Etemad, Michael Greenspan

Conditional Normalizing Flows (CNFs) are flexible generative models capable of representing complicated distributions with high dimensionality and large interdimensional correlations, making them appealing for structured…

motion predictionPredictionStructured PredictionTime Series+3

Learning Likelihoods with Conditional Normalizing Flows

2019-11-29 · Christina Winkler, Daniel Worrall, Emiel Hoogeboom, Max Welling

Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network u…

Structured PredictionSuper-Resolution

Generative structured normalizing flow Gaussian processes applied to spectroscopic data

2022-12-14 · Natalie Klein, Nishant Panda, Patrick Gasda, Diane Oyen

In this work, we propose a novel generative model for mapping inputs to structured, high-dimensional outputs using structured conditional normalizing flows and Gaussian process regression. The model is motivated by the n…

Gaussian ProcessesUncertainty Quantification

Generative Flows with Invertible Attentions

2021-06-07 · CVPR 2022 1 · Rhea Sanjay Sukthanker, Zhiwu Huang, Suryansh Kumar, Radu Timofte 외

Flow-based generative models have shown an excellent ability to explicitly learn the probability density function of data via a sequence of invertible transformations. Yet, learning attentions in generative flows remains…

Image Generation

Structured Neural Networks for Density Estimation and Causal Inference

2023-11-03 · NeurIPS 2023 11

Injecting structure into neural networks enables learning functions that satisfy invariances with respect to subsets of inputs. For instance, when learning generative models using neural networks, it is advantageous to e…

Causal InferencecounterfactualDensity Estimation