paper-with-me

홈 › Papers

Directly Training Joint Energy-Based Models for Conditional Synthesis and Calibrated Prediction of Multi-Attribute Data

2021-07-19 · Jacob Kelly, Richard Zemel, Will Grathwohl

Multi-attribute classification generalizes classification, presenting new challenges for making accurate predictions and quantifying uncertainty. We build upon recent work and show that architectures for multi-attribute prediction can be reinterpreted as energy-based models (EBMs). While existing EBM approaches achieve strong discriminative performance, they are unable to generate samples conditioned on novel attribute combinations. We propose a simple extension which expands the capabilities of EBMs to generating accurate conditional samples. Our approach, combined with newly developed techniques in energy-based model training, allows us to directly maximize the likelihood of data and labels under the unnormalized joint distribution. We evaluate our proposed approach on high-dimensional image data with high-dimensional binary attribute labels. We find our models are capable of both accurate, calibrated predictions and high-quality conditional synthesis of novel attribute combinations.

📄 PDF Abstract BibTeX arXiv:2108.04227

Code (1)

jacobjinkelly/gibbs-jem 공식 구현 pytorch

Tasks

Attribute

Methods 이 논문이 사용한 방법론

EBM 설명 없음

Similar Papers 제목 키워드 기반

Joint Training of Variational Auto-Encoder and Latent Energy-Based Model

2020-06-10 · CVPR 2020 6 · Tian Han, Erik Nijkamp, Linqi Zhou, Bo Pang 외

This paper proposes a joint training method to learn both the variational auto-encoder (VAE) and the latent energy-based model (EBM). The joint training of VAE and latent EBM are based on an objective function that consi…

Anomaly Detection

No Conditional Models for me: Training Joint EBMs on Mixed Continuous and Discrete Data

2021-02-26 · ICLR Workshop EBM 2021 5 · Jacob Kelly, Will Sussman Grathwohl

We propose energy-based models of the joint distribution of data and supervision. While challenging to work with, this approach gives flexibility when designing energy functions and easy parameterization for structured s…

Cooperative Training of Fast Thinking Initializer and Slow Thinking Solver for Conditional Learning

2019-02-07 · Jianwen Xie, Zilong Zheng, Xiaolin Fang, Song-Chun Zhu 외

This paper studies the problem of learning the conditional distribution of a high-dimensional output given an input, where the output and input may belong to two different domains, e.g., the output is a photo image and t…

Image GenerationImage-to-Image Translation

Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction

2023-04-13 · ICCV 2023 1 · Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian 외

3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images. Despite numerous task-specific methods, developing a comprehensive model remains challenging. In thi…

3D-Aware Image Synthesis3D Generation3D ReconstructionDecoder+4

Learning Energy-Based Model with Variational Auto-Encoder as Amortized Sampler

2020-12-29 · Jianwen Xie, Zilong Zheng, Ping Li

Due to the intractable partition function, training energy-based models (EBMs) by maximum likelihood requires Markov chain Monte Carlo (MCMC) sampling to approximate the gradient of the Kullback-Leibler divergence betwee…