paper-with-me

홈 › Papers

Generative Models as Distributions of Functions

2021-02-09 · Emilien Dupont, Yee Whye Teh, Arnaud Doucet

Generative models are typically trained on grid-like data such as images. As a result, the size of these models usually scales directly with the underlying grid resolution. In this paper, we abandon discretized grids and instead parameterize individual data points by continuous functions. We then build generative models by learning distributions over such functions. By treating data points as functions, we can abstract away from the specific type of data we train on and construct models that are agnostic to discretization. To train our model, we use an adversarial approach with a discriminator that acts on continuous signals. Through experiments on a wide variety of data modalities including images, 3D shapes and climate data, we demonstrate that our model can learn rich distributions of functions independently of data type and resolution.

📄 PDF Abstract BibTeX arXiv:2102.04776

Code (1)

EmilienDupont/neural-function-distributions 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Evidential Softmax for Sparse Multimodal Distributions in Deep Generative Models

2021-10-27 · NeurIPS 2021 12 · Phil Chen, Masha Itkina, Ransalu Senanayake, Mykel J. Kochenderfer

Many applications of generative models rely on the marginalization of their high-dimensional output probability distributions. Normalization functions that yield sparse probability distributions can make exact marginaliz…

Improving Evolutionary Strategies with Generative Neural Networks

2019-01-31 · Louis Faury, Clement Calauzenes, Olivier Fercoq, Syrine Krichen

Evolutionary Strategies (ES) are a popular family of black-box zeroth-order optimization algorithms which rely on search distributions to efficiently optimize a large variety of objective functions. This paper investigat…

Neural Generative Models for Global Optimization with Gradients

2018-05-22 · Louis Faury, Flavian vasile, Clément Calauzènes, Olivier Fercoq

The aim of global optimization is to find the global optimum of arbitrary classes of functions, possibly highly multimodal ones. In this paper we focus on the subproblem of global optimization for differentiable function…

Bayesian OptimizationGaussian Processesglobal-optimization

On the ability of neural nets to express distributions

2017-02-22 · Holden Lee, Rong Ge, Tengyu Ma, Andrej Risteski 외

Deep neural nets have caused a revolution in many classification tasks. A related ongoing revolution -- also theoretically not understood -- concerns their ability to serve as generative models for complicated types of d…

Generative Bayesian Optimization: Generative Models as Acquisition Functions

2025-10-29 · Rafael Oliveira, Daniel M. Steinberg, Edwin V. Bonilla arxiv

We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large batch scaling as generative sampling, o…