paper-with-me

Papers

Neural Control Variates

2020-06-02 · Thomas Müller, Fabrice Rousselle, Jan Novák, Alexander Keller

We propose neural control variates (NCV) for unbiased variance reduction in parametric Monte Carlo integration. So far, the core challenge of applying the method of control variates has been finding a good approximation of the integrand that is cheap to integrate. We show that a set of neural networks can face that challenge: a normalizing flow that approximates the shape of the integrand and another neural network that infers the solution of the integral equation. We also propose to leverage a neural importance sampler to estimate the difference between the original integrand and the learned control variate. To optimize the resulting parametric estimator, we derive a theoretically optimal, variance-minimizing loss function, and propose an alternative, composite loss for stable online training in practice. When applied to light transport simulation, neural control variates are capable of matching the state-of-the-art performance of other unbiased approaches, while providing means to develop more performant, practical solutions. Specifically, we show that the learned light-field approximation is of sufficient quality for high-order bounces, allowing us to omit the error correction and thereby dramatically reduce the noise at the cost of negligible visible bias.

📄 PDF Abstract BibTeX arXiv:2006.01524

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Using Large Ensembles of Control Variates for Variational Inference

2018-10-30 · NeurIPS 2018 12 · Tomas Geffner, Justin Domke

Variational inference is increasingly being addressed with stochastic optimization. In this setting, the gradient's variance plays a crucial role in the optimization procedure, since high variance gradients lead to poor …

Stochastic OptimizationVariational Inference

Probabilistic Model Incorporating Auxiliary Covariates to Control FDR

2022-10-06 · Lin Qiu, Nils Murrugarra-Llerena, Vítor Silva, Lin Lin 외

Controlling False Discovery Rate (FDR) while leveraging the side information of multiple hypothesis testing is an emerging research topic in modern data science. Existing methods rely on the test-level covariates while i…

model

Coordinate-wise Control Variates for Deep Policy Gradients

2021-07-11 · Yuanyi Zhong, Yuan Zhou, Jian Peng

The control variates (CV) method is widely used in policy gradient estimation to reduce the variance of the gradient estimators in practice. A control variate is applied by subtracting a baseline function from the state-…

continuous-controlContinuous Control

Stochastic Multi-Armed Bandits with Control Variates

2021-05-09 · NeurIPS 2021 12 · Arun Verma, Manjesh K. Hanawal

This paper studies a new variant of the stochastic multi-armed bandits problem where auxiliary information about the arm rewards is available in the form of control variates. In many applications like queuing and wireles…

Multi-Armed Bandits

Scalable Control Variates for Monte Carlo Methods via Stochastic Optimization

2020-06-12 · Shijing Si, Chris. J. Oates, Andrew B. Duncan, Lawrence Carin 외

Control variates are a well-established tool to reduce the variance of Monte Carlo estimators. However, for large-scale problems including high-dimensional and large-sample settings, their advantages can be outweighed by…

Bayesian InferenceStochastic Optimization