paper-with-me

Papers

Training neural control variates using correlated configurations

2025-05-12 · Hyunwoo Oh

Neural control variates (NCVs) have emerged as a powerful tool for variance reduction in Monte Carlo (MC) simulations, particularly in high-dimensional problems where traditional control variates are difficult to construct analytically. By training neural networks to learn auxiliary functions correlated with the target observable, NCVs can significantly reduce estimator variance while preserving unbiasedness. However, a critical but often overlooked aspect of NCV training is the role of autocorrelated samples generated by Markov Chain Monte Carlo (MCMC). While such samples are typically discarded for error estimation due to their statistical redundancy, they may contain useful information about the structure of the underlying probability distribution that can benefit the training process. In this work, we systematically examine the effect of using correlated configurations in training neural control variates. We demonstrate, both conceptually and numerically, that training on correlated data can improve control variate performance, especially in settings with limited computational resources. Our analysis includes empirical results from $U(1)$ gauge theory and scalar field theory, illustrating when and how autocorrelated samples enhance NCV construction. These findings provide practical guidance for the efficient use of MCMC data in training neural networks.

📄 PDF Abstract BibTeX arXiv:2505.07719

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Ensembled sparse-input hierarchical networks for high-dimensional datasets

2020-05-11 · Jean Feng, Noah Simon

Neural networks have seen limited use in prediction for high-dimensional data with small sample sizes, because they tend to overfit and require tuning many more hyperparameters than existing off-the-shelf machine learnin…

Vocal Bursts Intensity Prediction

Graph-based regularization for regression problems with alignment and highly-correlated designs

2018-03-20 · Yuan Li, Benjamin Mark, Garvesh Raskutti, Rebecca Willett 외

Sparse models for high-dimensional linear regression and machine learning have received substantial attention over the past two decades. Model selection, or determining which features or covariates are the best explanato…

Model Selectionregression

When do Random Forests work?

2025-04-17 · C. Revelas, O. Boldea, B. J. M. Werker

We study the effectiveness of randomizing split-directions in random forests. Prior literature has shown that, on the one hand, randomization can reduce variance through decorrelation, and, on the other hand, randomizati…

Controlling for Omitted Variable Bias in Deep Neural Networks

2026-08-26 · Manuel Pfeuffer, Roshan Prakash Rane, Kerstin Ritter, Sonja Greven arxiv

Control variables are widely used in statistical modelling to account for omitted variable bias of known confounders. However, they have largely been underexplored in deep learning. This is surprising, given that deep le…

For high-dimensional hierarchical models, consider exchangeability of effects across covariates instead of across datasets

2021-07-13 · NeurIPS 2021 12 · Brian L. Trippe, Hilary K. Finucane, Tamara Broderick

Hierarchical Bayesian methods enable information sharing across multiple related regression problems. While standard practice is to model regression parameters (effects) as (1) exchangeable across datasets and (2) correl…

regression