paper-with-me

Papers

Deep Bayesian Active Learning for Accelerating Stochastic Simulation

2021-06-05 · Dongxia Wu, Ruijia Niu, Matteo Chinazzi, Alessandro Vespignani, Yi-An Ma, Rose Yu

Stochastic simulations such as large-scale, spatiotemporal, age-structured epidemic models are computationally expensive at fine-grained resolution. While deep surrogate models can speed up the simulations, doing so for stochastic simulations and with active learning approaches is an underexplored area. We propose Interactive Neural Process (INP), a deep Bayesian active learning framework for learning deep surrogate models to accelerate stochastic simulations. INP consists of two components, a spatiotemporal surrogate model built upon Neural Process (NP) family and an acquisition function for active learning. For surrogate modeling, we develop Spatiotemporal Neural Process (STNP) to mimic the simulator dynamics. For active learning, we propose a novel acquisition function, Latent Information Gain (LIG), calculated in the latent space of NP based models. We perform a theoretical analysis and demonstrate that LIG reduces sample complexity compared with random sampling in high dimensions. We also conduct empirical studies on three complex spatiotemporal simulators for reaction diffusion, heat flow, and infectious disease. The results demonstrate that STNP outperforms the baselines in the offline learning setting and LIG achieves the state-of-the-art for Bayesian active learning.

📄 PDF Abstract BibTeX arXiv:2106.02770

Code (1)

rose-stl-lab/interactive-neural-process 공식 구현 pytorch

Tasks

Active Learning

Similar Papers 제목 키워드 기반

Accelerating Reinforcement Learning Training Using Simulation Surrogate Models

2026-05-26 · Mohammadmahdi Ghasemloo, David J. Eckman, Yaxian Li arxiv

High-fidelity simulation models are widely used to analyze complex stochastic systems, but their high computational cost motivates the development of cheaper surrogate models that approximate the simulation model's input…

Reinforcement Learning

Bayesian E(3)-Equivariant Interatomic Potential with Iterative Restratification of Many-body Message Passing

2025-10-03 · Soohaeng Yoo Willow, Tae Hyeon Park, Gi Beom Sim, Sung Wook Moon 외 arxiv

Machine learning potentials (MLPs) have become essential for large-scale atomistic simulations, enabling ab initio-level accuracy with computational efficiency. However, current MLPs struggle with uncertainty quantificat…

Computational EfficiencyActive Learning

Accelerating Convergence of Stein Variational Gradient Descent via Deep Unfolding

2024-02-23 · Yuya Kawamura, Satoshi Takabe

Stein variational gradient descent (SVGD) is a prominent particle-based variational inference method used for sampling a target distribution. SVGD has attracted interest for application in machine-learning techniques suc…

Bayesian InferenceVariational Inference

Bayesian multi-objective optimization for stochastic simulators: an extension of the Pareto Active Learning method

2022-07-08 · Bruno Barracosa, Julien Bect, Héloïse Dutrieux Baraffe, Juliette Morin 외

This article focuses on the multi-objective optimization of stochastic simulators with high output variance, where the input space is finite and the objective functions are expensive to evaluate. We rely on Bayesian opti…

Active LearningBayesian Optimization

Bayesian posterior approximation with stochastic ensembles

2022-12-15 · CVPR 2023 1 · Oleksandr Balabanov, Bernhard Mehlig, Hampus Linander

We introduce ensembles of stochastic neural networks to approximate the Bayesian posterior, combining stochastic methods such as dropout with deep ensembles. The stochastic ensembles are formulated as families of distrib…

Bayesian Inferenceimage-classificationImage ClassificationVariational Inference