paper-with-me

홈 › Papers

Scalable Inference-Time Annealing with Surrogate Likelihood Estimators

2026-05-29 · Daniel Peñaherrera, Rishal Aggarwal, David Ryan Koes arxiv

A long standing challenge in computational chemistry and biophysics is efficiently sampling the Boltzmann distribution of molecules. Advances in generative modeling have been proposed to address the limitations of conventional sampling techniques by eliminating the computational cost of simulation. A promising direction is iteratively finetuning diffusion models along a temperature ladder whereby training data is generated via importance sampling during inference-time annealing. Unfortunately, these methods require computing a divergence over the score field to estimate importance weights, rendering them intractable for larger systems. Here we present scalable inference-time annealing (SITA), which retrains flow-based models to generate samples at progressively lower temperatures using an energy-based model to facilitate fast surrogate likelihoods. We demonstrate state-of-the-art performance on both Alanine Dipeptide and Alanine Tripeptide while avoiding costly divergence terms. Our code is available at https://github.com/countrsignal/sita.git

📄 PDF Abstract BibTeX arXiv:2605.31498

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Simulated Annealing Approach to Bayesian Inference

2015-09-17 · Carlo Albert

A generic algorithm for the extraction of probabilistic (Bayesian) information about model parameters from data is presented. The algorithm propagates an ensemble of particles in the product space of model parameters and…

Bayesian Inference

Black-box optimization and quantum annealing for filtering out mislabeled training instances

2025-01-12 · Makoto Otsuka, Kento Kodama, Keisuke Morita, Masayuki Ohzeki

This study proposes an approach for removing mislabeled instances from contaminated training datasets by combining surrogate model-based black-box optimization (BBO) with postprocessing and quantum annealing. Mislabeled …

Keeping Score: Efficiency Improvements in Neural Likelihood Surrogate Training via Score-Augmented Loss Functions

2026-05-12 · Alexander Shen, Mikael Kuusela arxiv

For stochastic process models, parameter inference is often severely bottlenecked by computationally expensive likelihood functions. Simulation-based inference (SBI) bypasses this restriction by constructing amortized su…

Stochastic Variational Inference via Upper Bound

2019-12-02 · Chunlin Ji, Haige Shen

Stochastic variational inference (SVI) plays a key role in Bayesian deep learning. Recently various divergences have been proposed to design the surrogate loss for variational inference. We present a simple upper bound o…

Variational Inference

Variational Tempering

2014-11-07 · Stephan Mandt, James McInerney, Farhan Abrol, Rajesh Ranganath 외

Variational inference (VI) combined with data subsampling enables approximate posterior inference over large data sets, but suffers from poor local optima. We first formulate a deterministic annealing approach for the ge…

Variational Inference