Simulation-based Inference via Langevin Dynamics with Score Matching
Simulation-based inference (SBI) enables Bayesian analysis when the likelihood is intractable but model simulations are available. Recent advances in statistics and machine learning, including Approximate Bayesian Computation and deep generative models, have expanded the applicability of SBI, yet these methods often face substantial computational challenges as the sample size and parameter dimension increase. In this paper, we propose a novel scalable SBI method that integrates score matching with Langevin dynamics, while explicitly exploiting the statistical structure of log-likelihood functions. Our approach combines (i) a localization scheme that concentrates computation in regions of high posterior mass and (ii) a structured score network that embeds key properties of likelihood scores, including additivity across observations and Fisher information identities. We provide theoretical and empirical evidence demonstrating that the proposed structured score-matching approach improves statistical efficiency and computational scalability, achieving competitive or superior performance compared to existing SBI methods on both benchmark and challenging problems with large sample sizes and moderate-dimensional parameter spaces.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Adversarial score matching and improved sampling for image generation
Denoising Score Matching with Annealed Langevin Sampling (DSM-ALS) has recently found success in generative modeling. The approach works by first training a neural network to estimate the score of a distribution, and the…
DenoisingImage GenerationReal-Time Generative Policy via Langevin-Guided Flow Matching for Autonomous Driving
Reinforcement learning (RL) is a fundamental methodology in autonomous driving systems, where generative policies exhibit considerable potential by leveraging their ability to model complex distributions to enhance explo…
Reinforcement LearningAutonomous DrivingTheoretical guidelines for annealed Langevin dynamics in compositional simulation-based inference
Compositional score-based approaches to simulation-based inference (SBI) approximate the posterior over a shared parameter given $n$ independent observations by aggregating individually learned posterior scores: currentl…
Generative Modelling with High-Order Langevin Dynamics
Diffusion generative modelling (DGM) based on stochastic differential equations (SDEs) with score matching has achieved unprecedented results in data generation. In this paper, we propose a novel fast high-quality genera…
Image GenerationUnconditional Image GenerationScore-based Metropolis-Hastings for Fractional Langevin Algorithms
Sampling from heavy-tailed and multimodal distributions is challenging when neither the target density nor the proposal density can be evaluated, as in $α$-stable Lévy-driven fractional Langevin algorithms. While the tar…