paper-with-me

Papers

MetaDNS: Enhancing Exploration in Discrete Neural Samplers via Well-Tempered Metadynamics

2026-05-20 · Xiaochen Du, Juno Nam, Jaemoo Choi, Wei Guo, Sathya Edamadaka, Junyi Sha, Elton Pan, Yongxin Chen, Molei Tao, Rafael Gómez-Bombarelli arxiv

Sampling from discrete distributions with multiple modes and energy barriers is fundamental to machine learning and computational physics. Recent discrete neural samplers like MDNS suffer from mode collapse and fail to sample high-energy barrier regions between modes, which is critical for free energy estimation and understanding phase transitions. We propose Metadynamics Discrete Neural Sampler (MetaDNS), a general framework integrating well-tempered metadynamics into discrete diffusion or autoregressive samplers. By maintaining an adaptive, history-dependent bias potential along selected low-dimensional coordinates, MetaDNS forces exploration of previously inaccessible regions, enabling free energy reconstruction infeasible with standard neural samplers due to a lack of high-energy samples. On challenging low-temperature benchmarks including Ising, Potts, and the copper-gold binary alloy, MetaDNS reproduces the thermodynamic distribution. Compared to MCMC-based metadynamics, MetaDNS also achieves comparable exploration requiring fewer bias deposition steps.

📄 PDF Abstract BibTeX arXiv:2605.21722

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Exploring Non-Convex Discrete Energy Landscapes: An Efficient Langevin-Like Sampler with Replica Exchange

2025-01-28 · Haoyang Zheng, Hengrong Du, Ruqi Zhang, Guang Lin

Gradient-based Discrete Samplers (GDSs) are effective for sampling discrete energy landscapes. However, they often stagnate in complex, non-convex settings. To improve exploration, we introduce the Discrete Replica EXcha…

Discrete diffusion samplers and bridges: Off-policy algorithms and applications in latent spaces

2026-02-05 · Arran Carter, Sanghyeok Choi, Kirill Tamogashev, Víctor Elvira 외 arxiv

Sampling from a distribution $p(x) \propto e^{-\mathcal{E}(x)}$ known up to a normalising constant is an important and challenging problem in statistics. Recent years have seen the rise of a new family of amortised sampl…

Discrete Langevin-Inspired Posterior Sampling

2026-05-10 · Chaitanya Amballa, Sattwik Basu, Jorge Vančo Sampedro, Romit Roy Choudhury arxiv

We study posterior sampling for inverse problems in discrete state spaces using discrete diffusion models as generative priors. While continuous diffusion models have become widely used for inverse problems, their discre…

Image Restoration

Corrected Samplers for Discrete Flow Models

2026-01-30 · Zhengyan Wan, Yidong Ouyang, Liyan Xie, Hongyuan Zha 외 arxiv

Discrete flow models (DFMs) have been proposed to learn the data distribution on finite state space, offering a flexible framework as an alternative to discrete diffusion models. A line of recent work has studied sampler…

Text-to-Image Generation

Discrete Langevin Sampler via Wasserstein Gradient Flow

2022-06-29 · Haoran Sun, Hanjun Dai, Bo Dai, Haomin Zhou 외

It is known that gradient-based MCMC samplers for continuous spaces, such as Langevin Monte Carlo (LMC), can be derived as particle versions of a gradient flow that minimizes KL divergence on a Wasserstein manifold. The …