paper-with-me

홈 › Papers

Beyond ELBOs: A Large-Scale Evaluation of Variational Methods for Sampling

2024-06-11 · Denis Blessing, Xiaogang Jia, Johannes Esslinger, Francisco Vargas, Gerhard Neumann

Monte Carlo methods, Variational Inference, and their combinations play a pivotal role in sampling from intractable probability distributions. However, current studies lack a unified evaluation framework, relying on disparate performance measures and limited method comparisons across diverse tasks, complicating the assessment of progress and hindering the decision-making of practitioners. In response to these challenges, our work introduces a benchmark that evaluates sampling methods using a standardized task suite and a broad range of performance criteria. Moreover, we study existing metrics for quantifying mode collapse and introduce novel metrics for this purpose. Our findings provide insights into strengths and weaknesses of existing sampling methods, serving as a valuable reference for future developments. The code is publicly available here.

📄 PDF Abstract BibTeX arXiv:2406.07423

Code (1)

denisbless/variational_sampling_methods 공식 구현 jax

Tasks

Decision MakingVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Collapsed Variational Bounds for Bayesian Neural Networks

2021-12-01 · NeurIPS 2021 12 · Marcin Tomczak, Siddharth Swaroop, Andrew Foong, Richard Turner

Recent interest in learning large variational Bayesian Neural Networks (BNNs) has been partly hampered by poor predictive performance caused by underfitting, and their performance is known to be very sensitive to the pri…

Variational Inference

Semi-Implicit Variational Inference via Score Matching

2023-08-19 · Longlin Yu, Cheng Zhang

Semi-implicit variational inference (SIVI) greatly enriches the expressiveness of variational families by considering implicit variational distributions defined in a hierarchical manner. However, due to the intractable d…

Bayesian InferenceDenoisingVariational Inference

LATENT OPTIMIZATION VARIATIONAL AUTOENCODER FOR CONDITIONAL MOLECULAR GENERATION

2021-01-01 · Kisoo Kwon, Jung-Hyun Park, Kuhwan Jeong, Sunjae Lee 외

Variational autoencoder (VAE) is a generation algorithm, consisting of an encoder and a decoder, and the latent variable from the encoder is used as the input of the decoder. VAE is widely used for image, audio and text…

DecoderText Generation

Tighter Variational Bounds are Not Necessarily Better

2018-02-13 · ICML 2018 7 · Tom Rainforth, Adam R. Kosiorek, Tuan Anh Le, Chris J. Maddison 외

We provide theoretical and empirical evidence that using tighter evidence lower bounds (ELBOs) can be detrimental to the process of learning an inference network by reducing the signal-to-noise ratio of the gradient esti…

Stochastic Variational Propagation: Local, Scalable and Efficient Alternative to Backpropagation

2025-05-08 · Bojian Yin, Federico Corradi

Backpropagation (BP) is the cornerstone of deep learning, but its reliance on global gradient synchronization limits scalability and imposes significant memory overhead. We propose Stochastic Variational Propagation (SVP…

DiversityRepresentation LearningVariational Inference