paper-with-me

홈 › Papers

Beta-Sigma VAE: Separating beta and decoder variance in Gaussian variational autoencoder

2024-09-14 · Seunghwan Kim, Seungkyu Lee

Variational autoencoder (VAE) is an established generative model but is notorious for its blurriness. In this work, we investigate the blurry output problem of VAE and resolve it, exploiting the variance of Gaussian decoder and $\beta$ of beta-VAE. Specifically, we reveal that the indistinguishability of decoder variance and $\beta$ hinders appropriate analysis of the model by random likelihood value, and limits performance improvement by omitting the gain from $\beta$. To address the problem, we propose Beta-Sigma VAE (BS-VAE) that explicitly separates $\beta$ and decoder variance $\sigma^2_x$ in the model. Our method demonstrates not only superior performance in natural image synthesis but also controllable parameters and predictable analysis compared to conventional VAE. In our experimental evaluation, we employ the analysis of rate-distortion curve and proxy metrics on computer vision datasets. The code is available on https://github.com/overnap/BS-VAE

📄 PDF Abstract BibTeX arXiv:2409.09361

Code (1)

overnap/bs-vae 공식 구현 pytorch

Tasks

DecoderImage Generation

Similar Papers 제목 키워드 기반

Metric-Aware Principal Component Analysis (MAPCA):A Unified Framework for Scale-Invariant Representation Learning

2026-04-15 · Michael Leznik arxiv

We introduce Metric-Aware Principal Component Analysis (MAPCA), a unified framework for scale-invariant representation learning based on the generalised eigenproblem max Tr(W^T Sigma W) subject to W^T M W = I, where M is…

Self-Supervised LearningRepresentation Learning

Learning and Inference in Imaginary Noise Models

2020-05-18 · Saeed Saremi

Inspired by recent developments in learning smoothed densities with empirical Bayes, we study variational autoencoders with a decoder that is tailored for the random variable $Y=X+N(0,\sigma^2 I_d)$. A notion of smoothed…

DecoderVariational Inference

On the Optimal Weighted $\ell_2$ Regularization in Overparameterized Linear Regression

2020-06-10 · NeurIPS 2020 12 · Denny Wu, Ji Xu

We consider the linear model $\mathbf{y} = \mathbf{X} \mathbf{\beta}_\star + \mathbf{\epsilon}$ with $\mathbf{X}\in \mathbb{R}^{n\times p}$ in the overparameterized regime $p>n$. We estimate $\mathbf{\beta}_\star$ via ge…

regression

Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime

2025-07-15 · Amit Attia, Matan Schliserman, Uri Sherman, Tomer Koren

We study population convergence guarantees of stochastic gradient descent (SGD) for smooth convex objectives in the interpolation regime, where the noise at optimum is zero or near zero. The behavior of the last iterate …

Continual Learning

Superspreading of SARS-CoV-2 in the USA

2020-07-30 · Calvin Pozderac, Brian Skinner

A number of epidemics, including the SARS-CoV-1 epidemic of 2002-2004, have been known to exhibit superspreading, in which a small fraction of infected individuals is responsible for the majority of new infections. The e…