paper-with-me

홈 › Papers

Heavy-Tailed Class-Conditional Priors for Long-Tailed Generative Modeling

2025-09-02 · Aymene Mohammed Bouayed, Samuel Deslauriers-Gauthier, Adrian Iaccovelli, David Naccache arxiv

Variational Autoencoders (VAEs) with global priors trained under an imbalanced empirical class distribution can lead to underrepresentation of tail classes in the latent space. While $t^3$VAE improves robustness via heavy-tailed Student's $t$-distribution priors, its single global prior still allocates mass proportionally to class frequency. We address this latent geometric bias by introducing C-$t^3$VAE, which assigns a per-class Student's $t$ joint prior over latent and output variables. This design promotes uniform prior mass across class-conditioned components. To optimize our model we derive a closed-form objective from the $γ$-power divergence, and we introduce an equal-weight latent mixture for class-balanced generation. On SVHN-LT, CIFAR100-LT, and CelebA datasets, C-$t^3$VAE consistently attains lower FID scores than $t^3$VAE and Gaussian-based VAE baselines under severe class imbalance while remaining competitive in balanced or mildly imbalanced settings. In per-class F1 evaluations, our model outperforms the conditional Gaussian VAE across highly imbalanced settings. Moreover, we identify the mild imbalance threshold $ρ< 5$, for which Gaussian-based models remain competitive. However, for $ρ\geq 5$ our approach yields improved class-balanced generation and mode coverage.

📄 PDF Abstract BibTeX arXiv:2509.02154

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Heavy-Tailed Process Priors for Selective Shrinkage

2010-12-01 · NeurIPS 2010 12 · Fabian L. Wauthier, Michael. I. Jordan

Heavy-tailed distributions are often used to enhance the robustness of regression and classification methods to outliers in output space. Often, however, we are confronted with ``outliers'' in input space, which are iso…

Gaussian ProcessesGeneral Classificationregression

Heavy-Tailed Diffusion Models

2024-10-18 · Kushagra Pandey, Jaideep Pathak, Yilun Xu, Stephan Mandt 외

Diffusion models achieve state-of-the-art generation quality across many applications, but their ability to capture rare or extreme events in heavy-tailed distributions remains unclear. In this work, we show that traditi…

Denoising

Mirror Flow Matching with Heavy-Tailed Priors for Generative Modeling on Convex Domains

2025-10-10 · Yunrui Guan, Krishnakumar Balasubramanian, Shiqian Ma arxiv

We study generative modeling on convex domains using flow matching and mirror maps, and identify two fundamental challenges. First, standard log-barrier mirror maps induce heavy-tailed dual distributions, leading to ill-…

Bayesian neural network priors for edge-preserving inversion

2021-12-20 · Chen Li, Matthew Dunlop, Georg Stadler

We consider Bayesian inverse problems wherein the unknown state is assumed to be a function with discontinuous structure a priori. A class of prior distributions based on the output of neural networks with heavy-tailed w…

\ell_1-regression with Heavy-tailed Distributions

2018-12-01 · NeurIPS 2018 12 · Lijun Zhang, Zhi-Hua Zhou

In this paper, we consider the problem of linear regression with heavy-tailed distributions. Different from previous studies that use the squared loss to measure the performance, we choose the absolute loss, which is cap…

regression