paper-with-me

홈 › Papers

The Learnability Gap in Medical Latent Diffusion

2026-05-16 · Mischa Dombrowski, Felix Nützel, Bernhard Kainz arxiv

Generative data augmentation with latent diffusion models is a promising strategy for addressing class imbalance in medical imaging, yet current approaches focus on perceptual fidelity and domain-specific autoencoder fine-tuning while neglecting a more fundamental bottleneck. We identify and formalize the learnability gap: large-scale pretrained autoencoders faithfully encode discriminative features for medical classification, as evidenced by near-lossless performance in reconstruction space, yet their latent representations are structured in ways that are difficult for classifiers to learn from. Across five autoencoder families and four medical benchmarks spanning chest radiography, dermatoscopy, computed tomography, and echocardiography, we show that this gap persists regardless of architecture, initialization strategy, or hyperparameter tuning, and that medical-domain fine-tuning of the autoencoder does not close it. To probe and partially narrow the gap, we develop noise-conditioned latent classifiers with FiLM layers and image-space distillation that offer 64x throughput and 120x memory gains over image-space models while serving as diagnostic tools for latent space quality. Our analysis provides a new framework for evaluating autoencoder latent spaces and identifies their structure, rather than their fidelity or domain specificity, as the primary obstacle to closing the performance gap between real and synthetic medical training data.

📄 PDF Abstract BibTeX arXiv:2605.17087

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Probing the Latent Hierarchical Structure of Data via Diffusion Models

2024-10-17 · Antonio Sclocchi, Alessandro Favero, Noam Itzhak Levi, Matthieu Wyart

High-dimensional data must be highly structured to be learnable. Although the compositional and hierarchical nature of data is often put forward to explain learnability, quantitative measurements establishing these prope…

Spectrum Matching: a Unified Perspective for Superior Diffusability in Latent Diffusion

2026-03-15 · Mang Ning, Mingxiao Li, Le Zhang, Lanmiao Liu 외 arxiv

In this paper, we study the diffusability (learnability) of variational autoencoders (VAE) in latent diffusion. First, we show that pixel-space diffusion trained with an MSE objective is inherently biased toward learning…

Semantic correspondence

Learnability-Guided Diffusion for Dataset Distillation

2026-04-01 · Jeffrey A. Chan-Santiago, Mubarak Shah arxiv

Training machine learning models on massive datasets is expensive and time-consuming. Dataset distillation addresses this by creating a small synthetic dataset that achieves the same performance as the full dataset. Rece…

Language-Guided Trajectory Traversal in Disentangled Stable Diffusion Latent Space for Factorized Medical Image Generation

2025-03-30 · Zahra Tehraninasab, Amar Kumar, Tal Arbel

Text-to-image diffusion models have demonstrated a remarkable ability to generate photorealistic images from natural language prompts. These high-resolution, language-guided synthesized images are essential for the expla…

DiagnosticDisentanglementImage GenerationMedical Image Generation

Similarity-aware Syncretic Latent Diffusion Model for Medical Image Translation with Representation Learning

2024-06-20 · Tingyi Lin, Pengju Lyu, Jie Zhang, Yuqing Wang 외

Non-contrast CT (NCCT) imaging may reduce image contrast and anatomical visibility, potentially increasing diagnostic uncertainty. In contrast, contrast-enhanced CT (CECT) facilitates the observation of regions of intere…

DiagnosticRepresentation LearningTranslation