paper-with-me

Papers

Beyond the Generative Learning Trilemma: Generative Model Assessment in Data Scarcity Domains

2025-04-14 · Marco Salmè, Lorenzo Tronchin, Rosa Sicilia, Paolo Soda, Valerio Guarrasi

Data scarcity remains a critical bottleneck impeding technological advancements across various domains, including but not limited to medicine and precision agriculture. To address this challenge, we explore the potential of Deep Generative Models (DGMs) in producing synthetic data that satisfies the Generative Learning Trilemma: fidelity, diversity, and sampling efficiency. However, recognizing that these criteria alone are insufficient for practical applications, we extend the trilemma to include utility, robustness, and privacy, factors crucial for ensuring the applicability of DGMs in real-world scenarios. Evaluating these metrics becomes particularly challenging in data-scarce environments, as DGMs traditionally rely on large datasets to perform optimally. This limitation is especially pronounced in domains like medicine and precision agriculture, where ensuring acceptable model performance under data constraints is vital. To address these challenges, we assess the Generative Learning Trilemma in data-scarcity settings using state-of-the-art evaluation metrics, comparing three prominent DGMs: Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and Diffusion Models (DMs). Furthermore, we propose a comprehensive framework to assess utility, robustness, and privacy in synthetic data generated by DGMs. Our findings demonstrate varying strengths among DGMs, with each model exhibiting unique advantages based on the application context. This study broadens the scope of the Generative Learning Trilemma, aligning it with real-world demands and providing actionable guidance for selecting DGMs tailored to specific applications.

📄 PDF Abstract BibTeX arXiv:2504.10555

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamics

2026-03-11 · Tianshuo Xu, Zhifei Chen, Leyi Wu, Hao Lu 외 arxiv

The ultimate goal of video generation is to satisfy a fundamental trilemma: achieving high visual quality, maintaining rigorous physical consistency, and enabling precise controllability. While recent models can maintain…

Autonomous DrivingVideo Generation

Tackling the Generative Learning Trilemma with Denoising Diffusion GANs

2021-12-15 · ICLR 2022 4 · Zhisheng Xiao, Karsten Kreis, Arash Vahdat

A wide variety of deep generative models has been developed in the past decade. Yet, these models often struggle with simultaneously addressing three key requirements including: high sample quality, mode coverage, and fa…

DiversityImage Generation

Beyond a Single Mode: GAN Ensembles for Diverse Medical Data Generation

2025-03-31 · Lorenzo Tronchin, Tommy Löfstedt, Paolo Soda, Valerio Guarrasi

The advancement of generative AI, particularly in medical imaging, confronts the trilemma of ensuring high fidelity, diversity, and efficiency in synthetic data generation. While Generative Adversarial Networks (GANs) ha…

DiagnosticDiversitySynthetic Data Generation

STaSy: Score-based Tabular data Synthesis

2022-10-08 · Jayoung Kim, Chaejeong Lee, Noseong Park

Tabular data synthesis is a long-standing research topic in machine learning. Many different methods have been proposed over the past decades, ranging from statistical methods to deep generative methods. However, it has …

DenoisingDiversity

The Score-Difference Flow for Implicit Generative Modeling

2023-04-25 · Romann M. Weber

Implicit generative modeling (IGM) aims to produce samples of synthetic data matching the characteristics of a target data distribution. Recent work (e.g. score-matching networks, diffusion models) has approached the IGM…

Denoising