paper-with-me

홈 › Papers

Hierarchical Clustering for Conditional Diffusion in Image Generation

2024-10-22 · Jorge da Silva Goncalves, Laura Manduchi, Moritz Vandenhirtz, Julia E. Vogt

Finding clusters of data points with similar characteristics and generating new cluster-specific samples can significantly enhance our understanding of complex data distributions. While clustering has been widely explored using Variational Autoencoders, these models often lack generation quality in real-world datasets. This paper addresses this gap by introducing TreeDiffusion, a deep generative model that conditions Diffusion Models on hierarchical clusters to obtain high-quality, cluster-specific generations. The proposed pipeline consists of two steps: a VAE-based clustering model that learns the hierarchical structure of the data, and a conditional diffusion model that generates realistic images for each cluster. We propose this two-stage process to ensure that the generated samples remain representative of their respective clusters and enhance image fidelity to the level of diffusion models. A key strength of our method is its ability to create images for each cluster, providing better visualization of the learned representations by the clustering model, as demonstrated through qualitative results. This method effectively addresses the generative limitations of VAE-based approaches while preserving their clustering performance. Empirically, we demonstrate that conditioning diffusion models on hierarchical clusters significantly enhances generative performance, thereby advancing the state of generative clustering models.

📄 PDF Abstract BibTeX arXiv:2410.16910

Code (1)

jogo175/treediffusion 공식 구현 pytorch

Tasks

ClusteringImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Nested Diffusion Models Using Hierarchical Latent Priors

2024-12-08 · CVPR 2025 1 · Xiao Zhang, Ruoxi Jiang, Rebecca Willett, Michael Maire

We introduce nested diffusion models, an efficient and powerful hierarchical generative framework that substantially enhances the generation quality of diffusion models, particularly for images of complex scenes. Our app…

Dimensionality ReductionImage Generation

Hierarchically branched diffusion models leverage dataset structure for class-conditional generation

2022-12-21 · Alex M. Tseng, Max Shen, Tommaso Biancalani, Gabriele Scalia

Class-labeled datasets, particularly those common in scientific domains, are rife with internal structure, yet current class-conditional diffusion models ignore these relationships and implicitly diffuse on all classes i…

Continual Learning

ST-DDPM: Explore Class Clustering for Conditional Diffusion Probabilistic Models

2021-09-29 · Zhijie Lin, Zijian Zhang, Zhou Zhao

Score-based generative models involve sequentially corrupting the data distribution with noise and then learns to recover the data distribution based on score matching. In this paper, for the diffusion probabilistic mode…

ClusteringConditional Image GenerationImage Generation

Structured Generations: Using Hierarchical Clusters to guide Diffusion Models

2024-07-08 · Jorge da Silva Goncalves, Laura Manduchi, Moritz Vandenhirtz, Julia E. Vogt

This paper introduces Diffuse-TreeVAE, a deep generative model that integrates hierarchical clustering into the framework of Denoising Diffusion Probabilistic Models (DDPMs). The proposed approach generates new images by…

ClusteringDenoising

DiFiC: Your Diffusion Model Holds the Secret to Fine-Grained Clustering

2024-12-25 · Ruohong Yang, Peng Hu, Xi Peng, Xiting Liu 외

Fine-grained clustering is a practical yet challenging task, whose essence lies in capturing the subtle differences between instances of different classes. Such subtle differences can be easily disrupted by data augmenta…

ClusteringData AugmentationImage ClusteringImage Generation