Improving Denoising Diffusion Probabilistic Models via Exploiting Shared Representations
In this work, we address the challenge of multi-task image generation with limited data for denoising diffusion probabilistic models (DDPM), a class of generative models that produce high-quality images by reversing a noisy diffusion process. We propose a novel method, SR-DDPM, that leverages representation-based techniques from few-shot learning to effectively learn from fewer samples across different tasks. Our method consists of a core meta architecture with shared parameters, i.e., task-specific layers with exclusive parameters. By exploiting the similarity between diverse data distributions, our method can scale to multiple tasks without compromising the image quality. We evaluate our method on standard image datasets and show that it outperforms both unconditional and conditional DDPM in terms of FID and SSIM metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingFew-Shot LearningImage GenerationSSIMMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Binary Diffusion Probabilistic Model
We introduce the Binary Diffusion Probabilistic Model (BDPM), a novel generative model optimized for binary data representations. While denoising diffusion probabilistic models (DDPMs) have demonstrated notable success i…
Blind Face RestorationDenoisingFacial InpaintingImage Generation+5RGB-D-Fusion: Image Conditioned Depth Diffusion of Humanoid Subjects
We present RGB-D-Fusion, a multi-modal conditional denoising diffusion probabilistic model to generate high resolution depth maps from low-resolution monocular RGB images of humanoid subjects. RGB-D-Fusion first generate…
DenoisingSuper-ResolutionStructure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting
Denoising diffusion probabilistic models for image inpainting aim to add the noise to the texture of image during the forward process and recover masked regions with unmasked ones of the texture via the reverse denoising…
DenoisingImage InpaintingResEnsemble-DDPM: Residual Denoising Diffusion Probabilistic Models for Ensemble Learning
Nowadays, denoising diffusion probabilistic models have been adapted for many image segmentation tasks. However, existing end-to-end models have already demonstrated remarkable capabilities. Rather than using denoising d…
DenoisingEnsemble LearningImage GenerationImage Segmentation+2PolyDiff: Generating 3D Polygonal Meshes with Diffusion Models
We introduce PolyDiff, the first diffusion-based approach capable of directly generating realistic and diverse 3D polygonal meshes. In contrast to methods that use alternate 3D shape representations (e.g. implicit repres…
AvgDenoising