paper-with-me

홈 › Papers

Diffusion Model with Perceptual Loss

2023-12-30 · Shanchuan Lin, Xiao Yang

Diffusion models without guidance tend to generate unrealistic samples, yet the cause of this problem is not fully studied. Our analysis suggests that the loss objective plays an important role in shaping the learned distribution and the common mean squared error loss is not optimal. We hypothesize that a better loss objective can be designed with inductive biases and propose a novel self-perceptual loss that utilizes the diffusion model itself as the perceptual loss. Our work demonstrates that perceptual loss can be used in diffusion training to improve sample quality effectively. Models trained using our objective can generate realistic samples without guidance. We hope our work paves the way for more future explorations of the diffusion loss objective.

📄 PDF Abstract BibTeX arXiv:2401.00110

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingDiversitymodel

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Denoising Autoencoder A Denoising Autoencoder is a modification on the autoencoder to prevent the network learning the identity function.…

Similar Papers 제목 키워드 기반

PixelGen: Improving Pixel Diffusion with Perceptual Supervision

2026-02-02 · Zehong Ma, Ruihan Xu, Shiliang Zhang arxiv

Pixel diffusion generates images directly in pixel space, avoiding the VAE artifacts and representational bottlenecks of two-stage latent diffusion. Recent JiT further simplifies pixel diffusion with x-prediction, where …

Text-to-Image Generation

Boosting Latent Diffusion with Perceptual Objectives

2024-11-06 · Tariq Berrada, Pietro Astolfi, Melissa Hall, Marton Havasi 외

Latent diffusion models (LDMs) power state-of-the-art high-resolution generative image models. LDMs learn the data distribution in the latent space of an autoencoder (AE) and produce images by mapping the generated laten…

Decoder

HF-Diff: High-Frequency Perceptual Loss and Distribution Matching for One-Step Diffusion-Based Image Super-Resolution

2024-11-20 · Shoaib Meraj Sami, Md Mahedi Hasan, Jeremy Dawson, Nasser Nasrabadi

Although recent diffusion-based single-step super-resolution methods achieve better performance as compared to SinSR, they are computationally complex. To improve the performance of SinSR, we investigate preserving the h…

Image Super-ResolutionSuper-Resolution

A Residual Diffusion Model for High Perceptual Quality Codec Augmentation

2023-01-13 · Noor Fathima Ghouse, Jens Petersen, Auke Wiggers, Tianlin Xu 외

Diffusion probabilistic models have recently achieved remarkable success in generating high quality image and video data. In this work, we build on this class of generative models and introduce a method for lossy compres…

Image CompressionVocal Bursts Intensity Prediction

E2EDiff: Direct Mapping from Noise to Data for Enhanced Diffusion Models

2024-12-30 · Zhiyu Tan, Wenxu Qian, Hesen Chen, Mengping Yang 외

Diffusion models have emerged as a powerful framework for generative modeling, achieving state-of-the-art performance across various tasks. However, they face several inherent limitations, including a training-sampling g…