paper-with-me

홈 › Papers

Co-learning Single-Step Diffusion Upsampler and Downsampler with Two Discriminators and Distillation

2024-10-10 · Sohwi Kim, Tae-Kyun Kim

Super-resolution (SR) aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts, often relying on effective downsampling to generate diverse and realistic training pairs. In this work, we propose a co-learning framework that jointly optimizes a single-step diffusion-based upsampler and a learnable downsampler, enhanced by two discriminators and a cyclic distillation strategy. Our learnable downsampler is designed to better capture realistic degradation patterns while preserving structural details in the LR domain, which is crucial for enhancing SR performance. By leveraging a diffusion-based approach, our model generates diverse LR-HR pairs during training, enabling robust learning across varying degradations. We demonstrate the effectiveness of our method on both general real-world and domain-specific face SR tasks, achieving state-of-the-art performance in both fidelity and perceptual quality. Our approach not only improves efficiency with a single inference step but also ensures high-quality image reconstruction, bridging the gap between synthetic and real-world SR scenarios.

📄 PDF Abstract BibTeX arXiv:2410.07663

Code (0)

등록된 구현이 없습니다.

Tasks

Image ReconstructionSuper-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

A Visually Attentive Splice Localization Network with Multi-Domain Feature Extractor and Multi-Receptive Field Upsampler

2024-01-13 · Ankit Yadav, Dinesh Kumar Vishwakarma

Image splice manipulation presents a severe challenge in today's society. With easy access to image manipulation tools, it is easier than ever to modify images that can mislead individuals, organizations or society. In t…

Image Manipulation

Learning Spatio-Temporal Downsampling for Effective Video Upscaling

2022-03-15 · Xiaoyu Xiang, Yapeng Tian, Vijay Rengarajan, Lucas Young 외

Downsampling is one of the most basic image processing operations. Improper spatio-temporal downsampling applied on videos can cause aliasing issues such as moir\'e patterns in space and the wagon-wheel effect in time. C…

Quantization

Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation

2024-02-16 · Lanqing Guo, Yingqing He, Haoxin Chen, Menghan Xia 외

Diffusion models have proven to be highly effective in image and video generation; however, they still face composition challenges when generating images of varying sizes due to single-scale training data. Adapting large…

Video Generation

FSVideo: Fast Speed Video Diffusion Model in a Highly-Compressed Latent Space

2026-02-02 · FSVideo Team, Qingyu Chen, Zhiyuan Fang, Haibin Huang 외 arxiv

We introduce FSVideo, a fast speed transformer-based image-to-video (I2V) diffusion framework. We build our framework on the following key components: 1.) a new video autoencoder with highly-compressed latent space ($64\…

Multistep Distillation of Diffusion Models via Moment Matching

2024-06-06 · Tim Salimans, Thomas Mensink, Jonathan Heek, Emiel Hoogeboom

We present a new method for making diffusion models faster to sample. The method distills many-step diffusion models into few-step models by matching conditional expectations of the clean data given noisy data along the …