ExpRDiff: Short-exposure Guided Diffusion Model for Realistic Local Motion Deblurring
Removing blur caused by moving objects is challenging, as the moving objects are usually significantly blurry while the static background remains clear. Existing methods that rely on local blur detection often suffer from inaccuracies and cannot generate satisfactory results when focusing solely on blurred regions. To overcome these problems, we first design a context-based local blur detection module that incorporates additional contextual information to improve the identification of blurry regions. Considering that modern smartphones are equipped with cameras capable of providing short-exposure images, we develop a blur-aware guided image restoration method that utilizes sharp structural details from short-exposure images, facilitating accurate reconstruction of heavily blurred regions. Furthermore, to restore images realistically and visually-pleasant, we develop a short-exposure guided diffusion model that explores useful features from short-exposure images and blurred regions to better constrain the diffusion process. Finally, we formulate the above components into a simple yet effective network, named ExpRDiff. Experimental results show that ExpRDiff performs favorably against state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringImage RestorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DiffHDR: Re-Exposing LDR Videos with Video Diffusion Models
Most digital videos are stored in 8-bit low dynamic range (LDR) formats, where much of the original high dynamic range (HDR) scene radiance is lost due to saturation and quantization. This loss of highlight and shadow de…
LSD$_2$ -- Joint Denoising and Deblurring of Short and Long Exposure Images with CNNs
The paper addresses the problem of acquiring high-quality photographs with handheld smartphone cameras in low-light imaging conditions. We propose an approach based on capturing pairs of short and long exposure images in…
DeblurringDenoisingLow-light Image Restoration with Short- and Long-exposure Raw Pairs
Low-light imaging with handheld mobile devices is a challenging issue. Limited by the existing models and training data, most existing methods cannot be effectively applied in real scenarios. In this paper, we propose a …
Image RestorationTemplate-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM
Reconstructing 3D humans from a single image has been extensively investigated. However, existing approaches often fall short on capturing fine geometry and appearance details, hallucinating occluded parts with plausible…
DecoderNeRFZero-shot Medical Image Translation via Frequency-Guided Diffusion Models
Recently, the diffusion model has emerged as a superior generative model that can produce high quality and realistic images. However, for medical image translation, the existing diffusion models are deficient in accurate…
AnatomySSIMTranslationZero-Shot Learning