paper-with-me

홈 › Papers

Learning Single Image Defocus Deblurring with Misaligned Training Pairs

2022-11-26 · Yu Li, Dongwei Ren, Xinya Shu, WangMeng Zuo

By adopting popular pixel-wise loss, existing methods for defocus deblurring heavily rely on well aligned training image pairs. Although training pairs of ground-truth and blurry images are carefully collected, e.g., DPDD dataset, misalignment is inevitable between training pairs, making existing methods possibly suffer from deformation artifacts. In this paper, we propose a joint deblurring and reblurring learning (JDRL) framework for single image defocus deblurring with misaligned training pairs. Generally, JDRL consists of a deblurring module and a spatially invariant reblurring module, by which deblurred result can be adaptively supervised by ground-truth image to recover sharp textures while maintaining spatial consistency with the blurry image. First, in the deblurring module, a bi-directional optical flow-based deformation is introduced to tolerate spatial misalignment between deblurred and ground-truth images. Second, in the reblurring module, deblurred result is reblurred to be spatially aligned with blurry image, by predicting a set of isotropic blur kernels and weighting maps. Moreover, we establish a new single image defocus deblurring (SDD) dataset, further validating our JDRL and also benefiting future research. Our JDRL can be applied to boost defocus deblurring networks in terms of both quantitative metrics and visual quality on DPDD, RealDOF and our SDD datasets.

📄 PDF Abstract BibTeX arXiv:2211.14502

Code (2)

Hunter-Will/JDRL-mindspore 공식 구현 mindspore
liyucs/jdrl 공식 구현 pytorch

Tasks

DeblurringImage Defocus DeblurringOptical Flow Estimation

Similar Papers 제목 키워드 기반

Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs

2024-09-26 · Xinya Shu, Yu Li, Dongwei Ren, Xiaohe Wu 외

For single image defocus deblurring, acquiring well-aligned training pairs (or training triplets), i.e., a defocus blurry image, an all-in-focus sharp image (and a defocus blur map), is an intricate task for the developm…

DeblurringImage Defocus Deblurring

Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild

2022-11-25 · Jucai Zhai, Pengcheng Zeng, Chihao Ma, Yong Zhao 외

Recent research showed that the dual-pixel sensor has made great progress in defocus map estimation and image defocus deblurring. However, extracting real-time dual-pixel views is troublesome and complex in algorithm dep…

DeblurringGenerative Adversarial NetworkImage DeblurringImage Defocus Deblurring

Iterative Filter Adaptive Network for Single Image Defocus Deblurring

2021-08-31 · CVPR 2021 1 · Junyong Lee, Hyeongseok Son, Jaesung Rim, Sunghyun Cho 외

We propose a novel end-to-end learning-based approach for single image defocus deblurring. The proposed approach is equipped with a novel Iterative Filter Adaptive Network (IFAN) that is specifically designed to handle s…

DeblurringImage Defocus Deblurring

Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning

2021-08-11 · Abdullah Abuolaim, Mahmoud Afifi, Michael S. Brown

Many camera sensors use a dual-pixel (DP) design that operates as a rudimentary light field providing two sub-aperture views of a scene in a single capture. The DP sensor was developed to improve how cameras perform auto…

DeblurringDepth EstimationImage DeblurringImage Defocus Deblurring+3

The RealDefocus Benchmark for Defocus Deblurring

2026-07-23 · Tim Seizinger, Zhuyun Zhou, Radu Timofte arxiv

Single-Image Defocus Deblurring (SIDD) aims to recover an all-in-focus image from a single defocused observation, but rigorous and reproducible evaluation remains challenging due to the scarcity of realistic, high-resolu…

Image Restoration