paper-with-me

Papers

Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs

2024-09-26 · Xinya Shu, Yu Li, Dongwei Ren, Xiaohe Wu, Jin Li, WangMeng Zuo

For single image defocus deblurring, acquiring well-aligned training pairs (or training triplets), i.e., a defocus blurry image, an all-in-focus sharp image (and a defocus blur map), is an intricate task for the development of deblurring models. Existing image defocus deblurring methods typically rely on training data collected by specialized imaging equipment, presupposing that these pairs or triplets are perfectly aligned. However, in practical scenarios involving the collection of real-world data, direct acquisition of training triplets is infeasible, and training pairs inevitably encounter spatial misalignment issues. In this work, we introduce a reblurring-guided learning framework for single image defocus deblurring, enabling the learning of a deblurring network even with misaligned training pairs. Specifically, we first propose a baseline defocus deblurring network that utilizes spatially varying defocus blur map as degradation prior to enhance the deblurring performance. Then, to effectively learn the baseline defocus deblurring network with misaligned training pairs, our reblurring module ensures spatial consistency between the deblurred image, the reblurred image and the input blurry image by reconstructing spatially variant isotropic blur kernels. Moreover, the spatially variant blur derived from the reblurring module can serve as pseudo supervision for defocus blur map during training, interestingly transforming training pairs into training triplets. Additionally, we have collected a new dataset specifically for single image defocus deblurring (SDD) with typical misalignments, which not only substantiates our proposed method but also serves as a benchmark for future research.

📄 PDF Abstract BibTeX arXiv:2409.17792

Code (1)

ssscrystal/reblurring-guided-jdrl 공식 구현 pytorch

Tasks

DeblurringImage Defocus Deblurring

Similar Papers 제목 키워드 기반

Learning Single Image Defocus Deblurring with Misaligned Training Pairs

2022-11-26 · Yu Li, Dongwei Ren, Xinya Shu, WangMeng Zuo

By adopting popular pixel-wise loss, existing methods for defocus deblurring heavily rely on well aligned training image pairs. Although training pairs of ground-truth and blurry images are carefully collected, e.g., DPD…

DeblurringImage Defocus DeblurringOptical Flow Estimation

Iterative Filter Adaptive Network for Single Image Defocus Deblurring

2021-08-31 · CVPR 2021 1 · Junyong Lee, Hyeongseok Son, Jaesung Rim, Sunghyun Cho 외

We propose a novel end-to-end learning-based approach for single image defocus deblurring. The proposed approach is equipped with a novel Iterative Filter Adaptive Network (IFAN) that is specifically designed to handle s…

DeblurringImage Defocus Deblurring

Neumann Network With Recursive Kernels for Single Image Defocus Deblurring

2023-01-01 · CVPR 2023 1 · Yuhui Quan, Zicong Wu, Hui Ji

Single image defocus deblurring (SIDD) refers to recovering an all-in-focus image from a defocused blurry one. It is a challenging recovery task due to the spatially-varying defocus blurring effects with significant …

DeblurringImage Defocus Deblurring

K3DN: Disparity-Aware Kernel Estimation for Dual-Pixel Defocus Deblurring

2023-01-01 · CVPR 2023 1 · Yan Yang, Liyuan Pan, Liu Liu, Miaomiao Liu

The dual-pixel (DP) sensor captures a two-view image pair in a single snapshot by splitting each pixel in half. The disparity occurs in defocus blurred regions between the two views of the DP pair, while the in-focus…

DeblurringImage Restoration

Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild

2022-11-25 · Jucai Zhai, Pengcheng Zeng, Chihao Ma, Yong Zhao 외

Recent research showed that the dual-pixel sensor has made great progress in defocus map estimation and image defocus deblurring. However, extracting real-time dual-pixel views is troublesome and complex in algorithm dep…

DeblurringGenerative Adversarial NetworkImage DeblurringImage Defocus Deblurring