paper-with-me

Papers

Defocus Map Estimation and Deblurring from a Single Dual-Pixel Image

2021-10-12 · ICCV 2021 10 · Shumian Xin, Neal Wadhwa, Tianfan Xue, Jonathan T. Barron, Pratul P. Srinivasan, Jiawen Chen, Ioannis Gkioulekas, Rahul Garg

We present a method that takes as input a single dual-pixel image, and simultaneously estimates the image's defocus map -- the amount of defocus blur at each pixel -- and recovers an all-in-focus image. Our method is inspired from recent works that leverage the dual-pixel sensors available in many consumer cameras to assist with autofocus, and use them for recovery of defocus maps or all-in-focus images. These prior works have solved the two recovery problems independently of each other, and often require large labeled datasets for supervised training. By contrast, we show that it is beneficial to treat these two closely-connected problems simultaneously. To this end, we set up an optimization problem that, by carefully modeling the optics of dual-pixel images, jointly solves both problems. We use data captured with a consumer smartphone camera to demonstrate that, after a one-time calibration step, our approach improves upon prior works for both defocus map estimation and blur removal, despite being entirely unsupervised.

📄 PDF Abstract BibTeX arXiv:2110.05655

Code (0)

등록된 구현이 없습니다.

Tasks

Deblurring

Similar Papers 제목 키워드 기반

Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild

2022-11-25 · Jucai Zhai, Pengcheng Zeng, Chihao Ma, Yong Zhao 외

Recent research showed that the dual-pixel sensor has made great progress in defocus map estimation and image defocus deblurring. However, extracting real-time dual-pixel views is troublesome and complex in algorithm dep…

DeblurringGenerative Adversarial NetworkImage DeblurringImage Defocus Deblurring

Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning

2021-08-11 · Abdullah Abuolaim, Mahmoud Afifi, Michael S. Brown

Many camera sensors use a dual-pixel (DP) design that operates as a rudimentary light field providing two sub-aperture views of a scene in a single capture. The DP sensor was developed to improve how cameras perform auto…

DeblurringDepth EstimationImage DeblurringImage Defocus Deblurring+3

Iterative Filter Adaptive Network for Single Image Defocus Deblurring

2021-08-31 · CVPR 2021 1 · Junyong Lee, Hyeongseok Son, Jaesung Rim, Sunghyun Cho 외

We propose a novel end-to-end learning-based approach for single image defocus deblurring. The proposed approach is equipped with a novel Iterative Filter Adaptive Network (IFAN) that is specifically designed to handle s…

DeblurringImage Defocus Deblurring

Defocus Deblurring Using Dual-Pixel Data

2020-05-01 · ECCV 2020 8 · Abdullah Abuolaim, Michael S. Brown

Defocus blur arises in images that are captured with a shallow depth of field due to the use of a wide aperture. Correcting defocus blur is challenging because the blur is spatially varying and difficult to estimate. We …

DeblurringImage Defocus Deblurring

Learning Dual-Pixel Alignment for Defocus Deblurring

2022-04-26 · Yu Li, Yaling Yi, Dongwei Ren, Qince Li 외

It is a challenging task to recover sharp image from a single defocus blurry image in real-world applications. On many modern cameras, dual-pixel (DP) sensors create two-image views, based on which stereo information can…

DeblurringDecoder