Learning Spatially Varying Pixel Exposures for Motion Deblurring
Computationally removing the motion blur introduced by camera shake or object motion in a captured image remains a challenging task in computational photography. Deblurring methods are often limited by the fixed global exposure time of the image capture process. The post-processing algorithm either must deblur a longer exposure that contains relatively little noise or denoise a short exposure that intentionally removes the opportunity for blur at the cost of increased noise. We present a novel approach of leveraging spatially varying pixel exposures for motion deblurring using next-generation focal-plane sensor--processors along with an end-to-end design of these exposures and a machine learning--based motion-deblurring framework. We demonstrate in simulation and a physical prototype that learned spatially varying pixel exposures (L-SVPE) can successfully deblur scenes while recovering high frequency detail. Our work illustrates the promising role that focal-plane sensor--processors can play in the future of computational imaging.
Code (1)
Tasks
DeblurringSimilar Papers 제목 키워드 기반
Efficient Video Deblurring Guided by Motion Magnitude
Video deblurring is a highly under-constrained problem due to the spatially and temporally varying blur. An intuitive approach for video deblurring includes two steps: a) detecting the blurry region in the current frame;…
DeblurringOptical Flow EstimationVideo DeblurringDeep Joint Demosaicing and High Dynamic Range Imaging within a Single Shot
Spatially varying exposure (SVE) is a promising choice for high-dynamic-range (HDR) imaging (HDRI). The SVE-based HDRI, which is called single-shot HDRI, is an efficient solution to avoid ghosting artifacts. However, it …
DemosaickingJoint Demosaicing and Deghosting of Time-Varying Exposures for Single-Shot HDR Imaging
The quad-Bayer patterned image sensor has made significant improvements in spatial resolution over recent years due to advancements in image sensor technology. This has enabled single-shot high-dynamic-range (HDR) im…
DemosaickingHDR ReconstructionHDR Video Reconstruction with Tri-Exposure Quad-Bayer Sensors
We propose a novel high dynamic range (HDR) video reconstruction method with new tri-exposure quad-bayer sensors. Thanks to the larger number of exposure sets and their spatially uniform deployment over a frame, they are…
Video ReconstructionIterative Filter Adaptive Network for Single Image Defocus Deblurring
We propose a novel end-to-end learning-based approach for single image defocus deblurring. The proposed approach is equipped with a novel Iterative Filter Adaptive Network (IFAN) that is specifically designed to handle s…
DeblurringImage Defocus Deblurring