Face Deblurring using Dual Camera Fusion on Mobile Phones
Motion blur of fast-moving subjects is a longstanding problem in photography and very common on mobile phones due to limited light collection efficiency, particularly in low-light conditions. While we have witnessed great progress in image deblurring in recent years, most methods require significant computational power and have limitations in processing high-resolution photos with severe local motions. To this end, we develop a novel face deblurring system based on the dual camera fusion technique for mobile phones. The system detects subject motion to dynamically enable a reference camera, e.g., ultrawide angle camera commonly available on recent premium phones, and captures an auxiliary photo with faster shutter settings. While the main shot is low noise but blurry, the reference shot is sharp but noisy. We learn ML models to align and fuse these two shots and output a clear photo without motion blur. Our algorithm runs efficiently on Google Pixel 6, which takes 463 ms overhead per shot. Our experiments demonstrate the advantage and robustness of our system against alternative single-image, multi-frame, face-specific, and video deblurring algorithms as well as commercial products. To the best of our knowledge, our work is the first mobile solution for face motion deblurring that works reliably and robustly over thousands of images in diverse motion and lighting conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringImage DeblurringVideo DeblurringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deformable Convolutions and LSTM-based Flexible Event Frame Fusion Network for Motion Deblurring
Event cameras differ from conventional RGB cameras in that they produce asynchronous data sequences. While RGB cameras capture every frame at a fixed rate, event cameras only capture changes in the scene, resulting in sp…
DeblurringImage DeblurringDiffusion-based Event Generation for High-Quality Image Deblurring
While event-based deblurring have demonstrated impressive results, they are impractical for consumer photos captured by cell phones and digital cameras that are not equipped with the event sensor. To address this pro…
DeblurringImage DeblurringRT-Focuser: A Real-Time Lightweight Model for Edge-side Image Deblurring
Motion blur caused by camera or object movement severely degrades image quality and poses challenges for real-time applications such as autonomous driving, UAV perception, and medical imaging. In this paper, a lightweigh…
Autonomous DrivingImage DeblurringDeep Hybrid Camera Deblurring for Smartphone Cameras
Mobile cameras, despite their significant advancements, still have difficulty in low-light imaging due to compact sensors and lenses, leading to longer exposures and motion blur. Traditional blind deconvolution methods a…
DeblurringReal-World Efficient Blind Motion Deblurring via Blur Pixel Discretization
As recent advances in mobile camera technology have enabled the capability to capture high-resolution images, such as 4K images, the demand for an efficient deblurring model handling large motion has increased. In this p…
4kDeblurringregression