Image Deblurring Using Smartphone Inertial Sensors
Removing image blur caused by camera shake is an ill-posed problem, as both the latent image and the point spread function (PSF) are unknown. A recent approach to address this problem is to record camera motion through inertial sensors, i.e., gyroscopes and accelerometers, and then reconstruct spatially-variant PSFs from these readings. While this approach has been effective for high-quality inertial sensors, it has been infeasible for the inertial sensors in smartphones, which are of relatively low quality and present a number of challenging issues, including varying sensor parameters, high sensor noise, and calibration error. In this paper, we identify the issues that plague smartphone inertial sensors and propose a solution that successfully utilizes the sensor readings for image deblurring. With both the sensor data and the image itself, the proposed method is able to accurately estimate the sensor parameters online and also the spatially-variant PSFs for enhanced deblurring performance. The effectiveness of this technique is demonstrated in experiments on a popular mobile phone. With this approach, the quality of image deblurring can be appreciably raised on the most common of imaging devices.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringImage DeblurringSimilar Papers 제목 키워드 기반
Development of Smartphone Application for Evaluation of Passenger Comfort
Nowadays, smartphones are not utilized for communications only. Smartphones are equipped with a lot of sensors that can be utilized for different purposes. For example, inertial sensors have been used extensively in rece…
Deep Lidar-guided Image Deblurring
The rise of portable Lidar instruments, including their adoption in smartphones, opens the door to novel computational imaging techniques. Being an active sensing instrument, Lidar can provide complementary data to passi…
Continual LearningDeblurringDecoderImage DeblurringDeep Hybrid Camera Deblurring for Smartphone Cameras
Mobile cameras, despite their significant advancements, still have difficulty in low-light imaging due to compact sensors and lenses, leading to longer exposures and motion blur. Traditional blind deconvolution methods a…
DeblurringLearning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data
Recent work has shown impressive results on data-driven defocus deblurring using the two-image views available on modern dual-pixel (DP) sensors. One significant challenge in this line of research is access to DP data. D…
DeblurringImage Defocus DeblurringVideo DeblurringSmartDepthSync: Open Source Synchronized Video Recording System of Smartphone RGB and Depth Camera Range Image Frames with Sub-millisecond Precision
Nowadays, smartphones can produce a synchronized (synced) stream of high-quality data, including RGB images, inertial measurements, and other data. Therefore, smartphones are becoming appealing sensor systems in the robo…