paper-with-me

Papers

Gyroscope-Assisted Motion Deblurring Network

2024-02-10 · Simin Luan, Cong Yang, Zeyd Boukhers, Xue Qin, Dongfeng Cheng, Wei Sui, Zhijun Li

Image research has shown substantial attention in deblurring networks in recent years. Yet, their practical usage in real-world deblurring, especially motion blur, remains limited due to the lack of pixel-aligned training triplets (background, blurred image, and blur heat map) and restricted information inherent in blurred images. This paper presents a simple yet efficient framework to synthetic and restore motion blur images using Inertial Measurement Unit (IMU) data. Notably, the framework includes a strategy for training triplet generation, and a Gyroscope-Aided Motion Deblurring (GAMD) network for blurred image restoration. The rationale is that through harnessing IMU data, we can determine the transformation of the camera pose during the image exposure phase, facilitating the deduction of the motion trajectory (aka. blur trajectory) for each point inside the three-dimensional space. Thus, the synthetic triplets using our strategy are inherently close to natural motion blur, strictly pixel-aligned, and mass-producible. Through comprehensive experiments, we demonstrate the advantages of the proposed framework: only two-pixel errors between our synthetic and real-world blur trajectories, a marked improvement (around 33.17%) of the state-of-the-art deblurring method MIMO on Peak Signal-to-Noise Ratio (PSNR).

📄 PDF Abstract BibTeX arXiv:2402.06854

Code (1)

lsmlovefm/GAMD-Net 공식 구현 pytorch

Tasks

DeblurringImage RestorationTriplet

Similar Papers 제목 키워드 기반

Gyroscope-Aided Motion Deblurring with Deep Networks

2018-10-01 · Janne Mustaniemi, Juho Kannala, Simo Särkkä, Jiri Matas 외

We propose a deblurring method that incorporates gyroscope measurements into a convolutional neural network (CNN). With the help of such measurements, it can handle extremely strong and spatially-variant motion blur. At …

Deblurring

Gyro-Based Multi-Image Deconvolution for Removing Handshake Blur

2014-06-01 · CVPR 2014 6 · Sung Hee Park, Marc Levoy

Image deblurring to remove blur caused by camera shake has been intensively studied. Nevertheless, most methods are brittle and computationally expensive. In this paper we analyze multi-image approaches, which capture an…

DeblurringImage DeblurringImage Deconvolution

Image Deblurring Using Smartphone Inertial Sensors

2016-06-01 · CVPR 2016 6 · Zhe Hu, Lu Yuan, Stephen Lin, Ming-Hsuan Yang

Removing image blur caused by camera shake is an ill-posed problem, as both the latent image and the point spread function (PSF) are unknown. A recent approach to address this problem is to record camera motion through i…

DeblurringImage Deblurring

Human and Scene Motion Deblurring using Pseudo-blur Synthesizer

2021-11-25 · Jonathan Samuel Lumentut, In Kyu Park

Present-day deep learning-based motion deblurring methods utilize the pair of synthetic blur and sharp data to regress any particular framework. This task is designed for directly translating a blurry image input into it…

Deblurring

DeepOIS: Gyroscope-Guided Deep Optical Image Stabilizer Compensation

2021-01-27 · Haipeng Li, Shuaicheng Liu, Jue Wang

Mobile captured images can be aligned using their gyroscope sensors. Optical image stabilizer (OIS) terminates this possibility by adjusting the images during the capturing. In this work, we propose a deep network that c…