paper-with-me

Papers

Efficient Video Deblurring Guided by Motion Magnitude

2022-07-27 · Yusheng Wang, Yunfan Lu, Ye Gao, Lin Wang, Zhihang Zhong, Yinqiang Zheng, Atsushi Yamashita

Video deblurring is a highly under-constrained problem due to the spatially and temporally varying blur. An intuitive approach for video deblurring includes two steps: a) detecting the blurry region in the current frame; b) utilizing the information from clear regions in adjacent frames for current frame deblurring. To realize this process, our idea is to detect the pixel-wise blur level of each frame and combine it with video deblurring. To this end, we propose a novel framework that utilizes the motion magnitude prior (MMP) as guidance for efficient deep video deblurring. Specifically, as the pixel movement along its trajectory during the exposure time is positively correlated to the level of motion blur, we first use the average magnitude of optical flow from the high-frequency sharp frames to generate the synthetic blurry frames and their corresponding pixel-wise motion magnitude maps. We then build a dataset including the blurry frame and MMP pairs. The MMP is then learned by a compact CNN by regression. The MMP consists of both spatial and temporal blur level information, which can be further integrated into an efficient recurrent neural network (RNN) for video deblurring. We conduct intensive experiments to validate the effectiveness of the proposed methods on the public datasets.

📄 PDF Abstract BibTeX arXiv:2207.13374

Code (2)

sollynoay/mmp-rnn 공식 구현 pytorch
vlis2022/awesome-image-prior

Tasks

DeblurringOptical Flow EstimationVideo Deblurring

Similar Papers 제목 키워드 기반

Event-guided Deblurring of Unknown Exposure Time Videos

2021-12-13 · Taewoo Kim, Jeongmin Lee, Lin Wang, Kuk-Jin Yoon

Motion deblurring is a highly ill-posed problem due to the loss of motion information in the blur degradation process. Since event cameras can capture apparent motion with a high temporal resolution, several attempts hav…

Deblurring

Event-guided Multi-patch Network with Self-supervision for Non-uniform Motion Deblurring

2023-02-14 · Hongguang Zhang, Limeng Zhang, Yuchao Dai, Hongdong Li 외

Contemporary deep learning multi-scale deblurring models suffer from many issues: 1) They perform poorly on non-uniformly blurred images/videos; 2) Simply increasing the model depth with finer-scale levels cannot improve…

Deblurring

CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurring

2024-08-27 · Taewoo Kim, Hoonhee Cho, Kuk-Jin Yoon

Video deblurring aims to enhance the quality of restored results in motion-blurred videos by effectively gathering information from adjacent video frames to compensate for the insufficient data in a single blurred frame.…

DeblurringVideo Deblurring

Frequency-aware Event-based Video Deblurring for Real-World Motion Blur

2024-01-01 · CVPR 2024 1 · Taewoo Kim, Hoonhee Cho, Kuk-Jin Yoon

Video deblurring aims to restore sharp frames from blurred video clips. Despite notable progress in video deblurring works it is still a challenging problem because of the loss of motion information during the durati…

DeblurringVideo AlignmentVideo Deblurring

Real-Time Video Deblurring via Lightweight Motion Compensation

2022-05-25 · Hyeongseok Son, Junyong Lee, Sunghyun Cho, Seungyong Lee

While motion compensation greatly improves video deblurring quality, separately performing motion compensation and video deblurring demands huge computational overhead. This paper proposes a real-time video deblurring fr…

DeblurringMotion CompensationVideo Deblurring