paper-with-me

홈 › Papers

Recurrent Video Deblurring with Blur-Invariant Motion Estimation and Pixel Volumes

2021-08-23 · Hyeongseok Son, Junyong Lee, Jonghyeop Lee, Sunghyun Cho, Seungyong Lee

For the success of video deblurring, it is essential to utilize information from neighboring frames. Most state-of-the-art video deblurring methods adopt motion compensation between video frames to aggregate information from multiple frames that can help deblur a target frame. However, the motion compensation methods adopted by previous deblurring methods are not blur-invariant, and consequently, their accuracy is limited for blurry frames with different blur amounts. To alleviate this problem, we propose two novel approaches to deblur videos by effectively aggregating information from multiple video frames. First, we present blur-invariant motion estimation learning to improve motion estimation accuracy between blurry frames. Second, for motion compensation, instead of aligning frames by warping with estimated motions, we use a pixel volume that contains candidate sharp pixels to resolve motion estimation errors. We combine these two processes to propose an effective recurrent video deblurring network that fully exploits deblurred previous frames. Experiments show that our method achieves the state-of-the-art performance both quantitatively and qualitatively compared to recent methods that use deep learning.

📄 PDF Abstract BibTeX arXiv:2108.09982

Code (2)

codeslake/PVDNet 공식 구현 pytorch
crazyCoderLi/PVDNet_copy_for_test pytorch

Tasks

DeblurringMotion CompensationMotion EstimationVideo Deblurring

Similar Papers 제목 키워드 기반

Efficient Video Deblurring Guided by Motion Magnitude

2022-07-27 · Yusheng Wang, Yunfan Lu, Ye Gao, Lin Wang 외

Video deblurring is a highly under-constrained problem due to the spatially and temporally varying blur. An intuitive approach for video deblurring includes two steps: a) detecting the blurry region in the current frame;…

DeblurringOptical Flow EstimationVideo Deblurring

CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurring

2024-08-27 · Taewoo Kim, Hoonhee Cho, Kuk-Jin Yoon

Video deblurring aims to enhance the quality of restored results in motion-blurred videos by effectively gathering information from adjacent video frames to compensate for the insufficient data in a single blurred frame.…

DeblurringVideo Deblurring

Pay Attention to Hidden States for Video Deblurring: Ping-Pong Recurrent Neural Networks and Selective Non-Local Attention

2022-03-30 · JoonKyu Park, Seungjun Nah, Kyoung Mu Lee

Video deblurring models exploit information in the neighboring frames to remove blur caused by the motion of the camera and the objects. Recurrent Neural Networks~(RNNs) are often adopted to model the temporal dependency…

DeblurringVideo Deblurring

Real-Time Video Deblurring via Lightweight Motion Compensation

2022-05-25 · Hyeongseok Son, Junyong Lee, Sunghyun Cho, Seungyong Lee

While motion compensation greatly improves video deblurring quality, separately performing motion compensation and video deblurring demands huge computational overhead. This paper proposes a real-time video deblurring fr…

DeblurringMotion CompensationVideo Deblurring

Blur More To Deblur Better: Multi-Blur2Deblur For Efficient Video Deblurring

2020-12-23 · Dongwon Park, Dong Un Kang, Se Young Chun

One of the key components for video deblurring is how to exploit neighboring frames. Recent state-of-the-art methods either used aligned adjacent frames to the center frame or propagated the information on past frames to…

DeblurringImage DeblurringVideo Deblurring