paper-with-me

Papers

Generalizing Event-Based Motion Deblurring in Real-World Scenarios

2023-08-11 · ICCV 2023 1 · Xiang Zhang, Lei Yu, Wen Yang, Jianzhuang Liu, Gui-Song Xia

Event-based motion deblurring has shown promising results by exploiting low-latency events. However, current approaches are limited in their practical usage, as they assume the same spatial resolution of inputs and specific blurriness distributions. This work addresses these limitations and aims to generalize the performance of event-based deblurring in real-world scenarios. We propose a scale-aware network that allows flexible input spatial scales and enables learning from different temporal scales of motion blur. A two-stage self-supervised learning scheme is then developed to fit real-world data distribution. By utilizing the relativity of blurriness, our approach efficiently ensures the restored brightness and structure of latent images and further generalizes deblurring performance to handle varying spatial and temporal scales of motion blur in a self-distillation manner. Our method is extensively evaluated, demonstrating remarkable performance, and we also introduce a real-world dataset consisting of multi-scale blurry frames and events to facilitate research in event-based deblurring.

📄 PDF Abstract BibTeX arXiv:2308.05932

Code (1)

xiangz-0/gem 공식 구현 pytorch

Tasks

DeblurringSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Motion Deblurring with Real Events

2021-09-28 · ICCV 2021 10 · Fang Xu, Lei Yu, Bishan Wang, Wen Yang 외

In this paper, we propose an end-to-end learning framework for event-based motion deblurring in a self-supervised manner, where real-world events are exploited to alleviate the performance degradation caused by data inco…

Deblurring

Frequency-aware Event-based Video Deblurring for Real-World Motion Blur

2024-01-01 · CVPR 2024 1 · Taewoo Kim, Hoonhee Cho, Kuk-Jin Yoon

Video deblurring aims to restore sharp frames from blurred video clips. Despite notable progress in video deblurring works it is still a challenging problem because of the loss of motion information during the durati…

DeblurringVideo AlignmentVideo Deblurring

Restoring Real-World Degraded Events Improves Deblurring Quality

2024-07-30 · Yeqing Shen, Shang Li, Kun Song

Due to its high speed and low latency, DVS is frequently employed in motion deblurring. Ideally, high-quality events would adeptly capture intricate motion information. However, real-world events are generally degraded, …

DeblurringDenoisingImage Deblurring

CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurring

2024-08-27 · Taewoo Kim, Hoonhee Cho, Kuk-Jin Yoon

Video deblurring aims to enhance the quality of restored results in motion-blurred videos by effectively gathering information from adjacent video frames to compensate for the insufficient data in a single blurred frame.…

DeblurringVideo Deblurring

Learning Parallax for Stereo Event-based Motion Deblurring

2023-09-18 · Mingyuan Lin, Chi Zhang, Chu He, Lei Yu

Due to the extremely low latency, events have been recently exploited to supplement lost information for motion deblurring. Existing approaches largely rely on the perfect pixel-wise alignment between intensity images an…

DeblurringStereo Matching