Motion Deblurring with Real Events
In this paper, we propose an end-to-end learning framework for event-based motion deblurring in a self-supervised manner, where real-world events are exploited to alleviate the performance degradation caused by data inconsistency. To achieve this end, optical flows are predicted from events, with which the blurry consistency and photometric consistency are exploited to enable self-supervision on the deblurring network with real-world data. Furthermore, a piece-wise linear motion model is proposed to take into account motion non-linearities and thus leads to an accurate model for the physical formation of motion blurs in the real-world scenario. Extensive evaluation on both synthetic and real motion blur datasets demonstrates that the proposed algorithm bridges the gap between simulated and real-world motion blurs and shows remarkable performance for event-based motion deblurring in real-world scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringSimilar Papers 제목 키워드 기반
Restoring Real-World Degraded Events Improves Deblurring Quality
Due to its high speed and low latency, DVS is frequently employed in motion deblurring. Ideally, high-quality events would adeptly capture intricate motion information. However, real-world events are generally degraded, …
DeblurringDenoisingImage DeblurringGeneralizing Event-Based Motion Deblurring in Real-World Scenarios
Event-based motion deblurring has shown promising results by exploiting low-latency events. However, current approaches are limited in their practical usage, as they assume the same spatial resolution of inputs and speci…
DeblurringSelf-Supervised LearningEvent-guided Deblurring of Unknown Exposure Time Videos
Motion deblurring is a highly ill-posed problem due to the loss of motion information in the blur degradation process. Since event cameras can capture apparent motion with a high temporal resolution, several attempts hav…
DeblurringEvent-based Image Deblurring with Dynamic Motion Awareness
Non-uniform image deblurring is a challenging task due to the lack of temporal and textural information in the blurry image itself. Complementary information from auxiliary sensors such event sensors are being explored t…
DeblurringImage DeblurringLearning Parallax for Stereo Event-based Motion Deblurring
Due to the extremely low latency, events have been recently exploited to supplement lost information for motion deblurring. Existing approaches largely rely on the perfect pixel-wise alignment between intensity images an…
DeblurringStereo Matching