Motion-blurred Video Interpolation and Extrapolation
Abrupt motion of camera or objects in a scene result in a blurry video, and therefore recovering high quality video requires two types of enhancements: visual enhancement and temporal upsampling. A broad range of research attempted to recover clean frames from blurred image sequences or temporally upsample frames by interpolation, yet there are very limited studies handling both problems jointly. In this work, we present a novel framework for deblurring, interpolating and extrapolating sharp frames from a motion-blurred video in an end-to-end manner. We design our framework by first learning the pixel-level motion that caused the blur from the given inputs via optical flow estimation and then predict multiple clean frames by warping the decoded features with the estimated flows. To ensure temporal coherence across predicted frames and address potential temporal ambiguity, we propose a simple, yet effective flow-based rule. The effectiveness and favorability of our approach are highlighted through extensive qualitative and quantitative evaluations on motion-blurred datasets from high speed videos.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringOptical Flow EstimationSimilar Papers 제목 키워드 기반
Learning to Synthesize Motion Blur
We present a technique for synthesizing a motion blurred image from a pair of unblurred images captured in succession. To build this system we motivate and design a differentiable "line prediction" layer to be used as pa…
Extrapolative-Interpolative Cycle-Consistency Learning for Video Frame Extrapolation
Video frame extrapolation is a task to predict future frames when the past frames are given. Unlike previous studies that usually have been focused on the design of modules or construction of networks, we propose a novel…
Joint Video Multi-Frame Interpolation and Deblurring under Unknown Exposure Time
Natural videos captured by consumer cameras often suffer from low framerate and motion blur due to the combination of dynamic scene complexity, lens and sensor imperfection, and less than ideal exposure setting. As a res…
Contrastive LearningDeblurringVideo Frame InterpolationVideo ReconstructionVideo Reconstruction from a Single Motion Blurred Image using Learned Dynamic Phase Coding
Video reconstruction from a single motion-blurred image is a challenging problem, which can enhance the capabilities of existing cameras. Recently, several works addressed this task using conventional imaging and deep le…
Video Frame InterpolationVideo ReconstructionBiM-VFI: directional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions
Existing Video Frame interpolation (VFI) models tend to suffer from time-to-location ambiguity when trained with video of non-uniform motions, such as accelerating, decelerating, and changing directions, which often yiel…
Knowledge DistillationMotion EstimationOptical Flow EstimationVideo Frame Interpolation