Quadratic video interpolation
Video interpolation is an important problem in computer vision, which helps overcome the temporal limitation of camera sensors. Existing video interpolation methods usually assume uniform motion between consecutive frames and use linear models for interpolation, which cannot well approximate the complex motion in the real world. To address these issues, we propose a quadratic video interpolation method which exploits the acceleration information in videos. This method allows prediction with curvilinear trajectory and variable velocity, and generates more accurate interpolation results. For high-quality frame synthesis, we develop a flow reversal layer to estimate flow fields starting from the unknown target frame to the source frame. In addition, we present techniques for flow refinement. Extensive experiments demonstrate that our approach performs favorably against the existing linear models on a wide variety of video datasets.
Code (1)
Similar Papers 제목 키워드 기반
Enhanced Quadratic Video Interpolation
With the prosperity of digital video industry, video frame interpolation has arisen continuous attention in computer vision community and become a new upsurge in industry. Many learning-based methods have been proposed a…
Super-ResolutionVideo Frame InterpolationIQ-VFI: Implicit Quadratic Motion Estimation for Video Frame Interpolation
Advanced video frame interpolation (VFI) algorithms approximate intermediate motions between two input frames to synthesize intermediate frame. However they struggle to handle complex scenarios with curvilinear motio…
Knowledge DistillationMotion EstimationVideo Frame InterpolationNon-linear Motion Estimation for Video Frame Interpolation using Space-time Convolutions
Video frame interpolation aims to synthesize one or multiple frames between two consecutive frames in a video. It has a wide range of applications including slow-motion video generation, frame-rate up-scaling and develop…
Motion EstimationVideo Frame InterpolationVideo GenerationExplicit Depth-Aware Blurry Video Frame Interpolation Guided by Differential Curves
Blurry video frame interpolation (BVFI), which aims to generate high-frame-rate clear videos from low-frame-rate blurry inputs, is a challenging yet significant task in computer vision. Current state-of-the-art appro…
Optical Flow EstimationVideo Frame InterpolationAIM 2020 Challenge on Video Temporal Super-Resolution
Videos in the real-world contain various dynamics and motions that may look unnaturally discontinuous in time when the recordedframe rate is low. This paper reports the second AIM challenge on Video Temporal Super-Resolu…
Super-Resolution