BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation
Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on bilateral motion estimation. First, we develop the bilateral motion network with the bilateral cost volume to estimate bilateral motions accurately. Then, we approximate bi-directional motions to predict a different kind of bilateral motions. We then warp the two input frames using the estimated bilateral motions. Next, we develop the dynamic filter generation network to yield dynamic blending filters. Finally, we combine the warped frames using the dynamic blending filters to generate intermediate frames. Experimental results show that the proposed algorithm outperforms the state-of-the-art video interpolation algorithms on several benchmark datasets.
Code (1)
Tasks
Motion EstimationVideo Frame InterpolationSimilar Papers 제목 키워드 기반
BMBC: Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation
Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on …
Motion EstimationVideo Frame InterpolationBiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolation
A novel 4K video frame interpolator based on bilateral transformer (BiFormer) is proposed in this paper, which performs three steps: global motion estimation, local motion refinement, and frame synthesis. First, in globa…
4kMotion EstimationVideo Frame InterpolationAsymmetric Bilateral Motion Estimation for Video Frame Interpolation
We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motio…
Motion EstimationVideo Frame InterpolationAsymmetric Bilateral Phase Correlation for Optical Flow Estimation in the Frequency Domain
We address the problem of motion estimation in images operating in the frequency domain. A method is presented which extends phase correlation to handle multiple motions present in an area. Our scheme is based on a novel…
Motion EstimationOptical Flow EstimationUnsupervised Video Object Segmentation with Motion-based Bilateral Networks
In this work, we study the unsupervised video object segmentation problem where moving objects are segmented without prior knowledge of these objects. First, we propose a motion-based bilateral network to estimate the ba…
ObjectSegmentationSemantic SegmentationUnsupervised Video Object Segmentation+3