Asymmetric Bilateral Motion Estimation for Video Frame Interpolation
We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to interpolate an anchor frame. Second, we estimate asymmetric bilateral motions fields from the anchor frame to the input frames. Third, we use the asymmetric fields to warp the input frames backward and reconstruct the intermediate frame. Last, to refine the intermediate frame, we develop a new synthesis network that generates a set of dynamic filters and a residual frame using local and global information. Experimental results show that the proposed algorithm achieves excellent performance on various datasets. The source codes and pretrained models are available at https://github.com/JunHeum/ABME.
Code (1)
Tasks
Motion EstimationVideo Frame InterpolationSimilar Papers 제목 키워드 기반
BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation
Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on …
Motion EstimationVideo Frame InterpolationBMBC: Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation
Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on …
Motion EstimationVideo Frame InterpolationBiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolation
A novel 4K video frame interpolator based on bilateral transformer (BiFormer) is proposed in this paper, which performs three steps: global motion estimation, local motion refinement, and frame synthesis. First, in globa…
4kMotion EstimationVideo Frame InterpolationAsymmetric Bilateral Phase Correlation for Optical Flow Estimation in the Frequency Domain
We address the problem of motion estimation in images operating in the frequency domain. A method is presented which extends phase correlation to handle multiple motions present in an area. Our scheme is based on a novel…
Motion EstimationOptical Flow EstimationBATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
Video Object Segmentation (VOS) is fundamental to video understanding. Transformer-based methods show significant performance improvement on semi-supervised VOS. However, existing work faces challenges segmenting visuall…
ObjectOptical Flow EstimationSegmentationSemantic Segmentation+5