BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolation
A novel 4K video frame interpolator based on bilateral transformer (BiFormer) is proposed in this paper, which performs three steps: global motion estimation, local motion refinement, and frame synthesis. First, in global motion estimation, we predict symmetric bilateral motion fields at a coarse scale. To this end, we propose BiFormer, the first transformer-based bilateral motion estimator. Second, we refine the global motion fields efficiently using blockwise bilateral cost volumes (BBCVs). Third, we warp the input frames using the refined motion fields and blend them to synthesize an intermediate frame. Extensive experiments demonstrate that the proposed BiFormer algorithm achieves excellent interpolation performance on 4K datasets. The source codes are available at https://github.com/JunHeum/BiFormer.
Code (1)
Tasks
4kMotion EstimationVideo Frame InterpolationSimilar Papers 제목 키워드 기반
Bilateral Interaction for Local-Global Collaborative Perception in Low-Light Image Enhancement
Low-light image enhancement is a challenging task due to the limited visibility in dark environments. While recent advances have shown progress in integrating CNNs and Transformers, the inadequate local-global perceptual…
Image EnhancementLow-Light Image EnhancementBMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation
Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on …
Motion EstimationVideo Frame InterpolationBMBC: Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation
Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on …
Motion EstimationVideo Frame InterpolationBATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
Video Object Segmentation (VOS) is fundamental to video understanding. Transformer-based methods show significant performance improvement on semi-supervised VOS. However, existing work faces challenges segmenting visuall…
ObjectOptical Flow EstimationSegmentationSemantic Segmentation+5Asymmetric Bilateral Motion Estimation for Video Frame Interpolation
We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motio…
Motion EstimationVideo Frame Interpolation