paper-with-me

홈 › Papers

Asymmetric Bilateral Motion Estimation for Video Frame Interpolation

2021-08-15 · ICCV 2021 10 · Junheum Park, Chul Lee, Chang-Su Kim

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to interpolate an anchor frame. Second, we estimate asymmetric bilateral motions fields from the anchor frame to the input frames. Third, we use the asymmetric fields to warp the input frames backward and reconstruct the intermediate frame. Last, to refine the intermediate frame, we develop a new synthesis network that generates a set of dynamic filters and a residual frame using local and global information. Experimental results show that the proposed algorithm achieves excellent performance on various datasets. The source codes and pretrained models are available at https://github.com/JunHeum/ABME.

📄 PDF Abstract BibTeX arXiv:2108.06815

Code (1)

junheum/abme 공식 구현 pytorch

Tasks

Motion EstimationVideo Frame Interpolation

Similar Papers 제목 키워드 기반

BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation

2020-07-17 · Junheum Park, Keunsoo Ko, Chul Lee, Chang-Su Kim

Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on …

Motion EstimationVideo Frame Interpolation

BMBC: Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation

2020-08-01 · ECCV 2020 8 · Junheum Park, Keunsoo Ko, Chul Lee, Chang-Su Kim

Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on …

Motion EstimationVideo Frame Interpolation

BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolation

2023-04-05 · CVPR 2023 6 · Junheum Park, Jintae Kim, Chang-Su Kim

A novel 4K video frame interpolator based on bilateral transformer (BiFormer) is proposed in this paper, which performs three steps: global motion estimation, local motion refinement, and frame synthesis. First, in globa…

4kMotion EstimationVideo Frame Interpolation

Asymmetric Bilateral Phase Correlation for Optical Flow Estimation in the Frequency Domain

2018-11-01 · Vasileios Argyriou

We address the problem of motion estimation in images operating in the frequency domain. A method is presented which extends phase correlation to handle multiple motions present in an area. Our scheme is based on a novel…

Motion EstimationOptical Flow Estimation

BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation

2022-08-01 · Ye Yu, Jialin Yuan, Gaurav Mittal, Li Fuxin 외

Video Object Segmentation (VOS) is fundamental to video understanding. Transformer-based methods show significant performance improvement on semi-supervised VOS. However, existing work faces challenges segmenting visuall…

ObjectOptical Flow EstimationSegmentationSemantic Segmentation+5