paper-with-me

Papers

Video Frame Interpolation Based on Deformable Kernel Region

2022-04-25 · Haoyue Tian, Pan Gao, Xiaojiang Peng

Video frame interpolation task has recently become more and more prevalent in the computer vision field. At present, a number of researches based on deep learning have achieved great success. Most of them are either based on optical flow information, or interpolation kernel, or a combination of these two methods. However, these methods have ignored that there are grid restrictions on the position of kernel region during synthesizing each target pixel. These limitations result in that they cannot well adapt to the irregularity of object shape and uncertainty of motion, which may lead to irrelevant reference pixels used for interpolation. In order to solve this problem, we revisit the deformable convolution for video interpolation, which can break the fixed grid restrictions on the kernel region, making the distribution of reference points more suitable for the shape of the object, and thus warp a more accurate interpolation frame. Experiments are conducted on four datasets to demonstrate the superior performance of the proposed model in comparison to the state-of-the-art alternatives.

📄 PDF Abstract BibTeX arXiv:2204.11396

Code (1)

luka0714/VFIDKR 공식 구현 pytorch

Tasks

Optical Flow EstimationVideo Frame Interpolation

Methods 이 논문이 사용한 방법론

Deformable Convolution Deformable convolutions add 2D offsets to the regular grid sampling locations in the standard convolution. It enables free…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

H-VFI: Hierarchical Frame Interpolation for Videos with Large Motions

2022-11-21 · Changlin Li, Guangyang Wu, Yanan sun, Xin Tao 외

Capitalizing on the rapid development of neural networks, recent video frame interpolation (VFI) methods have achieved notable improvements. However, they still fall short for real-world videos containing large motions. …

Video Frame Interpolation

Video Frame Interpolation via Generalized Deformable Convolution

2020-08-24 · Zhihao Shi, Xiaohong Liu, Kangdi Shi, Linhui Dai 외

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be…

Video Frame Interpolation

E-VFIA : Event-Based Video Frame Interpolation with Attention

2022-09-19 · Onur Selim Kılıç, Ahmet Akman, A. Aydin Alatan

Video frame interpolation (VFI) is a fundamental vision task that aims to synthesize several frames between two consecutive original video images. Most algorithms aim to accomplish VFI by using only keyframes, which is a…

Optical Flow EstimationVideo Frame Interpolation

Multiple Video Frame Interpolation via Enhanced Deformable Separable Convolution

2020-06-15 · Xianhang Cheng, Zhenzhong Chen

Generating non-existing frames from a consecutive video sequence has been an interesting and challenging problem in the video processing field. Typical kernel-based interpolation methods predict pixels with a single conv…

Motion EstimationOptical Flow EstimationVideo Frame Interpolation

Temporal Modulation Network for Controllable Space-Time Video Super-Resolution

2021-04-21 · CVPR 2021 1 · Gang Xu, Jun Xu, Zhen Li, Liang Wang 외

Space-time video super-resolution (STVSR) aims to increase the spatial and temporal resolutions of low-resolution and low-frame-rate videos. Recently, deformable convolution based methods have achieved promising STVSR pe…

Space-time Video Super-resolutionSuper-ResolutionVideo Super-Resolution