paper-with-me

홈 › Papers

Enhancing Deformable Convolution based Video Frame Interpolation with Coarse-to-fine 3D CNN

2022-02-15 · Duolikun Danier, Fan Zhang, David Bull

This paper presents a new deformable convolution-based video frame interpolation (VFI) method, using a coarse to fine 3D CNN to enhance the multi-flow prediction. This model first extracts spatio-temporal features at multiple scales using a 3D CNN, and estimates multi-flows using these features in a coarse-to-fine manner. The estimated multi-flows are then used to warp the original input frames as well as context maps, and the warped results are fused by a synthesis network to produce the final output. This VFI approach has been fully evaluated against 12 state-of-the-art VFI methods on three commonly used test databases. The results evidently show the effectiveness of the proposed method, which offers superior interpolation performance over other state of the art algorithms, with PSNR gains up to 0.19dB.

📄 PDF Abstract BibTeX arXiv:2202.07731

Code (0)

등록된 구현이 없습니다.

Tasks

Video Frame Interpolation

Methods 이 논문이 사용한 방법론

3D CNN 설명 없음

Similar Papers 제목 키워드 기반

Video Frame Interpolation via Generalized Deformable Convolution

2020-08-24 · Zhihao Shi, Xiaohong Liu, Kangdi Shi, Linhui Dai 외

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be…

Video Frame Interpolation

Convolutional Neural Networks vs. Deformable Image Registration For Medical Slice Interpolation

2020-04-28 · Dilip Kumar Verma, Ahmadreza Baghaie

Medical image slice interpolation is an active field of research. The methods for this task can be categorized into two broad groups: intensity-based and object-based interpolation methods. While intensity-based methods …

Image RegistrationObjectVideo Frame Interpolation

Video Frame Interpolation Based on Deformable Kernel Region

2022-04-25 · Haoyue Tian, Pan Gao, Xiaojiang Peng

Video frame interpolation task has recently become more and more prevalent in the computer vision field. At present, a number of researches based on deep learning have achieved great success. Most of them are either base…

Optical Flow EstimationVideo Frame Interpolation

DCNGAN: A Deformable Convolutional-Based GAN with QP Adaptation for Perceptual Quality Enhancement of Compressed Video

2022-01-22 · Saiping Zhang, Luis Herranz, Marta Mrak, Marc Gorriz Blanch 외

In this paper, we propose a deformable convolution-based generative adversarial network (DCNGAN) for perceptual quality enhancement of compressed videos. DCNGAN is also adaptive to the quantization parameters (QPs). Comp…

Generative Adversarial NetworkQuantization

Global Spatial-Temporal Information-based Residual ConvLSTM for Video Space-Time Super-Resolution

2024-07-11 · Congrui Fu, Hui Yuan, Shiqi Jiang, Guanghui Zhang 외

By converting low-frame-rate, low-resolution videos into high-frame-rate, high-resolution ones, space-time video super-resolution techniques can enhance visual experiences and facilitate more efficient information dissem…

Space-time Video Super-resolutionSuper-ResolutionVideo Super-Resolution