paper-with-me

Papers

Deep Bayesian Video Frame Interpolation

2022-10-23 · Conference 2022 10 · ZHIYANG YU, Yu Zhang, Xujie Xiang, Dongqing Zou, Xijun Chen, Jimmy S. Ren

Abstract. We present deep Bayesian video frame interpolation, a novel approach for upsampling a low frame-rate video temporally to its higher frame-rate counterpart. Our approach learns posterior distributions of optical flows and frames to be interpolated, which is optimized via learned gradient descent for fast convergence. Each learned step is a lightweight network manipulating gradients of the log-likelihood of estimated frames and flows. Such gradients, parameterized either explicitly or implicitly, model the fidelity of current estimations when matching real image and flow distributions to explain the input observations. With this approach we show new records on 8 of 10 benchmarks, using an architecture with half the parameters of the state-of-the-art model.

📄 PDF Abstract BibTeX

Code (1)

Oceanlib/DBVI pytorch

Tasks

Video Frame Interpolation

Similar Papers 제목 키워드 기반

Optimizing Video Prediction via Video Frame Interpolation

2022-06-27 · CVPR 2022 1 · Yue Wu, Qiang Wen, Qifeng Chen

Video prediction is an extrapolation task that predicts future frames given past frames, and video frame interpolation is an interpolation task that estimates intermediate frames between two frames. We have witnessed the…

Open-Ended Question AnsweringPredictionVideo Frame InterpolationVideo Prediction

Connecting and Comparing Language Model Interpolation Techniques

2019-08-26 · Ernest Pusateri, Christophe Van Gysel, Rami Botros, Sameer Badaskar 외

In this work, we uncover a theoretical connection between two language model interpolation techniques, count merging and Bayesian interpolation. We compare these techniques as well as linear interpolation in three scenar…

Language ModelingLanguage Modellingmodel

A Perceptual Quality Metric for Video Frame Interpolation

2022-10-04 · Qiqi Hou, Abhijay Ghildyal, Feng Liu

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few …

Video Frame Interpolation

Video Motion Graphs

2025-03-26 · Haiyang Liu, Zhan Xu, Fa-Ting Hong, Hsin-Ping Huang 외

We present Video Motion Graphs, a system designed to generate realistic human motion videos. Using a reference video and conditional signals such as music or motion tags, the system synthesizes new videos by first retrie…

Motion InterpolationVideo Frame InterpolationVideo Generation

Texture-aware Video Frame Interpolation

2021-02-26 · Duolikun Danier, David Bull

Temporal interpolation has the potential to be a powerful tool for video compression. Existing methods for frame interpolation do not discriminate between video textures and generally invoke a single general model capabl…

Texture ClassificationVideo CompressionVideo Frame Interpolation