Deep Bayesian Video Frame Interpolation
Abstract. We present deep Bayesian video frame interpolation, a novel approach for upsampling a low frame-rate video temporally to its higher frame-rate counterpart. Our approach learns posterior distributions of optical flows and frames to be interpolated, which is optimized via learned gradient descent for fast convergence. Each learned step is a lightweight network manipulating gradients of the log-likelihood of estimated frames and flows. Such gradients, parameterized either explicitly or implicitly, model the fidelity of current estimations when matching real image and flow distributions to explain the input observations. With this approach we show new records on 8 of 10 benchmarks, using an architecture with half the parameters of the state-of-the-art model.
Code (1)
Tasks
Video Frame InterpolationSimilar Papers 제목 키워드 기반
Optimizing Video Prediction via Video Frame Interpolation
Video prediction is an extrapolation task that predicts future frames given past frames, and video frame interpolation is an interpolation task that estimates intermediate frames between two frames. We have witnessed the…
Open-Ended Question AnsweringPredictionVideo Frame InterpolationVideo PredictionConnecting and Comparing Language Model Interpolation Techniques
In this work, we uncover a theoretical connection between two language model interpolation techniques, count merging and Bayesian interpolation. We compare these techniques as well as linear interpolation in three scenar…
Language ModelingLanguage ModellingmodelA Perceptual Quality Metric for Video Frame Interpolation
Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few …
Video Frame InterpolationVideo Motion Graphs
We present Video Motion Graphs, a system designed to generate realistic human motion videos. Using a reference video and conditional signals such as music or motion tags, the system synthesizes new videos by first retrie…
Motion InterpolationVideo Frame InterpolationVideo GenerationTexture-aware Video Frame Interpolation
Temporal interpolation has the potential to be a powerful tool for video compression. Existing methods for frame interpolation do not discriminate between video textures and generally invoke a single general model capabl…
Texture ClassificationVideo CompressionVideo Frame Interpolation