Implementing Adaptive Separable Convolution for Video Frame Interpolation
As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen new research involving various techniques in deep learning. In this paper, we replicate the work of Niklaus et al. on Adaptive Separable Convolution, which claims high quality results on the video frame interpolation task. We apply the same network structure trained on a smaller dataset and experiment with various different loss functions, in order to determine the optimal approach in data-scarce scenarios. The best resulting model is still able to provide visually pleasing videos, although achieving lower evaluation scores.
Code (3)
Tasks
Video Frame InterpolationSimilar Papers 제목 키워드 기반
Video Frame Interpolation via Adaptive Separable Convolution
Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution pr…
Optical Flow EstimationVideo Frame InterpolationRevisiting Adaptive Convolutions for Video Frame Interpolation
Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of vari…
DenoisingImage DenoisingVideo Frame InterpolationVideo PredictionJoint Optimization of Primary and Secondary Transforms Using Rate-Distortion Optimized Transform Design
Data-dependent transforms are increasingly being incorporated into next-generation video coding systems such as AVM, a codec under development by the Alliance for Open Media (AOM), and VVC. To circumvent the computationa…
ClusteringMultiple Video Frame Interpolation via Enhanced Deformable Separable Convolution
Generating non-existing frames from a consecutive video sequence has been an interesting and challenging problem in the video processing field. Typical kernel-based interpolation methods predict pixels with a single conv…
Motion EstimationOptical Flow EstimationVideo Frame InterpolationSeparable Convolutional LSTMs for Faster Video Segmentation
Semantic Segmentation is an important module for autonomous robots such as self-driving cars. The advantage of video segmentation approaches compared to single image segmentation is that temporal image information is con…
GPUImage SegmentationSegmentationSelf-Driving Cars+3