Video Interpolation using Optical Flow and Laplacian Smoothness
Non-rigid video interpolation is a common computer vision task. In this paper we present an optical flow approach which adopts a Laplacian Cotangent Mesh constraint to enhance the local smoothness. Similar to Li et al., our approach adopts a mesh to the image with a resolution up to one vertex per pixel and uses angle constraints to ensure sensible local deformations between image pairs. The Laplacian Mesh constraints are expressed wholly inside the optical flow optimization, and can be applied in a straightforward manner to a wide range of image tracking and registration problems. We evaluate our approach by testing on several benchmark datasets, including the Middlebury and Garg et al. datasets. In addition, we show application of our method for constructing 3D Morphable Facial Models from dynamic 3D data.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
FeatureFlow: Robust Video Interpolation via Structure-to-Texture Generation
Video interpolation aims to synthesize non-existent frames between two consecutive frames. Although existing optical flow based methods have achieved promising results, they still face great challenges in dealing with th…
Optical Flow EstimationTexture SynthesisVideo Frame InterpolationOptical Flow Estimation Using Laplacian Mesh Energy
In this paper we present a novel non-rigid optical flow algorithm for dense image correspondence and non-rigid registration. The algorithm uses a unique Laplacian Mesh Energy term to encourage local smoothness whilst sim…
Optical Flow EstimationVideo Interpolation by Event-driven Anisotropic Adjustment of Optical Flow
Video frame interpolation is a challenging task due to the ever-changing real-world scene. Previous methods often calculate the bi-directional optical flows and then predict the intermediate optical flows under the linea…
Optical Flow EstimationVideo Frame InterpolationFLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolation
A majority of methods for video frame interpolation compute bidirectional optical flow between adjacent frames of a video, followed by a suitable warping algorithm to generate the output frames. However, approaches relyi…
Action RecognitionMotion MagnificationOptical Flow EstimationVideo Frame InterpolationOptical Flow Regularization of Implicit Neural Representations for Video Frame Interpolation
Recent works have shown the ability of Implicit Neural Representations (INR) to carry meaningful representations of signal derivatives. In this work, we leverage this property to perform Video Frame Interpolation (VFI) b…
Optical Flow EstimationVideo CompressionVideo Frame Interpolation