FineNet: Frame Interpolation and Enhancement for Face Video Deblurring
The objective of this work is to deblur face videos. We propose a method that tackles this problem from two directions: (1) enhancing the blurry frames, and (2) treating the blurry frames as missing values and estimate them by interpolation. These approaches are complementary to each other, and their combination outperforms individual ones. We also introduce a novel module that leverages the structure of faces for finding positional offsets between video frames. This module can be integrated into the processing pipelines of both approaches, improving the quality of the final outcome. Experiments on three real and synthetically generated blurry video datasets show that our method outperforms the previous state-of-the-art methods by a large margin in terms of both quantitative and qualitative results.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringMissing ValuesVideo DeblurringSimilar Papers 제목 키워드 기반
MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Frame Interpolation and Enhancement
Motion estimation (ME) and motion compensation (MC) have dominated classical video frame interpolation systems over the past decades. Recently, the convolutional neural networks set up a new data-driven paradigm for fram…
Computational EfficiencyDenoisingMotion CompensationMotion Estimation+4MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancement
Motion estimation (ME) and motion compensation (MC) have been widely used for classical video frame interpolation systems over the past decades. Recently, a number of data-driven frame interpolation methods based on conv…
Computational EfficiencyDenoisingMotion CompensationMotion Estimation+4FAIVConf: Face enhancement for AI-based Video Conference with Low Bit-rate
Recently, high-quality video conferencing with fewer transmission bits has become a very hot and challenging problem. We propose FAIVConf, a specially designed video compression framework for video conferencing, based on…
Face GenerationFace SwappingVideo CompressionReFIn: A Refinement Approach for Video Frame Interpolation
Video Frame Interpolation is an important video enhancement problem which aims to generate one or multiple frames between consecutive frames in video. Optical flow-based frame interpolation approaches estimate intermedia…
Optical Flow EstimationVideo EnhancementVideo Frame InterpolationNNVISR: Bring Neural Network Video Interpolation and Super Resolution into Video Processing Framework
We present NNVISR - an open-source filter plugin for the VapourSynth video processing framework, which facilitates the application of neural networks for various kinds of video enhancing tasks, including denoising, super…
DenoisingSuper-ResolutionVideo Enhancement