Dilated convolutional neural network-based deep reference picture generation for video compression
Motion estimation and motion compensation are indispensable parts of inter prediction in video coding. Since the motion vector of objects is mostly in fractional pixel units, original reference pictures may not accurately provide a suitable reference for motion compensation. In this paper, we propose a deep reference picture generator which can create a picture that is more relevant to the current encoding frame, thereby further reducing temporal redundancy and improving video compression efficiency. Inspired by the recent progress of Convolutional Neural Network(CNN), this paper proposes to use a dilated CNN to build the generator. Moreover, we insert the generated deep picture into Versatile Video Coding(VVC) as a reference picture and perform a comprehensive set of experiments to evaluate the effectiveness of our network on the latest VVC Test Model VTM. The experimental results demonstrate that our proposed method achieves on average 9.7% bit saving compared with VVC under low-delay P configuration.
Code (1)
Tasks
Motion CompensationMotion EstimationVideo CompressionSimilar Papers 제목 키워드 기반
HEVC Inter Coding Using Deep Recurrent Neural Networks and Artificial Reference Pictures
The efficiency of motion compensated prediction in modern video codecs highly depends on the available reference pictures. Occlusions and non-linear motion pose challenges for the motion compensation and often result in …
Motion CompensationPredictionC3DVQA: Full-Reference Video Quality Assessment with 3D Convolutional Neural Network
Traditional video quality assessment (VQA) methods evaluate localized picture quality and video score is predicted by temporally aggregating frame scores. However, video quality exhibits different characteristics from st…
Video Quality AssessmentVisual Question Answering (VQA)Convolutional Network for Attribute-driven and Identity-preserving Human Face Generation
This paper focuses on the problem of generating human face pictures from specific attributes. The existing CNN-based face generation models, however, either ignore the identity of the generated face or fail to preserve t…
AttributeFace GenerationSpatiotemporal Dilated Convolution with Uncertain Matching for Video-based Crowd Estimation
In this paper, we propose a novel SpatioTemporal convolutional Dense Network (STDNet) to address the video-based crowd counting problem, which contains the decomposition of 3D convolution and the 3D spatiotemporal dilate…
Crowd CountingSpotting Football Events Using Two-Stream Convolutional Neural Network and Dilated Recurrent Neural Network
This paper addresses the problem of event detection and localization in long football (soccer) videos. Our key idea is that understanding the long-range dependencies between video frames is imperative for accurate event …
Action SpottingEvent Detection