Distortion-Aware Loop Filtering of Intra 360^o Video Coding with Equirectangular Projection
In this paper, we propose a distortion-aware loop filtering model to improve the performance of intra coding for 360$^o$ videos projected via equirectangular projection (ERP) format. To enable the awareness of distortion, our proposed module analyzes content characteristics based on a coding unit (CU) partition mask and processes them through partial convolution to activate the specified area. The feature recalibration module, which leverages cascaded residual channel-wise attention blocks (RCABs) to adjust the inter-channel and intra-channel features automatically, is capable of adapting with different quality levels. The perceptual geometry optimization combining with weighted mean squared error (WMSE) and the perceptual loss guarantees both the local field of view (FoV) and global image reconstruction with high quality. Extensive experimental results show that our proposed scheme achieves significant bitrate savings compared with the anchor (HM + 360Lib), leading to 8.9%, 9.0%, 7.1% and 7.4% on average bit rate reductions in terms of PSNR, WPSNR, and PSNR of two viewports for luminance component of 360^o videos, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
ERPImage ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Global Appearance and Local Coding Distortion based Fusion Framework for CNN based Filtering in Video Coding
In-loop filtering is used in video coding to process the reconstructed frame in order to remove blocking artifacts. With the development of convolutional neural networks (CNNs), CNNs have been explored for in-loop filter…
BlockingSandwiched Video Compression: Efficiently Extending the Reach of Standard Codecs with Neural Wrappers
We propose sandwiched video compression -- a video compression system that wraps neural networks around a standard video codec. The sandwich framework consists of a neural pre- and post-processor with a standard video co…
Motion CompensationVideo CompressionIn-Loop Filtering via Trained Look-Up Tables
In-loop filtering (ILF) is a key technology for removing the artifacts in image/video coding standards. Recently, neural network-based in-loop filtering methods achieve remarkable coding gains beyond the capability of ad…
Image RestorationEfficient coding of 360° videos exploiting inactive regions in projection formats
This paper presents an efficient method for encoding common projection formats in 360$^\circ$ video coding, in which we exploit inactive regions. These regions are ignored in the reconstruction of the equirectangular for…
On Intra Video Coding and In-loop Filtering for Neural Object Detection Networks
Classical video coding for satisfying humans as the final user is a widely investigated field of studies for visual content, and common video codecs are all optimized for the human visual system (HVS). But are the assump…
Autonomous Drivingobject-detectionObject Detectionvalid