SSIM-Based CTU-Level Joint Optimal Bit Allocation and Rate Distortion Optimization
Structural similarity (SSIM)-based distortion $D_\text{SSIM}$ is more consistent with human perception than the traditional mean squared error $D_\text{MSE}$. To achieve better video quality, many studies on optimal bit allocation (OBA) and rate-distortion optimization (RDO) used $D_\text{SSIM}$ as the distortion metric. However, many of them failed to optimize OBA and RDO jointly based on SSIM, thus causing a non-optimal R-$D_\text{SSIM}$ performance. This problem is due to the lack of an accurate R-$D_\text{SSIM}$ model that can be used uniformly in both OBA and RDO. To solve this problem, we propose a $D_\text{SSIM}$-$D_\text{MSE}$ model first. Based on this model, the complex R-$D_\text{SSIM}$ cost in RDO can be calculated as simpler R-$D_\text{MSE}$ cost with a new SSIM-related Lagrange multiplier. This not only reduces the computation burden of SSIM-based RDO, but also enables the R-$D_\text{SSIM}$ model to be uniformly used in OBA and RDO. Moreover, with the new SSIM-related Lagrange multiplier in hand, the joint relationship of R-$D_\text{SSIM}$-$\lambda_\text{SSIM}$ (the negative derivative of R-$D_\text{SSIM}$) can be built, based on which the R-$D_\text{SSIM}$ model parameters can be calculated accurately. With accurate and unified R-$D_\text{SSIM}$ model, SSIM-based OBA and SSIM-based RDO are unified together in our scheme, called SOSR. Compared with the HEVC reference encoder HM16.20, SOSR saves 4%, 10%, and 14% bitrate under the same SSIM in all-intra, hierarchical and non-hierarchical low-delay-B configurations, which is superior to other state-of-the-art schemes.
Code (0)
등록된 구현이 없습니다.
Tasks
SSIMSimilar Papers 제목 키워드 기반
Joint Optimization for SSIM-Based CTU-Level Bit Allocation and Rate Distortion Optimization
Structural similarity (SSIM)-based distortion Dssim is more consistent with human perception than the traditional mean squared error Dmse. To achieve better video encoding quality, many studies on optimal bit allocation …
Image Quality AssessmentSSIMVideo CompressionVideo Quality AssessmentUniform Pessimistic Risk and its Optimal Portfolio
The optimal allocation of assets has been widely discussed with the theoretical analysis of risk measures, and pessimism is one of the most attractive approaches beyond the conventional optimal portfolio model. The $\alp…
quantile regressionscoring ruleCalibrating Attribution Proxies for Reward Allocation in Participatory Weather Sensing
Large-scale IoT weather sensing networks require incentive mechanisms to sustain participation, yet determining how much value individual data contributions bring to the network remains an open problem. Existing approach…
Input Convex Graph Neural Networks: An Application to Optimal Control and Design Optimization
Despite the success of modeling networked systems via graph neural networks (GNN), applying GNN for the model-based control is pessimistic since the non-convexity of GNN models hinders solving model-based control problem…
Decision MakingDeepWiVe: Deep-Learning-Aided Wireless Video Transmission
We present DeepWiVe, the first-ever end-to-end joint source-channel coding (JSCC) video transmission scheme that leverages the power of deep neural networks (DNNs) to directly map video signals to channel symbols, combin…
Deep LearningMS-SSIMReinforcement Learning (RL)SSIM+1