JND-Based Perceptual Optimization For Learned Image Compression
Recently, learned image compression schemes have achieved remarkable improvements in image fidelity (e.g., PSNR and MS-SSIM) compared to conventional hybrid image coding ones due to their high-efficiency non-linear transform, end-to-end optimization frameworks, etc. However, few of them take the Just Noticeable Difference (JND) characteristic of the Human Visual System (HVS) into account and optimize learned image compression towards perceptual quality. To address this issue, a JND-based perceptual quality loss is proposed. Considering that the amounts of distortion in the compressed image at different training epochs under different Quantization Parameters (QPs) are different, we develop a distortion-aware adjustor. After combining them together, we can better assign the distortion in the compressed image with the guidance of JND to preserve the high perceptual quality. All these designs enable the proposed method to be flexibly applied to various learned image compression schemes with high scalability and plug-and-play advantages. Experimental results on the Kodak dataset demonstrate that the proposed method has led to better perceptual quality than the baseline model under the same bit rate.
Code (0)
등록된 구현이 없습니다.
Tasks
Image CompressionMS-SSIMQuantizationSSIMSimilar Papers 제목 키워드 기반
A Practical Approach for Rate-Distortion-Perception Analysis in Learned Image Compression
Rate-distortion optimization (RDO) of codecs, where distortion is quantified by the mean-square error, has been a standard practice in image/video compression over the years. RDO serves well for optimization of codec per…
Image CompressionVideo CompressionProxIQA: A Proxy Approach to Perceptual Optimization of Learned Image Compression
The use of $\ell_p$ $(p=1,2)$ norms has largely dominated the measurement of loss in neural networks due to their simplicity and analytical properties. However, when used to assess the loss of visual information, these s…
Image CompressionPerceptual Learned Image Compression via End-to-End JND-Based Optimization
Emerging Learned image Compression (LC) achieves significant improvements in coding efficiency by end-to-end training of neural networks for compression. An important benefit of this approach over traditional codecs is t…
DecoderImage CompressionHigh Visual-Fidelity Learned Video Compression
With the growing demand for video applications, many advanced learned video compression methods have been developed, outperforming traditional methods in terms of objective quality metrics such as PSNR. Existing methods …
Video CompressionSwinIQA: Learned Swin Distance for Compressed Image Quality Assessment
Image compression has raised widespread interest recently due to its significant importance for multimedia storage and transmission. Meanwhile, a reliable image quality assessment (IQA) for compressed images can not only…
Compressed Image Quality AssessmentFull reference image quality assessmentFull-Reference Image Quality AssessmentImage Compression+1