paper-with-me

Papers

Optimally Controllable Perceptual Lossy Compression

2022-06-21 · Zeyu Yan, Fei Wen, Peilin Liu

Recent studies in lossy compression show that distortion and perceptual quality are at odds with each other, which put forward the tradeoff between distortion and perception (D-P). Intuitively, to attain different perceptual quality, different decoders have to be trained. In this paper, we present a nontrivial finding that only two decoders are sufficient for optimally achieving arbitrary (an infinite number of different) D-P tradeoff. We prove that arbitrary points of the D-P tradeoff bound can be achieved by a simple linear interpolation between the outputs of a minimum MSE decoder and a specifically constructed perfect perceptual decoder. Meanwhile, the perceptual quality (in terms of the squared Wasserstein-2 distance metric) can be quantitatively controlled by the interpolation factor. Furthermore, to construct a perfect perceptual decoder, we propose two theoretically optimal training frameworks. The new frameworks are different from the distortion-plus-adversarial loss based heuristic framework widely used in existing methods, which are not only theoretically optimal but also can yield state-of-the-art performance in practical perceptual decoding. Finally, we validate our theoretical finding and demonstrate the superiority of our frameworks via experiments. Code is available at: https://github.com/ZeyuYan/Controllable-Perceptual-Compression

📄 PDF Abstract BibTeX arXiv:2206.10082

Code (1)

zeyuyan/controllable-perceptual-compression 공식 구현 pytorch

Tasks

Decoder

Similar Papers 제목 키워드 기반

Machine Perceptual Quality: Evaluating the Impact of Severe Lossy Compression on Audio and Image Models

2024-01-15 · Dan Jacobellis, Daniel Cummings, Neeraja J. Yadwadkar

In the field of neural data compression, the prevailing focus has been on optimizing algorithms for either classical distortion metrics, such as PSNR or SSIM, or human perceptual quality. With increasing amounts of data …

Data Compressionimage-classificationImage ClassificationImage Segmentation+5

Unlocking the Potential of Digital Pathology: Novel Baselines for Compression

2024-12-17 · Maximilian Fischer, Peter Neher, Peter Schüffler, Sebastian Ziegler 외

Digital pathology offers a groundbreaking opportunity to transform clinical practice in histopathological image analysis, yet faces a significant hurdle: the substantial file sizes of pathological Whole Slide Images (WSI…

whole slide images

Deep Perceptual Image Quality Assessment for Compression

2021-03-01 · Juan Carlos Mier, Eddie Huang, Hossein Talebi, Feng Yang 외

Lossy Image compression is necessary for efficient storage and transfer of data. Typically the trade-off between bit-rate and quality determines the optimal compression level. This makes the image quality metric an integ…

Image CompressionImage Quality AssessmentSSIM

On Perceptual Lossy Compression: The Cost of Perceptual Reconstruction and An Optimal Training Framework

2021-06-05 · Zeyu Yan, Fei Wen, Rendong Ying, Chao Ma 외

Lossy compression algorithms are typically designed to achieve the lowest possible distortion at a given bit rate. However, recent studies show that pursuing high perceptual quality would lead to increase of the lowest a…

Decoder

Controllable Generative Video Compression

2026-04-08 · Ding Ding, Daowen Li, Ying Chen, Yixin Gao 외 arxiv

Perceptual video compression adopts generative video modeling to improve perceptual realism but frequently sacrifices signal fidelity, diverging from the goal of video compression to faithfully reproduce visual signal. T…

Video Generation