paper-with-me

Papers

The Rate-Distortion-Perception-Classification Tradeoff: Joint Source Coding and Modulation via Inverse-Domain GANs

2023-12-22 · Junli Fang, João F. C. Mota, Baoshan Lu, Weicheng Zhang, Xuemin Hong

The joint source-channel coding (JSCC) framework leverages deep learning to learn from data the best codes for source and channel coding. When the output signal, rather than being binary, is directly mapped onto the IQ domain (complex-valued), we call the resulting framework joint source coding and modulation (JSCM). We consider a JSCM scenario and show the existence of a strict tradeoff between channel rate, distortion, perception, and classification accuracy, a tradeoff that we name RDPC. We then propose two image compression methods to navigate that tradeoff: the RDPCO algorithm which, under simple assumptions, directly solves the optimization problem characterizing the tradeoff, and an algorithm based on an inverse-domain generative adversarial network (ID-GAN), which is more general and achieves extreme compression. Simulation results corroborate the theoretical findings, showing that both algorithms exhibit the RDPC tradeoff. They also demonstrate that the proposed ID-GAN algorithm effectively balances image distortion, perception, and classification accuracy, and significantly outperforms traditional separation-based methods and recent deep JSCM architectures in terms of one or more of these metrics.

📄 PDF Abstract BibTeX arXiv:2312.14792

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial NetworkImage CompressionNavigate

Similar Papers 제목 키워드 기반

On The Classification-Distortion-Perception Tradeoff

2019-04-18 · NeurIPS 2019 12 · Dong Liu, Haochen Zhang, Zhiwei Xiong

Signal degradation is ubiquitous and computational restoration of degraded signal has been investigated for many years. Recently, it is reported that the capability of signal restoration is fundamentally limited by the p…

ClassificationGeneral Classification

Training-Free Rate-Distortion-Perception Traversal With Diffusion

2026-03-04 · Yuhan Wang, Suzhi Bi, Ying-Jun Angela Zhang arxiv

The rate-distortion-perception (RDP) tradeoff characterizes the fundamental limits of lossy compression by jointly considering bitrate, reconstruction fidelity, and perceptual quality. While recent neural compression met…

Universal Representations for Classification-enhanced Lossy Compression

2025-04-12 · Nam Nguyen

In lossy compression, the classical tradeoff between compression rate and reconstruction distortion has traditionally guided algorithm design. However, Blau and Michaeli [5] introduced a generalized framework, known as t…

ClassificationImage Compression

Universal Rate-Distortion-Perception Representations for Lossy Compression

2021-06-18 · NeurIPS 2021 12 · George Zhang, Jingjing Qian, Jun Chen, Ashish Khisti

In the context of lossy compression, Blau & Michaeli (2019) adopt a mathematical notion of perceptual quality and define the information rate-distortion-perception function, generalizing the classical rate-distortion tra…

DecoderImage Compression

Characterization of the Distortion-Perception Tradeoff for Finite Channels with Arbitrary Metrics

2024-02-03 · Dror Freirich, Nir Weinberger, Ron Meir

Whenever inspected by humans, reconstructed signals should not be distinguished from real ones. Typically, such a high perceptual quality comes at the price of high reconstruction error, and vice versa. We study this dis…