paper-with-me

홈 › Papers

Model-Aware Rate-Distortion Limits for Task-Oriented Source Coding

2026-02-13 · Andriy Enttsel, Vincent Corlay arxiv

Task-Oriented Source Coding (TOSC) has emerged as a paradigm for efficient visual data communication in machine-centric inference systems, where bitrate, latency, and task performance must be jointly optimized under resource constraints. While recent works have proposed rate-distortion bounds for coding for machines, these results often rely on strong assumptions on task identifiability and neglect the impact of deployed task models. In this work, we revisit the fundamental limits of single-TOSC through the lens of indirect rate-distortion theory. We highlight the conditions under which existing rate-distortion bounds are achievable and show their limitations in realistic settings. We then introduce task model-aware rate-distortion bounds that account for task model suboptimality and architectural constraints. Experiments on standard classification benchmarks confirm that current learned TOSC schemes operate far from these limits, highlighting transmitter-side complexity as a key bottleneck.

📄 PDF Abstract BibTeX arXiv:2602.12866

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Joint Source-Channel-Generation Coding: From Distortion-oriented Reconstruction to Semantic-consistent Generation

2026-01-19 · Tong Wu, Zhiyong Chen, Guo Lu, Li Song 외 arxiv

Conventional communication systems, including both separation-based coding and AI-driven joint source-channel coding (JSCC), are largely guided by Shannon's rate-distortion theory. However, relying on generic distortion …

Multi-Level Curriculum for Training a Distortion-Aware Barrel Distortion Rectification Model

2021-01-01 · ICCV 2021 10 · Kang Liao, Chunyu Lin, Lixin Liao, Yao Zhao 외

Barrel distortion rectification aims at removing the radial distortion in a distorted image captured by a wide-angle lens. Previous deep learning methods mainly solve this problem by learning the implicit distortion …

Revisiting 360 Depth Estimation with PanoGabor: A New Fusion Perspective

2024-08-29 · Zhijie Shen, Chunyu Lin, Lang Nie, Kang Liao

Depth estimation from a monocular 360 image is important to the perception of the entire 3D environment. However, the inherent distortion and large field of view (FoV) in 360 images pose great challenges for this task. T…

Depth EstimationERPSensitivity

Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models

2024-07-22 · Alliot Nagle, Adway Girish, Marco Bondaschi, Michael Gastpar 외

We formalize the problem of prompt compression for large language models (LLMs) and present a framework to unify token-level prompt compression methods which create hard prompts for black-box models. We derive the distor…

Natural Language Queries

Rate-Distortion Limits for Multimodal Retrieval: Theory, Optimal Codes, and Finite-Sample Guarantees

2025-09-14 · Thomas Y. Chen arxiv

We establish the first information-theoretic limits for multimodal retrieval. Casting ranking as lossy source coding, we derive a single-letter rate-distortion function $R(D)$ for reciprocal-rank distortion and prove a c…