paper-with-me

홈 › Papers

Conditional Residual Coding: A Remedy for Bottleneck Problems in Conditional Inter Frame Coding

2023-07-24 · Fabian Brand, Jürgen Seiler, André Kaup

Conditional coding is a new video coding paradigm enabled by neural-network-based compression. It can be shown that conditional coding is in theory better than the traditional residual coding, which is widely used in video compression standards like HEVC or VVC. However, on closer inspection, it becomes clear that conditional coders can suffer from information bottlenecks in the prediction path, i.e., that due to the data processing inequality not all information from the prediction signal can be passed to the reconstructed signal, thereby impairing the coder performance. In this paper we propose the conditional residual coding concept, which we derive from information theoretical properties of the conditional coder. This coder significantly reduces the influence of bottlenecks, while maintaining the theoretical performance of the conditional coder. We provide a theoretical analysis of the coding paradigm and demonstrate the performance of the conditional residual coder in a practical example. We show that conditional residual coders alleviate the disadvantages of conditional coders while being able to maintain their advantages over residual coders. In the spectrum of residual and conditional coding, we can therefore consider them as ``the best from both worlds''.

📄 PDF Abstract BibTeX arXiv:2307.12864

Code (0)

등록된 구현이 없습니다.

Tasks

Video Compression

Similar Papers 제목 키워드 기반

MaskCRT: Masked Conditional Residual Transformer for Learned Video Compression

2023-12-25 · Yi-Hsin Chen, Hong-Sheng Xie, Cheng-Wei Chen, Zong-Lin Gao 외

Conditional coding has lately emerged as the mainstream approach to learned video compression. However, a recent study shows that it may perform worse than residual coding when the information bottleneck arises. Conditio…

MS-SSIMSSIMVideo Compression

On the Rate-Distortion-Complexity Trade-offs of Neural Video Coding

2024-10-04 · Yi-Hsin Chen, Kuan-Wei Ho, Martin Benjak, Jörn Ostermann 외

This paper aims to delve into the rate-distortion-complexity trade-offs of modern neural video coding. Recent years have witnessed much research effort being focused on exploring the full potential of neural video coding…

Generalized Difference Coder: A Novel Conditional Autoencoder Structure for Video Compression

2021-12-15 · Fabian Brand, Jürgen Seiler, André Kaup

Motion compensated inter prediction is a common component of all video coders. The concept was established in traditional hybrid coding and successfully transferred to learning-based video compression. To compress the re…

Video Compression

Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck

2026-05-08 · Zihan Huang, Junda Wu, Tong Yu, Qianqi Yan 외 arxiv

While LLM-based agents excel at planning and executing long action sequences, their execution often remains inconsistent across trials, limiting reliability. Consolidating agent consistency requires distilling trial-erro…

Conditional and Residual Methods in Scalable Coding for Humans and Machines

2023-05-04 · Anderson de Andrade, Alon Harell, Yalda Foroutan, Ivan V. Bajić

We present methods for conditional and residual coding in the context of scalable coding for humans and machines. Our focus is on optimizing the rate-distortion performance of the reconstruction task using the informatio…

Image Reconstructionobject-detectionObject DetectionSemantic Segmentation