paper-with-me

홈 › Papers

Task-Aware Encoder Control for Deep Video Compression

2024-04-07 · CVPR 2024 1 · Xingtong Ge, Jixiang Luo, Xinjie Zhang, Tongda Xu, Guo Lu, Dailan He, Jing Geng, Yan Wang, Jun Zhang, Hongwei Qin

Prior research on deep video compression (DVC) for machine tasks typically necessitates training a unique codec for each specific task, mandating a dedicated decoder per task. In contrast, traditional video codecs employ a flexible encoder controller, enabling the adaptation of a single codec to different tasks through mechanisms like mode prediction. Drawing inspiration from this, we introduce an innovative encoder controller for deep video compression for machines. This controller features a mode prediction and a Group of Pictures (GoP) selection module. Our approach centralizes control at the encoding stage, allowing for adaptable encoder adjustments across different tasks, such as detection and tracking, while maintaining compatibility with a standard pre-trained DVC decoder. Empirical evidence demonstrates that our method is applicable across multiple tasks with various existing pre-trained DVCs. Moreover, extensive experiments demonstrate that our method outperforms previous DVC by about 25% bitrate for different tasks, with only one pre-trained decoder.

📄 PDF Abstract BibTeX arXiv:2404.04848

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderVideo Compression

Similar Papers 제목 키워드 기반

RL-RC-DoT: A Block-level RL agent for Task-Aware Video Compression

2025-01-21 · CVPR 2025 1 · Uri Gadot, Assaf Shocher, Shie Mannor, Gal Chechik 외

Video encoders optimize compression for human perception by minimizing reconstruction error under bit-rate constraints. In many modern applications such as autonomous driving, an overwhelming majority of videos serve as …

Autonomous DrivingObject RecognitionQuantizationReinforcement Learning (RL)+1

Content Adaptive and Error Propagation Aware Deep Video Compression

2020-03-25 · ECCV 2020 8 · Guo Lu, Chunlei Cai, Xiaoyun Zhang, Li Chen 외

Recently, learning based video compression methods attract increasing attention. However, the previous works suffer from error propagation due to the accumulation of reconstructed error in inter predictive coding. Meanwh…

DecoderVideo Compression

Compression-Aware Video Super-Resolution

2023-01-01 · CVPR 2023 1 · Yingwei Wang, Xu Jia, Xin Tao, Takashi Isobe 외

Videos stored on mobile devices or delivered on the Internet are usually in compressed format and are of various unknown compression parameters, but most video super-resolution (VSR) methods often assume ideal inputs…

Model CompressionSuper-ResolutionVideo EnhancementVideo Super-Resolution

GRACE: Generation-aware latent compression for efficient video generation

2026-10-07 · Jiyoung Kim, Paul Hyunbin Cho, Jisu Nam, Donghoon Lee 외 hf

Highly compressed video autoencoders offer an effective way to accelerate video diffusion models, as the Diffusion Transformer (DiT) operates on far fewer tokens. However, such autoencoders are challenging to train, sinc…

Video Generation

TVC: Tokenized Video Compression with Ultra-Low Bitrate

2025-04-22 · Lebin Zhou, Cihan Ruan, Nam Ling, Wei Wang 외

Tokenized visual representations have shown great promise in image compression, yet their extension to video remains underexplored due to the challenges posed by complex temporal dynamics and stringent bitrate constraint…

DecoderImage CompressionVideo Compression