paper-with-me

Papers

Bridging the gap between image coding for machines and humans

2024-01-19 · Nam Le, Honglei Zhang, Francesco Cricri, Ramin G. Youvalari, Hamed Rezazadegan Tavakoli, Emre Aksu, Miska M. Hannuksela, Esa Rahtu

Image coding for machines (ICM) aims at reducing the bitrate required to represent an image while minimizing the drop in machine vision analysis accuracy. In many use cases, such as surveillance, it is also important that the visual quality is not drastically deteriorated by the compression process. Recent works on using neural network (NN) based ICM codecs have shown significant coding gains against traditional methods; however, the decompressed images, especially at low bitrates, often contain checkerboard artifacts. We propose an effective decoder finetuning scheme based on adversarial training to significantly enhance the visual quality of ICM codecs, while preserving the machine analysis accuracy, without adding extra bitcost or parameters at the inference phase. The results show complete removal of the checkerboard artifacts at the negligible cost of -1.6% relative change in task performance score. In the cases where some amount of artifacts is tolerable, such as when machine consumption is the primary target, this technique can enhance both pixel-fidelity and feature-fidelity scores without losing task performance.

📄 PDF Abstract BibTeX arXiv:2401.10732

Code (0)

등록된 구현이 없습니다.

Tasks

Decoder

Similar Papers 제목 키워드 기반

Scalable Image Coding for Humans and Machines Using Feature Fusion Network

2024-05-15 · Takahiro Shindo, Taiju Watanabe, Yui Tatsumi, Hiroshi Watanabe

As image recognition models become more prevalent, scalable coding methods for machines and humans gain more importance. Applications of image recognition models include traffic monitoring and farm management. In these u…

Image Compression

VVC+M: Plug and Play Scalable Image Coding for Humans and Machines

2023-05-17 · Alon Harell, Yalda Foroutan, Ivan V. Bajic

Compression for machines is an emerging field, where inputs are encoded while optimizing the performance of downstream automated analysis. In scalable coding for humans and machines, the compressed representation used fo…

Image Compression

Training-Free Continuous Bitrate Control for Scalable Image Coding for Humans and Machines

2026-05-29 · Yui Tatsumi, Hiroshi Watanabe arxiv

Continuous variable-rate compression is highly demanded in real-world applications, but remains underexplored in scalable image coding for humans and machines. In this paper, we propose a training-free variable-rate scal…

Rate-Distortion in Image Coding for Machines

2022-09-21 · Alon Harell, Anderson de Andrade, Ivan V. Bajic

In recent years, there has been a sharp increase in transmission of images to remote servers specifically for the purpose of computer vision. In many applications, such as surveillance, images are mostly transmitted for …

Refining Coded Image in Human Vision Layer Using CNN-Based Post-Processing

2024-05-20 · Takahiro Shindo, Yui Tatsumi, Taiju Watanabe, Hiroshi Watanabe

Scalable image coding for both humans and machines is a technique that has gained a lot of attention recently. This technology enables the hierarchical decoding of images for human vision and image recognition models. It…

Image Compression