paper-with-me

홈 › Papers

Causal Context Adjustment Loss for Learned Image Compression

2024-10-07 · Minghao Han, Shiyin Jiang, Shengxi Li, Xin Deng, Mai Xu, Ce Zhu, Shuhang Gu

In recent years, learned image compression (LIC) technologies have surpassed conventional methods notably in terms of rate-distortion (RD) performance. Most present learned techniques are VAE-based with an autoregressive entropy model, which obviously promotes the RD performance by utilizing the decoded causal context. However, extant methods are highly dependent on the fixed hand-crafted causal context. The question of how to guide the auto-encoder to generate a more effective causal context benefit for the autoregressive entropy models is worth exploring. In this paper, we make the first attempt in investigating the way to explicitly adjust the causal context with our proposed Causal Context Adjustment loss (CCA-loss). By imposing the CCA-loss, we enable the neural network to spontaneously adjust important information into the early stage of the autoregressive entropy model. Furthermore, as transformer technology develops remarkably, variants of which have been adopted by many state-of-the-art (SOTA) LIC techniques. The existing computing devices have not adapted the calculation of the attention mechanism well, which leads to a burden on computation quantity and inference latency. To overcome it, we establish a convolutional neural network (CNN) image compression model and adopt the unevenly channel-wise grouped strategy for high efficiency. Ultimately, the proposed CNN-based LIC network trained with our Causal Context Adjustment loss attains a great trade-off between inference latency and rate-distortion performance.

📄 PDF Abstract BibTeX arXiv:2410.04847

Code (1)

LabShuHangGU/CCA 공식 구현 pytorch

Tasks

Image Compression

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

A Neural Mean Embedding Approach for Back-door and Front-door Adjustment

2022-10-12 · Liyuan Xu, Arthur Gretton

We consider the estimation of average and counterfactual treatment effects, under two settings: back-door adjustment and front-door adjustment. The goal in both cases is to recover the treatment effect without having an …

counterfactualDensity Estimationregression

Causality-aware counterfactual confounding adjustment for feature representations learned by deep models

2020-04-20 · Elias Chaibub Neto

Causal modeling has been recognized as a potential solution to many challenging problems in machine learning (ML). Here, we describe how a recently proposed counterfactual approach developed to deconfound linear structur…

counterfactualGeneral ClassificationImage Classification

Causal Intervention for Weakly-Supervised Semantic Segmentation

2020-09-26 · NeurIPS 2020 12 · Dong Zhang, Hanwang Zhang, Jinhui Tang, Xian-Sheng Hua 외

We present a causal inference framework to improve Weakly-Supervised Semantic Segmentation (WSSS). Specifically, we aim to generate better pixel-level pseudo-masks by using only image-level labels -- the most crucial ste…

AttributeCausal InferenceSegmentationSemantic Segmentation+2

Integrating Earth Observation Data into Causal Inference: Challenges and Opportunities

2023-01-30 · Connor T. Jerzak, Fredrik Johansson, Adel Daoud

Observational studies require adjustment for confounding factors that are correlated with both the treatment and outcome. In the setting where the observed variables are tabular quantities such as average income in a nei…

Causal InferenceEarth Observation

Deep Semantics-Aware Photo Adjustment

2017-06-26 · Seonghyeon Nam, Seon Joo Kim

Automatic photo adjustment is to mimic the photo retouching style of professional photographers and automatically adjust photos to the learned style. There have been many attempts to model the tone and the color adjustme…

Photo RetouchingScene Parsing