paper-with-me

홈 › Papers

Learned Image Compression with Generalized Octave Convolution and Cross-Resolution Parameter Estimation

2022-09-07 · Haisheng Fu, Feng Liang

The application of the context-adaptive entropy model significantly improves the rate-distortion (R-D) performance, in which hyperpriors and autoregressive models are jointly utilized to effectively capture the spatial redundancy of the latent representations. However, the latent representations still contain some spatial correlations. In addition, these methods based on the context-adaptive entropy model cannot be accelerated in the decoding process by parallel computing devices, e.g. FPGA or GPU. To alleviate these limitations, we propose a learned multi-resolution image compression framework, which exploits the recently developed octave convolutions to factorize the latent representations into the high-resolution (HR) and low-resolution (LR) parts, similar to wavelet transform, which further improves the R-D performance. To speed up the decoding, our scheme does not use context-adaptive entropy model. Instead, we exploit an additional hyper layer including hyper encoder and hyper decoder to further remove the spatial redundancy of the latent representation. Moreover, the cross-resolution parameter estimation (CRPE) is introduced into the proposed framework to enhance the flow of information and further improve the rate-distortion performance. An additional information-fidelity loss is proposed to the total loss function to adjust the contribution of the LR part to the final bit stream. Experimental results show that our method separately reduces the decoding time by approximately 73.35 % and 93.44 % compared with that of state-of-the-art learned image compression methods, and the R-D performance is still better than H.266/VVC(4:2:0) and some learning-based methods on both PSNR and MS-SSIM metrics across a wide bit rates.

📄 PDF Abstract BibTeX arXiv:2209.03353

Code (0)

등록된 구현이 없습니다.

Tasks

GPUImage CompressionMS-SSIMparameter estimationSSIM

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Generalized Octave Convolutions for Learned Multi-Frequency Image Compression

2020-02-24 · Mohammad Akbari, Jie Liang, Jingning Han, Chengjie Tu

Learned image compression has recently shown the potential to outperform the standard codecs. State-of-the-art rate-distortion (R-D) performance has been achieved by context-adaptive entropy coding approaches in which hy…

DenoisingImage CompressionImage DenoisingMS-SSIM+2

Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blocks

2020-12-31 · Mohammad Akbari, Jie Liang, Jingning Han, Chengjie Tu

Recently deep learning-based image compression has shown the potential to outperform traditional codecs. However, most existing methods train multiple networks for multiple bit rates, which increase the implementation co…

DecoderImage CompressionQuantization

OMR-NET: a two-stage octave multi-scale residual network for screen content image compression

2024-07-11 · Shiqi Jiang, Ting Ren, Congrui Fu, Shuai Li 외

Screen content (SC) differs from natural scene (NS) with unique characteristics such as noise-free, repetitive patterns, and high contrast. Aiming at addressing the inadequacies of current learned image compression (LIC)…

Image Compression

Multi-scale Octave Convolutions for Robust Speech Recognition

2019-10-31 · Joanna Rownicka, Peter Bell, Steve Renals

We propose a multi-scale octave convolution layer to learn robust speech representations efficiently. Octave convolutions were introduced by Chen et al [1] in the computer vision field to reduce the spatial redundancy of…

Computational EfficiencyRobust Speech Recognitionspeech-recognitionSpeech Recognition

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

2019-06-28 · Zhun Fan, Jiajie Mo, Benzhang Qiu, Wenji Li 외

Retinal vessel segmentation is a crucial step in diagnosing and screening various diseases, including diabetes, ophthalmologic diseases, and cardiovascular diseases. In this paper, we propose an effective and efficient m…

DecoderRetinal Vessel SegmentationSegmentationSpecificity