Another Way to the Top: Exploit Contextual Clustering in Learned Image Coding
While convolution and self-attention are extensively used in learned image compression (LIC) for transform coding, this paper proposes an alternative called Contextual Clustering based LIC (CLIC) which primarily relies on clustering operations and local attention for correlation characterization and compact representation of an image. As seen, CLIC expands the receptive field into the entire image for intra-cluster feature aggregation. Afterward, features are reordered to their original spatial positions to pass through the local attention units for inter-cluster embedding. Additionally, we introduce the Guided Post-Quantization Filtering (GuidedPQF) into CLIC, effectively mitigating the propagation and accumulation of quantization errors at the initial decoding stage. Extensive experiments demonstrate the superior performance of CLIC over state-of-the-art works: when optimized using MSE, it outperforms VVC by about 10% BD-Rate in three widely-used benchmark datasets; when optimized using MS-SSIM, it saves more than 50% BD-Rate over VVC. Our CLIC offers a new way to generate compact representations for image compression, which also provides a novel direction along the line of LIC development.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringImage CompressionMS-SSIMQuantizationSSIMMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
External Patch Prior Guided Internal Clustering for Image Denoising
Natural image modeling plays a key role in many vision problems such as image denoising. Image priors are widely used to regularize the denoising process, which is an illposed inverse problem. One category of denoising m…
ClusteringDenoisingImage DenoisingOptimal Exploitation of Clustering and History Information in Multi-Armed Bandit
We consider the stochastic multi-armed bandit problem and the contextual bandit problem with historical observations and pre-clustered arms. The historical observations can contain any number of instances for each arm, a…
ClusteringLearning Semantic Annotations for Tabular Data
The usefulness of tabular data such as web tables critically depends on understanding their semantics. This study focuses on column type prediction for tables without any meta data. Unlike traditional lexical matching-ba…
Column Type AnnotationPredictionTable annotationType predictionContextual unsupervised deep clustering in digital pathology
Clustering can be used in medical imaging research to identify different domains within a specific dataset, aiding in a better understanding of subgroups or strata that may not have been annotated. Moreover, in digital p…
ClusteringDeep Clusteringwhole slide imagesImage Generation from Contextually-Contradictory Prompts
Text-to-image diffusion models excel at generating high-quality, diverse images from natural language prompts. However, they often fail to produce semantically accurate results when the prompt contains concept combinatio…
DenoisingImage GenerationLarge Language Model