Efficient Masked Image Compression with Position-Indexed Self-Attention
In recent years, image compression for high-level vision tasks has attracted considerable attention from researchers. Given that object information in images plays a far more crucial role in downstream tasks than background information, some studies have proposed semantically structuring the bitstream to selectively transmit and reconstruct only the information required by these tasks. However, such methods structure the bitstream after encoding, meaning that the coding process still relies on the entire image, even though much of the encoded information will not be transmitted. This leads to redundant computations. Traditional image compression methods require a two-dimensional image as input, and even if the unimportant regions of the image are set to zero by applying a semantic mask, these regions still participate in subsequent computations as part of the image. To address such limitations, we propose an image compression method based on a position-indexed self-attention mechanism that encodes and decodes only the visible parts of the masked image. Compared to existing semantic-structured compression methods, our approach can significantly reduce computational costs.
Code (0)
등록된 구현이 없습니다.
Tasks
Image CompressionPositionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Masked Surfel Prediction for Self-Supervised Point Cloud Learning
Masked auto-encoding is a popular and effective self-supervised learning approach to point cloud learning. However, most of the existing methods reconstruct only the masked points and overlook the local geometry informat…
DecoderPoint cloud reconstructionSelf-Supervised LearningA Fast Palette Reordering Technique Based on GPU-Optimized Genetic Algorithms
Color re-indexing is one of main approaches for improving the loss-less compression of color indexed images. Zero-order entropy reduction of indexes matrix is the key to obtain high compression ratio. However, obtaining …
ClusteringGPULabel Ranker: Self-Aware Preference for Classification Label Position in Visual Masked Self-Supervised Pre-Trained Model
This paper investigates the impact of randomly initialized unique encoding of classification label position on the visual masked self-supervised pre-trained model when fine-tuning downstream classification tasks. Our fin…
ClassificationDimensionality ReductionHuman Activity RecognitionImage Classification+3Image Compression with Product Quantized Masked Image Modeling
Recent neural compression methods have been based on the popular hyperprior framework. It relies on Scalar Quantization and offers a very strong compression performance. This contrasts from recent advances in image gener…
Image CompressionImage GenerationQuantizationRepresentation Learning+1SemanticMIM: Marring Masked Image Modeling with Semantics Compression for General Visual Representation
This paper represents a neat yet effective framework, named SemanticMIM, to integrate the advantages of masked image modeling (MIM) and contrastive learning (CL) for general visual representation. We conduct a thorough c…
Contrastive Learning