Image Compression using only Attention based Neural Networks
In recent research, Learned Image Compression has gained prominence for its capacity to outperform traditional handcrafted pipelines, especially at low bit-rates. While existing methods incorporate convolutional priors with occasional attention blocks to address long-range dependencies, recent advances in computer vision advocate for a transformative shift towards fully transformer-based architectures grounded in the attention mechanism. This paper investigates the feasibility of image compression exclusively using attention layers within our novel model, QPressFormer. We introduce the concept of learned image queries to aggregate patch information via cross-attention, followed by quantization and coding techniques. Through extensive evaluations, our work demonstrates competitive performance achieved by convolution-free architectures across the popular Kodak, DIV2K, and CLIC datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Image CompressionQuantizationSimilar Papers 제목 키워드 기반
Efficient Masked Image Compression with Position-Indexed Self-Attention
In recent years, image compression for high-level vision tasks has attracted considerable attention from researchers. Given that object information in images plays a far more crucial role in downstream tasks than backgro…
Image CompressionPositionAttention-guided Image Compression by Deep Reconstruction of Compressive Sensed Saliency Skeleton
We propose a deep learning system for attention-guided dual-layer image compression (AGDL). In the AGDL compression system, an image is encoded into two layers, a base layer and an attention-guided refinement layer. Unli…
Compressive SensingImage CompressionSASIC: Stereo Image Compression With Latent Shifts and Stereo Attention
We propose a learned method for stereo image compression that leverages the similarity of the left and right images in a stereo pair due to overlapping fields of view. The left image is compressed by a learned compre…
Image CompressionMulti-spectral Entropy Constrained Neural Compression of Solar Imagery
Missions studying the dynamic behaviour of the Sun are defined to capture multi-spectral images of the sun and transmit them to the ground station in a daily basis. To make transmission efficient and feasible, image comp…
Image CompressionGABIC: Graph-based Attention Block for Image Compression
While standardized codecs like JPEG and HEVC-intra represent the industry standard in image compression, neural Learned Image Compression (LIC) codecs represent a promising alternative. In detail, integrating attention m…
Image Compression