Transformer-based Learned Image Compression for Joint Decoding and Denoising
This work introduces a Transformer-based image compression system. It has the flexibility to switch between the standard image reconstruction and the denoising reconstruction from a single compressed bitstream. Instead of training separate decoders for these tasks, we incorporate two add-on modules to adapt a pre-trained image decoder from performing the standard image reconstruction to joint decoding and denoising. Our scheme adopts a two-pronged approach. It features a latent refinement module to refine the latent representation of a noisy input image for reconstructing a noise-free image. Additionally, it incorporates an instance-specific prompt generator that adapts the decoding process to improve on the latent refinement. Experimental results show that our method achieves a similar level of denoising quality to training a separate decoder for joint decoding and denoising at the expense of only a modest increase in the decoder's model size and computational complexity.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderDenoisingImage CompressionImage ReconstructionSimilar Papers 제목 키워드 기반
Entroformer: A Transformer-based Entropy Model for Learned Image Compression
One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules. Previous works build e…
image-classificationImage ClassificationImage CompressionPositionText-to-Image Synthesis Based on Object-Guided Joint-Decoding Transformer
Object-guided text-to-image synthesis aims to generate images from natural language descriptions built by two-step frameworks, i.e., the model generates the layout and then synthesizes images from the layout and capt…
Image GenerationObjectTask 2A Learned Pixel-by-Pixel Lossless Image Compression Method with 59K Parameters and Parallel Decoding
This paper considers lossless image compression and presents a learned compression system that can achieve state-of-the-art lossless compression performance but uses only 59K parameters, which is more than 30x less than …
DecoderGPUImage CompressionEfficient Contextformer: Spatio-Channel Window Attention for Fast Context Modeling in Learned Image Compression
Entropy estimation is essential for the performance of learned image compression. It has been demonstrated that a transformer-based entropy model is of critical importance for achieving a high compression ratio, however,…
Image CompressionCorner-to-Center Long-range Context Model for Efficient Learned Image Compression
In the framework of learned image compression, the context model plays a pivotal role in capturing the dependencies among latent representations. To reduce the decoding time resulting from the serial autoregressive conte…
DecoderImage Compression