DSSLIC: Deep Semantic Segmentation-based Layered Image Compression
Deep learning has revolutionized many computer vision fields in the last few years, including learning-based image compression. In this paper, we propose a deep semantic segmentation-based layered image compression (DSSLIC) framework in which the semantic segmentation map of the input image is obtained and encoded as the base layer of the bit-stream. A compact representation of the input image is also generated and encoded as the first enhancement layer. The segmentation map and the compact version of the image are then employed to obtain a coarse reconstruction of the image. The residual between the input and the coarse reconstruction is additionally encoded as another enhancement layer. Experimental results show that the proposed framework outperforms the H.265/HEVC-based BPG and other codecs in both PSNR and MS-SSIM metrics across a wide range of bit rates in RGB domain. Besides, since semantic segmentation map is included in the bit-stream, the proposed scheme can facilitate many other tasks such as image search and object-based adaptive image compression.
Code (2)
Tasks
Image CompressionImage RetrievalMS-SSIMSegmentationSemantic SegmentationSSIMSimilar Papers 제목 키워드 기반
Image Compression with Encoder-Decoder Matched Semantic Segmentation
In recent years, layered image compression is demonstrated to be a promising direction, which encodes a compact representation of the input image and apply an up-sampling network to reconstruct the image. To further impr…
DecoderImage CompressionSegmentationSemantic SegmentationStable Diffusion is a Natural Cross-Modal Decoder for Layered AI-generated Image Compression
Recent advances in Artificial Intelligence Generated Content (AIGC) have garnered significant interest, accompanied by an increasing need to transmit and compress the vast number of AI-generated images (AIGIs). However, …
DecoderImage CompressionImage GenerationLayered Interpretation of Street View Images
We propose a layered street view model to encode both depth and semantic information on street view images for autonomous driving. Recently, stixels, stix-mantics, and tiered scene labeling methods have been proposed to …
Autonomous DrivingGPUScene LabelingScene SegmentationSQ-GAN: Semantic Image Communications Using Masked Vector Quantization
This work introduces Semantically Masked VQ-GAN (SQ-GAN), a novel approach integrating generative models to optimize image compression for semantic/task-oriented communications. SQ-GAN employs off-the-shelf semantic sema…
Image CompressionQuantizationSegmentationSemantic SegmentationImproved Hybrid Layered Image Compression using Deep Learning and Traditional Codecs
Recently deep learning-based methods have been applied in image compression and achieved many promising results. In this paper, we propose an improved hybrid layered image compression framework by combining deep learning…
Deep LearningImage CompressionMS-SSIMSSIM