DeepSIC: Deep Semantic Image Compression
Incorporating semantic information into the codecs during image compression can significantly reduce the repetitive computation of fundamental semantic analysis (such as object recognition) in client-side applications. The same practice also enable the compressed code to carry the image semantic information during storage and transmission. In this paper, we propose a concept called Deep Semantic Image Compression (DeepSIC) and put forward two novel architectures that aim to reconstruct the compressed image and generate corresponding semantic representations at the same time. The first architecture performs semantic analysis in the encoding process by reserving a portion of the bits from the compressed code to store the semantic representations. The second performs semantic analysis in the decoding step with the feature maps that are embedded in the compressed code. In both architectures, the feature maps are shared by the compression and the semantic analytics modules. To validate our approaches, we conduct experiments on the publicly available benchmarking datasets and achieve promising results. We also provide a thorough analysis of the advantages and disadvantages of the proposed technique.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingImage CompressionObject RecognitionSimilar Papers 제목 키워드 기반
Data-Driven Deep MIMO Detection:Network Architectures and Generalization Analysis
In practical Multiuser Multiple-Input Multiple-Output (MU-MIMO) systems, symbol detection remains challenging due to severe inter-user interference and sensitivity to Channel State Information (CSI) uncertainty. In contr…
DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detection
Digital receivers are required to recover the transmitted symbols from their observed channel output. In multiuser multiple-input multiple-output (MIMO) setups, where multiple symbols are simultaneously transmitted, accu…
Transfer-based Adversarial Poisoning Attacks for Online (MIMO-)Deep Receviers
Recently, the design of wireless receivers using deep neural networks (DNNs), known as deep receivers, has attracted extensive attention for ensuring reliable communication in complex channel environments. To adapt quick…
Meta-LearningHierarchical Semantic Compression for Consistent Image Semantic Restoration
The emerging semantic compression has been receiving increasing research efforts most recently, capable of achieving high fidelity restoration during compression, even at extremely low bitrates. However, existing semanti…
Feature CompressionSemantic CompressionVideo CompressionSMIC: Semantic Multi-Item Compression based on CLIP dictionary
Semantic compression, a compression scheme where the distortion metric, typically MSE, is replaced with semantic fidelity metrics, tends to become more and more popular. Most recent semantic compression schemes rely on t…
Semantic Compression