Deep Joint Source-Channel Coding Based on Semantics of Pixels
The semantic information of the image for intelligent tasks is hidden behind the pixels, and slight changes in the pixels will affect the performance of intelligent tasks. In order to preserve semantic information behind pixels for intelligent tasks during wireless image transmission, we propose a joint source-channel coding method based on semantics of pixels, which can improve the performance of intelligent tasks for images at the receiver by retaining semantic information. Specifically, we first utilize gradients of intelligent task's perception results with respect to pixels to represent the semantic importance of pixels. Then, we extract the semantic distortion, and train the deep joint source-channel coding network with the goal of minimizing semantic distortion rather than pixel's distortion. Experiment results demonstrate that the proposed method improves the performance of the intelligent classification task by 1.38% and 66% compared with the SOTA deep joint source-channel coding method and the traditional separately source-channel coding method at the same transmission ra te and signal-to-noise ratio.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Deep Joint Source-Channel Coding for Wireless Image Transmission with Semantic Importance
The sixth-generation mobile communication system proposes the vision of smart interconnection of everything, which requires accomplishing communication tasks while ensuring the performance of intelligent tasks. A joint s…
Semantics Alignment via Split Learning for Resilient Multi-User Semantic Communication
Recent studies on semantic communication commonly rely on neural network (NN) based transceivers such as deep joint source and channel coding (DeepJSCC). Unlike traditional transceivers, these neural transceivers are tra…
DecoderSemantic CommunicationDeep Joint Semantic Coding and Beamforming for Near-Space Airship-Borne Massive MIMO Network
Near-space airship-borne communication network is recognized to be an indispensable component of the future integrated ground-air-space network thanks to airships' advantage of long-term residency at stratospheric altitu…
Image ReconstructionSemantic CommunicationDeep Joint Source-Channel Coding for Wireless Image Transmission with Entropy-Aware Adaptive Rate Control
Adaptive rate control for deep joint source and channel coding (JSCC) is considered as an effective approach to transmit sufficient information in scenarios with limited communication resources. We propose a deep JSCC sc…
Joint Sensing and Semantic Communications with Multi-Task Deep Learning
This paper explores the integration of deep learning techniques for joint sensing and communications, with an extension to semantic communications. The integrated system comprises a transmitter and receiver operating ove…
DecoderDeep LearningMulti-Task Learning