Semantic MIMO Systems for Speech-to-Text Transmission
Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the single-user multiple-input multiple-output (MIMO) and multi-user MIMO communication scenarios, named SAC-ST. Particularly, a semantic communication system to serve the speech-to-text task at the receiver is first designed, which compresses the semantic information and generates the low-dimensional semantic features by leveraging the transformer module. In addition, a novel semantic-aware network is proposed to facilitate transmission with high semantic fidelity by identifying the critical semantic information and guaranteeing its accurate recovery. Furthermore, we extend the SAC-ST with a neural network-enabled channel estimation network to mitigate the dependence on accurate channel state information and validate the feasibility of SAC-ST in practical communication environments. Simulation results will show that the proposed SAC-ST outperforms the communication framework without the semantic-aware network for speech-to-text transmission over the MIMO channels in terms of the speech-to-text metrics, especially in the low signal-to-noise regime. Moreover, the SAC-ST with the developed channel estimation network is comparable to the SAC-ST with perfect channel state information.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic CommunicationSpeech-to-TextSimilar Papers 제목 키워드 기반
MIMO Speech Compression and Enhancement Based on Convolutional Denoising Autoencoder
For speech-related applications in IoT environments, identifying effective methods to handle interference noises and compress the amount of data in transmissions is essential to achieve high-quality services. In this stu…
DenoisingContext Video Semantic Transmission with Variable Length and Rate Coding over MIMO Channels
The evolution of semantic communications has profoundly impacted wireless video transmission, whose applications dominate driver of modern bandwidth consumption. However, most existing schemes are predominantly optimized…
Semantic CommunicationDeep Learning Enabled Semantic Communications with Speech Recognition and Synthesis
In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication s…
Deep LearningSemantic Communicationspeech-recognitionSpeech Recognition+1SCAN: Semantic Communication with Adaptive Channel Feedback
In existing semantic communication systems for image transmission, some images are generally reconstructed with considerably low quality. As a result, the reliable transmission of each image cannot be guaranteed, bringin…
Semantic CommunicationSemantic-preserved Communication System for Highly Efficient Speech Transmission
Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus …
Semantic Communicationspeech-recognitionSpeech RecognitionSpeech-to-Text