paper-with-me

홈 › Papers

Semantic MIMO Systems for Speech-to-Text Transmission

2024-05-13 · Zhenzi Weng, Zhijin Qin, Huiqiang Xie, Xiaoming Tao, Khaled B. Letaief

Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the single-user multiple-input multiple-output (MIMO) and multi-user MIMO communication scenarios, named SAC-ST. Particularly, a semantic communication system to serve the speech-to-text task at the receiver is first designed, which compresses the semantic information and generates the low-dimensional semantic features by leveraging the transformer module. In addition, a novel semantic-aware network is proposed to facilitate transmission with high semantic fidelity by identifying the critical semantic information and guaranteeing its accurate recovery. Furthermore, we extend the SAC-ST with a neural network-enabled channel estimation network to mitigate the dependence on accurate channel state information and validate the feasibility of SAC-ST in practical communication environments. Simulation results will show that the proposed SAC-ST outperforms the communication framework without the semantic-aware network for speech-to-text transmission over the MIMO channels in terms of the speech-to-text metrics, especially in the low signal-to-noise regime. Moreover, the SAC-ST with the developed channel estimation network is comparable to the SAC-ST with perfect channel state information.

📄 PDF Abstract BibTeX arXiv:2405.08096

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic CommunicationSpeech-to-Text

Similar Papers 제목 키워드 기반

MIMO Speech Compression and Enhancement Based on Convolutional Denoising Autoencoder

2020-05-24 · You-Jin Li, Syu-Siang Wang, Yu Tsao, Borching Su

For speech-related applications in IoT environments, identifying effective methods to handle interference noises and compress the amount of data in transmissions is essential to achieve high-quality services. In this stu…

Denoising

Context Video Semantic Transmission with Variable Length and Rate Coding over MIMO Channels

2025-12-23 · Bingyan Xie, Yongpeng Wu, Wenjun Zhang, Derrick Wing Kwan Ng 외 arxiv

The evolution of semantic communications has profoundly impacted wireless video transmission, whose applications dominate driver of modern bandwidth consumption. However, most existing schemes are predominantly optimized…

Semantic Communication

Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesis

2022-05-09 · Zhenzi Weng, Zhijin Qin, Xiaoming Tao, Chengkang Pan 외

In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication s…

Deep LearningSemantic Communicationspeech-recognitionSpeech Recognition+1

SCAN: Semantic Communication with Adaptive Channel Feedback

2023-06-27 · Guangyi Zhang, Qiyu Hu, Yunlong Cai, Guanding Yu

In existing semantic communication systems for image transmission, some images are generally reconstructed with considerably low quality. As a result, the reliable transmission of each image cannot be guaranteed, bringin…

Semantic Communication

Semantic-preserved Communication System for Highly Efficient Speech Transmission

2022-05-25 · Tianxiao Han, Qianqian Yang, Zhiguo Shi, Shibo He 외

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus …

Semantic Communicationspeech-recognitionSpeech RecognitionSpeech-to-Text