Demo: Real-Time Semantic Communications with a Vision Transformer
Semantic communications are expected to enable the more effective delivery of meaning rather than a precise transfer of symbols. In this paper, we propose an end-to-end deep neural network-based architecture for image transmission and demonstrate its feasibility in a real-time wireless channel by implementing a prototype based on a field-programmable gate array (FPGA). We demonstrate that this system outperforms the traditional 256-quadrature amplitude modulation system in the low signal-to-noise ratio regime with the popular CIFAR-10 dataset. To the best of our knowledge, this is the first work that implements and investigates real-time semantic communications with a vision transformer.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editing
Real-time computer vision (CV) plays a crucial role in various real-world applications, whose performance is highly dependent on communication networks. Nonetheless, the data-oriented characteristics of conventional comm…
Facial EditingSemantic CommunicationSemantic Communications in Networked Systems: A Data Significance Perspective
We present our vision for a departure from the established way of architecting and assessing communication networks, by incorporating the semantics of information for communications and control in networked systems. We d…
compressed sensingDecision MakingBridging Neural Networks and Wireless Systems with MIMO-OFDM Semantic Communications
Semantic communications aim to enhance transmission efficiency by jointly optimizing source coding, channel coding, and modulation. While prior research has demonstrated promising performance in simulations, real-world i…
Semantic CommunicationOn the Role of ViT and CNN in Semantic Communications: Analysis and Prototype Validation
Semantic communications have shown promising advancements by optimizing source and channel coding jointly. However, the dynamics of these systems remain understudied, limiting research and performance gains. Inspired by …
Vision Transformer-based Semantic Communications With Importance-Aware Quantization
Semantic communications provide significant performance gains over traditional communications by transmitting task-relevant semantic features through wireless channels. However, most existing studies rely on end-to-end (…
image-classificationImage ClassificationImage CompressionQuantization+1