paper-with-me

Papers

Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence

2024-01-18 · Jie Guo, Hao Chen, Bin Song, Yuhao Chi, Chau Yuen, Fei Richard Yu, Geoffrey Ye Li, Dusit Niyato

In this article, we present a novel framework, named distributed task-oriented communication networks (DTCN), based on recent advances in multimodal semantic transmission and edge intelligence. In DTCN, the multimodal knowledge of semantic relays and the adaptive adjustment capability of edge intelligence can be integrated to improve task performance. Specifically, we propose the key techniques in the framework, such as semantic alignment and complement, a semantic relay scheme for deep joint source-channel relay coding, and collaborative device-server optimization and inference. Furthermore, a multimodal classification task is used as an example to demonstrate the benefits of the proposed DTCN over existing methods. Numerical results validate that DTCN can significantly improve the accuracy of classification tasks, even in harsh communication scenarios (e.g., low signal-to-noise regime), thanks to multimodal semantic relay and edge intelligence.

📄 PDF Abstract BibTeX arXiv:2401.09904

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Task-Oriented Multi-User Semantic Communications for VQA Task

2021-08-16 · Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li

Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users t…

Question AnsweringSemantic CommunicationVisual Question AnsweringVisual Question Answering (VQA)

SIMAC: A Semantic-Driven Integrated Multimodal Sensing And Communication Framework

2025-03-11 · Yubo Peng, Luping Xiang, Kun Yang, Feibo Jiang 외

Traditional single-modality sensing faces limitations in accuracy and capability, and its decoupled implementation with communication systems increases latency in bandwidth-constrained environments. Additionally, single-…

Large Language ModelMulti-Task Learning

Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networks

2025-05-05 · Baoxia Du, Hongyang Du, Dusit Niyato, Ruidong Li

Task-oriented semantic communication has emerged as a fundamental approach for enhancing performance in various communication scenarios. While recent advances in Generative Artificial Intelligence (GenAI), such as Large …

Question AnsweringSemantic CommunicationVisual Question AnsweringVisual Question Answering (VQA)

Task-Agnostic Semantic Communications Relying on Information Bottleneck and Federated Meta-Learning

2025-04-30 · Hao Wei, Wen Wang, Wanli Ni, Wenjun Xu 외

As a paradigm shift towards pervasive intelligence, semantic communication (SemCom) has shown great potentials to improve communication efficiency and provide user-centric services by delivering task-oriented semantic me…

Meta-LearningSemantic Communication

Latent Space Alignment for Semantic Channel Equalization

2024-05-22 · Tomás Hüttebräucker, Mohamed Sana, Emilio Calvanese Strinati

We relax the constraint of a shared language between agents in a semantic and goal-oriented communication system to explore the effect of language mismatch in distributed task solving. We propose a mathematical framework…