paper-with-me

Papers

Personalized Saliency in Task-Oriented Semantic Communications: Image Transmission and Performance Analysis

2022-09-25 · Jiawen Kang, Hongyang Du, Zonghang Li, Zehui Xiong, Shiyao Ma, Dusit Niyato, Yuan Li

Semantic communication, as a promising technology, has emerged to break through the Shannon limit, which is envisioned as the key enabler and fundamental paradigm for future 6G networks and applications, e.g., smart healthcare. In this paper, we focus on UAV image-sensing-driven task-oriented semantic communications scenarios. The majority of existing work has focused on designing advanced algorithms for high-performance semantic communication. However, the challenges, such as energy-hungry and efficiency-limited image retrieval manner, and semantic encoding without considering user personality, have not been explored yet. These challenges have hindered the widespread adoption of semantic communication. To address the above challenges, at the semantic level, we first design an energy-efficient task-oriented semantic communication framework with a triple-based {\color{black}scene graph} for image information. We then design a new personalized semantic encoder based on user interests to meet the requirements of personalized saliency. Moreover, at the communication level, we study the effects of dynamic wireless fading channels on semantic transmission mathematically and thus design an optimal multi-user resource allocation scheme by using game theory. Numerical results based on real-world datasets clearly indicate that the proposed framework and schemes significantly enhance the personalization and anti-interference performance of semantic communication, and are also efficient to improve the communication quality of semantic communication services.

📄 PDF Abstract BibTeX arXiv:2209.12274

Code (1)

Lizonghang/PerSF-SemCom 공식 구현 pytorch

Tasks

Image RetrievalRetrievalSemantic Communication

Similar Papers 제목 키워드 기반

Common Language for Goal-Oriented Semantic Communications: A Curriculum Learning Framework

2021-11-15 · Mohammad Karimzadeh Farshbafan, Walid Saad, Merouane Debbah

Semantic communications will play a critical role in enabling goal-oriented services over next-generation wireless systems. However, most prior art in this domain is restricted to specific applications (e.g., text or ima…

Reinforcement Learning (RL)

Will 6G be Semantic Communications? Opportunities and Challenges from Task Oriented and Secure Communications to Integrated Sensing

2024-01-03 · Yalin E. Sagduyu, Tugba Erpek, Aylin Yener, Sennur Ulukus

This paper explores opportunities and challenges of task (goal)-oriented and semantic communications for next-generation (NextG) communication networks through the integration of multi-task learning. This approach employ…

Federated LearningMulti-Task LearningRobust Design

Goal-oriented Semantic Communications for Metaverse Construction via Generative AI and Optimal Transport

2024-11-25 · Zhe Wang, Nan Li, Yansha Deng, A. Hamid Aghvami

The emergence of the metaverse has boosted productivity and creativity, driving real-time updates and personalized content, which will substantially increase data traffic. However, current bit-oriented communication netw…

DecoderSemantic Communication

Task-Oriented Multi-User Semantic Communications for VQA Task

2021-08-16 · Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li

Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users t…

Question AnsweringSemantic CommunicationVisual Question AnsweringVisual Question Answering (VQA)

Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications

2022-07-19 · Deniz Gunduz, Zhijin Qin, Inaki Estella Aguerri, Harpreet S. Dhillon 외

Communication systems to date primarily aim at reliably communicating bit sequences. Such an approach provides efficient engineering designs that are agnostic to the meanings of the messages or to the goal that the messa…