Trustworthy Image Semantic Communication with GenAI: Explainablity, Controllability, and Efficiency
Image semantic communication (ISC) has garnered significant attention for its potential to achieve high efficiency in visual content transmission. However, existing ISC systems based on joint source-channel coding face challenges in interpretability, operability, and compatibility. To address these limitations, we propose a novel trustworthy ISC framework. This approach leverages text extraction and segmentation mapping techniques to convert images into explainable semantics, while employing Generative Artificial Intelligence (GenAI) for multiple downstream inference tasks. We also introduce a multi-rate ISC transmission protocol that dynamically adapts to both the received explainable semantic content and specific task requirements at the receiver. Simulation results demonstrate that our framework achieves explainable learning, decoupled training, and compatible transmission in various application scenarios. Finally, some intriguing research directions and application scenarios are identified.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic CommunicationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards 6G Intelligence: The Role of Generative AI in Future Wireless Networks
Ambient intelligence (AmI) is a computing paradigm in which physical environments are embedded with sensing, computation, and communication so they can perceive people and context, decide appropriate actions, and respond…
GenAINet: Enabling Wireless Collective Intelligence via Knowledge Transfer and Reasoning
Generative Artificial Intelligence (GenAI) and communication networks are expected to have groundbreaking synergies for 6G. Connecting GenAI agents via a wireless network can potentially unleash the power of Collective I…
Transfer LearningAt the Dawn of Generative AI Era: A Tutorial-cum-Survey on New Frontiers in 6G Wireless Intelligence
The majority of data-driven wireless research leans heavily on discriminative AI (DAI) that requires vast real-world datasets. Unlike the DAI, Generative AI (GenAI) pertains to generative models (GMs) capable of discerni…
Edge-computingISACUnderstanding U.S. Users' Security and Privacy Transparency Needs for Consumer-Facing Generative AI
Users increasingly rely on consumer-facing generative AI (GenAI) for tasks ranging from everyday needs to sensitive use cases. Yet, it remains unclear whether and how existing security and privacy (S&P) communications in…
Task-Oriented Connectivity for Networked Robotics with Generative AI and Semantic Communications
The convergence of robotics, advanced communication networks, and artificial intelligence (AI) holds the promise of transforming industries through fully automated and intelligent operations. In this work, we introduce a…
Anomaly DetectionSemantic Communication