Investigating the Development of Task-Oriented Communication in Vision-Language Models
We investigate whether \emph{LLM-based agents} can develop task-oriented communication protocols that differ from standard natural language in collaborative reasoning tasks. Our focus is on two core properties such task-oriented protocols may exhibit: Efficiency -- conveying task-relevant information more concisely than natural language, and Covertness -- becoming difficult for external observers to interpret, raising concerns about transparency and control. To investigate these aspects, we use a referential-game framework in which vision-language model (VLM) agents communicate, providing a controlled, measurable setting for evaluating language variants. Experiments show that VLMs can develop effective, task-adapted communication patterns. At the same time, they can develop covert protocols that are difficult for humans and external agents to interpret. We also observe spontaneous coordination between similar models without explicitly shared protocols. These findings highlight both the potential and the risks of task-oriented communication, and position referential games as a valuable testbed for future work in this area.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Robust Information Bottleneck for Task-Oriented Communication with Digital Modulation
Task-oriented communications, mostly using learning-based joint source-channel coding (JSCC), aim to design a communication-efficient edge inference system by transmitting task-relevant information to the receiver. Howev…
InformativenessViWi Vision-Aided mmWave Beam Tracking: Dataset, Task, and Baseline Solutions
Vision-aided wireless communication is motivated by the recent advances in deep learning and computer vision as well as the increasing dependence on line-of-sight links in millimeter wave (mmWave) and terahertz systems. …
Dataset GenerationTask-oriented and Semantics-aware Communications for Augmented Reality
Upon the advent of the emerging metaverse and its related applications in Augmented Reality (AR), the current bit-oriented network struggles to support real-time changes for the vast amount of associated information, cre…
Goal-Oriented Semantic Communications for 6G Networks
Upon the arrival of emerging devices, including Extended Reality (XR) and Unmanned Aerial Vehicles (UAVs), the traditional communication framework is approaching Shannon's physical capacity limit and fails to guarantee t…
Semantic CommunicationFrequency Modulation for Task-Oriented Communications and Multiple Access
In the context of task-oriented communications we advocate the development of waveforms for Federated Edge Learning (FEEL). Over-the-air computing (AirComp) has emerged as a communication scheme that allows to compute a …