paper-with-me

Papers

Knowledge Distillation from Language-Oriented to Emergent Communication for Multi-Agent Remote Control

2024-01-23 · Yongjun Kim, Sejin Seo, Jihong Park, Mehdi Bennis, Seong-Lyun Kim, Junil Choi

In this work, we compare emergent communication (EC) built upon multi-agent deep reinforcement learning (MADRL) and language-oriented semantic communication (LSC) empowered by a pre-trained large language model (LLM) using human language. In a multi-agent remote navigation task, with multimodal input data comprising location and channel maps, it is shown that EC incurs high training cost and struggles when using multimodal data, whereas LSC yields high inference computing cost due to the LLM's large size. To address their respective bottlenecks, we propose a novel framework of language-guided EC (LEC) by guiding the EC training using LSC via knowledge distillation (KD). Simulations corroborate that LEC achieves faster travel time while avoiding areas with poor channel conditions, as well as speeding up the MADRL training convergence by up to 61.8% compared to EC.

📄 PDF Abstract BibTeX arXiv:2401.12624

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningKnowledge DistillationLanguage ModelingLanguage ModellingLarge Language ModelSemantic Communication

Methods 이 논문이 사용한 방법론

Travel 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Language-Oriented Communication with Semantic Coding and Knowledge Distillation for Text-to-Image Generation

2023-09-20 · Hyelin Nam, Jihong Park, Jinho Choi, Mehdi Bennis 외

By integrating recent advances in large language models (LLMs) and generative models into the emerging semantic communication (SC) paradigm, in this article we put forward to a novel framework of language-oriented semant…

Image GenerationIn-Context LearningKnowledge DistillationSemantic Communication+2

Concept-Best-Matching: Evaluating Compositionality in Emergent Communication

2024-03-17 · Boaz Carmeli, Yonatan Belinkov, Ron Meir

Artificial agents that learn to communicate in order to accomplish a given task acquire communication protocols that are typically opaque to a human. A large body of work has attempted to evaluate the emergent communicat…

Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models

2025-06-16 · Chuanhong Liu, Caili Guo, Yang Yang, Mingzhe Chen 외

Recent studies have focused on leveraging large-scale artificial intelligence (LAI) models to improve semantic representation and compression capabilities. However, the substantial computational demands of LAI models pos…

Knowledge DistillationSemantic Communication

Emergent Communication for Rules Reasoning

2023-11-08 · NeurIPS 2023 11

Research on emergent communication between deep-learning-based agents has received extensive attention due to its inspiration for linguistics and artificial intelligence. However, previous attempts have hovered around em…

Semantic Communication meets System 2 ML: How Abstraction, Compositionality and Emergent Languages Shape Intelligence

2025-05-27 · Mehdi Bennis, Salem Lahlou

The trajectories of 6G and AI are set for a creative collision. However, current visions for 6G remain largely incremental evolutions of 5G, while progress in AI is hampered by brittle, data-hungry models that lack robus…

Semantic Communication