CB2: Collaborative Natural Language Interaction Research Platform
CB2 is a multi-agent platform to study collaborative natural language interaction in a grounded task-oriented scenario. It includes a 3D game environment, a backend server designed to serve trained models to human agents, and various tools and processes to enable scalable studies. We deploy CB2 at https://cb2.ai as a system demonstration with a learned instruction following model.
Code (1)
Tasks
Instruction FollowingSimilar Papers 제목 키워드 기반
CoSearchAgent: A Lightweight Collaborative Search Agent with Large Language Models
Collaborative search supports multiple users working together to accomplish a specific search task. Research has found that designing lightweight collaborative search plugins within instant messaging platforms aligns bet…
Collaborative construction of lexicographic and parallel datasets for African languages: first assessment
Faced with a considerable lack of resources in African languages to carry out work in Natural Language Processing (NLP), Natural Language Understanding (NLU) and artificial intelligence, the research teams of NTeALan ass…
Natural Language UnderstandingAerialMind: Towards Referring Multi-Object Tracking in UAV Scenarios
Referring Multi-Object Tracking (RMOT) aims to achieve precise object detection and tracking through natural language instructions, representing a fundamental capability for intelligent robotic systems. However, current …
Representation LearningMulti-Object TrackingObject DetectionHuman-guided Collaborative Problem Solving: A Natural Language based Framework
We consider the problem of human-machine collaborative problem solving as a planning task coupled with natural language communication. Our framework consists of three components -- a natural language engine that parses t…
MinecraftTwo Heads Are Better Than One: Collaborative LLM Embodied Agents for Human-Robot Interaction
With the recent development of natural language generation models - termed as large language models (LLMs) - a potential use case has opened up to improve the way that humans interact with robot assistants. These LLMs sh…
AI AgentText Generation