Back to the Blocks World: Learning New Actions through Situated Human-Robot Dialogue
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks
An ideal integration of autonomous agents in a human world implies that they are able to collaborate on human terms. In particular, theory of mind plays an important role in maintaining common ground during human collabo…
MinecraftTheory of Mind ModelingSituated Instruction Following
Language is never spoken in a vacuum. It is expressed, comprehended, and contextualized within the holistic backdrop of the speaker's history, actions, and environment. Since humans are used to communicating efficiently …
Instruction FollowingBuilding and Learning Structures in a Situated Blocks World Through Deep Language Understanding
We demonstrate a system for understanding natural language utterances for structure description and placement in a situated blocks world context. By relying on a rich, domain-specific adaptation of a generic ontology and…
SituatedThinker: Grounding LLM Reasoning with Real-World through Situated Thinking
Recent advances in large language models (LLMs) demonstrate their impressive reasoning capabilities. However, the reasoning confined to internal parametric space limits LLMs' access to real-time information and understan…
Mathematical ReasoningMulti-hop Question AnsweringQuestion Answeringtext-based gamesWhat to Say and When to Say it: Live Fitness Coaching as a Testbed for Situated Interaction
Vision-language models have shown impressive progress in recent years. However, existing models are largely limited to turn-based interactions, where each turn must be stepped (i.e., prompted) by the user. Open-ended, as…