A Robotic Agent in a Virtual Environment that Performs Situated Incremental Understanding of Navigational Utterances
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModellingSpeech RecognitionSpeech SynthesisSimilar Papers 제목 키워드 기반
How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus
Intelligent agents that are confronted with novel concepts in situated environments will need to ask their human teammates questions to learn about the physical world. To better understand this problem, we need data abou…
Novel ConceptsQuestion GenerationQuestion-GenerationDecision-Theoretic Question Generation for Situated Reference Resolution: An Empirical Study and Computational Model
Dialogue agents that interact with humans in situated environments need to manage referential ambiguity across multiple modalities and ask for help as needed. However, it is not clear what kinds of questions such agents …
Question GenerationQuestion-Generationslot-fillingSlot FillingLearning to Generate Pointing Gestures in Situated Embodied Conversational Agents
One of the main goals of robotics and intelligent agent research is to enable natural communication with humans in physically situated settings. While recent work has focused on verbal modes such as language and speech, …
Reinforcement LearningGesture GenerationSituated Instruction Following
Language is never spoken in a vacuum. It is expressed, comprehended, and contextualized within the holistic backdrop of the speaker's history, actions, and environment. Since humans are used to communicating efficiently …
Instruction FollowingSIMMC: Situated Interactive Multi-Modal Conversational Data Collection And Evaluation Platform
As digital virtual assistants become ubiquitous, it becomes increasingly important to understand the situated behaviour of users as they interact with these assistants. To this end, we introduce SIMMC, an extension to Pa…
AI AgentUnity