paper-with-me

홈 › Papers

Interactive Learning of Grounded Verb Semantics towards Human-Robot Communication

2017-07-01 · ACL 2017 7 · Lanbo She, Joyce Chai

To enable human-robot communication and collaboration, previous works represent grounded verb semantics as the potential change of state to the physical world caused by these verbs. Grounded verb semantics are acquired mainly based on the parallel data of the use of a verb phrase and its corresponding sequences of primitive actions demonstrated by humans. The rich interaction between teachers and students that is considered important in learning new skills has not yet been explored. To address this limitation, this paper presents a new interactive learning approach that allows robots to proactively engage in interaction with human partners by asking good questions to learn models for grounded verb semantics. The proposed approach uses reinforcement learning to allow the robot to acquire an optimal policy for its question-asking behaviors by maximizing the long-term reward. Our empirical results have shown that the interactive learning approach leads to more reliable models for grounded verb semantics, especially in the noisy environment which is full of uncertainties. Compared to previous work, the models acquired from interactive learning result in a 48{\%} to 145{\%} performance gain when applied in new situations.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

A Review of Verbal and Non-Verbal Human-Robot Interactive Communication

2014-01-20 · Nikolaos Mavridis

In this paper, an overview of human-robot interactive communication is presented, covering verbal as well as non-verbal aspects of human-robot interaction. Following a historical introduction, and motivation towards flui…

Enabling Robots to Draw and Tell: Towards Visually Grounded Multimodal Description Generation

2021-01-14 · Ting Han, Sina Zarrieß

Socially competent robots should be equipped with the ability to perceive the world that surrounds them and communicate about it in a human-like manner. Representative skills that exhibit such ability include generating …

Language Acquisition is Embodied, Interactive, Emotive: a Research Proposal

2021-05-10 · Casey Kennington

Humans' experience of the world is profoundly multimodal from the beginning, so why do existing state-of-the-art language models only use text as a modality to learn and represent semantic meaning? In this paper we revie…

Language Acquisition

Hierarchical Policies from Verbal and Egocentric Human Signals for Natural Human-Robot Interaction

2026-06-09 · Dongjun Lee, Juheon Choi, Dong Kyu Shin, Sinjae Kang 외 arxiv

For natural human-robot interaction, a robot must understand human intent expressed not only through language but also through nonverbal signals such as gestures and gaze. However, current robot policies rely on language…

Multimodal Resources for Human-Robot Communication Modelling

2016-05-01 · LREC 2016 5 · Stavroula{--}Evita Fotinea, Eleni Efthimiou, Maria Koutsombogera, Athanasia-Lida Dimou 외

This paper reports on work related to the modelling of Human-Robot Communication on the basis of multimodal and multisensory human behaviour analysis. A primary focus in this framework of analysis is the definition of se…