At your Command! An Empirical Study on How LaypersonsTeach Robots New Functions

2020-09-14 · Sebastian Weigelt, Vanessa Steurer, Walter F. Tichy

Even though intelligent systems such as Siri or Google Assistant are enjoyable (and useful) dialog partners, users can only access predefined functionality. Enabling end-users to extend the functionality of intelligent systems will be the next big thing. To promote research in this area we carried out an empirical study on how laypersons teach robots new functions by means of natural language instructions. The result is a labeled corpus consisting of 3168 submissions given by 870 subjects. The analysis of the dataset revealed that many participants used certain wordings to express their wish to teach new functionality; two corresponding trigrams are among the most frequent. On the contrary, more than one third (36.93%) did not verbalize the teaching intent at all. We labeled the semantic constituents in the utterances: declaration (including the name of the function) and intermediate steps. The full corpus is publicly available: http://dx.doi.org/10.21227/zecn-6c61

📄 PDF Abstract BibTeX arXiv:2009.06510

Code (0)

등록된 구현이 없습니다.

Leveraging Untrustworthy Commands for Multi-Robot Coordination in Unpredictable Environments: A Bandit Submodular Maximization Approach

2023-09-28 · Zirui Xu, Xiaofeng Lin, Vasileios Tzoumas

We study the problem of multi-agent coordination in unpredictable and partially-observable environments with untrustworthy external commands. The commands are actions suggested to the robots, and are untrustworthy in tha…

Morphology dictates a robot's ability to ground crowd-proposed language

2017-12-16 · Zahra Mahoor, Jack Felag, Josh Bongard

As more robots act in physical proximity to people, it is essential to ensure they make decisions and execute actions that align with human values. To do so, robots need to understand the true intentions behind human-iss…

The RobotSlang Benchmark: Dialog-guided Robot Localization and Navigation

2020-10-23 · Shurjo Banerjee, Jesse Thomason, Jason J. Corso

Autonomous robot systems for applications from search and rescue to assistive guidance should be able to engage in natural language dialog with people. To study such cooperative communication, we introduce Robot Simultan…

Navigate Simultaneous Localization and Mapping

Robot Sound Interpretation: Combining Sight and Sound in Learning-Based Control

2019-09-19 · Peixin Chang, Shuijing Liu, Haonan Chen, Katherine Driggs-Campbell

We explore the interpretation of sound for robot decision making, inspired by human speech comprehension. While previous methods separate sound processing unit and robot controller, we propose an end-to-end deep neural n…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Structured Learning for Context-aware Spoken Language Understanding of Robotic Commands

2017-08-01 · WS 2017 8 · Andrea Vanzo, Danilo Croce, Roberto Basili, Daniele Nardi

Service robots are expected to operate in specific environments, where the presence of humans plays a key role. A major feature of such robotics platforms is thus the ability to react to spoken commands. This requires th…

Spoken Language Understanding