Incremental Learning for Robot Perception through HRI
Scene understanding and object recognition is a difficult to achieve yet crucial skill for robots. Recently, Convolutional Neural Networks (CNN), have shown success in this task. However, there is still a gap between their performance on image datasets and real-world robotics scenarios. We present a novel paradigm for incrementally improving a robot's visual perception through active human interaction. In this paradigm, the user introduces novel objects to the robot by means of pointing and voice commands. Given this information, the robot visually explores the object and adds images from it to re-train the perception module. Our base perception module is based on recent development in object detection and recognition using deep learning. Our method leverages state of the art CNNs from off-line batch learning, human guidance, robot exploration and incremental on-line learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Incremental LearningObjectobject-detectionObject DetectionObject RecognitionScene UnderstandingSimilar Papers 제목 키워드 기반
Knowledge Acquisition and Completion for Long-Term Human-Robot Interactions using Knowledge Graph Embedding
In Human-Robot Interaction (HRI) systems, a challenging task is sharing the representation of the operational environment, fusing symbolic knowledge and perceptions, between users and robots. With the existing HRI pipeli…
Continual LearningGraph EmbeddingIncremental LearningKnowledge Graph EmbeddingGibbs Sampling Strategies for Semantic Perception of Streaming Video Data
Topic modeling of streaming sensor data can be used for high level perception of the environment by a mobile robot. In this paper we compare various Gibbs sampling strategies for topic modeling of streaming spatiotempora…
Occupancy Grids: A Stochastic Spatial Representation for Active Robot Perception
In this paper we provide an overview of a new framework for robot perception, real-world modelling, and navigation that uses a stochastic tesselated representation of spatial information called the Occupancy Grid. The Oc…
Decision MakingPositionIncremental Learning of Humanoid Robot Behavior from Natural Interaction and Large Language Models
Natural-language dialog is key for intuitive human-robot interaction. It can be used not only to express humans' intents, but also to communicate instructions for improvement if a robot does not understand a command corr…
Incremental LearningPrompt LearningTactile-Filter: Interactive Tactile Perception for Part Mating
Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. Our tactile sensing provides us with a lot of information regarding contact formations as well as geometric information about objects du…