Autonomous Curiosity for Real-Time Training Onboard Robotic Agents
Learning requires both study and curiosity. A good learner is not only good at extracting information from the data given to it, but also skilled at finding the right new information to learn from. This is especially true when a human operator is required to provide the ground truth - such a source should only be queried sparingly. In this work, we address the problem of curiosity as it relates to online, real-time, human-in-the-loop training of an object detection algorithm onboard a robotic platform, one where motion produces new views of the subject. We propose a deep reinforcement learning approach that decides when to ask the human user for ground truth, and when to move. Through a series of experiments, we demonstrate that our agent learns a movement and request policy that is at least 3x more effective at using human user interactions to train an object detector than untrained approaches, and is generalizable to a variety of subjects and environments.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement Learningobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Learning to Learn in Simulation
Deep learning often requires the manual collection and annotation of a training set. On robotic platforms, can we partially automate this task by training the robot to be curious, i.e., to seek out beneficial training in…
Deep Reinforcement Learningobject-detectionObject DetectionReinforcement LearningCapsule Network Performance with Autonomous Navigation
Capsule Networks (CapsNets) have been proposed as an alternative to Convolutional Neural Networks (CNNs). This paper showcases how CapsNets are more capable than CNNs for autonomous agent exploration of realistic scenari…
Autonomous NavigationReinforcement LearningModeling Curiosity in a Mobile Robot for Long-Term Autonomous Exploration and Monitoring
This paper presents a novel approach to modeling curiosity in a mobile robot, which is useful for monitoring and adaptive data collection tasks, especially in the context of long term autonomous missions where pre-progra…
Parameter Estimation using Reinforcement Learning Causal Curiosity: Limits and Challenges
Causal understanding is important in many disciplines of science and engineering, where we seek to understand how different factors in the system causally affect an experiment or situation and pave a pathway towards crea…
Disentanglementparameter estimationClassical and Quantum Physical Reservoir Computing for Onboard Artificial Intelligence Systems: A Perspective
Artificial intelligence (AI) systems of autonomous systems such as drones, robots and self-driving cars may consume up to 50% of total power available onboard, thereby limiting the vehicle's range of functions and consid…
Autonomous VehiclesSelf-Driving Cars