Improving Behavioural Cloning with Positive Unlabeled Learning
Learning control policies offline from pre-recorded datasets is a promising avenue for solving challenging real-world problems. However, available datasets are typically of mixed quality, with a limited number of the trajectories that we would consider as positive examples; i.e., high-quality demonstrations. Therefore, we propose a novel iterative learning algorithm for identifying expert trajectories in unlabeled mixed-quality robotics datasets given a minimal set of positive examples, surpassing existing algorithms in terms of accuracy. We show that applying behavioral cloning to the resulting filtered dataset outperforms several competitive offline reinforcement learning and imitation learning baselines. We perform experiments on a range of simulated locomotion tasks and on two challenging manipulation tasks on a real robotic system; in these experiments, our method showcases state-of-the-art performance. Our website: \url{https://sites.google.com/view/offline-policy-learning-pubc}.
Code (0)
등록된 구현이 없습니다.
Tasks
Behavioural cloningD4RLImitation Learningreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Improving Behavioural Cloning with Human-Driven Dynamic Dataset Augmentation
Behavioural cloning has been extensively used to train agents and is recognized as a fast and solid approach to teach general behaviours based on expert trajectories. Such method follows the supervised learning paradigm …
Behavioural cloningBehavioural Cloning in VizDoom
This paper describes methods for training autonomous agents to play the game "Doom 2" through Imitation Learning (IL) using only pixel data as input. We also explore how Reinforcement Learning (RL) compares to IL for hum…
Behavioural cloningImitation LearningReinforcement Learning (RL)Benchmarking End-to-End Behavioural Cloning on Video Games
Behavioural cloning, where a computer is taught to perform a task based on demonstrations, has been successfully applied to various video games and robotics tasks, with and without reinforcement learning. This also inclu…
Behavioural cloningBenchmarkingReinforcement LearningPlaying Minecraft with Behavioural Cloning
MineRL 2019 competition challenged participants to train sample-efficient agents to play Minecraft, by using a dataset of human gameplay and a limit number of steps the environment. We approached this task with behaviour…
Behavioural cloningMinecraftCounter-Strike Deathmatch with Large-Scale Behavioural Cloning
This paper describes an AI agent that plays the popular first-person-shooter (FPS) video game `Counter-Strike; Global Offensive' (CSGO) from pixel input. The agent, a deep neural network, matches the performance of the m…
AI AgentBehavioural cloningFPS GamesImitation Learning