Leveraging Human Guidance for Deep Reinforcement Learning Tasks
Reinforcement learning agents can learn to solve sequential decision tasks by interacting with the environment. Human knowledge of how to solve these tasks can be incorporated using imitation learning, where the agent learns to imitate human demonstrated decisions. However, human guidance is not limited to the demonstrations. Other types of guidance could be more suitable for certain tasks and require less human effort. This survey provides a high-level overview of five recent learning frameworks that primarily rely on human guidance other than conventional, step-by-step action demonstrations. We review the motivation, assumption, and implementation of each framework. We then discuss possible future research directions.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningImitation Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Explanation Augmented Feedback in Human-in-the-Loop Reinforcement Learning
Human-in-the-loop Reinforcement Learning (HRL) aims to integrate human guidance with Reinforcement Learning (RL) algorithms to improve sample efficiency and performance. A common type of human guidance in HRL is binary e…
Atari Gamesreinforcement-learningReinforcement LearningReinforcement Learning (RL)Prioritized Experience-based Reinforcement Learning with Human Guidance for Autonomous Driving
Reinforcement learning (RL) requires skillful definition and remarkable computational efforts to solve optimization and control problems, which could impair its prospect. Introducing human guidance into reinforcement lea…
Autonomous Drivingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Widening the Pipeline in Human-Guided Reinforcement Learning with Explanation and Context-Aware Data Augmentation
Human explanation (e.g., in terms of feature importance) has been recently used to extend the communication channel between human and agent in interactive machine learning. Under this setting, human trainers provide not …
Atari GamesData AugmentationDeep Reinforcement LearningFeature Importance+3HARP: Human-Assisted Regrouping with Permutation Invariant Critic for Multi-Agent Reinforcement Learning
Human-in-the-loop reinforcement learning integrates human expertise to accelerate agent learning and provide critical guidance and feedback in complex fields. However, many existing approaches focus on single-agent tasks…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningDual-Granularity Contrastive Reward via Generated Episodic Guidance for Efficient Embodied RL
Designing suitable rewards poses a significant challenge in reinforcement learning (RL), especially for embodied manipulation. Trajectory success rewards are suitable for human judges or model fitting, but the sparsity s…
Reinforcement LearningDomain AdaptationVideo Generation