KoGuN: Accelerating Deep Reinforcement Learning via Integrating Human Suboptimal Knowledge

2020-02-18 · Peng Zhang, Jianye Hao, Weixun Wang, Hongyao Tang, Yi Ma, Yihai Duan, Yan Zheng

Reinforcement learning agents usually learn from scratch, which requires a large number of interactions with the environment. This is quite different from the learning process of human. When faced with a new task, human naturally have the common sense and use the prior knowledge to derive an initial policy and guide the learning process afterwards. Although the prior knowledge may be not fully applicable to the new task, the learning process is significantly sped up since the initial policy ensures a quick-start of learning and intermediate guidance allows to avoid unnecessary exploration. Taking this inspiration, we propose knowledge guided policy network (KoGuN), a novel framework that combines human prior suboptimal knowledge with reinforcement learning. Our framework consists of a fuzzy rule controller to represent human knowledge and a refine module to fine-tune suboptimal prior knowledge. The proposed framework is end-to-end and can be combined with existing policy-based reinforcement learning algorithm. We conduct experiments on both discrete and continuous control tasks. The empirical results show that our approach, which combines human suboptimal knowledge and RL, achieves significant improvement on learning efficiency of flat RL algorithms, even with very low-performance human prior knowledge.

📄 PDF Abstract BibTeX arXiv:2002.07418

Code (0)

등록된 구현이 없습니다.

Tasks

Common Sense Reasoning continuous-control Continuous ControlDeep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

N3P: Accelerated Automated Parking via a Learning-Based Naturalistic Three-Stage Scheme

2026-05-21 · Yifan Xue, Toktam Mohammadnejad, Faizan M Tariq, Sangjae Bae 외 arxiv

Autonomous parking requires efficient path planning that ensures kinematic feasibility and collision avoidance in constrained environments. Hybrid A* is widely used but computationally expensive, while reinforcement lear…

Reinforcement Learning Collision Avoidance

Accelerating Reinforcement Learning for Reaching using Continuous Curriculum Learning

2020-02-07 · Sha Luo, Hamidreza Kasaei, Lambert Schomaker

Reinforcement learning has shown great promise in the training of robot behavior due to the sequential decision making characteristics. However, the required enormous amount of interactive and informative training data p…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Accelerating Reinforcement Learning Agent with EEG-based Implicit Human Feedback

2020-06-30 · Duo Xu, Mohit Agarwal, Ekansh Gupta, Faramarz Fekri 외

Providing Reinforcement Learning (RL) agents with human feedback can dramatically improve various aspects of learning. However, previous methods require human observer to give inputs explicitly (e.g., press buttons, voic…

Autonomous Driving EEG Electroencephalogram (EEG)reinforcement-learning+3

Preference-Calibrated Human-in-the-Loop Reinforcement Learning for Robotic Manipulation

2026-06-02 · Zeyi Liu, Guangyao Liu, Yinuo Qu, Yuquan Xue 외 arxiv

Human-in-the-loop reinforcement learning (HIL-RL) improves sample efficiency in real-robot manipulation through online human intervention. However, successful trajectories may include suboptimal actions that deviate from…

Reinforcement Learning Robot Manipulation

Towards Reinforcement Learning from Neural Feedback: Mapping fNIRS Signals to Agent Performance

2025-11-17 · Julia Santaniello, Matthew Russell, Benson Jiang, Donatello Sassaroli 외 arxiv

Reinforcement Learning from Human Feedback (RLHF) is a methodology that aligns agent behavior with human preferences by integrating user feedback into the agent's training process. This paper introduces a framework that …

Multi-class Classification Reinforcement Learning