Interactive Double Deep Q-network: Integrating Human Interventions and Evaluative Predictions in Reinforcement Learning of Autonomous Driving

2025-04-28 · Alkis Sygkounas, Ioannis Athanasiadis, Andreas Persson, Michael Felsberg, Amy Loutfi

Integrating human expertise with machine learning is crucial for applications demanding high accuracy and safety, such as autonomous driving. This study introduces Interactive Double Deep Q-network (iDDQN), a Human-in-the-Loop (HITL) approach that enhances Reinforcement Learning (RL) by merging human insights directly into the RL training process, improving model performance. Our proposed iDDQN method modifies the Q-value update equation to integrate human and agent actions, establishing a collaborative approach for policy development. Additionally, we present an offline evaluative framework that simulates the agent's trajectory as if no human intervention had occurred, to assess the effectiveness of human interventions. Empirical results in simulated autonomous driving scenarios demonstrate that iDDQN outperforms established approaches, including Behavioral Cloning (BC), HG-DAgger, Deep Q-Learning from Demonstrations (DQfD), and vanilla DRL in leveraging human expertise for improving performance and adaptability.

📄 PDF Abstract BibTeX arXiv:2505.01440

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingQ-LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

GAN-Based Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback

2021-04-14 · Jie Huang, Rongshun Juan, Randy Gomez, Keisuke Nakamura 외

Deep reinforcement learning (DRL) has achieved great successes in many simulated tasks. The sample inefficiency problem makes applying traditional DRL methods to real-world robots a great challenge. Generative Adversaria…

Deep Reinforcement Learning Imitation Learning reinforcement-learning Reinforcement Learning+1

Human Engagement Providing Evaluative and Informative Advice for Interactive Reinforcement Learning

2020-09-21 · Adam Bignold, Francisco Cruz, Richard Dazeley, Peter Vamplew 외

Interactive reinforcement learning proposes the use of externally-sourced information in order to speed up the learning process. When interacting with a learner agent, humans may provide either evaluative or informative …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Accelerating the Learning of TAMER with Counterfactual Explanations

2021-08-03 · Jakob Karalus, Felix Lindner

The capability to interactively learn from human feedback would enable agents in new settings. For example, even novice users could train service robots in new tasks naturally and interactively. Human-in-the-loop Reinfor…

counterfactual reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

IDEA: Interactive DoublE Attentions from Label Embedding for Text Classification

2022-09-23 · Ziyuan Wang, Hailiang Huang, Songqiao Han

Current text classification methods typically encode the text merely into embedding before a naive or complicated classifier, which ignores the suggestive information contained in the label text. As a matter of fact, hum…

text-classification Text Classification

Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework

2020-01-23 · Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson, Hayley Hung

Interactive reinforcement learning provides a way for agents to learn to solve tasks from evaluative feedback provided by a human user. Previous research showed that humans give copious feedback early in training but ver…