paper-with-me

Papers

Offline Reinforcement Learning using Human-Aligned Reward Labeling for Autonomous Emergency Braking in Occluded Pedestrian Crossing

2025-04-11 · Vinal Asodia, ZhenHua Feng, Saber Fallah

Effective leveraging of real-world driving datasets is crucial for enhancing the training of autonomous driving systems. While Offline Reinforcement Learning enables the training of autonomous vehicles using such data, most available datasets lack meaningful reward labels. Reward labeling is essential as it provides feedback for the learning algorithm to distinguish between desirable and undesirable behaviors, thereby improving policy performance. This paper presents a novel pipeline for generating human-aligned reward labels. The proposed approach addresses the challenge of absent reward signals in real-world datasets by generating labels that reflect human judgment and safety considerations. The pipeline incorporates an adaptive safety component, activated by analyzing semantic segmentation maps, allowing the autonomous vehicle to prioritize safety over efficiency in potential collision scenarios. The proposed pipeline is applied to an occluded pedestrian crossing scenario with varying levels of pedestrian traffic, using synthetic and simulation data. The results indicate that the generated reward labels closely match the simulation reward labels. When used to train the driving policy using Behavior Proximal Policy Optimisation, the results are competitive with other baselines. This demonstrates the effectiveness of our method in producing reliable and human-aligned reward signals, facilitating the training of autonomous driving systems through Reinforcement Learning outside of simulation environments and in alignment with human values.

📄 PDF Abstract BibTeX arXiv:2504.08704

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingAutonomous VehiclesSemantic Segmentation

Similar Papers 제목 키워드 기반

Binary Reward Labeling: Bridging Offline Preference and Reward-Based Reinforcement Learning

2024-06-14 · Yinglun Xu, David Zhu, Rohan Gumaste, Gagandeep Singh

Offline reinforcement learning has become one of the most practical RL settings. However, most existing works on offline RL focus on the standard setting with scalar reward feedback. It remains unknown how to universally…

D4RLOffline RL

LEASE: Offline Preference-based Reinforcement Learning with High Sample Efficiency

2024-12-30 · Xiao-Yin Liu, Guotao Li, Xiao-Hu Zhou, Zeng-Guang Hou

Offline preference-based reinforcement learning (PbRL) provides an effective way to overcome the challenges of designing reward and the high costs of online interaction. However, since labeling preference needs real-time…

reinforcement-learningReinforcement Learning

Online Policy Learning from Offline Preferences

2024-03-15 · Guoxi Zhang, Han Bao, Hisashi Kashima

In preference-based reinforcement learning (PbRL), a reward function is learned from a type of human feedback called preference. To expedite preference collection, recent works have leveraged \emph{offline preferences}, …

continuous-controlContinuous Control

Real-World Offline Reinforcement Learning from Vision Language Model Feedback

2024-11-08 · Sreyas Venkataraman, YuFei Wang, Ziyu Wang, Zackory Erickson 외

Offline reinforcement learning can enable policy learning from pre-collected, sub-optimal datasets without online interactions. This makes it ideal for real-world robots and safety-critical scenarios, where collecting on…

Language ModelingLanguage ModellingOffline RLQ-Learning+2

Video-Based Optimal Transport for Feedback-Efficient Offline Preference-Based Reinforcement Learning

2026-06-15 · Tung M. Luu, Hwanhee Kim, Younghwan Lee, Chang D. Yoo arxiv

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL (PbRL) offers a promising alternative by learning reward functions from human feedback,…

Reinforcement Learning