An End-to-end Deep Reinforcement Learning Approach for the Long-term Short-term Planning on the Frenet Space
Tactical decision making and strategic motion planning for autonomous highway driving are challenging due to the complication of predicting other road users' behaviors, diversity of environments, and complexity of the traffic interactions. This paper presents a novel end-to-end continuous deep reinforcement learning approach towards autonomous cars' decision-making and motion planning. For the first time, we define both states and action spaces on the Frenet space to make the driving behavior less variant to the road curvatures than the surrounding actors' dynamics and traffic interactions. The agent receives time-series data of past trajectories of the surrounding vehicles and applies convolutional neural networks along the time channels to extract features in the backbone. The algorithm generates continuous spatiotemporal trajectories on the Frenet frame for the feedback controller to track. Extensive high-fidelity highway simulations on CARLA show the superiority of the presented approach compared with commonly used baselines and discrete reinforcement learning on various traffic scenarios. Furthermore, the proposed method's advantage is confirmed with a more comprehensive performance evaluation against 1000 randomly generated test scenarios.
Code (1)
Tasks
Decision MakingDeep Reinforcement LearningDiversityMotion Planningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Time SeriesTime Series AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Long-term planning, short-term adjustments
Deep Reinforcement Learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their app…
Deep Reinforcement LearningPredictionQ-LearningReinforcement Learning (RL)Long Short-Term Memory for Spatial Encoding in Multi-Agent Path Planning
Reinforcement learning-based path planning for multi-agent systems of varying size constitutes a research topic with increasing significance as progress in domains such as urban air mobility and autonomous aerial vehicle…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)LLM-Enhanced Reinforcement Learning for Long-Term User Satisfaction in Interactive Recommendation
Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to impr…
Reinforcement LearningTwo-Timescale Hierarchical Reinforcement Learning for Resilient Operations
Unexpected shocks recur in global operations, requiring decision rules that adapt as market and operating conditions change. Many operational systems also have hierarchical structures in which long-term and short-term de…
Hierarchical Reinforcement LearningUAV Path Planning Employing MPC- Reinforcement Learning Method Considering Collision Avoidance
In this paper, we tackle the problem of Unmanned Aerial (UA V) path planning in complex and uncertain environments by designing a Model Predictive Control (MPC), based on a Long-Short-Term Memory (LSTM) network integrate…
Collision AvoidanceDeep Reinforcement LearningModel Predictive Controlreinforcement-learning+2