paper-with-me

홈 › Papers

Implicit Sensing in Traffic Optimization: Advanced Deep Reinforcement Learning Techniques

2023-09-25 · Emanuel Figetakis, Yahuza Bello, Ahmed Refaey, Lei Lei, Medhat Moussa

A sudden roadblock on highways due to many reasons such as road maintenance, accidents, and car repair is a common situation we encounter almost daily. Autonomous Vehicles (AVs) equipped with sensors that can acquire vehicle dynamics such as speed, acceleration, and location can make intelligent decisions to change lanes before reaching a roadblock. A number of literature studies have examined car-following models and lane-changing models. However, only a few studies proposed an integrated car-following and lane-changing model, which has the potential to model practical driving maneuvers. Hence, in this paper, we present an integrated car-following and lane-changing decision-control system based on Deep Reinforcement Learning (DRL) to address this issue. Specifically, we consider a scenario where sudden construction work will be carried out along a highway. We model the scenario as a Markov Decision Process (MDP) and employ the well-known DQN algorithm to train the RL agent to make the appropriate decision accordingly (i.e., either stay in the same lane or change lanes). To overcome the delay and computational requirement of DRL algorithms, we adopt an MEC-assisted architecture where the RL agents are trained on MEC servers. We utilize the highly reputable SUMO simulator and OPENAI GYM to evaluate the performance of the proposed model under two policies; {\epsilon}-greedy policy and Boltzmann policy. The results unequivocally demonstrate that the DQN agent trained using the {\epsilon}-greedy policy significantly outperforms the one trained with the Boltzmann policy.

📄 PDF Abstract BibTeX arXiv:2309.14395

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesDeep Reinforcement LearningOpenAI Gymreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…
Repair 설명 없음

Similar Papers 제목 키워드 기반

Short vs. Long-term Coordination of Drones: When Distributed Optimization Meets Deep Reinforcement Learning

2023-11-16 · Chuhao Qin, Evangelos Pournaras

Swarms of autonomous interactive drones can provide compelling sensing capabilities in Smart City applications, such as traffic monitoring. This paper focuses on the task assignment problem for large-scale spatio-tempora…

Decision MakingDeep Reinforcement LearningDisaster ResponseDistributed Optimization+3

Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal control

2021-12-19 · Liang Zhang, Qiang Wu, Jun Shen, Linyuan Lü 외

Many studies confirmed that a proper traffic state representation is more important than complex algorithms for the classical traffic signal control (TSC) problem. In this paper, we (1) present a novel, flexible and effi…

Reinforcement Learning (RL)Traffic Signal Control

Overview of Sensing Attacks on Autonomous Vehicle Technologies and Impact on Traffic Flow

2024-01-26 · Zihao Li, Sixu Li, Hao Zhang, Yang Zhou 외

While perception systems in Connected and Autonomous Vehicles (CAVs), which encompass both communication technologies and advanced sensors, promise to significantly reduce human driving errors, they also expose CAVs to v…

Autonomous Vehicles

Analytical Optimized Traffic Flow Recovery for Large-scale Urban Transportation Network

2024-09-05 · Sicheng Fu, Haotian Shi, Shixiao Liang, Xin Wang 외

The implementation of intelligent transportation systems (ITS) has enhanced data collection in urban transportation through advanced traffic sensing devices. However, the high costs associated with installation and maint…

Traffic Co-Simulation Framework Empowered by Infrastructure Camera Sensing and Reinforcement Learning

2024-12-05 · Talha Azfar, Ruimin Ke

Traffic simulations are commonly used to optimize traffic flow, with reinforcement learning (RL) showing promising potential for automated traffic signal control. Multi-agent reinforcement learning (MARL) is particularly…

Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2