Deep Reinforcement Learning Aided Packet-Routing For Aeronautical Ad-Hoc Networks Formed by Passenger Planes

2021-10-28 · Dong Liu, Jingjing Cui, Jiankang Zhang, Chenyang Yang, Lajos Hanzo

Data packet routing in aeronautical ad-hoc networks (AANETs) is challenging due to their high-dynamic topology. In this paper, we invoke deep reinforcement learning for routing in AANETs aiming at minimizing the end-to-end (E2E) delay. Specifically, a deep Q-network (DQN) is conceived for capturing the relationship between the optimal routing decision and the local geographic information observed by the forwarding node. The DQN is trained in an offline manner based on historical flight data and then stored by each airplane for assisting their routing decisions during flight. To boost the learning efficiency and the online adaptability of the proposed DQN-routing, we further exploit the knowledge concerning the system's dynamics by using a deep value network (DVN) conceived with a feedback mechanism. Our simulation results show that both DQN-routing and DVN-routing achieve lower E2E delay than the benchmark protocol, and DVN-routing performs similarly to the optimal routing that relies on perfect global information.

📄 PDF Abstract BibTeX arXiv:2110.15146

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Deep Learning Aided Packet Routing in Aeronautical Ad-Hoc Networks Relying on Real Flight Data: From Single-Objective to Near-Pareto Multi-Objective Optimization

2021-10-28 · Dong Liu, Jiankang Zhang, Jingjing Cui, Soon-Xin Ng 외

Data packet routing in aeronautical ad-hoc networks (AANETs) is challenging due to their high-dynamic topology. In this paper, we invoke deep learning (DL) to assist routing in AANETs. We set out from the single objectiv…

TRUAV: Distributed Multi-Agent Reinforcement Learning for Trajectory Planning and Routing Enhancement in UAV-Aided IoT-Enabled VANETs

2026-07-26 · Muhammad Umar Farooq Qaisar, Lin Zhang, Zhen Chen, Wajdy Othman 외 arxiv

Unmanned aerial vehicles (UAVs) have emerged as a key enabler of next-generation Internet of Things (IoT) ecosystems, offering flexible aerial relaying to extend connectivity across dynamic vehicular ad hoc networks (VAN…

Multi-agent Reinforcement Learning Trajectory Planning

Toward Packet Routing with Fully-distributed Multi-agent Deep Reinforcement Learning

2019-05-09 · Xinyu You, Xuanjie Li, Yuedong Xu, Hui Feng 외

Packet routing is one of the fundamental problems in computer networks in which a router determines the next-hop of each packet in the queue to get it as quickly as possible to its destination. Reinforcement learning (RL…

Decision Making Deep Reinforcement Learning Q-Learning reinforcement-learning+2

Reinforcement Learning Framework for Opportunistic Routing in WSNs

2013-10-31 · G. Srinivas Rao, A. V. Ramana

Routing packets opportunistically is an essential part of multihop ad hoc wireless sensor networks. The existing routing techniques are not adaptive opportunistic. In this paper we have proposed an adaptive opportunistic…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Relational Deep Reinforcement Learning for Routing in Wireless Networks

2020-12-31 · Victoria Manfredi, Alicia Wolfe, Bing Wang, Xiaolan Zhang

While routing in wireless networks has been studied extensively, existing protocols are typically designed for a specific set of network conditions and so cannot accommodate any drastic changes in those conditions. For i…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)