Learning an Adaptive Forwarding Strategy for Mobile Wireless Networks: Resource Usage vs. Latency
Designing effective routing strategies for mobile wireless networks is challenging due to the need to seamlessly adapt routing behavior to spatially diverse and temporally changing network conditions. In this work, we use deep reinforcement learning (DeepRL) to learn a scalable and generalizable single-copy routing strategy for such networks. We make the following contributions: i) we design a reward function that enables the DeepRL agent to explicitly trade-off competing network goals, such as minimizing delay vs. the number of transmissions per packet; ii) we propose a novel set of relational neighborhood, path, and context features to characterize mobile wireless networks and model device mobility independently of a specific network topology; and iii) we use a flexible training approach that allows us to combine data from all packets and devices into a single offline centralized training set to train a single DeepRL agent. To evaluate generalizeability and scalability, we train our DeepRL agent on one mobile network scenario and then test it on other mobile scenarios, varying the number of devices and transmission ranges. Our results show our learned single-copy routing strategy outperforms all other strategies in terms of delay except for the optimal strategy, even on scenarios on which the DeepRL agent was not trained.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Continual Learning to Generalize Forwarding Strategies for Diverse Mobile Wireless Networks
Deep reinforcement learning (DRL) has been successfully used to design forwarding strategies for multi-hop mobile wireless networks. While such strategies can be used directly for networks with varied connectivity and dy…
Reinforcement LearningContinual LearningDynamics of Data Delivery in Mobile Ad-hoc Networks: A Bargaining Game Approach
Abstract— In this paper, we address the problem of dynamic packet forwarding with a set of wireless autonomous ad hoc network nodes, where each node acting in a selfish manner tries to use the resources of other no…
A Deep Joint Source-Channel Coding Scheme for Hybrid Mobile Multi-hop Networks
Efficient data transmission across mobile multi-hop networks that connect edge devices to core servers presents significant challenges, particularly due to the variability in link qualities between wireless and wired seg…
Cross-Link Interference Mitigation With Over-the-Air Pilot Forwarding for Dynamic TDD
Dynamic time-division duplex (D-TDD) aided mobile communication systems bear the potential to achieve significantly higher spectral efficiency than traditional static TDD based systems. However, strong cross-link interfe…
Combine Clustering With Game to Resist Selective Forwarding in Wireless Sensor Networks
ABSTRACT Deployed in a harsh or hostile environment and running in an unattended state, wireless sensor networks (WSNs) are vulnerable to many attacks. The selective forwarding attack is one most difficult to be detect…
Clustering