Learning Ad Hoc Network Dynamics via Graph-Structured World Models
Ad hoc wireless networks exhibit complex, innate and coupled dynamics: node mobility, energy depletion and topology change that are difficult to model analytically. Model-free deep reinforcement learning requires sustained online interaction whereas existing model based approaches use flat state representations that lose per node structure. Therefore we propose G-RSSM, a graph structured recurrent state space model that maintains per node latent states with cross node multi head attention to learn the dynamics jointly from offline trajectories. We apply the proposed method to the downstream task clustering where a cluster head selection policy trains entirely through imagined rollouts in the learned world model. Across 27 evaluation scenarios spanning MANET, VANET, FANET, WSN and tactical networks with N=30 to 1000 nodes, the learned policy maintains high connectivity with only trained for N=50. Herein, we propose the first multi physics graph structured world model applied to combinatorial per node decision making in size agnostic wireless ad hoc networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningDecision MakingSimilar Papers 제목 키워드 기반
Model-based Meta Reinforcement Learning using Graph Structured Surrogate Models
Reinforcement learning is a promising paradigm for solving sequential decision-making problems, but low data efficiency and weak generalization across tasks are bottlenecks in real-world applications. Model-based meta re…
Decision MakingMeta Reinforcement Learningreinforcement-learningReinforcement Learning+3A Spacetime Perspective on Dynamical Computation in Neural Information Processing Systems
There is now substantial evidence for traveling waves and other structured spatiotemporal recurrent neural dynamics in cortical structures; but these observations have typically been difficult to reconcile with notions o…
Learning Symbolic Models for Graph-structured Physical Mechanism
Graph-structured physical mechanisms are ubiquitous in real-world scenarios, thus revealing underneath formulas is of great importance for scientific discovery. However, classical symbolic regression methods fail on this…
regressionscientific discoverySymbolic RegressionPhysics-Aware Difference Graph Networks for Sparsely-Observed Dynamics
Sparsely available data points cause numerical error on finite differences which hinders us from modeling the dynamics of physical systems. The discretization error becomes even larger when the sparse data are irregularl…
Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics
Sparsely available data points cause a numerical error on finite differences which hinder to modeling the dynamics of physical systems. The discretization error becomes even larger when the sparse data are irregularly di…