Learning Decentralized Flocking Controllers with Spatio-Temporal Graph Neural Network
Recently a line of researches has delved the use of graph neural networks (GNNs) for decentralized control in swarm robotics. However, it has been observed that relying solely on the states of immediate neighbors is insufficient to imitate a centralized control policy. To address this limitation, prior studies proposed incorporating $L$-hop delayed states into the computation. While this approach shows promise, it can lead to a lack of consensus among distant flock members and the formation of small clusters, consequently resulting in the failure of cohesive flocking behaviors. Instead, our approach leverages spatiotemporal GNN, named STGNN that encompasses both spatial and temporal expansions. The spatial expansion collects delayed states from distant neighbors, while the temporal expansion incorporates previous states from immediate neighbors. The broader and more comprehensive information gathered from both expansions results in more effective and accurate predictions. We develop an expert algorithm for controlling a swarm of robots and employ imitation learning to train our decentralized STGNN model based on the expert algorithm. We simulate the proposed STGNN approach in various settings, demonstrating its decentralized capacity to emulate the global expert algorithm. Further, we implemented our approach to achieve cohesive flocking, leader following and obstacle avoidance by a group of Crazyflie drones. The performance of STGNN underscores its potential as an effective and reliable approach for achieving cohesive flocking, leader following and obstacle avoidance tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph Neural NetworkImitation LearningSimilar Papers 제목 키워드 기반
Learning Decentralized Swarms Using Rotation Equivariant Graph Neural Networks
The orchestration of agents to optimize a collective objective without centralized control is challenging yet crucial for applications such as controlling autonomous fleets, and surveillance and reconnaissance using sens…
Graph Neural NetworkMathGraph Neural Networks for Decentralized Controllers
Dynamical systems comprised of autonomous agents arise in many relevant problems such as multi-agent robotics, smart grids, or smart cities. Controlling these systems is of paramount importance to guarantee a successful …
Synthesizing Decentralized Controllers with Graph Neural Networks and Imitation Learning
Dynamical systems consisting of a set of autonomous agents face the challenge of having to accomplish a global task, relying only on local information. While centralized controllers are readily available, they face limit…
Imitation LearningVGAI: End-to-End Learning of Vision-Based Decentralized Controllers for Robot Swarms
Decentralized coordination of a robot swarm requires addressing the tension between local perceptions and actions, and the accomplishment of a global objective. In this work, we propose to learn decentralized controllers…
Graph Neural NetworkLearning Rigidity-based Flocking Control with Gaussian Processes
Flocking control of multi-agents system is challenging for agents with partially unknown dynamics. This paper proposes an online learning-based controller to stabilize flocking motion of double-integrator agents with add…
Gaussian Processes