A Learning Framework For Cooperative Collision Avoidance of UAV Swarms Leveraging Domain Knowledge
This paper presents a multi-agent reinforcement learning (MARL) framework for cooperative collision avoidance of UAV swarms leveraging domain knowledge-driven reward. The reward is derived from knowledge in the domain of image processing, approximating contours on a two-dimensional field. By modeling obstacles as maxima on the field, collisions are inherently avoided as contours never go through peaks or intersect. Additionally, counters are smooth and energy-efficient. Our framework enables training with large swarm sizes as the agent interaction is minimized and the need for complex credit assignment schemes or observation sharing mechanisms in state-of-the-art MARL approaches are eliminated. Moreover, UAVs obtain the ability to adapt to complex environments where contours may be non-viable or non-existent through intensive training. Extensive experiments are conducted to evaluate the performances of our framework against state-of-the-art MARL algorithms.
Code (0)
등록된 구현이 없습니다.
Tasks
Collision AvoidanceMulti-agent Reinforcement LearningSimilar Papers 제목 키워드 기반
Contingency Model-based Control (CMC) for Communicationless Cooperative Collision Avoidance in Robot Swarms
Cooperative collision avoidance between robots, or `agents,' in swarm operations remains an open challenge. Assuming a decentralized architecture, each agent is responsible for making its own decisions and choosing its c…
Collision AvoidanceStigmergy-based collision-avoidance algorithm for self-organising swarms
Real-time multi-agent collision-avoidance algorithms comprise a key enabling technology for the practical use of self-organising swarms of drones. This paper proposes a decentralised reciprocal collision-avoidance algori…
Collision AvoidanceDiversityScalable Task-Driven Robotic Swarm Control via Collision Avoidance and Learning Mean-Field Control
In recent years, reinforcement learning and its multi-agent analogue have achieved great success in solving various complex control problems. However, multi-agent reinforcement learning remains challenging both in its th…
Collision AvoidanceMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning+1Collision-Free Multi-Agent Coverage Control for Non-Cooperating Swarms: Preliminary Results
The main contribution of this paper is a methodology for multiple non-cooperating swarms of unmanned aerial vehicles to independently cover a common area. In contrast to previous research on coverage control involving mo…
Collision AvoidanceAn LGMD Based Competitive Collision Avoidance Strategy for UAV
Building a reliable and efficient collision avoidance system for unmanned aerial vehicles (UAVs) is still a challenging problem. This research takes inspiration from locusts, which can fly in dense swarms for hundreds of…
Collision Avoidance