Distributed Wildfire Surveillance with Autonomous Aircraft using Deep Reinforcement Learning

2018-10-09 · Kyle D. Julian, Mykel J. Kochenderfer

Teams of autonomous unmanned aircraft can be used to monitor wildfires, enabling firefighters to make informed decisions. However, controlling multiple autonomous fixed-wing aircraft to maximize forest fire coverage is a complex problem. The state space is high dimensional, the fire propagates stochastically, the sensor information is imperfect, and the aircraft must coordinate with each other to accomplish their mission. This work presents two deep reinforcement learning approaches for training decentralized controllers that accommodate the high dimensionality and uncertainty inherent in the problem. The first approach controls the aircraft using immediate observations of the individual aircraft. The second approach allows aircraft to collaborate on a map of the wildfire's state and maintain a time history of locations visited, which are used as inputs to the controller. Simulation results show that both approaches allow the aircraft to accurately track wildfire expansions and outperform an online receding horizon controller. Additional simulations demonstrate that the approach scales with different numbers of aircraft and generalizes to different wildfire shapes.

📄 PDF Abstract BibTeX arXiv:1810.04244

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Image-based Guidance of Autonomous Aircraft for Wildfire Surveillance and Prediction

2018-10-04 · Kyle D. Julian, Mykel J. Kochenderfer

Small unmanned aircraft can help firefighters combat wildfires by providing real-time surveillance of the growing fires. However, guiding the aircraft autonomously given only wildfire images is a challenging problem. Thi…

Deep Reinforcement Learning Navigate Reinforcement Learning

Hierarchical Framework for Optimizing Wildfire Surveillance and Suppression using Human-Autonomous Teaming

2024-06-25 · Mahdi Al-Husseini, Kyle Wray, Mykel Kochenderfer

The integration of manned and unmanned aircraft can help improve wildfire response. Wildfire containment failures occur when resources available to first responders, who execute the initial stages of wildfire management …

Collision Avoidance

Improving Autonomous Separation Assurance through Distributed Reinforcement Learning with Attention Networks

2023-08-09 · Marc W. Brittain, Luis E. Alvarez, Kara Breeden

Advanced Air Mobility (AAM) introduces a new, efficient mode of transportation with the use of vehicle autonomy and electrified aircraft to provide increasingly autonomous transportation between previously underserved ma…

Distributed Computing reinforcement-learning

On the Role of Field of View for Occlusion Removal with Airborne Optical Sectioning

2022-04-28 · Francis Seits, Indrajit Kurmi, Rakesh John Amala Arokia Nathan, Rudolf Ortner 외

Occlusion caused by vegetation is an essential problem for remote sensing applications in areas, such as search and rescue, wildfire detection, wildlife observation, surveillance, border control, and others. Airborne Opt…

Multi-Agent Reinforcement Learning for Autonomous UAV Exploration in Wildfire Response

2026-09-09 · Caden Chandra, Jerry Ng arxiv

This study develops a deep reinforcement learning framework for training Unmanned Aerial Vehicle (UAV) agents to navigate and monitor simulated wildfire environments. Results show that agents learn increasingly stable an…

Multi-agent Reinforcement Learning