paper-with-me

홈 › Papers

Fault Tolerant Control of a Quadcopter using Reinforcement Learning

2025-09-09 · Muzaffar Habib, Adnan Maqsood, Adnan Fayyaz ud Din arxiv

This study presents a novel reinforcement learning (RL)-based control framework aimed at enhancing the safety and robustness of the quadcopter, with a specific focus on resilience to in-flight one propeller failure. Addressing the critical need of a robust control strategy for maintaining a desired altitude for the quadcopter to safe the hardware and the payload in physical applications. The proposed framework investigates two RL methodologies Dynamic Programming (DP) and Deep Deterministic Policy Gradient (DDPG), to overcome the challenges posed by the rotor failure mechanism of the quadcopter. DP, a model-based approach, is leveraged for its convergence guarantees, despite high computational demands, whereas DDPG, a model-free technique, facilitates rapid computation but with constraints on solution duration. The research challenge arises from training RL algorithms on large dimensions and action domains. With modifications to the existing DP and DDPG algorithms, the controllers were trained not only to cater for large continuous state and action domain and also achieve a desired state after an inflight propeller failure. To verify the robustness of the proposed control framework, extensive simulations were conducted in a MATLAB environment across various initial conditions and underscoring its viability for mission-critical quadcopter applications. A comparative analysis was performed between both RL algorithms and their potential for applications in faulty aerial systems.

📄 PDF Abstract BibTeX arXiv:2509.07707

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Fault-Tolerant Control of Quadcopter UAVs Using Robust Adaptive Sliding Mode Approach

2018-12-28 · Energies 2018 12 · Ngoc Phi Nguyen and Sung Kyung Hong *

In this paper, a fault-tolerant control method is proposed for quadcopter unmanned aerial vehicles (UAV) to account for system uncertainties and actuator faults. A mathematical model of the quadcopter UAV is first intr…

SLAM-Based Navigation and Fault Resilience in a Surveillance Quadcopter with Embedded Vision Systems

2025-04-18 · Abhishek Tyagi, Charu Gaur

We present an autonomous aerial surveillance platform, Veg, designed as a fault-tolerant quadcopter system that integrates visual SLAM for GPS-independent navigation, advanced control architecture for dynamic stability, …

Face Recognitionobject-detectionObject DetectionRaspberry Pi 4

Mid-flight Propeller Failure Detection and Control of Propeller-deficient Quadcopter using Reinforcement Learning

2020-02-26 · Rohitkumar Arasanipalai, Aakriti Agrawal, Debasish Ghose

Quadcopters can suffer from loss of propellers in mid-flight, thus requiring a need to have a system that detects single and multiple propeller failures and an adaptive controller that stabilizes the propeller-deficient …

Fault Detectionreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Comparison of Model Predictive and Reinforcement Learning Methods for Fault Tolerant Control

2020-08-10 · Ibrahim Ahmed, Hamed Khorasgani, Gautam Biswas

A desirable property in fault-tolerant controllers is adaptability to system changes as they evolve during systems operations. An adaptive controller does not require optimal control policies to be enumerated for possibl…

Hierarchical Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Fault-Tolerant Control of Degrading Systems with On-Policy Reinforcement Learning

2020-08-10 · Ibrahim Ahmed, Marcos Quiñones-Grueiro, Gautam Biswas

We propose a novel adaptive reinforcement learning control approach for fault tolerant control of degrading systems that is not preceded by a fault detection and diagnosis step. Therefore, \textit{a priori} knowledge of …

Fault Detectionreinforcement-learningReinforcement Learning (RL)