paper-with-me

Papers

AirPilot: Interpretable PPO-based DRL Auto-Tuned Nonlinear PID Drone Controller for Robust Autonomous Flights

2024-03-30 · Junyang Zhang, Cristian Emanuel Ocampo Rivera, Kyle Tyni, Steven Nguyen

Navigation precision, speed and stability are crucial for safe Unmanned Aerial Vehicle (UAV) flight maneuvers and effective flight mission executions in dynamic environments. Different flight missions may have varying objectives, such as minimizing energy consumption, achieving precise positioning, or maximizing speed. A controller that can adapt to different objectives on the fly is highly valuable. Proportional Integral Derivative (PID) controllers are one of the most popular and widely used control algorithms for drones and other control systems, but their linear control algorithm fails to capture the nonlinear nature of the dynamic wind conditions and complex drone system. Manually tuning the PID gains for various missions can be time-consuming and requires significant expertise. This paper aims to revolutionize drone flight control by presenting the AirPilot, a nonlinear Deep Reinforcement Learning (DRL) - enhanced Proportional Integral Derivative (PID) drone controller using Proximal Policy Optimization (PPO). AirPilot controller combines the simplicity and effectiveness of traditional PID control with the adaptability, learning capability, and optimization potential of DRL. This makes it better suited for modern drone applications where the environment is dynamic, and mission-specific performance demands are high. We employed a COEX Clover autonomous drone for training the DRL agent within the simulator and implemented it in a real-world lab setting, which marks a significant milestone as one of the first attempts to apply a DRL-based flight controller on an actual drone. Airpilot is capable of reducing the navigation error of the default PX4 PID position controller by 90%, improving effective navigation speed of a fine-tuned PID controller by 21%, reducing settling time and overshoot by 17% and 16% respectively.

📄 PDF Abstract BibTeX arXiv:2404.00204

Code (1)

garyz712/drlpiddronecontrol 공식 구현

Tasks

Deep Reinforcement LearningDrone ControllerNavigatereinforcement-learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

FairPilot: An Explorative System for Hyperparameter Tuning through the Lens of Fairness

2023-04-10 · Francesco Di Carlo, Nazanin Nezami, Hadis Anahideh, Abolfazl Asudeh

Despite the potential benefits of machine learning (ML) in high-risk decision-making domains, the deployment of ML is not accessible to practitioners, and there is a risk of discrimination. To establish trust and accepta…

Decision MakingFairness

Situation-Aware Deep Reinforcement Learning for Autonomous Nonlinear Mobility Control in Cyber-Physical Loitering Munition Systems

2022-12-31 · Hyunsoo Lee, Soohyun Park, Won Joon Yun, Soyi Jung 외

According to the rapid development of drone technologies, drones are widely used in many applications including military domains. In this paper, a novel situation-aware DRL- based autonomous nonlinear drone mobility cont…

Deep Reinforcement LearningUnity

Improving Drone Racing Performance Through Iterative Learning MPC

2025-08-01 · Haocheng Zhao, Niklas Schlüter, Lukas Brunke, Angela P. Schoellig arxiv

Autonomous drone racing presents a challenging control problem, requiring real-time decision-making and robust handling of nonlinear system dynamics. While iterative learning model predictive control (LMPC) offers a prom…

Rich State Observations Empower Reinforcement Learning to Surpass PID: A Drone Ball Balancing Study

2025-09-25 · Mingjiang Liu, Hailong Huang arxiv

This paper addresses a drone ball-balancing task, in which a drone stabilizes a ball atop a movable beam through cable-based interaction. We propose a hierarchical control framework that decouples high-level balancing po…

Reinforcement Learning

AlphaPilot: Autonomous Drone Racing

2020-05-26 · Philipp Foehn, Dario Brescianini, Elia Kaufmann, Titus Cieslewski 외

This paper presents a novel system for autonomous, vision-based drone racing combining learned data abstraction, nonlinear filtering, and time-optimal trajectory planning. The system has successfully been deployed at the…

NavigateTrajectory Planning