paper-with-me

홈 › Papers

Leveling the Playing Field: Carefully Comparing Classical and Learned Controllers for Quadrotor Trajectory Tracking

2025-06-21 · Pratik Kunapuli, Jake Welde, Dinesh Jayaraman, Vijay Kumar

Learning-based control approaches like reinforcement learning (RL) have recently produced a slew of impressive results for tasks like quadrotor trajectory tracking and drone racing. Naturally, it is common to demonstrate the advantages of these new controllers against established methods like analytical controllers. We observe, however, that reliably comparing the performance of such very different classes of controllers is more complicated than might appear at first sight. As a case study, we take up the problem of agile tracking of an end-effector for a quadrotor with a fixed arm. We develop a set of best practices for synthesizing the best-in-class RL and geometric controllers (GC) for benchmarking. In the process, we resolve widespread RL-favoring biases in prior studies that provide asymmetric access to: (1) the task definition, in the form of an objective function, (2) representative datasets, for parameter optimization, and (3) feedforward information, describing the desired future trajectory. The resulting findings are the following: our improvements to the experimental protocol for comparing learned and classical controllers are critical, and each of the above asymmetries can yield misleading conclusions. Prior works have claimed that RL outperforms GC, but we find the gaps between the two controller classes are much smaller than previously published when accounting for symmetric comparisons. Geometric control achieves lower steady-state error than RL, while RL has better transient performance, resulting in GC performing better in relatively slow or less agile tasks, but RL performing better when greater agility is required. Finally, we open-source implementations of geometric and RL controllers for these aerial vehicles, implementing best practices for future development. Website and code is available at https://pratikkunapuli.github.io/rl-vs-gc/

📄 PDF Abstract BibTeX arXiv:2506.17832

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Is Deep Reinforcement Learning Really Superhuman on Atari? Leveling the playing field

2019-08-13 · Marin Toromanoff, Emilie Wirbel, Fabien Moutarde

Consistent and reproducible evaluation of Deep Reinforcement Learning (DRL) is not straightforward. In the Arcade Learning Environment (ALE), small changes in environment parameters such as stochasticity or the maximum a…

Atari GamesDeep Reinforcement LearningGeneral Reinforcement Learningreinforcement-learning+2

Human-AI Collaborative Bot Detection in MMORPGs

2025-08-28 · Jaeman Son, Hyunsoo Kim arxiv

In Massively Multiplayer Online Role-Playing Games (MMORPGs), auto-leveling bots exploit automated programs to level up characters at scale, undermining gameplay balance and fairness. Detecting such bots is challenging, …

Representation Learning

Leveling the Playing Field -- Fairness in AI Versus Human Game Benchmarks

2019-03-17 · Rodrigo Canaan, Christoph Salge, Julian Togelius, Andy Nealen

From the beginning if the history of AI, there has been interest in games as a platform of research. As the field developed, human-level competence in complex games became a target researchers worked to reach. Only relat…

Fairness

Safe Linear Leveling Bandits

2021-12-13 · Ilker Demirel, Mehmet Ufuk Ozdemir, Cem Tekin

Multi-armed bandits (MAB) are extensively studied in various settings where the objective is to \textit{maximize} the actions' outcomes (i.e., rewards) over time. Since safety is crucial in many real-world problems, safe…

Multi-Armed BanditsThompson Sampling

ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicine

2021-11-26 · Ilker Demirel, Ahmet Alparslan Celik, Cem Tekin

Finding an optimal individualized treatment regimen is considered one of the most challenging precision medicine problems. Various patient characteristics influence the response to the treatment, and hence, there is no o…

Thompson Sampling