QuadSim: A Quadcopter Rotational Dynamics Simulation Framework For Reinforcement Learning Algorithms
This study focuses on designing and developing a mathematically based quadcopter rotational dynamics simulation framework for testing reinforcement learning (RL) algorithms in many flexible configurations. The design of the simulation framework aims to simulate both linear and nonlinear representations of a quadcopter by solving initial value problems for ordinary differential equation (ODE) systems. In addition, the simulation environment is capable of making the simulation deterministic/stochastic by adding random Gaussian noise in the forms of process and measurement noises. In order to ensure that the scope of this simulation environment is not limited only with our own RL algorithms, the simulation environment has been expanded to be compatible with the OpenAI Gym toolkit. The framework also supports multiprocessing capabilities to run simulation environments simultaneously in parallel. To test these capabilities, many state-of-the-art deep RL algorithms were trained in this simulation framework and the results were compared in detail.
Code (1)
Tasks
OpenAI Gymreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Learning a Single Near-hover Position Controller for Vastly Different Quadcopters
This paper proposes an adaptive near-hover position controller for quadcopters, which can be deployed to quadcopters of very different mass, size and motor constants, and also shows rapid adaptation to unknown disturbanc…
Drone ControllerPositionROS-Based Multi-Agent Systems COntrol Simulation Testbed (MASCOT)
This paper presents a simulation testbed developed for testing and demonstration of decentralized control algorithms designed for multi-agent systems. Aimed at bridging a gap between theory and practical deployment of su…
Modeling and Control of a Novel Bi-Quadcopter with Auxiliary Thruster Mechanism
In this paper, a new under-actuated Bi-Quadcopter Unmanned Aerial Vehicle is introduced. The proposed drone configuration can be controlled similar to a Bicopter. The dynamics of the proposed Bi-Quadcopter is developed u…
PositionVariance Reduction of Quadcopter Trajectory Tracking in Turbulent Wind
We consider a quadcopter operating in a turbulent windy environment. The turbulent environment may be imposed on a quadcopter by structures, landscapes, terrains and most importantly by the unique physical phenomena in t…
A real-time GP based MPC for quadcopters with unknown disturbances
Gaussian Process (GP) regressions have proven to be a valuable tool to predict disturbances and model mismatches and incorporate this information into a Model Predictive Control (MPC) prediction. Unfortunately, the compu…
Model Predictive ControlRaspberry Pi 4