paper-with-me

Papers

Self-adaptive Torque Vectoring Controller Using Reinforcement Learning

2021-03-27 · Shayan Taherian, Sampo Kuutti, Marco Visca, Saber Fallah

Continuous direct yaw moment control systems such as torque-vectoring controller are an essential part for vehicle stabilization. This controller has been extensively researched with the central objective of maintaining the vehicle stability by providing consistent stable cornering response. The ability of careful tuning of the parameters in a torque-vectoring controller can significantly enhance vehicle's performance and stability. However, without any re-tuning of the parameters, especially in extreme driving conditions e.g. low friction surface or high velocity, the vehicle fails to maintain the stability. In this paper, the utility of Reinforcement Learning (RL) based on Deep Deterministic Policy Gradient (DDPG) as a parameter tuning algorithm for torque-vectoring controller is presented. It is shown that, torque-vectoring controller with parameter tuning via reinforcement learning performs well on a range of different driving environment e.g., wide range of friction conditions and different velocities, which highlight the advantages of reinforcement learning as an adaptive algorithm for parameter tuning. Moreover, the robustness of DDPG algorithm are validated under scenarios which are beyond the training environment of the reinforcement learning algorithm. The simulation has been carried out using a four wheels vehicle model with nonlinear tire characteristics. We compare our DDPG based parameter tuning against a genetic algorithm and a conventional trial-and-error tunning of the torque vectoring controller, and the results demonstrated that the reinforcement learning based parameter tuning significantly improves the stability of the vehicle.

📄 PDF Abstract BibTeX arXiv:2103.14892

Code (1)

shayantaherian/Vehicle-Stabilisation-Using-Reinforcement-Learning 공식 구현

Tasks

Frictionreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…
Batch Normalization 설명 없음
Weight Decay 설명 없음
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
DDPG DDPG, or Deep Deterministic Policy Gradient, is an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action…

Similar Papers 제목 키워드 기반

Autonomous Emergency Braking With Driver-In-The-Loop: Torque Vectoring for Active Learning

2024-02-16 · Benjamin Sullivan, Jingjing Jiang, Georgios Mavros, Wen-Hua Chen

Autonomous Emergency Braking (AEB) potentially brings significant improvements in automotive safety due to its ability to autonomously prevent collisions in situations where the driver may not be able to do so. Driven by…

Active LearningFrictionparameter estimation

Autonomous Emergency Collision Avoidance and Stabilisation in Structured Environments

2020-04-16

In this paper, a novel closed-loop control framework for autonomous obstacle avoidance on a curve road is presented. The proposed framework provides two main functionalities; (i) collision free trajectory planning using …

Collision AvoidanceFrictionTrajectory Planning

Developmental Reinforcement Learning of Control Policy of a Quadcopter UAV with Thrust Vectoring Rotors

2020-07-15 · Aditya M. Deshpande, Rumit Kumar, Ali A. Minai, Manish Kumar

In this paper, we present a novel developmental reinforcement learning-based controller for a quadcopter with thrust vectoring capabilities. This multirotor UAV design has tilt-enabled rotors. It utilizes the rotor force…

Developmental LearningDrone ControllerGeneral Reinforcement Learningreinforcement-learning+1

Adaptive Torque Control of Exoskeletons under Spasticity Conditions via Reinforcement Learning

2025-03-14 · Andrés Chavarrías, David Rodriguez-Cianca, Pablo Lanillos

Spasticity is a common movement disorder symptom in individuals with cerebral palsy, hereditary spastic paraplegia, spinal cord injury and stroke, being one of the most disabling features in the progression of these dise…

Deep Reinforcement LearningReinforcement Learning (RL)

Thruster-Enhanced Locomotion: A Decoupled Model Predictive Control with Learned Contact Residuals

2025-08-05 · Chenghao Wang, Alireza Ramezani arxiv

Husky Carbon, a robot developed by Northeastern University, serves as a research platform to explore unification of posture manipulation and thrust vectoring. Unlike conventional quadrupeds, its joint actuators and thrus…