Comparison of Model Predictive and Reinforcement Learning Methods for Fault Tolerant Control

2020-08-10 · Ibrahim Ahmed, Hamed Khorasgani, Gautam Biswas

A desirable property in fault-tolerant controllers is adaptability to system changes as they evolve during systems operations. An adaptive controller does not require optimal control policies to be enumerated for possible faults. Instead it can approximate one in real-time. We present two adaptive fault-tolerant control schemes for a discrete time system based on hierarchical reinforcement learning. We compare their performance against a model predictive controller in presence of sensor noise and persistent faults. The controllers are tested on a fuel tank model of a C-130 plane. Our experiments demonstrate that reinforcement learning-based controllers perform more robustly than model predictive controllers under faults, partially observable system models, and varying sensor noise levels.

📄 PDF Abstract BibTeX arXiv:2008.04403

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Fault-Tolerant Routing in Hypercube Networks by Avoiding Faulty Nodes

2019-05-01 · Shadrokh Samavi, Pejman Khadivi

Next to the high performance, the essential feature of the multiprocessor systems is their fault-tolerant capability. In this regard, fault-tolerant interconnection networks and especially fault-tolerant routing methods …

Actuator Fault-Tolerant Vehicle Motion Control: A Survey

2021-03-25 · Torben Stolte

The advent of automated vehicles operating at SAE levels 4 and 5 poses high fault tolerance demands for all functions contributing to the driving task. At the actuator level, fault-tolerant vehicle motion control, which …

Survey

Reinforcement Learning Decoders for Fault-Tolerant Quantum Computation

2018-10-16 · Ryan Sweke, Markus S. Kesselring, Evert P. L. van Nieuwenburg, Jens Eisert

Topological error correcting codes, and particularly the surface code, currently provide the most feasible roadmap towards large-scale fault-tolerant quantum computation. As such, obtaining fast and flexible decoding alg…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A GOA-Based Fault-Tolerant Trajectory Tracking Control for an Underwater Vehicle of Multi-Thruster System without Actuator Saturation

2023-01-04 · Danjie Zhu, Lei Wang, Hua Zhang, Simon X. Yang

This paper proposes an intelligent fault-tolerant control (FTC) strategy to tackle the trajectory tracking problem of an underwater vehicle (UV) under thruster damage (power loss) cases and meanwhile resolve the actuator…

Decentralized Federated Policy Gradient with Byzantine Fault-Tolerance and Provably Fast Convergence

2024-01-07 · Philip Jordan, Florian Grötschla, Flint Xiaofeng Fan, Roger Wattenhofer

In Federated Reinforcement Learning (FRL), agents aim to collaboratively learn a common task, while each agent is acting in its local environment without exchanging raw trajectories. Existing approaches for FRL either (a…