paper-with-me

Papers

Generalised Regret Optimal Controller Synthesis for Constrained Systems

2022-11-15 · Alexandre Didier, Melanie N. Zeilinger

This paper presents a synthesis method for the generalised dynamic regret problem, comparing the performance of a strictly causal controller to the optimal non-causal controller under a weighted disturbance. This framework encompasses both the dynamic regret problem, considering the difference of the incurred costs, as well as the competitive ratio, which considers their ratio, and which have both been proposed as inherently adaptive alternatives to classical control methods. Furthermore, we extend the synthesis to the case of pointwise-in-time bounds on the disturbance and show that the optimal solution is no worse than the bounded energy optimal solution and is lower bounded by a constant factor, which is only dependent on the disturbance weight. The proposed optimisation-based synthesis allows considering systems subject to state and input constraints. Finally, we provide a numerical example which compares the synthesised controller performance to $\mathcal{H}_2$- and $\mathcal{H}_\infty$-controllers.

📄 PDF Abstract BibTeX arXiv:2211.08101

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Foundations of Safe Online Reinforcement Learning in the Linear Quadratic Regulator: $\sqrt{T}$-Regret

2025-04-25 · Benjamin Schiffer, Lucas Janson

Understanding how to efficiently learn while adhering to safety constraints is essential for using online reinforcement learning in practical applications. However, proving rigorous regret bounds for safety-constrained r…

reinforcement-learningReinforcement Learning

Safe Control of Partially-Observed Linear Time-Varying Systems with Minimal Worst-Case Dynamic Regret

2022-08-18 · HongYu Zhou, Vasileios Tzoumas

We present safe control of partially-observed linear time-varying systems in the presence of unknown and unpredictable process and measurement noise. We introduce a control algorithm that minimizes dynamic regret, i.e., …

A System Level Approach to Regret Optimal Control

2022-02-28 · Alexandre Didier, Jerome Sieber, Melanie N. Zeilinger

We present an optimisation-based method for synthesising a dynamic regret optimal controller for linear systems with potentially adversarial disturbances and known or adversarial initial conditions. The dynamic regret is…

Safe Control with Minimal Regret

2022-03-01 · Andrea Martin, Luca Furieri, Florian Dörfler, John Lygeros 외

As we move towards safety-critical cyber-physical systems that operate in non-stationary and uncertain environments, it becomes crucial to close the gap between classical optimal control algorithms and adaptive learning-…

Regret Analysis of Policy Optimization over Submanifolds for Linearly Constrained Online LQG

2024-03-13 · Ting-Jui Chang, Shahin Shahrampour

Recent advancement in online optimization and control has provided novel tools to study online linear quadratic regulator (LQR) problems, where cost matrices are varying adversarially over time. However, the controller p…