Nonuniqueness and Convergence to Equivalent Solutions in Observer-based Inverse Reinforcement Learning
A key challenge in solving the deterministic inverse reinforcement learning (IRL) problem online and in real-time is the existence of multiple solutions. Nonuniqueness necessitates the study of the notion of equivalent solutions, i.e., solutions that result in a different cost functional but same feedback matrix, and convergence to such solutions. While offline algorithms that result in convergence to equivalent solutions have been developed in the literature, online, real-time techniques that address nonuniqueness are not available. In this paper, a regularized history stack observer that converges to approximately equivalent solutions of the IRL problem is developed. Novel data-richness conditions are developed to facilitate the analysis and simulation results are provided to demonstrate the effectiveness of the developed technique.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Pilot Performance modeling via observer-based inverse reinforcement learning
The focus of this paper is behavior modeling for pilots of unmanned aerial vehicles. The pilot is assumed to make decisions that optimize an unknown cost functional, which is estimated from observed trajectories using a …
reinforcement-learningReinforcement LearningExploring the loss landscape of regularized neural networks via convex duality
We discuss several aspects of the loss landscape of regularized neural networks: the structure of stationary points, connectivity of optimal solutions, path with nonincreasing loss to arbitrary global optimum, and the no…
Online Observer-Based Inverse Reinforcement Learning
In this paper, a novel approach to the output-feedback inverse reinforcement learning (IRL) problem is developed by casting the IRL problem, for linear systems with quadratic cost functions, as a state estimation problem…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)State EstimationSymmetry-based observers for ODE systems
In this paper we introduce an observer design framework for ordinary differential equation (ODE) systems based on various types of existing or even novel one-parameter symmetries (exact, asymptotic and variational) endin…
Interturn Fault Detection in IPMSMs: Two Adaptive Observer-based Solutions
In this paper we address the problem of online detection of inter-turn short-circuit faults (ITSCFs) that occur in permanent magnet synchronous motors (PMSMs). We propose two solutions to this problem: (i) a very simple …
Fault Detectionparameter estimation