WFA-IRL: Inverse Reinforcement Learning of Autonomous Behaviors Encoded as Weighted Finite Automata

2021-03-10 · Tianyu Wang, Nikolay Atanasov

This paper presents a method for learning logical task specifications and cost functions from demonstrations. Constructing specifications by hand is challenging for complex objectives and constraints in autonomous systems. Instead, we consider demonstrated task executions, whose logic structure and transition costs need to be inferred by an autonomous agent. We employ a spectral learning approach to extract a weighted finite automaton (WFA), approximating the unknown task logic. Thereafter, we define a product between the WFA for high-level task guidance and a labeled Markov decision process for low-level control. An inverse reinforcement learning (IRL) problem is considered to learn a cost function by backpropagating the loss between agent and expert behaviors through the planning algorithm. Our proposed model, termed WFA-IRL, is capable of generalizing the execution of the inferred task specification in a suite of MiniGrid environments.

📄 PDF Abstract BibTeX arXiv:2103.05895

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning (RL)

Identifying Reaction-Aware Driving Styles of Stochastic Model Predictive Controlled Vehicles by Inverse Reinforcement Learning

2023-08-23 · Ni Dang, Tao Shi, Zengjie Zhang, Wanxin Jin 외

The driving style of an Autonomous Vehicle (AV) refers to how it behaves and interacts with other AVs. In a multi-vehicle autonomous driving system, an AV capable of identifying the driving styles of its nearby AVs can r…

Autonomous Driving Model Predictive Control

Inverse Reinforcement Learning with Multi-Relational Chains for Robot-Centered Smart Home

2014-08-16 · Kun Li, Max Q. -H. Meng

In a robot-centered smart home, the robot observes the home states with its own sensors, and then it can change certain object states according to an operator's commands for remote operations, or imitate the operator's b…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Estimating cognitive biases with attention-aware inverse planning

2025-10-29 · Sounak Banerjee, Daphne Cornelisse, Deepak Gopinath, Emily Sumner 외 arxiv

People's goal-directed behaviors are influenced by their cognitive biases, and autonomous systems that interact with people should be aware of this. For example, people's attention to objects in their environment will be…

Reinforcement Learning

Off-road Autonomous Vehicles Traversability Analysis and Trajectory Planning Based on Deep Inverse Reinforcement Learning

2019-09-16 · Zeyu Zhu, Nan Li, Ruoyu Sun, Huijing Zhao 외

Terrain traversability analysis is a fundamental issue to achieve the autonomy of a robot at off-road environments. Geometry-based and appearance-based methods have been studied in decades, while behavior-based methods e…

Autonomous Vehicles reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Inverse Reinforce Learning with Nonparametric Behavior Clustering

2017-12-15 · Siddharthan Rajasekaran, Jinwei Zhang, Jie Fu

Inverse Reinforcement Learning (IRL) is the task of learning a single reward function given a Markov Decision Process (MDP) without defining the reward function, and a set of demonstrations generated by humans/experts. H…

Clustering Reinforcement Learning