Inverse Reinforcement Learning in Large State Spaces via Function Approximation

2017-07-28 · Kun Li, Joel W. Burdick

This paper introduces a new method for inverse reinforcement learning in large-scale and high-dimensional state spaces. To avoid solving the computationally expensive reinforcement learning problems in reward learning, we propose a function approximation method to ensure that the Bellman Optimality Equation always holds, and then estimate a function to maximize the likelihood of the observed motion. The time complexity of the proposed method is linearly proportional to the cardinality of the action set, thus it can handle large state spaces efficiently. We test the proposed method in a simulated environment, and show that it is more accurate than existing methods and significantly better in scalability. We also show that the proposed method can extend many existing methods to high-dimensional state spaces. We then apply the method to evaluating the effect of rehabilitative stimulations on patients with spinal cord injuries based on the observed patient motions.

📄 PDF Abstract BibTeX arXiv:1707.09394

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Function Approximation Method for Model-based High-Dimensional Inverse Reinforcement Learning

2017-08-23 · Kun Li, Joel W. Burdick

This works handles the inverse reinforcement learning problem in high-dimensional state spaces, which relies on an efficient solution of model-based high-dimensional reinforcement learning problems. To solve the computat…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning to Drive using Inverse Reinforcement Learning and Deep Q-Networks

2016-12-12 · Sahand Sharifzadeh, Ioannis Chiotellis, Rudolph Triebel, Daniel Cremers

We propose an inverse reinforcement learning (IRL) approach using Deep Q-Networks to extract the rewards in problems with large state spaces. We evaluate the performance of this approach in a simulation-based autonomous …

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Model-Based Inverse Reinforcement Learning from Visual Demonstrations

2020-10-18 · Neha Das, Sarah Bechtle, Todor Davchev, Dinesh Jayaraman 외

Scaling model-based inverse reinforcement learning (IRL) to real robotic manipulation tasks with unknown dynamics remains an open problem. The key challenges lie in learning good dynamics models, developing algorithms th…

model Model Predictive Control reinforcement-learning Reinforcement Learning+1

Cost Function Estimation Using Inverse Reinforcement Learning with Minimal Observations

2025-05-13 · Sarmad Mehrdad, Avadesh Meduri, Ludovic Righetti

We present an iterative inverse reinforcement learning algorithm to infer optimal cost functions in continuous spaces. Based on a popular maximum entropy criteria, our approach iteratively finds a weight improvement step…

Privacy-preserving Q-Learning with Functional Noise in Continuous State Spaces

2019-01-30 · Baoxiang Wang, Nidhi Hegde

We consider differentially private algorithms for reinforcement learning in continuous spaces, such that neighboring reward functions are indistinguishable. This protects the reward information from being exploited by me…

Privacy Preserving Q-Learning reinforcement-learning Reinforcement Learning+1