Neuroevolution-Based Inverse Reinforcement Learning

2016-08-09 · Karan K. Budhraja, Tim Oates

The problem of Learning from Demonstration is targeted at learning to perform tasks based on observed examples. One approach to Learning from Demonstration is Inverse Reinforcement Learning, in which actions are observed to infer rewards. This work combines a feature based state evaluation approach to Inverse Reinforcement Learning with neuroevolution, a paradigm for modifying neural networks based on their performance on a given task. Neural networks are used to learn from a demonstrated expert policy and are evolved to generate a policy similar to the demonstration. The algorithm is discussed and evaluated against competitive feature-based Inverse Reinforcement Learning approaches. At the cost of execution time, neural networks allow for non-linear combinations of features in state evaluations. These valuations may correspond to state value or state reward. This results in better correspondence to observed examples as opposed to using linear combinations. This work also extends existing work on Bayesian Non-Parametric Feature Construction for Inverse Reinforcement Learning by using non-linear combinations of intermediate data to improve performance. The algorithm is observed to be specifically suitable for a linearly solvable non-deterministic Markov Decision Processes in which multiple rewards are sparsely scattered in state space. A conclusive performance hierarchy between evaluated algorithms is presented.

📄 PDF Abstract BibTeX arXiv:1608.02971

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Surrogate Models for Enhancing the Efficiency of Neuroevolution in Reinforcement Learning

2019-07-22 · Jörg Stork, Martin Zaefferer, Thomas Bartz-Beielstein, A. E. Eiben

In the last years, reinforcement learning received a lot of attention. One method to solve reinforcement learning tasks is Neuroevolution, where neural networks are optimized by evolutionary algorithms. A disadvantage of…

Evolutionary Algorithms reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Low Rank Factorizations are Indirect Encodings for Deep Neuroevolution

2025-04-03 · Jack Garbus, Jordan Pollack

Deep neuroevolution is a highly scalable alternative to reinforcement learning due to its unique ability to encode network updates in a small number of bytes. Recent insights from traditional deep learning indicate high-…

Language Modeling Language Modelling reinforcement-learning Reinforcement Learning

VINE: An Open Source Interactive Data Visualization Tool for Neuroevolution

2018-05-03 · Rui Wang, Jeff Clune, Kenneth O. Stanley

Recent advances in deep neuroevolution have demonstrated that evolutionary algorithms, such as evolution strategies (ES) and genetic algorithms (GA), can scale to train deep neural networks to solve difficult reinforceme…

Data Visualization Evolutionary Algorithms Reinforcement Learning Reinforcement Learning (RL)

Provably Sub-Linear Two-Timescale NeuroEvolution with Online Plasticity

2026-06-18 · Shishen Lin, Yixin Chen arxiv

NeuroEvolution of Augmenting Topologies (NEAT) is a widely used neuroevolution algorithm for learning neural network architectures and weights for control tasks. However, standard offline optimisation searches for connec…

Reinforcement Learning Continuous Control

Direct Mutation and Crossover in Genetic Algorithms Applied to Reinforcement Learning Tasks

2022-01-13 · Tarek Faycal, Claudio Zito

Neuroevolution has recently been shown to be quite competitive in reinforcement learning (RL) settings, and is able to alleviate some of the drawbacks of gradient-based approaches. This paper will focus on applying neuro…

OpenAI Gym reinforcement-learning Reinforcement Learning (RL)