A survey of benchmarking frameworks for reinforcement learning

2020-11-27 · Belinda Stapelberg, Katherine M. Malan

Reinforcement learning has recently experienced increased prominence in the machine learning community. There are many approaches to solving reinforcement learning problems with new techniques developed constantly. When solving problems using reinforcement learning, there are various difficult challenges to overcome. To ensure progress in the field, benchmarks are important for testing new algorithms and comparing with other approaches. The reproducibility of results for fair comparison is therefore vital in ensuring that improvements are accurately judged. This paper provides an overview of different contributions to reinforcement learning benchmarking and discusses how they can assist researchers to address the challenges facing reinforcement learning. The contributions discussed are the most used and recent in the literature. The paper discusses the contributions in terms of implementation, tasks and provided algorithm implementations with benchmarks. The survey aims to bring attention to the wide range of reinforcement learning benchmarking tasks available and to encourage research to take place in a standardised manner. Additionally, this survey acts as an overview for researchers not familiar with the different tasks that can be used to develop and test new reinforcement learning algorithms.

📄 PDF Abstract BibTeX arXiv:2011.13577

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarking reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Survey

Benchmarking Contemporary Deep Learning Hardware and Frameworks:A Survey of Qualitative Metrics

2019-07-05 · Wei Dai, Daniel Berleant

This paper surveys benchmarking principles, machine learning devices including GPUs, FPGAs, and ASICs, and deep learning software frameworks. It also reviews these technologies with respect to benchmarking from the persp…

Benchmarking BIG-bench Machine Learning Deep Learning

Advancing Human-Machine Teaming: Concepts, Challenges, and Applications

2025-03-16 · Dian Chen, Han Jun Yoon, Zelin Wan, Nithin Alluru 외

Human-Machine Teaming (HMT) is revolutionizing collaboration across domains such as defense, healthcare, and autonomous systems by integrating AI-driven decision-making, trust calibration, and adaptive teaming. This surv…

Benchmarking Decision Making Domain Adaptation

SoK: Adversarial Machine Learning Attacks and Defences in Multi-Agent Reinforcement Learning

2023-01-11 · Maxwell Standen, Junae Kim, Claudia Szabo

Multi-Agent Reinforcement Learning (MARL) is vulnerable to Adversarial Machine Learning (AML) attacks and needs adequate defences before it can be used in real world applications. We have conducted a survey into the use …

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Reinforcement Learning for Control Systems with Time Delays: A Comprehensive Survey

2026-01-30 · Armando Alves Neto arxiv

In the last decade, Reinforcement Learning (RL) has achieved remarkable success in the control and decision-making of complex dynamical systems. However, most RL algorithms rely on the Markov Decision Process assumption,…

Reinforcement Learning

Adversarial Reinforcement Learning Framework for Benchmarking Collision Avoidance Mechanisms in Autonomous Vehicles

2018-06-04 · Vahid Behzadan, Arslan Munir

With the rapidly growing interest in autonomous navigation, the body of research on motion planning and collision avoidance techniques has enjoyed an accelerating rate of novel proposals and developments. However, the co…

Autonomous Navigation Autonomous Vehicles Benchmarking Collision Avoidance+5