Quantity vs. Quality: On Hyperparameter Optimization for Deep Reinforcement Learning

2020-07-29 · Lars Hertel, Pierre Baldi, Daniel L. Gillen

Reinforcement learning algorithms can show strong variation in performance between training runs with different random seeds. In this paper we explore how this affects hyperparameter optimization when the goal is to find hyperparameter settings that perform well across random seeds. In particular, we benchmark whether it is better to explore a large quantity of hyperparameter settings via pruning of bad performers, or if it is better to aim for quality of collected results by using repetitions. For this we consider the Successive Halving, Random Search, and Bayesian Optimization algorithms, the latter two with and without repetitions. We apply these to tuning the PPO2 algorithm on the Cartpole balancing task and the Inverted Pendulum Swing-up task. We demonstrate that pruning may negatively affect the optimization and that repeated sampling does not help in finding hyperparameter settings that perform better across random seeds. From our experiments we conclude that Bayesian optimization with a noise robust acquisition function is the best choice for hyperparameter optimization in reinforcement learning tasks.

📄 PDF Abstract BibTeX arXiv:2007.14604

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationDeep Reinforcement LearningHyperparameter Optimization reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Random Search Random Search replaces the exhaustive enumeration of all combinations by selecting them randomly. This can be simply applied to the discrete setting described above, but also…

Consistent Quantity-Quality Control across Scenes for Deployment-Aware Gaussian Splatting

2025-05-15 · Fengdi Zhang, Hongkun Cao, Ruqi Huang

To reduce storage and computational costs, 3D Gaussian splatting (3DGS) seeks to minimize the number of Gaussians used while preserving high rendering quality, introducing an inherent trade-off between Gaussian quantity …

3DGS Model Compression Novel View Synthesis

HyperController: A Hyperparameter Controller for Fast and Stable Training of Reinforcement Learning Neural Networks

2025-04-27 · Jonathan Gornet, Yiannis Kantaros, Bruno Sinopoli

We introduce Hyperparameter Controller (HyperController), a computationally efficient algorithm for hyperparameter optimization during training of reinforcement learning neural networks. HyperController optimizes hyperpa…

Hyperparameter Optimization reinforcement-learning Reinforcement Learning

Hyperparameter Optimization for Driving Strategies Based on Reinforcement Learning

2024-07-19 · Nihal Acharya Adde, Hanno Gottschalk, Andreas Ebert

This paper focuses on hyperparameter optimization for autonomous driving strategies based on Reinforcement Learning. We provide a detailed description of training the RL agent in a simulation environment. Subsequently, w…

Autonomous Driving Bayesian Optimization global-optimization Hyperparameter Optimization+2

Reinforcement Learning Enhanced Quantum-inspired Algorithm for Combinatorial Optimization

2020-02-11 · Dmitrii Beloborodov, A. E. Ulanov, Jakob N. Foerster, Shimon Whiteson 외

Quantum hardware and quantum-inspired algorithms are becoming increasingly popular for combinatorial optimization. However, these algorithms may require careful hyperparameter tuning for each problem instance. We use a r…

Combinatorial Optimization Hyperparameter Optimization reinforcement-learning Reinforcement Learning+2

Rethinking the Efficiency and Effectiveness of Reinforcement Learning for Radiology Report Generation

2026-03-04 · Zilin Lu, Ruifeng Yuan, Weiwei Cao, Wanxing Chang 외 arxiv

Radiologists highly desire fully automated AI for radiology report generation (R2G), yet existing approaches fall short in clinical utility. Reinforcement learning (RL) holds potential to address these shortcomings, but …

Reinforcement Learning