Improving Nevergrad's Algorithm Selection Wizard NGOpt through Automated Algorithm Configuration
Algorithm selection wizards are effective and versatile tools that automatically select an optimization algorithm given high-level information about the problem and available computational resources, such as number and type of decision variables, maximal number of evaluations, possibility to parallelize evaluations, etc. State-of-the-art algorithm selection wizards are complex and difficult to improve. We propose in this work the use of automated configuration methods for improving their performance by finding better configurations of the algorithms that compose them. In particular, we use elitist iterated racing (irace) to find CMA configurations for specific artificial benchmarks that replace the hand-crafted CMA configurations currently used in the NGOpt wizard provided by the Nevergrad platform. We discuss in detail the setup of irace for the purpose of generating configurations that work well over the diverse set of problem instances within each benchmark. Our approach improves the performance of the NGOpt wizard, even on benchmark suites that were not part of the tuning by irace.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Black-Box Optimization Revisited: Improving Algorithm Selection Wizards through Massive Benchmarking
Existing studies in black-box optimization for machine learning suffer from low generalizability, caused by a typically selective choice of problem instances used for training and testing different optimization algorithm…
BenchmarkingTesting the Efficacy of Hyperparameter Optimization Algorithms in Short-Term Load Forecasting
Accurate forecasting of electrical demand is essential for maintaining a stable and reliable power grid, optimizing the allocation of energy resources, and promoting efficient energy consumption practices. This study inv…
Bayesian OptimizationHyperparameter OptimizationLoad ForecastingThe ELRA License Wizard
To allow an easy understanding of the various licenses that exist for the use of Language Resources (ELRA{'}s, META-SHARE{'}s, Creative Commons{'}, etc.), ELRA has developed a License Wizardto help the right-holders shar…
feature selectionPer-run Algorithm Selection with Warm-starting using Trajectory-based Features
Per-instance algorithm selection seeks to recommend, for a given problem instance and a given performance criterion, one or several suitable algorithms that are expected to perform well for the particular setting. The se…
Time Series Analysis