Predicting Effective Control Parameters for Differential Evolution using Cluster Analysis of Objective Function Features
A methodology is introduced which uses three simple objective function features to predict effective control parameters for differential evolution. This is achieved using cluster analysis techniques to classify objective functions using these features. Information on prior performance of various control parameters for each classification is then used to determine which control parameters to use in future optimisations. Our approach is compared to state-of-the-art adaptive and non-adaptive techniques. Two accepted bench mark suites are used to compare performance and in all cases we show that the improvement resulting from our approach is statistically significant. The majority of the computational effort of this methodology is performed off-line, however even when taking into account the additional on-line cost our approach outperforms other adaptive techniques. We also investigate the key tuning parameters of our methodology, such as number of clusters, which further support the finding that the simple features selected are predictors of effective control parameters. The findings presented in this paper are significant because they show that simple to calculate features of objective functions can help to select control parameters for optimisation algorithms. This can have an immediate positive impact on the application of these optimisation algorithms on real world problems, where it is often difficult to select effective control parameters.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Learning adaptive differential evolution algorithm from optimization experiences by policy gradient
Differential evolution is one of the most prestigious population-based stochastic optimization algorithm for black-box problems. The performance of a differential evolution algorithm depends highly on its mutation and cr…
Evolutionary AlgorithmsStochastic OptimizationACD-DE: An adaptive cluster division Differential Evolution for mitigating population diversity deficiency
Differential Evolution (DE) is a simple but powerful population based evolutionary algorithm, which was widely used to solve various complex optimization problems. However, even recently proposed state-of-the-art DE vari…
DiversityMetaDE: Evolving Differential Evolution by Differential Evolution
As a cornerstone in the Evolutionary Computation (EC) domain, Differential Evolution (DE) is known for its simplicity and effectiveness in handling challenging black-box optimization problems. While the advantages of DE …
Computational EfficiencyGPUHyperparameter OptimizationWhy is Differential Evolution Better than Grid Search for Tuning Defect Predictors?
Context: One of the black arts of data mining is learning the magic parameters which control the learners. In software analytics, at least for defect prediction, several methods, like grid search and differential evoluti…
Predicting The Evolution of Interfaces with Fourier Neural Operators
Recent progress in AI has established neural operators as powerful tools that can predict the evolution of partial differential equations, such as the Navier-Stokes equations. Some complex problems rely on sophisticated …