Optimistic variants of single-objective bilevel optimization for evolutionary algorithms
Single-objective bilevel optimization is a specialized form of constraint optimization problems where one of the constraints is an optimization problem itself. These problems are typically non-convex and strongly NP-Hard. Recently, there has been an increased interest from the evolutionary computation community to model bilevel problems due to its applicability in the real-world applications for decision-making problems. In this work, a partial nested evolutionary approach with a local heuristic search has been proposed to solve the benchmark problems and have outstanding results. This approach relies on the concept of intermarriage-crossover in search of feasible regions by exploiting information from the constraints. A new variant has also been proposed to the commonly used convergence approaches, i.e., optimistic and pessimistic. It is called extreme optimistic approach. The experimental results demonstrate the algorithm converges differently to known optimum solutions with the optimistic variants. Optimistic approach also outperforms pessimistic approach. Comparative statistical analysis of our approach with other recently published partial to complete evolutionary approaches demonstrates very competitive results.
Code (1)
Tasks
Bilevel OptimizationDecision MakingEvolutionary AlgorithmsHeuristic SearchSimilar Papers 제목 키워드 기반
Select-then-differentiate: Solving Bilevel Optimization with Manifold Lower-level Solution Sets
We study optimistic bilevel optimization when the lower-level problem has a non-isolated manifold of minimizers. In this setting, the hyper-objective may be non-differentiable because the upper-level criterion must choos…
Bilevel OptimizationHyperparameter Tuning Through Pessimistic Bilevel Optimization
Automated hyperparameter search in machine learning, especially for deep learning models, is typically formulated as a bilevel optimization problem, with hyperparameter values determined by the upper level and the model …
Bilevel OptimizationHyperparameter OptimizationA Single-Timescale Method for Stochastic Bilevel Optimization
Stochastic bilevel optimization generalizes the classic stochastic optimization from the minimization of a single objective to the minimization of an objective function that depends the solution of another optimization p…
Bilevel OptimizationMeta-LearningStochastic OptimizationOn Stability in Optimistic Bilevel Optimization
Solutions of bilevel optimization problems tend to suffer from instability under changes to problem data. In the optimistic setting, we construct a lifted formulation that exhibits desirable stability properties under mi…
Bilevel OptimizationEfficient Hessian-Free Methods for Multi-Objective Bilevel Optimization with Nonconvex Lower Level
Multi-objective bilevel optimization has wide applications in the AI area such as automated learning and multi-task meta-learning. Although recently some works have been begun to study the multi-objective bilevel optimiz…
Neural Architecture SearchBilevel Optimization