Trilevel and Multilevel Optimization using Monotone Operator Theory
We consider rather a general class of multi-level optimization problems, where a convex objective function is to be minimized subject to constraints of optimality of nested convex optimization problems. As a special case, we consider a trilevel optimization problem, where the objective of the two lower layers consists of a sum of a smooth and a non-smooth term.~Based on fixed-point theory and related arguments, we present a natural first-order algorithm and analyze its convergence and rates of convergence in several regimes of parameters.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Gradient Method for Multilevel Optimization
Although application examples of multilevel optimization have already been discussed since the 1990s, the development of solution methods was almost limited to bilevel cases due to the difficulty of the problem. In recen…
Bilevel OptimizationData PoisoningA stochastic gradient method for trilevel optimization
With the success that the field of bilevel optimization has seen in recent years, similar methodologies have started being applied to solving more difficult applications that arise in trilevel optimization. At the helm o…
Bilevel OptimizationCurriculum learning for multilevel budgeted combinatorial problems
Learning heuristics for combinatorial optimization problems through graph neural networks have recently shown promising results on some classic NP-hard problems. These are single-level optimization problems with only one…
Combinatorial OptimizationMulti-agent Reinforcement LearningA Fully Stochastic Primal-Dual Algorithm
A new stochastic primal--dual algorithm for solving a composite optimization problem is proposed. It is assumed that all the functions/operators that enter the optimization problem are given as statistical expectations. …
Non-Euclidean Enriched Contraction Theory for Monotone Operators and Monotone Dynamical Systems
We adopt an operator-theoretic perspective to analyze a class of nonlinear fixed-point iterations and discrete-time dynamical systems. Specifically, we study the Krasnoselskij iteration - at the heart of countless algori…