paper-with-me

Papers

A Barrier-Metric First-Order Method for Linearly Constrained Bilevel Optimization

2026-05-12 · Tenglong Hong, Paul Grigas arxiv

We study bilevel optimization with a fixed polyhedral lower feasible set. Such problems are challenging for two reasons: active-set changes can make the upper objective nonsmooth, and existing hypergradient methods typically require lower-Hessian inversions or equivalent linear solves, which are computationally expensive. To address these issues, we adopt a logarithmic barrier smoothing of the lower problem to obtain a differentiable approximation of the constrained bilevel objective, and develop a proxy-gradient algorithm for the resulting barrier-smoothed surrogate. The algorithm uses only gradients of the upper and lower objectives; its only second-order object is the explicit logarithmic barrier Hessian determined by the fixed polyhedral constraints. Barrier smoothing restores differentiability, but Euclidean smoothness constants are not uniformly bounded near the boundary. We therefore develop a local Dikin-geometry analysis in which the barrier-metric provides an oracle-free curvature scale near the moving lower centers. This leads to barrier-aware schedules that keep the iterates inside locally well-behaved regions. For the barrier-smoothed objective, we prove stationarity rates of $\widetilde{O}(K^{-2/3})$ in the deterministic setting and $\widetilde{O}(K^{-2/5})$ under upper-level-only bounded stochastic noise after $K$ outer iterations, together with quantitative bias control as the barrier parameter decreases.

📄 PDF Abstract BibTeX arXiv:2605.11476

Code (0)

등록된 구현이 없습니다.

Tasks

Bilevel Optimization

Similar Papers 제목 키워드 기반

Hessian barrier algorithms for linearly constrained optimization problems

2018-09-25 · Immanuel M. Bomze, Panayotis Mertikopoulos, Werner Schachinger, Mathias Staudigl

In this paper, we propose an interior-point method for linearly constrained optimization problems (possibly nonconvex). The method - which we call the Hessian barrier algorithm (HBA) - combines a forward Euler discretiza…

First-Order Methods for Linearly Constrained Bilevel Optimization

2024-06-18 · Guy Kornowski, Swati Padmanabhan, Kai Wang, Zhe Zhang 외

Algorithms for bilevel optimization often encounter Hessian computations, which are prohibitive in high dimensions. While recent works offer first-order methods for unconstrained bilevel problems, the constrained setting…

Bilevel Optimization

Understanding Limitation of Two Symmetrized Orders by Worst-case Complexity

2019-10-10 · Peijun Xiao, Zhisheng Xiao, Ruoyu Sun

Update order is one of the major design choices of block decomposition algorithms. There are at least two classes of deterministic update orders: nonsymmetric (e.g. cyclic order) and symmetric (e.g. Gaussian back substit…

Vocal Bursts Valence Prediction

Regret Analysis of Policy Optimization over Submanifolds for Linearly Constrained Online LQG

2024-03-13 · Ting-Jui Chang, Shahin Shahrampour

Recent advancement in online optimization and control has provided novel tools to study online linear quadratic regulator (LQR) problems, where cost matrices are varying adversarially over time. However, the controller p…

Wasserstein Distributionally Robust Control Barrier Function using Conditional Value-at-Risk with Differentiable Convex Programming

2023-09-15 · Alaa Eddine Chriat, Chuangchuang Sun

Control Barrier functions (CBFs) have attracted extensive attention for designing safe controllers for their deployment in real-world safety-critical systems. However, the perception of the surrounding environment is oft…