Bilevel Optimization
3개 벤치마크 · 논문 544편 · 이 태스크의 논문 보기 →
Benchmarks
Most implemented
Adaptive Personalized Federated Learning
OptNet: Differentiable Optimization as a Layer in Neural Networks
Nystrom Method for Accurate and Scalable Implicit Differentiation
Convex and Bilevel Optimization for Neuro-Symbolic Inference and Learning
Second-Order Sensitivity Analysis for Bilevel Optimization
Papers
SGHA: A Single-Loop Fully First-Order Algorithm for Nonconvex-Strongly-Convex Bilevel Optimization
In this work, we study the oracle complexity of finding an $ε$-stationary point for nonconvex-strongly-convex (NC-SC) bilevel optimization using only first-order oracles. Existing methods achieving the best-known complex…
Bilevel OptimizationDesigning Compact Neural Architectures via Neuron Gating and Mixed Activation
Neural Architecture Search (NAS) is naturally formulated as a bilevel optimization problem, where the upper-level optimizes the architecture using validation performance and the lower-level trains network parameters usin…
Neural Architecture SearchBilevel OptimizationFrom Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion
Diffusion models have achieved dominant performance in visual generation but suffer from substantial inference overhead. While cache-based acceleration has emerged as a promising solution, existing policies rely on local…
Bilevel OptimizationImage GenerationEfficient Hessian-Free Methods for Multi-Objective Bilevel Optimization with Nonconvex Lower Level
Multi-objective bilevel optimization has wide applications in the AI area such as automated learning and multi-task meta-learning. Although recently some works have been begun to study the multi-objective bilevel optimiz…
Neural Architecture SearchBilevel OptimizationSharper Analysis of Single-Loop Methods for Bilevel Optimization
Bilevel optimization underpins many machine learning applications, including hyperparameter optimization, meta-learning, neural architecture search, and reinforcement learning. While hypergradient-based methods have adva…
Hyperparameter OptimizationNeural Architecture SearchReinforcement LearningBilevel OptimizationFunctional Bilevel Optimization for Predictive Fairness
When sensitive attributes are continuous and high-dimensional $-$ demographic score vectors, posteriors over attributes, age or income profiles $-$ enforcing full statistical independence is often too restrictive, and ex…
Bilevel Optimization