paper-with-me

홈 › Papers

Deep Distributed Optimization for Large-Scale Quadratic Programming

2024-12-11 · Augustinos D. Saravanos, Hunter Kuperman, Alex Oshin, Arshiya Taj Abdul, Vincent Pacelli, Evangelos A. Theodorou

Quadratic programming (QP) forms a crucial foundation in optimization, encompassing a broad spectrum of domains and serving as the basis for more advanced algorithms. Consequently, as the scale and complexity of modern applications continue to grow, the development of efficient and reliable QP algorithms is becoming increasingly vital. In this context, this paper introduces a novel deep learning-aided distributed optimization architecture designed for tackling large-scale QP problems. First, we combine the state-of-the-art Operator Splitting QP (OSQP) method with a consensus approach to derive DistributedQP, a new method tailored for network-structured problems, with convergence guarantees to optimality. Subsequently, we unfold this optimizer into a deep learning framework, leading to DeepDistributedQP, which leverages learned policies to accelerate reaching to desired accuracy within a restricted amount of iterations. Our approach is also theoretically grounded through Probably Approximately Correct (PAC)-Bayes theory, providing generalization bounds on the expected optimality gap for unseen problems. The proposed framework, as well as its centralized version DeepQP, significantly outperform their standard optimization counterparts on a variety of tasks such as randomly generated problems, optimal control, linear regression, transportation networks and others. Notably, DeepDistributedQP demonstrates strong generalization by training on small problems and scaling to solve much larger ones (up to 50K variables and 150K constraints) using the same policy. Moreover, it achieves orders-of-magnitude improvements in wall-clock time compared to OSQP. The certifiable performance guarantees of our approach are also demonstrated, ensuring higher-quality solutions over traditional optimizers.

📄 PDF Abstract BibTeX arXiv:2412.12156

Code (0)

등록된 구현이 없습니다.

Tasks

Distributed OptimizationGeneralization Bounds

Similar Papers 제목 키워드 기반

Simultaneous Contact-Rich Grasping and Locomotion via Distributed Optimization Enabling Free-Climbing for Multi-Limbed Robots

2022-07-04 · Yuki Shirai, Xuan Lin, Alexander Schperberg, Yusuke Tanaka 외

While motion planning of locomotion for legged robots has shown great success, motion planning for legged robots with dexterous multi-finger grasping is not mature yet. We present an efficient motion planning framework f…

Distributed OptimizationMotion Planning

Distributed Differential Dynamic Programming Architectures for Large-Scale Multi-Agent Control

2022-07-27 · Augustinos D. Saravanos, Yuichiro Aoyama, Hongchang Zhu, Evangelos A. Theodorou

In this paper, we propose two novel decentralized optimization frameworks for multi-agent nonlinear optimal control problems in robotics. The aim of this work is to suggest architectures that inherit the computational ef…

Computational Efficiency

Quadratically constrained quadratic programming for classification using particle swarms and applications

2014-07-23 · Deepak Kumar, A. G. Ramakrishnan

Particle swarm optimization is used in several combinatorial optimization problems. In this work, particle swarms are used to solve quadratic programming problems with quadratic constraints. The approach of particle swar…

Binary ClassificationClassificationCombinatorial OptimizationGeneral Classification

UniAP: Unifying Inter- and Intra-Layer Automatic Parallelism by Mixed Integer Quadratic Programming

2023-07-31 · CVPR 2025 1 · Hao Lin, Ke wu, Jie Li, Jun Li 외

Distributed learning is commonly used for training deep learning models, especially large models. In distributed learning, manual parallelism (MP) methods demand considerable human effort and have limited flexibility. He…

Distributed Consensus Optimization with Consensus ALADIN

2025-03-21 · Xu Du, Jingzhe Wang

TThe paper proposes the Consensus Augmented Lagrange Alternating Direction Inexact Newton (Consensus ALADIN) algorithm, a novel approach for solving distributed consensus optimization problems (DC). Consensus ALADIN allo…

Computational Efficiency