paper-with-me

홈 › Papers

A Penalty Approach for Differentiation Through Black-Box Quadratic Programming Solvers

2026-02-15 · Yuxuan Linghu, Zhiyuan Liu, Qi Deng arxiv

Differentiating through the solution of a quadratic program (QP) is a central problem in differentiable optimization. Most existing approaches differentiate through the Karush--Kuhn--Tucker (KKT) system, but their computational cost and numerical robustness can degrade at scale. To address these limitations, we propose dXPP, a penalty-based differentiation framework that decouples QP solving from differentiation. In the solving step (forward pass), dXPP is solver-agnostic and can leverage any black-box QP solver. In the differentiation step (backward pass), we map the solution to a smooth approximate penalty problem and implicitly differentiate through it, requiring only the solution of a much smaller linear system in the primal variables. This approach bypasses the difficulties inherent in explicit KKT differentiation and significantly improves computational efficiency and robustness. We evaluate dXPP on various tasks, including randomly generated QPs, large-scale sparse projection problems, and a real-world multi-period portfolio optimization task. Empirical results demonstrate that dXPP is competitive with KKT-based differentiation methods and achieves substantial speedups on large-scale problems. Our implementation is open source and available at https://github.com/mmmmmmlinghu/dXPP.

📄 PDF Abstract BibTeX arXiv:2602.14154

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyPortfolio Optimization

Similar Papers 제목 키워드 기반

Differentiation Through Black-Box Quadratic Programming Solvers

2024-10-08 · Connor W. Magoon, Fengyu Yang, Noam Aigerman, Shahar Z. Kovalsky

In recent years, many deep learning approaches have incorporated layers that solve optimization problems (e.g., linear, quadratic, and semidefinite programs). Integrating these optimization problems as differentiable lay…

Efficient differentiable quadratic programming layers: an ADMM approach

2021-12-14 · Andrew Butler, Roy Kwon

Recent advances in neural-network architecture allow for seamless integration of convex optimization problems as differentiable layers in an end-to-end trainable neural network. Integrating medium and large scale quadrat…

Portfolio Optimization

Addressing Unboundedness in Quadratically-Constrained Mixed-Integer Problems

2024-05-06 · Guy Zepko, Ofer M. Shir

Mixed-integer (MI) quadratic models subject to quadratic constraints, known as All-Quadratic MI Programs, constitute a challenging class of NP-complete optimization problems. The particular scenario of unbounded integers…

Flexible Differentiable Optimization via Model Transformations

2022-06-10 · Mathieu Besançon, Joaquim Dias Garcia, Benoît Legat, Akshay Sharma

We introduce DiffOpt.jl, a Julia library to differentiate through the solution of optimization problems with respect to arbitrary parameters present in the objective and/or constraints. The library builds upon MathOptInt…

Hyperparameter Optimizationmodel

An Approximate, Efficient LP Solver for LP Rounding

2013-12-01 · NeurIPS 2013 12 · Srikrishna Sridhar, Stephen Wright, Christopher Re, Ji Liu 외

Many problems in machine learning can be solved by rounding the solution of an appropriate linear program. We propose a scheme that is based on a quadratic program relaxation which allows us to use parallel stochastic-co…

BIG-bench Machine Learning