paper-with-me

Papers

Simultaneous Learning and Optimization via Misspecified Saddle Point Problems

2025-10-06 · Mohammad Mahdi Ahmadi, Erfan Yazdandoost Hamedani arxiv

We study a class of misspecified saddle point (SP) problems, where the optimization objective depends on an unknown parameter that must be learned concurrently from data. Unlike existing studies that assume parameters are fully known or pre-estimated, our framework integrates optimization and learning into a unified formulation, enabling a more flexible problem class. To address this setting, we propose two algorithms based on the accelerated primal-dual (APD) by Hamedani & Aybat 2021. In particular, we first analyze the naive extension of the APD method by directly substituting the evolving parameter estimates into the primal-dual updates; then, we design a new learning-aware variant of the APD method that explicitly accounts for parameter dynamics by adjusting the momentum updates. Both methods achieve a provable convergence rate of $\mathcal{O}(\log K / K)$, while the learning-aware approach attains a tighter $\mathcal{O}(1)$ constant and further benefits from an adaptive step-size selection enabled by a backtracking strategy. Furthermore, we extend the framework to problems where the learning problem admits multiple optimal solutions, showing that our modified algorithm for a structured setting achieves an $\mathcal{O}(1/\sqrt{K})$ rate. To demonstrate practical impact, we evaluate our methods on a misspecified portfolio optimization problem and show superior empirical performance compared to state-of-the-art algorithms.

📄 PDF Abstract BibTeX arXiv:2510.05241

Code (0)

등록된 구현이 없습니다.

Tasks

Portfolio Optimization

Similar Papers 제목 키워드 기반

Online and Bandit Algorithms for Nonstationary Stochastic Saddle-Point Optimization

2019-12-03 · Abhishek Roy, Yifang Chen, Krishnakumar Balasubramanian, Prasant Mohapatra

Saddle-point optimization problems are an important class of optimization problems with applications to game theory, multi-agent reinforcement learning and machine learning. A majority of the rich literature available fo…

Multi-agent Reinforcement LearningReinforcement Learning

Local Saddle Point Optimization: A Curvature Exploitation Approach

2018-05-15 · Leonard Adolphs, Hadi Daneshmand, Aurelien Lucchi, Thomas Hofmann

Gradient-based optimization methods are the most popular choice for finding local optima for classical minimization and saddle point problems. Here, we highlight a systemic issue of gradient dynamics that arise for saddl…

Saddle-free Hessian-free Optimization

2015-05-30 · Martin Arjovsky

Nonconvex optimization problems such as the ones in training deep neural networks suffer from a phenomenon called saddle point proliferation. This means that there are a vast number of high error saddle points present in…

Second-order methods

Primal-Dual Sequential Subspace Optimization for Saddle-point Problems

2020-08-20 · Yoni Choukroun, Michael Zibulevsky, Pavel Kisilev

We introduce a new sequential subspace optimization method for large-scale saddle-point problems. It solves iteratively a sequence of auxiliary saddle-point problems in low-dimensional subspaces, spanned by directions de…

Distributed Saddle-Point Problems: Lower Bounds, Near-Optimal and Robust Algorithms

2020-10-25 · Aleksandr Beznosikov, Valentin Samokhin, Alexander Gasnikov

This paper focuses on the distributed optimization of stochastic saddle point problems. The first part of the paper is devoted to lower bounds for the centralized and decentralized distributed methods for smooth (strongl…

Distributed OptimizationFederated Learning