paper-with-me

Papers

Primal-dual algorithm for contextual stochastic combinatorial optimization

2025-05-07 · Louis Bouvier, Thibault Prunet, Vincent Leclère, Axel Parmentier

This paper introduces a novel approach to contextual stochastic optimization, integrating operations research and machine learning to address decision-making under uncertainty. Traditional methods often fail to leverage contextual information, which underscores the necessity for new algorithms. In this study, we utilize neural networks with combinatorial optimization layers to encode policies. Our goal is to minimize the empirical risk, which is estimated from past data on uncertain parameters and contexts. To that end, we present a surrogate learning problem and a generic primal-dual algorithm that is applicable to various combinatorial settings in stochastic optimization. Our approach extends classic Fenchel-Young loss results and introduces a new regularization method using sparse perturbations on the distribution simplex. This allows for tractable updates in the original space and can accommodate diverse objective functions. We demonstrate the linear convergence of our algorithm under certain conditions and provide a bound on the non-optimality of the resulting policy in terms of the empirical risk. Experiments on a contextual stochastic minimum weight spanning tree problem show that our algorithm is efficient and scalable, achieving performance comparable to imitation learning of solutions computed using an expensive Lagrangian-based heuristic.

📄 PDF Abstract BibTeX arXiv:2505.04757

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationDecision Making Under UncertaintyImitation LearningStochastic Optimization

Similar Papers 제목 키워드 기반

Stochastic Primal-Dual Algorithms with Faster Convergence than $O(1/\sqrt{T})$ for Problems without Bilinear Structure

2019-04-23 · Yan Yan, Yi Xu, Qihang Lin, Lijun Zhang 외

Previous studies on stochastic primal-dual algorithms for solving min-max problems with faster convergence heavily rely on the bilinear structure of the problem, which restricts their applicability to a narrowed range of…

Primal and Dual Combinatorial Dimensions

2021-08-23 · Pieter Kleer, Hans Simon

We give tight bounds on the relation between the primal and dual of various combinatorial dimensions, such as the pseudo-dimension and fat-shattering dimension, for multi-valued function classes. These dimensional notion…

Learning Theory

Stochastic Primal Dual Coordinate Method with Non-Uniform Sampling Based on Optimality Violations

2017-03-21 · Atsushi Shibagaki, Ichiro Takeuchi

We study primal-dual type stochastic optimization algorithms with non-uniform sampling. Our main theoretical contribution in this paper is to present a convergence analysis of Stochastic Primal Dual Coordinate (SPDC) Met…

Stochastic Optimization

An Efficient Pessimistic-Optimistic Algorithm for Stochastic Linear Bandits with General Constraints

2021-02-10 · NeurIPS 2021 12 · Xin Liu, Bin Li, Pengyi Shi, Lei Ying

This paper considers stochastic linear bandits with general nonlinear constraints. The objective is to maximize the expected cumulative reward over horizon $T$ subject to a set of constraints in each round $\tau\leq T$. …

Nearly Optimal Linear Convergence of Stochastic Primal-Dual Methods for Linear Programming

2021-11-10 · Haihao Lu, Jinwen Yang

There is a recent interest on first-order methods for linear programming (LP). In this paper,we propose a stochastic algorithm using variance reduction and restarts for solving sharp primal-dual problems such as LP. We s…