paper-with-me

Papers

Learning Decision-Sufficient Representations for Linear Optimization

2026-03-19 · Yuhan Ye, Saurabh Amin, Asuman Ozdaglar arxiv

We study how to construct compressed datasets that suffice to recover optimal decisions in linear programs with an unknown cost vector $c$ lying in a prior set $\mathcal{C}$. Recent work by Bennouna et al. provides an exact geometric characterization of sufficient decision datasets (SDDs) via an intrinsic decision-relevant dimension $d^\star$. However, their algorithm for constructing minimum-size SDDs requires solving mixed-integer programs. In this paper, we establish hardness results showing that computing $d^\star$ is NP-hard and deciding whether a dataset is globally sufficient is coNP-hard, thereby resolving a recent open problem posed by Bennouna et al. To address this worst-case intractability, we introduce pointwise sufficiency, a relaxation that requires sufficiency for an individual cost vector. Under nondegeneracy, we provide a polynomial-time cutting-plane algorithm for constructing pointwise-sufficient decision datasets. In a data-driven regime with i.i.d.\ costs, we further propose a cumulative algorithm that aggregates decision-relevant directions across samples, yielding a stable compression scheme of size at most $d^\star$. This leads to a distribution-free PAC guarantee: with high probability over the training sample, the pointwise sufficiency failure probability on a fresh draw is at most $\tilde{O}(d^\star/n)$, and this rate is tight up to logarithmic factors. Finally, we apply decision-sufficient representations to contextual linear optimization, obtaining compressed predictors with generalization bounds scaling as $\tilde{O}(\sqrt{d^\star/n})$ rather than $\tilde{O}(\sqrt{d/n})$, where $d$ is the ambient cost dimension.

📄 PDF Abstract BibTeX arXiv:2603.18551

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

What Data Enables Optimal Decisions? An Exact Characterization for Linear Optimization

2025-05-27 · Omar Bennouna, Amine Bennouna, Saurabh Amin, Asuman Ozdaglar

We study the fundamental question of how informative a dataset is for solving a given decision-making task. In our setting, the dataset provides partial information about unknown parameters that influence task outcomes. …

Decision Making

Guaranteed Sufficient Decrease for Stochastic Variance Reduced Gradient Optimization

2018-02-26 · Fanhua Shang, Yuanyuan Liu, Kaiwen Zhou, James Cheng 외

In this paper, we propose a novel sufficient decrease technique for stochastic variance reduced gradient descent methods such as SVRG and SAGA. In order to make sufficient decrease for stochastic optimization, we design …

Stochastic Optimization

Directed Regression

2009-12-01 · NeurIPS 2009 12 · Yi-Hao Kao, Benjamin V. Roy, Xiang Yan

When used to guide decisions, linear regression analysis typically involves estimation of regression coefficients via ordinary least squares and their subsequent use to make decisions. When there are multiple response va…

regression

Sampling from Gaussian Process Posteriors using Stochastic Gradient Descent

2023-06-20 · NeurIPS 2023 11 · Jihao Andreas Lin, Javier Antorán, Shreyas Padhy, David Janz 외

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size a…

Bayesian OptimizationDecision MakingGaussian ProcessesSequential Decision Making

Guaranteed Sufficient Decrease for Variance Reduced Stochastic Gradient Descent

2017-03-20 · Fanhua Shang, Yuanyuan Liu, James Cheng, Kelvin Kai Wing Ng 외

In this paper, we propose a novel sufficient decrease technique for variance reduced stochastic gradient descent methods such as SAG, SVRG and SAGA. In order to make sufficient decrease for stochastic optimization, we de…

Stochastic Optimization