paper-with-me

홈 › Papers

High-Dimensional Prediction for Sequential Decision Making

2023-10-26 · Georgy Noarov, Ramya Ramalingam, Aaron Roth, Stephan Xie

We study the problem of making predictions of an adversarially chosen high-dimensional state that are unbiased subject to an arbitrary collection of conditioning events, with the goal of tailoring these events to downstream decision makers. We give efficient algorithms for solving this problem, as well as a number of applications that stem from choosing an appropriate set of conditioning events. For example, we can efficiently make predictions targeted at polynomially many decision makers, giving each of them optimal swap regret if they best-respond to our predictions. We generalize this to online combinatorial optimization, where the decision makers have a very large action space, to give the first algorithms offering polynomially many decision makers no regret on polynomially many subsequences that may depend on their actions and the context. We apply these results to get efficient no-subsequence-regret algorithms in extensive-form games (EFGs), yielding a new family of regret guarantees for EFGs that generalizes some existing EFG regret notions, e.g. regret to informed causal deviations, and is generally incomparable to other known such notions. Next, we develop a novel transparent alternative to conformal prediction for building valid online adversarial multiclass prediction sets. We produce class scores that downstream algorithms can use for producing valid-coverage prediction sets, as if these scores were the true conditional class probabilities. We show this implies strong conditional validity guarantees including set-size-conditional and multigroup-fair coverage for polynomially many downstream prediction sets. Moreover, our class scores can be guaranteed to have improved $L_2$ loss, cross-entropy loss, and generally any Bregman loss, compared to any collection of benchmark models, yielding a high-dimensional real-valued version of omniprediction.

📄 PDF Abstract BibTeX arXiv:2310.17651

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationConformal PredictionDecision MakingPredictionSequential Decision Makingvalid

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

An Expandable Machine Learning-Optimization Framework to Sequential Decision-Making

2023-11-12 · Dogacan Yilmaz, İ. Esra Büyüktahtakın

We present an integrated prediction-optimization (PredOpt) framework to efficiently solve sequential decision-making problems by predicting the values of binary decision variables in an optimal solution. We address the k…

Combinatorial OptimizationDecision MakingDecoderSequential Decision Making

Human-in-the-loop Active Covariance Learning for Improving Prediction in Small Data Sets

2019-02-26 · Homayun Afrabandpey, Tomi Peltola, Samuel Kaski

Learning predictive models from small high-dimensional data sets is a key problem in high-dimensional statistics. Expert knowledge elicitation can help, and a strong line of work focuses on directly eliciting informative…

Decision MakingSequential Decision MakingSmall Data Image Classification

Translating the Rashomon Effect to Sequential Decision-Making Tasks

2025-12-19 · Dennis Gross, Jørn Eirik Betten, Helge Spieker arxiv

The Rashomon effect describes the phenomenon where multiple models trained on the same data produce identical predictions while differing in which features they rely on internally. This effect has been studied extensivel…

Improving Online Rent-or-Buy Algorithms with Sequential Decision Making and ML Predictions

2020-12-01 · NeurIPS 2020 12 · Soumya Banerjee

In this work we study online rent-or-buy problems as a sequential decision making problem. We show how one can integrate predictions, typically coming from a machine learning (ML) setup, into this framework. Specifically…

BIG-bench Machine LearningDecision MakingSequential Decision Making

Deeply AggreVaTeD: Differentiable Imitation Learning for Sequential Prediction

2017-03-03 · ICML 2017 8 · Wen Sun, Arun Venkatraman, Geoffrey J. Gordon, Byron Boots 외

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal orac…

Decision MakingDependency ParsingImitation LearningPrediction+3