paper-with-me

홈 › Papers

Deep Learning for Sequential Decision Making under Uncertainty: Foundations, Frameworks, and Frontiers

2026-04-13 · I. Esra Buyuktahtakin arxiv

Artificial intelligence (AI) is moving increasingly beyond prediction to support decisions in complex, uncertain, and dynamic environments. This shift creates a natural intersection with operations research and management sciences (OR/MS), which have long offered conceptual and methodological foundations for sequential decision-making under uncertainty. At the same time, recent advances in deep learning, including feedforward neural networks, LSTMs, transformers, and deep reinforcement learning, have expanded the scope of data-driven modeling and opened new possibilities for large-scale decision systems. This tutorial presents an OR/MS-centered perspective on deep learning for sequential decision-making under uncertainty. Its central premise is that deep learning is valuable not as a replacement for optimization, but as a complement to it. Deep learning brings adaptability and scalable approximation, whereas OR/MS provides the structural rigor needed to represent constraints, recourse, and uncertainty. The tutorial reviews key decision-making foundations, connects them to the major neural architectures in modern AI, and discusses leading approaches to integrating learning and optimization. It also highlights emerging impact in domains such as supply chains, healthcare and epidemic response, agriculture, energy, and autonomous operations. More broadly, it frames these developments as part of a wider transition from predictive AI toward decision-capable AI and highlights the role of OR/MS in shaping the next generation of integrated learning--optimization systems.

📄 PDF Abstract BibTeX arXiv:2604.11507

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningDecision Making

Similar Papers 제목 키워드 기반

A Survey of Knowledge-based Sequential Decision Making under Uncertainty

2020-08-19 · Shiqi Zhang, Mohan Sridharan

Reasoning with declarative knowledge (RDK) and sequential decision-making (SDM) are two key research areas in artificial intelligence. RDK methods reason with declarative domain knowledge, including commonsense knowledge…

Decision MakingDecision Making Under Uncertaintyreinforcement-learningReinforcement Learning (RL)+1

On Consequentialism and Fairness

2020-01-02 · Dallas Card, Noah A. Smith

Recent work on fairness in machine learning has primarily emphasized how to define, quantify, and encourage "fair" outcomes. Less attention has been paid, however, to the ethical foundations which underlie such efforts. …

BIG-bench Machine LearningDecision MakingEthicsFairness

Uncertainty as a Planning Signal: Multi-Turn Decision Making for Goal-Oriented Conversation

2026-04-05 · Xinyi Ling, Ye Liu, Reza Averly, Xia Ning arxiv

Goal-oriented conversational systems require making sequential decisions under uncertainty about the user's intent, where the algorithm must balance information acquisition and target commitment over multiple turns. Exis…

Decision Making

Decision Theoretic Foundations for Conformal Prediction: Optimal Uncertainty Quantification for Risk-Averse Agents

2025-02-04 · Shayan Kiyani, George Pappas, Aaron Roth, Hamed Hassani

A fundamental question in data-driven decision making is how to quantify the uncertainty of predictions in ways that can usefully inform downstream action. This interface between prediction uncertainty and decision-makin…

Conformal PredictionDecision MakingMedical DiagnosisPrediction+2

Counterfactual Explanations in Sequential Decision Making Under Uncertainty

2021-07-06 · NeurIPS 2021 12 · Stratis Tsirtsis, Abir De, Manuel Gomez-Rodriguez

Methods to find counterfactual explanations have predominantly focused on one step decision making processes. In this work, we initiate the development of methods to find counterfactual explanations for decision making p…

counterfactualCounterfactual ExplanationDecision MakingDecision Making Under Uncertainty+1