Distributional Multi-Objective Decision Making

2023-05-09 · Willem Röpke, Conor F. Hayes, Patrick Mannion, Enda Howley, Ann Nowé, Diederik M. Roijers

For effective decision support in scenarios with conflicting objectives, sets of potentially optimal solutions can be presented to the decision maker. We explore both what policies these sets should contain and how such sets can be computed efficiently. With this in mind, we take a distributional approach and introduce a novel dominance criterion relating return distributions of policies directly. Based on this criterion, we present the distributional undominated set and show that it contains optimal policies otherwise ignored by the Pareto front. In addition, we propose the convex distributional undominated set and prove that it comprises all policies that maximise expected utility for multivariate risk-averse decision makers. We propose a novel algorithm to learn the distributional undominated set and further contribute pruning operators to reduce the set to the convex distributional undominated set. Through experiments, we demonstrate the feasibility and effectiveness of these methods, making this a valuable new approach for decision support in real-world problems.

📄 PDF Abstract BibTeX arXiv:2305.05560

Code (1)

wilrop/distributional-dominance 공식 구현

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Risk Aware and Multi-Objective Decision Making with Distributional Monte Carlo Tree Search

2021-02-01 · Conor F. Hayes, Mathieu Reymond, Diederik M. Roijers, Enda Howley 외

In many risk-aware and multi-objective reinforcement learning settings, the utility of the user is derived from the single execution of a policy. In these settings, making decisions based on the average future returns is…

Decision Making Multi-Objective Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Wasserstein Distributionally Robust Inverse Multiobjective Optimization

2020-09-30 · Chaosheng Dong, Bo Zeng

Inverse multiobjective optimization provides a general framework for the unsupervised learning task of inferring parameters of a multiobjective decision making problem (DMP), based on a set of observed decisions from the…

Decision Making Multiobjective Optimization Portfolio Optimization

Data-Driven Offline Decision-Making via Invariant Representation Learning

2022-11-21 · Han Qi, Yi Su, Aviral Kumar, Sergey Levine

The goal in offline data-driven decision-making is synthesize decisions that optimize a black-box utility function, using a previously-collected static dataset, with no active interaction. These problems appear in many f…

Decision Making Domain Adaptation Reinforcement Learning (RL)Representation Learning

Distributionally Robust Optimization with Adversarial Data Contamination

2025-07-14 · Shuyao Li, Ilias Diakonikolas, Jelena Diakonikolas arxiv

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a pri…

Monte Carlo Tree Search Algorithms for Risk-Aware and Multi-Objective Reinforcement Learning

2022-11-23 · Conor F. Hayes, Mathieu Reymond, Diederik M. Roijers, Enda Howley 외

In many risk-aware and multi-objective reinforcement learning settings, the utility of the user is derived from a single execution of a policy. In these settings, making decisions based on the average future returns is n…

Multi-Objective Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1