Markov Decision Processes For Multi-Objective Satellite Task Planning

2019-10-18

This paper presents a semi-Markov decision process (SMDP) formulation of the satellite task scheduling problem. This formulation can consider multiple operational objectives simultaneously and plan transitions between distinct functional modes. We consider the problem of scheduling image collections, ground contacts, sun-pointed periods for battery recharging, and data recorder management for an agile, resource-constrained Earth-observing spacecraft. By considering multiple mission objectives simultaneously, the algorithm is able to find optimized task schedule that satisfies all operational constraints in a single planning step, thus reducing the operational complexity and number of steps involved in mission planning. We present two solution approaches based on forward search and Monte Carlo Tree search. We baseline against rule-based, graph search, and mixed-integer-linear programming approaches. The SMDP formulation is evaluated in both single-objective and multi-objective scenarios. The SMDP solution is found to perform comparably with the baseline methods at greatly increased speed in single-objective scenarios and greater schedule reward in multi-objective.

📄 PDF Abstract BibTeX arXiv:1910.08419

Code (0)

등록된 구현이 없습니다.

Tasks

ManagementSchedulingTask Planning

Omega-Regular Decision Processes

2023-12-14 · Ernst Moritz Hahn, Mateo Perez, Sven Schewe, Fabio Somenzi 외

Regular decision processes (RDPs) are a subclass of non-Markovian decision processes where the transition and reward functions are guarded by some regular property of the past (a lookback). While RDPs enable intuitive an…

Intrinsically Motivated Hierarchical Policy Learning in Multi-objective Markov Decision Processes

2023-08-18 · Sherif Abdelfattah, Kathryn Merrick, Jiankun Hu

Multi-objective Markov decision processes are sequential decision-making problems that involve multiple conflicting reward functions that cannot be optimized simultaneously without a compromise. This type of problems can…

Decision Making Multi-Objective Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Approximation of Lorenz-Optimal Solutions in Multiobjective Markov Decision Processes

2013-09-26 · Patrice Perny, Paul Weng, Judy Goldsmith, Josiah Hanna

This paper is devoted to fair optimization in Multiobjective Markov Decision Processes (MOMDPs). A MOMDP is an extension of the MDP model for planning under uncertainty while trying to optimize several reward functions s…

Decision Making for Autonomous Vehicles

2023-04-27 · Xinchen Li, Levent Guvenc, Bilin Aksun-Guvenc

This paper is on decision making of autonomous vehicles for handling roundabouts. The round intersection is introduced first followed by the Markov Decision Processes (MDP), the Partially Observable Markov Decision Proce…

Autonomous Vehicles Decision Making

Risk-Aware General-Utility Markov Decision Processes

2026-07-10 · Pedro P. Santos, Fábio Vital, Alberto Sardinha, Francisco S. Melo arxiv

We study general-utility Markov decision processes (GUMDPs) with risk-aware objectives. In this framework, an agent aims to optimize a risk measure of the distribution of objective values, where the objective function de…