paper-with-me

홈 › Papers

Scalable Dynamic Distributed Constraint Optimization with Metareasoning and Application to Continual Satellite Operations

2026-01-08 · Itai Zilberstein, Steve Chien arxiv

Dynamic distributed constraint optimization problems (DDCOPs) provide a general framework for coordinating autonomous agents in changing environments. However, existing DDCOP formulations do not adequately address settings where optimization and execution overlap, resources persist across time, and agents operate under limited computational and communication constraints. We extend the DDCOP model to address these challenges by introducing an execution-aware formulation, together with new algorithms and frameworks for efficiently computing solutions. We develop a general framework for metareasoning in DDCOPs, enabling agents to determine when the estimated benefit of recomputing solutions outweighs its computational cost. We further extend the neighborhood stochastic search algorithm to the dynamic setting, introducing dynamic incremental neighborhood stochastic search (D-NSS), a scalable decomposition-based DDCOP algorithm that efficiently repairs previous solutions in response to problem dynamics. We apply our methods to the real-world application of large-scale satellite scheduling. Deploying autonomy to satellites requires efficient computation and communication in the face of highly dynamic environments. We demonstrate that D-NSS stabilizes to high-quality solutions, outperforming standard DDCOP baselines in solution quality, computation time, and message volume, while our metareasoning framework successfully balances resource conservation with utility. These methods will support the NASA FAME mission, the largest in-space demonstration of distributed multi-agent AI to date.

📄 PDF Abstract BibTeX arXiv:2601.06188

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Metareasoning for Planning Under Uncertainty

2015-05-03 · Christopher H. Lin, Andrey Kolobov, Ece Kamar, Eric Horvitz

The conventional model for online planning under uncertainty assumes that an agent can stop and plan without incurring costs for the time spent planning. However, planning time is not free in most real-world settings. Fo…

Metareasoning in uncertain environments: a meta-BAMDP framework

2024-08-02 · Prakhar Godara, Tilman Diego Aléman, Angela J. Yu

\textit{Reasoning} may be viewed as an algorithm $P$ that makes a choice of an action $a^* \in \mathcal{A}$, aiming to optimize some outcome. However, executing $P$ itself bears costs (time, energy, limited capacity, etc…

Decision Making

Ideal Partition of Resources for Metareasoning

2021-10-18 · Eric Horvitz, John Breese

We can achieve significant gains in the value of computation by metareasoning about the nature or extent of base-level problem solving before executing a solution. However, resources that are irrevocably committed to met…

Learning to select computations

2017-11-18 · Frederick Callaway, Sayan Gul, Paul M. Krueger, Thomas L. Griffiths 외

The efficient use of limited computational resources is an essential ingredient of intelligence. Selecting computations optimally according to rational metareasoning would achieve this, but this is computationally intrac…

Management

Distributed Direct Preference Optimization

2026-05-20 · Zhanhong Jiang arxiv

Preference-based reinforcement learning (RL) is a key paradigm for aligning policies with human judgments, yet its theoretical behavior in distributed settings where preference data are fragmented across heterogeneous us…

Reinforcement LearningOffline RL