Plan Explanations as Model Reconciliation: Moving Beyond Explanation as Soliloquy
When AI systems interact with humans in the loop, they are often called on to provide explanations for their plans and behavior. Past work on plan explanations primarily involved the AI system explaining the correctness of its plan and the rationale for its decision in terms of its own model. Such soliloquy is wholly inadequate in most realistic scenarios where the humans have domain and task models that differ significantly from that used by the AI system. We posit that the explanations are best studied in light of these differing models. In particular, we show how explanation can be seen as a "model reconciliation problem" (MRP), where the AI system in effect suggests changes to the human's model, so as to make its plan be optimal with respect to that changed human model. We will study the properties of such explanations, present algorithms for automatically computing them, and evaluate the performance of the algorithms.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Plan Explanations as Model Reconciliation -- An Empirical Study
Recent work in explanation generation for decision making agents has looked at how unexplained behavior of autonomous systems can be understood in terms of differences in the model of the system and the human's understan…
Decision MakingExplanation GenerationmodelOn Generating Monolithic and Model Reconciling Explanations in Probabilistic Scenarios
Explanation generation frameworks aim to make AI systems' decisions transparent and understandable to human users. However, generating explanations in uncertain environments characterized by incomplete information and pr…
Explanation GenerationExplainable Knowledge Graph Embedding: Inference Reconciliation for Knowledge Inferences Supporting Robot Actions
Learned knowledge graph representations supporting robots contain a wealth of domain knowledge that drives robot behavior. However, there does not exist an inference reconciliation framework that expresses how a knowledg…
Decision MakingGraph EmbeddingKnowledge Graph EmbeddingSequential Decision MakingModel-Free Model Reconciliation
Designing agents capable of explaining complex sequential decisions remain a significant open problem in automated decision-making. Recently, there has been a lot of interest in developing approaches for generating such …
Decision MakingmodelPhilosophyAlgorithmic Recourse: from Counterfactual Explanations to Interventions
As machine learning is increasingly used to inform consequential decision-making (e.g., pre-trial bail and loan approval), it becomes important to explain how the system arrived at its decision, and also suggest actions …
counterfactualDecision Making