paper-with-me

홈 › Papers

Plan Explanations as Model Reconciliation: Moving Beyond Explanation as Soliloquy

2017-01-28 · Tathagata Chakraborti, Sarath Sreedharan, Yu Zhang, Subbarao Kambhampati

When AI systems interact with humans in the loop, they are often called on to provide explanations for their plans and behavior. Past work on plan explanations primarily involved the AI system explaining the correctness of its plan and the rationale for its decision in terms of its own model. Such soliloquy is wholly inadequate in most realistic scenarios where the humans have domain and task models that differ significantly from that used by the AI system. We posit that the explanations are best studied in light of these differing models. In particular, we show how explanation can be seen as a "model reconciliation problem" (MRP), where the AI system in effect suggests changes to the human's model, so as to make its plan be optimal with respect to that changed human model. We will study the properties of such explanations, present algorithms for automatically computing them, and evaluate the performance of the algorithms.

📄 PDF Abstract BibTeX arXiv:1701.08317

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Plan Explanations as Model Reconciliation -- An Empirical Study

2018-02-03 · Tathagata Chakraborti, Sarath Sreedharan, Sachin Grover, Subbarao Kambhampati

Recent work in explanation generation for decision making agents has looked at how unexplained behavior of autonomous systems can be understood in terms of differences in the model of the system and the human's understan…

Decision MakingExplanation Generationmodel

On Generating Monolithic and Model Reconciling Explanations in Probabilistic Scenarios

2024-05-29 · Stylianos Loukas Vasileiou, William Yeoh, Alessandro Previti, Tran Cao Son

Explanation generation frameworks aim to make AI systems' decisions transparent and understandable to human users. However, generating explanations in uncertain environments characterized by incomplete information and pr…

Explanation Generation

Explainable Knowledge Graph Embedding: Inference Reconciliation for Knowledge Inferences Supporting Robot Actions

2022-05-04 · Angel Daruna, Devleena Das, Sonia Chernova

Learned knowledge graph representations supporting robots contain a wealth of domain knowledge that drives robot behavior. However, there does not exist an inference reconciliation framework that expresses how a knowledg…

Decision MakingGraph EmbeddingKnowledge Graph EmbeddingSequential Decision Making

Model-Free Model Reconciliation

2019-03-17 · Sarath Sreedharan, Alberto Olmo, Aditya Prasad Mishra, Subbarao Kambhampati

Designing agents capable of explaining complex sequential decisions remain a significant open problem in automated decision-making. Recently, there has been a lot of interest in developing approaches for generating such …

Decision MakingmodelPhilosophy

Algorithmic Recourse: from Counterfactual Explanations to Interventions

2020-02-14 · Amir-Hossein Karimi, Bernhard Schölkopf, Isabel Valera

As machine learning is increasingly used to inform consequential decision-making (e.g., pre-trial bail and loan approval), it becomes important to explain how the system arrived at its decision, and also suggest actions …

counterfactualDecision Making