paper-with-me

Papers

Actual Causality and Responsibility Attribution in Decentralized Partially Observable Markov Decision Processes

2022-04-01 · Stelios Triantafyllou, Adish Singla, Goran Radanovic

Actual causality and a closely related concept of responsibility attribution are central to accountable decision making. Actual causality focuses on specific outcomes and aims to identify decisions (actions) that were critical in realizing an outcome of interest. Responsibility attribution is complementary and aims to identify the extent to which decision makers (agents) are responsible for this outcome. In this paper, we study these concepts under a widely used framework for multi-agent sequential decision making under uncertainty: decentralized partially observable Markov decision processes (Dec-POMDPs). Following recent works in RL that show correspondence between POMDPs and Structural Causal Models (SCMs), we first establish a connection between Dec-POMDPs and SCMs. This connection enables us to utilize a language for describing actual causality from prior work and study existing definitions of actual causality in Dec-POMDPs. Given that some of the well-known definitions may lead to counter-intuitive actual causes, we introduce a novel definition that more explicitly accounts for causal dependencies between agents' actions. We then turn to responsibility attribution based on actual causality, where we argue that in ascribing responsibility to an agent it is important to consider both the number of actual causes in which the agent participates, as well as its ability to manipulate its own degree of responsibility. Motivated by these arguments we introduce a family of responsibility attribution methods that extends prior work, while accounting for the aforementioned considerations. Finally, through a simulation-based experiment, we compare different definitions of actual causality and responsibility attribution methods. The empirical results demonstrate the qualitative difference between the considered definitions of actual causality and their impact on attributed responsibility.

📄 PDF Abstract BibTeX arXiv:2204.00302

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDecision Making Under UncertaintySequential Decision Making

Similar Papers 제목 키워드 기반

Towards Computationally Efficient Responsibility Attribution in Decentralized Partially Observable MDPs

2023-02-24 · Stelios Triantafyllou, Goran Radanovic

Responsibility attribution is a key concept of accountable multi-agent decision making. Given a sequence of actions, responsibility attribution mechanisms quantify the impact of each participating agent to the final outc…

Card GamesDecision Making

Causal Responsibility Attribution for Human-AI Collaboration

2024-11-05 · Yahang Qi, Bernhard Schölkopf, Zhijing Jin

As Artificial Intelligence (AI) systems increasingly influence decision-making across various fields, the need to attribute responsibility for undesirable outcomes has become essential, though complicated by the complex …

AttributecounterfactualCounterfactual ReasoningDecision Making

Attribution-Scores in Data Management and Explainable Machine Learning

2023-07-31 · Leopoldo Bertossi

We describe recent research on the use of actual causality in the definition of responsibility scores as explanations for query answers in databases, and for outcomes from classification models in machine learning. In th…

ClassificationManagement

Causality and Responsibility for Formal Verification and Beyond

2016-08-29 · Hana Chockler

The theory of actual causality, defined by Halpern and Pearl, and its quantitative measure - the degree of responsibility - was shown to be extremely useful in various areas of computer science due to a good match betwee…

Legal Reasoning

Human Attribution of Causality to AI Across Agency, Misuse, and Misalignment

2026-02-17 · Maria Victoria Carro, David Lagnado arxiv

AI-related incidents are becoming increasingly frequent and severe, ranging from safety failures to misuse by malicious actors. In such complex situations, identifying which elements caused an adverse outcome, the proble…