paper-with-me

홈 › Papers

Behaviour Discovery and Attribution for Explainable Reinforcement Learning

2025-03-19 · Rishav Rishav, Somjit Nath, Vincent Michalski, Samira Ebrahimi Kahou

Explaining the decisions made by reinforcement learning (RL) agents is critical for building trust and ensuring reliability in real-world applications. Traditional approaches to explainability often rely on saliency analysis, which can be limited in providing actionable insights. Recently, there has been growing interest in attributing RL decisions to specific trajectories within a dataset. However, these methods often generalize explanations to long trajectories, potentially involving multiple distinct behaviors. Often, providing multiple more fine grained explanations would improve clarity. In this work, we propose a framework for behavior discovery and action attribution to behaviors in offline RL trajectories. Our method identifies meaningful behavioral segments, enabling more precise and granular explanations associated with high level agent behaviors. This approach is adaptable across diverse environments with minimal modifications, offering a scalable and versatile solution for behavior discovery and attribution for explainable RL.

📄 PDF Abstract BibTeX arXiv:2503.14973

Code (0)

등록된 구현이 없습니다.

Tasks

Offline RLreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

FreqLens: Interpretable Frequency Attribution for Time Series Forecasting

2026-02-09 · Chi-Sheng Chen, Xinyu Zhang, En-Jui Kuo, Guan-Ying Chen 외 arxiv

Time series forecasting models often lack interpretability, limiting their adoption in domains requiring explainable predictions. We propose \textsc{FreqLens}, an interpretable forecasting framework that discovers and at…

Time Series Forecasting

Learning Task Agnostic Skills with Data-driven Guidance

2021-08-04 · ICML Workshop URL 2021 7 · Even Klemsdal, Sverre Herland, Abdulmajid Murad

To increase autonomy in reinforcement learning, agents need to learn useful behaviours without reliance on manually designed reward functions. To that end, skill discovery methods have been used to learn the intrinsic op…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

TREX: Trajectory Explanations for Multi-Objective Reinforcement Learning

2026-03-23 · Dilina Rajapakse, Juan C. Rosero, Ivana Dusparic arxiv

Reinforcement Learning (RL) has demonstrated its ability to solve complex decision-making problems in a variety of domains, by optimizing reward signals obtained through interaction with an environment. However, many rea…

Reinforcement Learning

Discovering Persistent Behavioural Patterns for Interpretable Blockchain Forensics

2026-08-13 · Dorottya Zelenyanszki, Zhe Hou, Kamanashis Biswas, Vallipuram Muthukkumarasamy arxiv

Public blockchain data enables large-scale DeFi-related analysis, but many existing approaches are application-specific, difficult to scale, or hard to interpret. This research proposes a scalable, application-agnostic f…

ConceptSMILE: Auditing the Trustworthiness of Concept-Based Explainable AI

2026-07-10 · Mohadeseh Mollapour, Koorosh Aslansefat, Zeinab Dehghani, Bhupesh Kumar Mishra 외 arxiv

Concept-based explainable artificial intelligence (AI) can make model reasoning more human-understandable, but concept-level outputs are not automatically trustworthy. We introduce ConceptSMILE, a model-agnostic perturba…