paper-with-me

Papers

XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniques

2024-02-20 · Yu Xiong, Zhipeng Hu, Ye Huang, Runze Wu, Kai Guan, Xingchen Fang, Ji Jiang, Tianze Zhou, Yujing Hu, Haoyu Liu, Tangjie Lyu, Changjie Fan

Reinforcement Learning (RL) has demonstrated substantial potential across diverse fields, yet understanding its decision-making process, especially in real-world scenarios where rationality and safety are paramount, is an ongoing challenge. This paper delves in to Explainable RL (XRL), a subfield of Explainable AI (XAI) aimed at unravelling the complexities of RL models. Our focus rests on state-explaining techniques, a crucial subset within XRL methods, as they reveal the underlying factors influencing an agent's actions at any given time. Despite their significant role, the lack of a unified evaluation framework hinders assessment of their accuracy and effectiveness. To address this, we introduce XRL-Bench, a unified standardized benchmark tailored for the evaluation and comparison of XRL methods, encompassing three main modules: standard RL environments, explainers based on state importance, and standard evaluators. XRL-Bench supports both tabular and image data for state explanation. We also propose TabularSHAP, an innovative and competitive XRL method. We demonstrate the practical utility of TabularSHAP in real-world online gaming services and offer an open-source benchmark platform for the straightforward implementation and evaluation of XRL methods. Our contributions facilitate the continued progression of XRL technology.

📄 PDF Abstract BibTeX arXiv:2402.12685

Code (1)

fuxiailab/xrl-bench 공식 구현 pytorch

Tasks

Decision MakingReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Evaluating RL Explainability Methods by How Much They Help Fix Bugs in Agents

2026-08-18 · Ram Rachum, Yotam Amitai, Bálint Gyevnár, Reuth Mirsky 외 arxiv

This preliminary paper outlines a planned evaluation benchmark for Explainable Reinforcement Learning (XRL) methods. Current evaluations rely on functionally-grounded metrics like faithfulness and compactness, and on hum…

Reinforcement Learning

The Arcade Learning Environment: An Evaluation Platform for General Agents

2012-07-19 · Marc G. Bellemare, Yavar Naddaf, Joel Veness, Michael Bowling

In this article we introduce the Arcade Learning Environment (ALE): both a challenge problem and a platform and methodology for evaluating the development of general, domain-independent AI technology. ALE provides an int…

Atari GamesBenchmarkingImitation Learningreinforcement-learning+3

$\mathbf{(N,K)}$-Puzzle: A Cost-Efficient Testbed for Benchmarking Reinforcement Learning Algorithms in Generative Language Model

2024-03-11 · Yufeng Zhang, Liyu Chen, Boyi Liu, Yingxiang Yang 외

Recent advances in reinforcement learning (RL) algorithms aim to enhance the performance of language models at scale. Yet, there is a noticeable absence of a cost-effective and standardized testbed tailored to evaluating…

BenchmarkingLanguage ModelingLanguage Modellingreinforcement-learning+1

Explainable Benchmarking through the Lense of Concept Learning

2025-10-23 · Quannian Zhang, Michael Röder, Nikit Srivastava, N'Dah Jean Kouagou 외 arxiv

Evaluating competing systems in a comparable way, i.e., benchmarking them, is an undeniable pillar of the scientific method. However, system performance is often summarized via a small number of metrics. The analysis of …

Question AnsweringKnowledge Graphs

Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection

2026-08-17 · Bowen Deng, Jiahui Zhan, Yikun Ji, Haozhen Yan 외 arxiv

The rapid progress of image generation models calls for AI-generated image (AIGI) detectors that are not only accurate but also explainable and reliable. While MLLM-based detectors can provide natural language explanatio…

Reinforcement LearningVisual GroundingImage Generation