paper-with-me

Papers

BEExAI: Benchmark to Evaluate Explainable AI

2024-07-29 · Samuel Sithakoul, Sara Meftah, Clément Feutry

Recent research in explainability has given rise to numerous post-hoc attribution methods aimed at enhancing our comprehension of the outputs of black-box machine learning models. However, evaluating the quality of explanations lacks a cohesive approach and a consensus on the methodology for deriving quantitative metrics that gauge the efficacy of explainability post-hoc attribution methods. Furthermore, with the development of increasingly complex deep learning models for diverse data applications, the need for a reliable way of measuring the quality and correctness of explanations is becoming critical. We address this by proposing BEExAI, a benchmark tool that allows large-scale comparison of different post-hoc XAI methods, employing a set of selected evaluation metrics.

📄 PDF Abstract BibTeX arXiv:2407.19897

Code (1)

squareresearchcenter-ai/beexai 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

ExCAM: Explainable Cultural Awareness Metrics

2026-05-28 · Christoph Leiter, Haiyue Song, Hour Kaing, Jin Tei 외 arxiv

Evaluating the cultural awareness of large language models is crucial to ensure the fairness of generated text and the generalizability of applications across the world. Recent benchmarks explore cultural goods like food…

Question AnsweringText Generation

FFA-IR: Towards an Explainable and Reliable Medical Report Generation Benchmark

2021-08-19 · Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2) 2021 8 · Mingjie Li, Wenjia Cai, Rui Liu, Yuetian Weng 외

The automatic generation of long and coherent medical reports given medical images (e.g. Chest X-ray and Fundus Fluorescein Angiography (FFA)) has great potential to support clinical practice. Researchers have explored a…

DiagnosticMedical Report GenerationText Generation

Explainable Deepfake Detection Challenge

2026-07-23 · Abhijeet Narang, Kartik Kuckreja, Shreya Ghosh, Muhammad Haris Khan 외 arxiv

Deepfake detection is moving beyond binary classification decisions toward systems that can also explain the visual evidence supporting those decisions. This transition is important for real-world verification settings, …

Explanation GenerationBinary ClassificationImage ClassificationSemantic Similarity

ExDDV: A New Dataset for Explainable Deepfake Detection in Video

2025-03-18 · Vlad Hondru, Eduard Hogea, Darian Onchis, Radu Tudor Ionescu

The ever growing realism and quality of generated videos makes it increasingly harder for humans to spot deepfake content, who need to rely more and more on automatic deepfake detectors. However, deepfake detectors are a…

DeepFake DetectionExplainable ModelsFace SwappingIn-Context Learning+1

Algebraically Explainable Controllers: Decision Trees and Support Vector Machines Join Forces

2022-08-26 · Florian Jüngermann, Jan Křetínský, Maximilian Weininger

Recently, decision trees (DT) have been used as an explainable representation of controllers (a.k.a. strategies, policies, schedulers). Although they are often very efficient and produce small and understandable controll…