BEExAI: Benchmark to Evaluate Explainable AI
Recent research in explainability has given rise to numerous post-hoc attribution methods aimed at enhancing our comprehension of the outputs of black-box machine learning models. However, evaluating the quality of explanations lacks a cohesive approach and a consensus on the methodology for deriving quantitative metrics that gauge the efficacy of explainability post-hoc attribution methods. Furthermore, with the development of increasingly complex deep learning models for diverse data applications, the need for a reliable way of measuring the quality and correctness of explanations is becoming critical. We address this by proposing BEExAI, a benchmark tool that allows large-scale comparison of different post-hoc XAI methods, employing a set of selected evaluation metrics.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ExCAM: Explainable Cultural Awareness Metrics
Evaluating the cultural awareness of large language models is crucial to ensure the fairness of generated text and the generalizability of applications across the world. Recent benchmarks explore cultural goods like food…
Question AnsweringText GenerationFFA-IR: Towards an Explainable and Reliable Medical Report Generation Benchmark
The automatic generation of long and coherent medical reports given medical images (e.g. Chest X-ray and Fundus Fluorescein Angiography (FFA)) has great potential to support clinical practice. Researchers have explored a…
DiagnosticMedical Report GenerationText GenerationExplainable Deepfake Detection Challenge
Deepfake detection is moving beyond binary classification decisions toward systems that can also explain the visual evidence supporting those decisions. This transition is important for real-world verification settings, …
Explanation GenerationBinary ClassificationImage ClassificationSemantic SimilarityExDDV: A New Dataset for Explainable Deepfake Detection in Video
The ever growing realism and quality of generated videos makes it increasingly harder for humans to spot deepfake content, who need to rely more and more on automatic deepfake detectors. However, deepfake detectors are a…
DeepFake DetectionExplainable ModelsFace SwappingIn-Context Learning+1Algebraically Explainable Controllers: Decision Trees and Support Vector Machines Join Forces
Recently, decision trees (DT) have been used as an explainable representation of controllers (a.k.a. strategies, policies, schedulers). Although they are often very efficient and produce small and understandable controll…