paper-with-me

Papers

Beyond Explainability: The Case for AI Validation

2025-05-27 · Dalit Ken-Dror Feldman, Daniel Benoliel

Artificial Knowledge (AK) systems are transforming decision-making across critical domains such as healthcare, finance, and criminal justice. However, their growing opacity presents governance challenges that current regulatory approaches, focused predominantly on explainability, fail to address adequately. This article argues for a shift toward validation as a central regulatory pillar. Validation, ensuring the reliability, consistency, and robustness of AI outputs, offers a more practical, scalable, and risk-sensitive alternative to explainability, particularly in high-stakes contexts where interpretability may be technically or economically unfeasible. We introduce a typology based on two axes, validity and explainability, classifying AK systems into four categories and exposing the trade-offs between interpretability and output reliability. Drawing on comparative analysis of regulatory approaches in the EU, US, UK, and China, we show how validation can enhance societal trust, fairness, and safety even where explainability is limited. We propose a forward-looking policy framework centered on pre- and post-deployment validation, third-party auditing, harmonized standards, and liability incentives. This framework balances innovation with accountability and provides a governance roadmap for responsibly integrating opaque, high-performing AK systems into society.

📄 PDF Abstract BibTeX arXiv:2505.21570

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

Extended Empirical Validation of the Explainability Solution Space

2026-03-01 · Antoni Mestre, Manoli Albert, Miriam Gil, Vicente Pelechano arxiv

This technical report provides an extended validation of the Explainability Solution Space (ESS) through cross-domain evaluation. While initial validation focused on employee attrition prediction, this study introduces a…

Beyond Known Reality: Exploiting Counterfactual Explanations for Medical Research

2023-07-05 · Toygar Tanyel, Serkan Ayvaz, Bilgin Keserci

The field of explainability in artificial intelligence (AI) has witnessed a growing number of studies and increasing scholarly interest. However, the lack of human-friendly and individual interpretations in explaining th…

counterfactualData AugmentationDecision Making

Unlocking Layer-wise Relevance Propagation for Autoencoders

2023-03-21 · Kenyu Kobayashi, Renata Khasanova, Arno Schneuwly, Felix Schmidt 외

Autoencoders are a powerful and versatile tool often used for various problems such as anomaly detection, image processing and machine translation. However, their reconstructions are not always trivial to explain. Theref…

Anomaly DetectionMachine TranslationTranslation

Explainable AI for clinical risk prediction: a survey of concepts, methods, and modalities

2023-08-16 · Munib Mesinovic, Peter Watkinson, Tingting Zhu

Recent advancements in AI applications to healthcare have shown incredible promise in surpassing human performance in diagnosis and disease prognosis. With the increasing complexity of AI models, however, concerns regard…

Decision MakingExplainable ModelsFairnessPrediction+1

Rad4XCNN: a new agnostic method for post-hoc global explanation of CNN-derived features by means of radiomics

2024-04-26 · Francesco Prinzi, Carmelo Militello, Calogero Zarcaro, Tommaso Vincenzo Bartolotta 외

In recent years, machine learning-based clinical decision support systems (CDSS) have played a key role in the analysis of several medical conditions. Despite their promising capabilities, the lack of transparency in AI …

Cancer Classification