paper-with-me

홈 › Papers

Multi-criteria Rank-based Aggregation for Explainable AI

2025-05-30 · Sujoy Chatterjee, Everton Romanzini Colombo, Marcos Medeiros Raimundo

Explainability is crucial for improving the transparency of black-box machine learning models. With the advancement of explanation methods such as LIME and SHAP, various XAI performance metrics have been developed to evaluate the quality of explanations. However, different explainers can provide contrasting explanations for the same prediction, introducing trade-offs across conflicting quality metrics. Although available aggregation approaches improve robustness, reducing explanations' variability, very limited research employed a multi-criteria decision-making approach. To address this gap, this paper introduces a multi-criteria rank-based weighted aggregation method that balances multiple quality metrics simultaneously to produce an ensemble of explanation models. Furthermore, we propose rank-based versions of existing XAI metrics (complexity, faithfulness and stability) to better evaluate ranked feature importance explanations. Extensive experiments on publicly available datasets demonstrate the robustness of the proposed model across these metrics. Comparative analyses of various multi-criteria decision-making and rank aggregation algorithms showed that TOPSIS and WSUM are the best candidates for this use case.

📄 PDF Abstract BibTeX arXiv:2505.24612

Code (1)

hiaac-finance/xai_aggregation 공식 구현

Tasks

Decision MakingFeature Importance

Methods 이 논문이 사용한 방법론

SHAP 설명 없음
LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…

Similar Papers 제목 키워드 기반

Towards Explainable TOPSIS: Visual Insights into the Effects of Weights and Aggregations on Rankings

2023-06-13 · Robert Susmaga, Izabela Szczech, Dariusz Brzezinski

Multi-Criteria Decision Analysis (MCDA) is extensively used across diverse industries to assess and rank alternatives. Among numerous MCDA methods developed to solve real-world ranking problems, TOPSIS remains one of the…

Ranking alternatives from opinions on criteria

2025-04-09 · Takahiro Suzuki, Stefano Moretti, Michele Aleandri

A primary challenge in collective decision-making is that achieving unanimous agreement is difficult, even at the level of criteria. The history of social choice theory illustrates this: numerous normative criteria on vo…

Decision Making

A novel active learning framework for classification: using weighted rank aggregation to achieve multiple query criteria

2018-09-27 · Yu Zhao, Zhenhui Shi, Jingyang Zhang, Dong Chen 외

Multiple query criteria active learning (MQCAL) methods have a higher potential performance than conventional active learning methods in which only one criterion is deployed for sample selection. A central issue related …

Active LearningGeneral Classification

Transforming User Defined Criteria into Explainable Indicators with an Integrated LLM AHP System

2025-11-12 · Geonwoo Bang, Dongho Kim, Moohong Min arxiv

Evaluating complex texts across domains requires converting user defined criteria into quantitative, explainable indicators, which is a persistent challenge in search and recommendation systems. Single prompt LLM evaluat…

Recommendation Systems

On the use of Aggregation Operators to improve Human Identification using Dental Records

2026-03-24 · Antonio D. Villegas-Yeguas, Guillermo R-García, Tzipi Kahana, Jorge Pinares Toledo 외 arxiv

The comparison of dental records is a standardized technique in forensic dentistry used to speed up the identification of individuals in multiple-comparison scenarios. Specifically, the odontogram comparison is a procedu…