paper-with-me

홈 › Papers

Found in Translation: semantic approaches for enhancing AI interpretability in face verification

2025-01-06 · Miriam Doh, Caroline Mazini Rodrigues, N. Boutry, L. Najman, Matei Mancas, Bernard Gosselin

The increasing complexity of machine learning models in computer vision, particularly in face verification, requires the development of explainable artificial intelligence (XAI) to enhance interpretability and transparency. This study extends previous work by integrating semantic concepts derived from human cognitive processes into XAI frameworks to bridge the comprehension gap between model outputs and human understanding. We propose a novel approach combining global and local explanations, using semantic features defined by user-selected facial landmarks to generate similarity maps and textual explanations via large language models (LLMs). The methodology was validated through quantitative experiments and user feedback, demonstrating improved interpretability. Results indicate that our semantic-based approach, particularly the most detailed set, offers a more nuanced understanding of model decisions than traditional methods. User studies highlight a preference for our semantic explanations over traditional pixelbased heatmaps, emphasizing the benefits of human-centric interpretability in AI. This work contributes to the ongoing efforts to create XAI frameworks that align AI models behaviour with human cognitive processes, fostering trust and acceptance in critical applications.

📄 PDF Abstract BibTeX arXiv:2501.05471

Code (0)

등록된 구현이 없습니다.

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Face Verification

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

LadleNet: A Two-Stage UNet for Infrared Image to Visible Image Translation Guided by Semantic Segmentation

2023-08-12 · Tonghui Zou, Lei Chen

The translation of thermal infrared (TIR) images into visible light (VI) images plays a critical role in enhancing model performance and generalization capability, particularly in various fields such as registration and …

Image RegistrationMS-SSIMSemantic SegmentationSSIM+1

Semantic Pivots Enable Cross-Lingual Transfer in Large Language Models

2025-05-22 · Kaiyu He, Tong Zhou, Yubo Chen, Delai Qiu 외

Large language models (LLMs) demonstrate remarkable ability in cross-lingual tasks. Understanding how LLMs acquire this ability is crucial for their interpretability. To quantify the cross-lingual ability of LLMs accurat…

AttributeCross-Lingual TransferTranslationWord Translation

Adaptive Inner Speech-Text Alignment for LLM-based Speech Translation

2025-03-13 · Henglyu Liu, Andong Chen, Kehai Chen, Xuefeng Bai 외

Recent advancement of large language models (LLMs) has led to significant breakthroughs across various tasks, laying the foundation for the development of LLM-based speech translation systems. Existing methods primarily …

Cross-Modal RetrievalTranslation

Aligning Visual and Semantic Interpretability through Visually Grounded Concept Bottleneck Models

2024-12-16 · Patrick Knab, Katharina Prasse, Sascha Marton, Christian Bartelt 외

The performance of neural networks increases steadily, but our understanding of their decision-making lags behind. Concept Bottleneck Models (CBMs) address this issue by incorporating human-understandable concepts into t…

Specificity

E-VarM: Enhanced Variational Word Masks to Improve the Interpretability of Text Classification Models

2022-10-01 · COLING 2022 10 · Ling Ge, Chunming Hu, Guanghui Ma, Junshuang Wu 외

Enhancing the interpretability of text classification models can help increase the reliability of these models in real-world applications. Currently, most researchers focus on extracting task-specific words from inputs t…

ClassificationContrastive Learningtext-classificationText Classification