paper-with-me

홈 › Papers

On Interpretability and Similarity in Concept-Based Machine Learning

2021-02-25 · Léonard Kwuida, Dmitry I. Ignatov

Machine Learning (ML) provides important techniques for classification and predictions. Most of these are black-box models for users and do not provide decision-makers with an explanation. For the sake of transparency or more validity of decisions, the need to develop explainable/interpretable ML-methods is gaining more and more importance. Certain questions need to be addressed: How does an ML procedure derive the class for a particular entity? Why does a particular clustering emerge from a particular unsupervised ML procedure? What can we do if the number of attributes is very large? What are the possible reasons for the mistakes for concrete cases and models? For binary attributes, Formal Concept Analysis (FCA) offers techniques in terms of intents of formal concepts, and thus provides plausible reasons for model prediction. However, from the interpretable machine learning viewpoint, we still need to provide decision-makers with the importance of individual attributes to the classification of a particular object, which may facilitate explanations by experts in various domains with high-cost errors like medicine or finance. We discuss how notions from cooperative game theory can be used to assess the contribution of individual attributes in classification and clustering processes in concept-based machine learning. To address the 3rd question, we present some ideas on how to reduce the number of attributes using similarities in large contexts.

📄 PDF Abstract BibTeX arXiv:2102.12723

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningClusteringGeneral ClassificationInterpretable Machine Learning

Similar Papers 제목 키워드 기반

On the Impact of Knowledge Distillation for Model Interpretability

2023-05-25 · Hyeongrok Han, Siwon Kim, Hyun-Soo Choi, Sungroh Yoon

Several recent studies have elucidated why knowledge distillation (KD) improves model performance. However, few have researched the other advantages of KD in addition to its improving model performance. In this study, we…

Knowledge Distillation

Interpretable Measures of Conceptual Similarity by Complexity-Constrained Descriptive Auto-Encoding

2024-02-14 · CVPR 2024 1 · Alessandro Achille, Greg Ver Steeg, Tian Yu Liu, Matthew Trager 외

Quantifying the degree of similarity between images is a key copyright issue for image-based machine learning. In legal doctrine however, determining the degree of similarity between works requires subjective analysis, a…

Descriptivetext similarity

Enforcing Interpretability in Time Series Transformers: A Concept Bottleneck Framework

2024-10-08 · Angela van Sprang, Erman Acar, Willem Zuidema

There has been a recent push of research on Transformer-based models for long-term time series forecasting, even though they are inherently difficult to interpret and explain. While there is a large body of work on inter…

Time SeriesTime Series Forecasting

ConceptHash: Interpretable Fine-Grained Hashing via Concept Discovery

2024-06-12 · Kam Woh Ng, Xiatian Zhu, Yi-Zhe Song, Tao Xiang

Existing fine-grained hashing methods typically lack code interpretability as they compute hash code bits holistically using both global and local features. To address this limitation, we propose ConceptHash, a novel met…

Image Retrieval

Universal Conceptual Structure in Neural Translation: Probing NLLB-200's Multilingual Geometry

2026-02-27 · Kyle Elliott Mathewson arxiv

Do neural machine translation models learn language-universal conceptual representations, or do they merely cluster languages by surface similarity? We investigate this question by probing the representation geometry of …

Machine Translation