paper-with-me

Papers

CB-SLICE: Concept-Based Interpretable Error Slice Discovery

2026-05-28 · Yael Konforti, Mateo Espinosa Zarlenga, Elaf Almahmoud, Mateja Jamnik arxiv

Despite strong average-case performance, deep learning models often exhibit systematic errors on specific population groups, known as error slices. Identifying these groups and the root causes of their failures is critical for model debugging and bias mitigation. However, existing error Slice Discovery Methods (SDMs) typically generate explanations disconnected from the model's inference process, thus only approximating the underlying error source and may be inaccurate. We address this limitation by leveraging Concept Bottleneck Models (CBMs), whose predictions are directly dependent on human-understandable semantic concepts. Since downstream task failures in CBMs commonly arise from concept mispredictions, concept representations provide a strong candidate for error slice identification, offering fine-grained explanations directly linked to the error source. Building on this insight, we introduce CB-SLICE, a concept-based SDM that groups samples with shared concept prediction failures and identifies the keyword concepts most responsible for each slice's failure mode. Across multiple benchmarks, we show that CB-SLICE outperforms state-of-the-art methods in uncovering well-known biases while providing richer and more faithful explanations of model errors.

📄 PDF Abstract BibTeX arXiv:2605.29836

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DebugAgent: Efficient and Interpretable Error Slice Discovery for Comprehensive Model Debugging

2025-01-28 · Muxi Chen, Chenchen Zhao, Qiang Xu

Despite the significant success of deep learning models in computer vision, they often exhibit systematic failures on specific data subsets, known as error slices. Identifying and mitigating these error slices is crucial…

image-classificationImage Classificationobject-detectionObject Detection+2

GH-ESD: Grounded Hypothesis-Driven Error Slice Discovery for Instance-Level Vision Tasks

2025-12-31 · Wei Zhang, Chaoqun Wang, Zixuan Guan, Sam Kao 외 arxiv

Systematic failures of vision models on semantically coherent subsets, known as error slices, reveal limitations in robustness and evaluation. Existing slice discovery approaches largely model slices as clusters in repre…

Object Detection

Domino: Discovering Systematic Errors with Cross-Modal Embeddings

2022-03-24 · ICLR 2022 4 · Sabri Eyuboglu, Maya Varma, Khaled Saab, Jean-Benoit Delbrouck 외

Machine learning models that achieve high overall accuracy often make systematic errors on important subsets (or slices) of data. Identifying underperforming slices is particularly challenging when working with high-dime…

Representation LearningSlice DiscoveryTime Series Analysis

Active Slice Discovery in Large Language Models

2025-11-24 · Minhui Zhang, Prahar Ijner, Yoav Wald, Elliot Creager arxiv

Large Language Models (LLMs) often exhibit systematic errors on specific subsets of data, known as error slices. For instance, a slice can correspond to a certain demographic, where a model does poorly in identifying tox…

Active Learning

Error Discovery by Clustering Influence Embeddings

2023-12-07 · NeurIPS 2023 11 · Fulton Wang, Julius Adebayo, Sarah Tan, Diego Garcia-Olano 외

We present a method for identifying groups of test examples -- slices -- on which a model under-performs, a task now known as slice discovery. We formalize coherence -- a requirement that erroneous predictions, within a …

ClusteringSlice Discovery