paper-with-me

홈 › Papers

Deferring Concept Bottleneck Models: Learning to Defer Interventions to Inaccurate Experts

2025-03-20 · Andrea Pugnana, Riccardo Massidda, Francesco Giannini, Pietro Barbiero, Mateo Espinosa Zarlenga, Roberto Pellungrini, Gabriele Dominici, Fosca Giannotti, Davide Bacciu

Concept Bottleneck Models (CBMs) are machine learning models that improve interpretability by grounding their predictions on human-understandable concepts, allowing for targeted interventions in their decision-making process. However, when intervened on, CBMs assume the availability of humans that can identify the need to intervene and always provide correct interventions. Both assumptions are unrealistic and impractical, considering labor costs and human error-proneness. In contrast, Learning to Defer (L2D) extends supervised learning by allowing machine learning models to identify cases where a human is more likely to be correct than the model, thus leading to deferring systems with improved performance. In this work, we gain inspiration from L2D and propose Deferring CBMs (DCBMs), a novel framework that allows CBMs to learn when an intervention is needed. To this end, we model DCBMs as a composition of deferring systems and derive a consistent L2D loss to train them. Moreover, by relying on a CBM architecture, DCBMs can explain why defer occurs on the final task. Our results show that DCBMs achieve high predictive performance and interpretability at the cost of deferring more to humans.

📄 PDF Abstract BibTeX arXiv:2503.16199

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

A Causal Framework for Evaluating Deferring Systems

2024-05-29 · Filippo Palomba, Andrea Pugnana, José Manuel Alvarez, Salvatore Ruggieri

Deferring systems extend supervised Machine Learning (ML) models with the possibility to defer predictions to human experts. However, evaluating the impact of a deferring strategy on system accuracy is still an overlooke…

Causal Inference

Evaluating Control Protocols for Untrusted AI Agents

2025-11-04 · Jon Kutasov, Chloe Loughridge, Yuqi Sun, Henry Sleight 외 arxiv

As AI systems become more capable and widely deployed as agents, ensuring their safe operation becomes critical. AI control offers one approach to mitigating the risk from untrusted AI agents by monitoring their actions …

L2D-Clinical: Learning to Defer for Adaptive Model Selection in Clinical Text Classification

2026-04-14 · Rishik Kondadadi, John E. Ortega arxiv

Clinical text classification requires choosing between specialized fine-tuned models (BERT variants) and general-purpose large language models (LLMs), yet neither dominates across all instances. We introduce Learning to …

Text Classification

Predict Responsibly: Improving Fairness and Accuracy by Learning to Defer

2017-11-17 · NeurIPS 2018 12 · David Madras, Toniann Pitassi, Richard Zemel

In many machine learning applications, there are multiple decision-makers involved, both automated and human. The interaction between these agents often goes unaddressed in algorithmic development. In this work, we explo…

Decision MakingFairness

Is Uncertainty Quantification a Viable Alternative to Learned Deferral?

2025-08-04 · Anna M. Wundram, Christian F. Baumgartner arxiv

Artificial Intelligence (AI) holds the potential to dramatically improve patient care. However, it is not infallible, necessitating human-AI-collaboration to ensure safe implementation. One aspect of AI safety is the mod…