paper-with-me

Papers

Interpretable Neural-Symbolic Concept Reasoning

2023-04-27 · Pietro Barbiero, Gabriele Ciravegna, Francesco Giannini, Mateo Espinosa Zarlenga, Lucie Charlotte Magister, Alberto Tonda, Pietro Lio', Frederic Precioso, Mateja Jamnik, Giuseppe Marra

Deep learning methods are highly accurate, yet their opaque decision process prevents them from earning full human trust. Concept-based models aim to address this issue by learning tasks based on a set of human-understandable concepts. However, state-of-the-art concept-based models rely on high-dimensional concept embedding representations which lack a clear semantic meaning, thus questioning the interpretability of their decision process. To overcome this limitation, we propose the Deep Concept Reasoner (DCR), the first interpretable concept-based model that builds upon concept embeddings. In DCR, neural networks do not make task predictions directly, but they build syntactic rule structures using concept embeddings. DCR then executes these rules on meaningful concept truth degrees to provide a final interpretable and semantically-consistent prediction in a differentiable manner. Our experiments show that DCR: (i) improves up to +25% w.r.t. state-of-the-art interpretable concept-based models on challenging benchmarks (ii) discovers meaningful logic rules matching known ground truths even in the absence of concept supervision during training, and (iii), facilitates the generation of counterfactual examples providing the learnt rules as guidance.

📄 PDF Abstract BibTeX arXiv:2304.14068

Code (1)

pietrobarbiero/pytorch_explain 공식 구현 pytorch

Tasks

counterfactual

Similar Papers 제목 키워드 기반

Interpretable Visual Reasoning via Induced Symbolic Space

2020-11-23 · ICCV 2021 10 · Zhonghao Wang, Kai Wang, Mo Yu, JinJun Xiong 외

We study the problem of concept induction in visual reasoning, i.e., identifying concepts and their hierarchical relationships from question-answer pairs associated with images; and achieve an interpretable model via wor…

Visual Question Answering (VQA)Visual Reasoning

Neurosymbolic Framework for Concept-Driven Logical Reasoning in Skeleton-Based Human Action Recognition

2026-05-08 · Talha Ilyas, Deval Mehta, Zongyuan Ge arxiv

Skeleton-based human activity recognition has achieved strong empirical performance, yet most existing models remain black boxes and difficult to interpret. In this work, we introduce a neurosymbolic formulation of skele…

Human Activity RecognitionRepresentation LearningAction UnderstandingAction Recognition

Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs

2026-05-31 · Wentao Mo, Yang Liu arxiv

Current 3D spatial reasoning methods face a fundamental trade-off: neuro-symbolic 3D (NS3D) concept learners achieve interpretable reasoning through compositional programs but are constrained to closed-set concept vocabu…

Question AnsweringSpatial Reasoning

Concept-RuleNet: Grounded Multi-Agent Neurosymbolic Reasoning in Vision Language Models

2025-11-13 · Sanchit Sinha, Guangzhi Xiong, Zhenghao He, Aidong Zhang arxiv

Modern vision-language models (VLMs) deliver impressive predictive accuracy yet offer little insight into 'why' a decision is reached, frequently hallucinating facts, particularly when encountering out-of-distribution da…

Visual Grounding

CLMN: Concept based Language Models via Neural Symbolic Reasoning

2025-10-11 · Yibo Yang arxiv

Deep learning has advanced NLP, but interpretability remains limited, especially in healthcare and finance. Concept bottleneck models tie predictions to human concepts in vision, but NLP versions either use binary activa…