paper-with-me

홈 › Papers

Neural Probabilistic Circuits: Enabling Compositional and Interpretable Predictions through Logical Reasoning

2025-01-13 · Weixin Chen, Simon Yu, Huajie Shao, Lui Sha, Han Zhao

End-to-end deep neural networks have achieved remarkable success across various domains but are often criticized for their lack of interpretability. While post hoc explanation methods attempt to address this issue, they often fail to accurately represent these black-box models, resulting in misleading or incomplete explanations. To overcome these challenges, we propose an inherently transparent model architecture called Neural Probabilistic Circuits (NPCs), which enable compositional and interpretable predictions through logical reasoning. In particular, an NPC consists of two modules: an attribute recognition model, which predicts probabilities for various attributes, and a task predictor built on a probabilistic circuit, which enables logical reasoning over recognized attributes to make class predictions. To train NPCs, we introduce a three-stage training algorithm comprising attribute recognition, circuit construction, and joint optimization. Moreover, we theoretically demonstrate that an NPC's error is upper-bounded by a linear combination of the errors from its modules. To further demonstrate the interpretability of NPC, we provide both the most probable explanations and the counterfactual explanations. Empirical results on four benchmark datasets show that NPCs strike a balance between interpretability and performance, achieving results competitive even with those of end-to-end black-box models while providing enhanced interpretability.

📄 PDF Abstract BibTeX arXiv:2501.07021

Code (0)

등록된 구현이 없습니다.

Tasks

AttributecounterfactualLogical Reasoning

Methods 이 논문이 사용한 방법론

HOC 설명 없음

Similar Papers 제목 키워드 기반

Understanding and Improving Adversarial Robustness of Neural Probabilistic Circuits

2025-09-24 · Weixin Chen, Han Zhao arxiv

Neural Probabilistic Circuits (NPCs), a new class of concept bottleneck models, comprise an attribute recognition model and a probabilistic circuit for reasoning. By integrating the outputs from these two modules, NPCs p…

Adversarial RobustnessImage Classification

A Compositional Atlas for Algebraic Circuits

2024-12-07 · Benjie Wang, Denis Deratani Mauá, Guy Van Den Broeck, YooJung Choi

Circuits based on sum-product structure have become a ubiquitous representation to compactly encode knowledge, from Boolean functions to probability distributions. By imposing constraints on the structure of such circuit…

Causal Inference

AC-SINDy: Compositional Sparse Identification of Nonlinear Dynamics

2026-04-20 · Peter Racioppo arxiv

We present AC-SINDy, a compositional extension of the Sparse Identification of Nonlinear Dynamics (SINDy) framework that replaces explicit feature libraries with a structured representation based on arithmetic circuits. …

Approximate Bayesian Inference via Bitstring Representations

2025-08-19 · Aleksanteri Sladek, Martin Trapp, Arno Solin arxiv

The machine learning community has recently put effort into quantized or low-precision arithmetics to scale large models. This paper proposes performing probabilistic inference in the quantized, discrete parameter space …

Interpretable Machine LearningBayesian Inference

A Compositional Theory of Curvature in Probabilistic Circuits

2026-08-13 · Hrithik Suresh, Sahil Sidheekh, Shelar Parth Vijay, Yasir Z 외 arxiv

Probabilistic Circuits (PCs) are generative models that support exact inference and, unlike deep neural networks, admit an exact and tractable measure of loss-surface curvature: the trace of the Hessian of the log-likeli…