paper-with-me

홈 › Papers

Sparse Probabilistic Graph Circuits

2025-08-11 · Martin Rektoris, Milan Papež, Václav Šmídl, Tomáš Pevný arxiv

Deep generative models (DGMs) for graphs achieve impressively high expressive power thanks to very efficient and scalable neural networks. However, these networks contain non-linearities that prevent analytical computation of many standard probabilistic inference queries, i.e., these DGMs are considered \emph{intractable}. While recently proposed Probabilistic Graph Circuits (PGCs) address this issue by enabling \emph{tractable} probabilistic inference, they operate on dense graph representations with $\mathcal{O}(n^2)$ complexity for graphs with $n$ nodes and \emph{$m$ edges}. To address this scalability issue, we introduce Sparse PGCs, a new class of tractable generative models that operate directly on sparse graph representation, reducing the complexity to $\mathcal{O}(n + m)$, which is particularly beneficial for $m \ll n^2$. In the context of de novo drug design, we empirically demonstrate that SPGCs retain exact inference capabilities, improve memory efficiency and inference speed, and match the performance of intractable DGMs in key metrics.

📄 PDF Abstract BibTeX arXiv:2508.07763

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Einsum Networks: Fast and Scalable Learning of Tractable Probabilistic Circuits

2020-04-13 · ICML 2020 1 · Robert Peharz, Steven Lang, Antonio Vergari, Karl Stelzner 외

Probabilistic circuits (PCs) are a promising avenue for probabilistic modeling, as they permit a wide range of exact and efficient inference routines. Recent ``deep-learning-style'' implementations of PCs strive for a be…

Winner-Take-All as Basic Probabilistic Inference Unit of Neuronal Circuits

2018-08-02 · Zhaofei Yu, Yonghong Tian, Tiejun Huang, Jian. K. Liu

Experimental observations of neuroscience suggest that the brain is working a probabilistic way when computing information with uncertainty. This processing could be modeled as Bayesian inference. However, it remains unc…

AllBayesian Inference

On the Relationship Between Monotone and Squared Probabilistic Circuits

2024-08-01 · Benjie Wang, Guy Van Den Broeck

Probabilistic circuits are a unifying representation of functions as computation graphs of weighted sums and products. Their primary application is in probabilistic modeling, where circuits with non-negative weights (mon…

Handling Epistemic and Aleatory Uncertainties in Probabilistic Circuits

2021-02-22 · Federico Cerutti, Lance M. Kaplan, Angelika Kimmig, Murat Sensoy

When collaborating with an AI system, we need to assess when to trust its recommendations. If we mistakenly trust it in regions where it is likely to err, catastrophic failures may occur, hence the need for Bayesian appr…

Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models

2024-03-28 · Samuel Marks, Can Rager, Eric J. Michaud, Yonatan Belinkov 외

We introduce methods for discovering and applying sparse feature circuits. These are causally implicated subnetworks of human-interpretable features for explaining language model behaviors. Circuits identified in prior w…

Language ModelingLanguage Modelling