paper-with-me

Papers

The Limits of Tractable Marginalization

2025-04-17 · Oliver Broadrick, Sanyam Agarwal, Guy Van Den Broeck, Markus Bläser

Marginalization -- summing a function over all assignments to a subset of its inputs -- is a fundamental computational problem with applications from probabilistic inference to formal verification. Despite its computational hardness in general, there exist many classes of functions (e.g., probabilistic models) for which marginalization remains tractable, and they can be commonly expressed by polynomial size arithmetic circuits computing multilinear polynomials. This raises the question, can all functions with polynomial time marginalization algorithms be succinctly expressed by such circuits? We give a negative answer, exhibiting simple functions with tractable marginalization yet no efficient representation by known models, assuming $\textsf{FP}\neq\#\textsf{P}$ (an assumption implied by $\textsf{P} \neq \textsf{NP}$). To this end, we identify a hierarchy of complexity classes corresponding to stronger forms of marginalization, all of which are efficiently computable on the known circuit models. We conclude with a completeness result, showing that whenever there is an efficient real RAM performing virtual evidence marginalization for a function, then there are small circuits for that function's multilinear representation.

📄 PDF Abstract BibTeX arXiv:2506.12020

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Neural Syntactic Generative Models with Exact Marginalization

2018-06-01 · NAACL 2018 6 · Jan Buys, Phil Blunsom

We present neural syntactic generative models with exact marginalization that support both dependency parsing and language modeling. Exact marginalization is made tractable through dynamic programming over shift-reduce p…

Dependency ParsingLanguage ModelingLanguage ModellingTransition-Based Dependency Parsing

Tensorial Mixture Models

2016-10-13 · Or Sharir, Ronen Tamari, Nadav Cohen, Amnon Shashua

Casting neural networks in generative frameworks is a highly sought-after endeavor these days. Contemporary methods, such as Generative Adversarial Networks, capture some of the generative capabilities, but not all. In p…

How to Square Tensor Networks and Circuits Without Squaring Them

2025-12-18 · Lorenzo Loconte, Adrián Javaloy, Antonio Vergari arxiv

Squared tensor networks (TNs) and their extension as computational graphs--squared circuits--have been used as expressive distribution estimators, yet supporting closed-form marginalization. However, the squaring operati…

Learning Distributions via Monte-Carlo Marginalization

2023-08-11 · Chenqiu Zhao, Guanfang Dong, Anup Basu

We propose a novel method to learn intractable distributions from their samples. The main idea is to use a parametric distribution model, such as a Gaussian Mixture Model (GMM), to approximate intractable distributions b…

DecoderDensity EstimationVariational Inference

Probabilistic Generating Circuits -- Demystified

2024-03-04 · Sanyam Agarwal, Markus Bläser

Zhang et al. (ICML 2021, PLMR 139, pp. 12447-1245) introduced probabilistic generating circuits (PGCs) as a probabilistic model to unify probabilistic circuits (PCs) and determinantal point processes (DPPs). At a first g…

Point Processes