paper-with-me

Papers

Variational DAG Estimation via State Augmentation With Stochastic Permutations

2024-02-04 · Edwin V. Bonilla, Pantelis Elinas, He Zhao, Maurizio Filippone, Vassili Kitsios, Terry O'Kane

Estimating the structure of a Bayesian network, in the form of a directed acyclic graph (DAG), from observational data is a statistically and computationally hard problem with essential applications in areas such as causal discovery. Bayesian approaches are a promising direction for solving this task, as they allow for uncertainty quantification and deal with well-known identifiability issues. From a probabilistic inference perspective, the main challenges are (i) representing distributions over graphs that satisfy the DAG constraint and (ii) estimating a posterior over the underlying combinatorial space. We propose an approach that addresses these challenges by formulating a joint distribution on an augmented space of DAGs and permutations. We carry out posterior estimation via variational inference, where we exploit continuous relaxations of discrete distributions. We show that our approach performs competitively when compared with a wide range of Bayesian and non-Bayesian benchmarks on a range of synthetic and real datasets.

📄 PDF Abstract BibTeX arXiv:2402.02644

Code (0)

등록된 구현이 없습니다.

Tasks

Causal DiscoveryUncertainty QuantificationVariational Inference

Similar Papers 제목 키워드 기반

Reparameterizing the Birkhoff Polytope for Variational Permutation Inference

2017-10-26 · Scott W. Linderman, Gonzalo E. Mena, Hal Cooper, Liam Paninski 외

Many matching, tracking, sorting, and ranking problems require probabilistic reasoning about possible permutations, a set that grows factorially with dimension. Combinatorial optimization algorithms may enable efficient …

Bayesian InferenceCombinatorial OptimizationVariational Inference

A Unified Analysis of Stochastic Gradient Descent with Arbitrary Data Permutations and Beyond

2025-01-27 · Yipeng Li, Xinchen Lyu, Zhenyu Liu

We aim to provide a unified convergence analysis for permutation-based Stochastic Gradient Descent (SGD), where data examples are permuted before each epoch. By examining the relations among permutations, we categorize e…

Federated Learning

Variational Learning for Insertion-based Generation

2026-06-01 · Yangtian Zhang, Zhe Wang, Arthur Gretton, Rex Ying 외 arxiv

Non-monotonic sequence generation methods, such as masked diffusion models, provide a flexible alternative to left-to-right autoregressive modeling by allowing tokens to be generated in non-fixed and prescribed orders. D…

ARM: Augment-REINFORCE-Merge Gradient for Stochastic Binary Networks

2018-07-30 · ICLR 2019 5 · Mingzhang Yin, Mingyuan Zhou

To backpropagate the gradients through stochastic binary layers, we propose the augment-REINFORCE-merge (ARM) estimator that is unbiased, exhibits low variance, and has low computational complexity. Exploiting variable a…

Data AugmentationVariational Inference

Stochastic Event-triggered Variational Bayesian Filtering

2022-06-14 · Xiaoxu Lv, Peihu Duan, Zhisheng Duan, Guanrong Chen 외

This paper proposes an event-triggered variational Bayesian filter for remote state estimation with unknown and time-varying noise covariances. After presetting multiple nominal process noise covariances and an initial m…

State Estimation