paper-with-me

홈 › Papers

Probabilistic Programs with Stochastic Conditioning

2020-10-01 · David Tolpin, Yuan Zhou, Tom Rainforth, Hongseok Yang

We tackle the problem of conditioning probabilistic programs on distributions of observable variables. Probabilistic programs are usually conditioned on samples from the joint data distribution, which we refer to as deterministic conditioning. However, in many real-life scenarios, the observations are given as marginal distributions, summary statistics, or samplers. Conventional probabilistic programming systems lack adequate means for modeling and inference in such scenarios. We propose a generalization of deterministic conditioning to stochastic conditioning, that is, conditioning on the marginal distribution of a variable taking a particular form. To this end, we first define the formal notion of stochastic conditioning and discuss its key properties. We then show how to perform inference in the presence of stochastic conditioning. We demonstrate potential usage of stochastic conditioning on several case studies which involve various kinds of stochastic conditioning and are difficult to solve otherwise. Although we present stochastic conditioning in the context of probabilistic programming, our formalization is general and applicable to other settings.

📄 PDF Abstract BibTeX arXiv:2010.00282

Code (1)

https://bitbucket.org/dtolpin/stochastic-conditioning 공식 구현

Tasks

Probabilistic Programming

Similar Papers 제목 키워드 기반

Bayesian Policy Search for Stochastic Domains

2020-10-01 · David Tolpin, Yuan Zhou, Hongseok Yang

AI planning can be cast as inference in probabilistic models, and probabilistic programming was shown to be capable of policy search in partially observable domains. Prior work introduces policy search through Markov cha…

Bayesian InferenceProbabilistic ProgrammingVariational Inference

Densities of Almost Surely Terminating Probabilistic Programs are Differentiable Almost Everywhere

2020-04-08 · Carol Mak, C. -H. Luke Ong, Hugo Paquet, Dominik Wagner

We study the differential properties of higher-order statistical probabilistic programs with recursion and conditioning. Our starting point is an open problem posed by Hongseok Yang: what class of statistical probabilist…

Stochastic Probabilistic Programs

2020-01-08 · David Tolpin, Tomer Dobkin

We introduce the notion of a stochastic probabilistic program and present a reference implementation of a probabilistic programming facility supporting specification of stochastic probabilistic programs and inference in …

Probabilistic Programming

Bob and Alice Go to a Bar: Reasoning About Future With Probabilistic Programs

2021-08-09 · David Tolpin, Tomer Dobkin

It is well known that reinforcement learning can be cast as inference in an appropriate probabilistic model. However, this commonly involves introducing a distribution over agent trajectories with probabilities proportio…

Bayesian InferenceProbabilistic Programmingreinforcement-learningReinforcement Learning+1

Semantics of higher-order probabilistic programs with conditioning

2019-02-28 · Fredrik Dahlqvist, Dexter Kozen

We present a denotational semantics for higher-order probabilistic programs in terms of linear operators between Banach spaces. Our semantics is rooted in the classical theory of Banach spaces and their tensor products, …