Exchangeable Variable Models
A sequence of random variables is exchangeable if its joint distribution is invariant under variable permutations. We introduce exchangeable variable models (EVMs) as a novel class of probabilistic models whose basic building blocks are partially exchangeable sequences, a generalization of exchangeable sequences. We prove that a family of tractable EVMs is optimal under zero-one loss for a large class of functions, including parity and threshold functions, and strictly subsumes existing tractable independence-based model families. Extensive experiments show that EVMs outperform state of the art classifiers such as SVMs and probabilistic models which are solely based on independence assumptions.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Testing Independence of Exchangeable Random Variables
Given well-shuffled data, can we determine whether the data items are statistically (in)dependent? Formally, we consider the problem of testing whether a set of exchangeable random variables are independent. We will show…
Restricting exchangeable nonparametric distributions
Distributions over exchangeable matrices with infinitely many columns are useful in constructing nonparametric latent variable models. However, the distribution implied by such models over the number of features exhibite…
Exchangeable Variational Autoencoders with Applications to Genomic Data
Exchangeable-structured datapoints are ubiquitous in statistical problems ranging from point clouds to graphs to sets. Particularly in biological settings where multiple experiments derived from a noisy scientific proces…
Bayesian InferenceExchangeability-Aware Sum-Product Networks
Sum-Product Networks (SPNs) are expressive probabilistic models that provide exact, tractable inference. They achieve this efficiency by making use of local independence. On the other hand, mixtures of exchangeable varia…
Bounded Difference Concentration for Infinitely Exchangeable Sequences with Applications to AI Benchmark Uncertainty
We consider the concentration properties of functions of infinitely exchangeable random variables. By conditioning on the de Finetti directing measure, we show that the deviation of any function with bounded-difference c…