paper-with-me

홈 › Papers

A Faster Sampler for Discrete Determinantal Point Processes

2022-10-31 · Simon Barthelmé, Nicolas Tremblay, Pierre-Olivier Amblard

Discrete Determinantal Point Processes (DPPs) have a wide array of potential applications for subsampling datasets. They are however held back in some cases by the high cost of sampling. In the worst-case scenario, the sampling cost scales as O(n^3) where n is the number of elements of the ground set. A popular workaround to this prohibitive cost is to sample DPPs defined by low-rank kernels. In such cases, the cost of standard sampling algorithms scales as O(np^2 + nm^2) where m is the (average) number of samples of the DPP (usually m << n) and p the rank of the kernel used to define the DPP (m \leq p \leq n). The first term, O(np^2), comes from a SVD-like step. We focus here on the second term of this cost, O(nm^2), and show that it can be brought down to O(nm + m^3 log m) without loss on the sampling's exactness. In practice, we observe very substantial speedups compared to the classical algorithm as soon as n > 1000. The algorithm described here is a close variant of the standard algorithm for sampling continuous DPPs, and uses rejection sampling. In the specific case of projection DPPs, we also show that any additional sample can be drawn in time O(m^3 log m). Finally, an interesting by-product of the analysis is that a realisation from a DPP is typically contained in a subset of size O(m log m) formed using leverage score i.i.d. sampling.

📄 PDF Abstract BibTeX arXiv:2210.17358

Code (1)

dahtah/DPP.jl 공식 구현

Tasks

Point Processes

Similar Papers 제목 키워드 기반

Approximate Inference in Continuous Determinantal Point Processes

2013-11-12 · Raja Hafiz Affandi, Emily B. Fox, Ben Taskar

Determinantal point processes (DPPs) are random point processes well-suited for modeling repulsion. In machine learning, the focus of DPP-based models has been on diverse subset selection from a discrete and finite base …

Point Processes

Approximate Inference in Continuous Determinantal Processes

2013-12-01 · NeurIPS 2013 12 · Raja Hafiz Affandi, Emily Fox, Ben Taskar

Determinantal point processes (DPPs) are random point processes well-suited for modeling repulsion. In machine learning, the focus of DPP-based models has been on diverse subset selection from a discrete and finite base …

Point Processes

Fast Sampling for Strongly Rayleigh Measures with Application to Determinantal Point Processes

2016-07-13 · Chengtao Li, Stefanie Jegelka, Suvrit Sra

In this note we consider sampling from (non-homogeneous) strongly Rayleigh probability measures. As an important corollary, we obtain a fast mixing Markov Chain sampler for Determinantal Point Processes.

Point Processes

Discrete Sampling using Semigradient-based Product Mixtures

2018-07-04 · Alkis Gotovos, Hamed Hassani, Andreas Krause, Stefanie Jegelka

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal p…

Point Processes

Fixed-point algorithms for learning determinantal point processes

2015-08-04 · Zelda Mariet, Suvrit Sra

Determinantal point processes (DPPs) offer an elegant tool for encoding probabilities over subsets of a ground set. Discrete DPPs are parametrized by a positive semidefinite matrix (called the DPP kernel), and estimating…

Point Processes