paper-with-me

Papers

Scalable MCMC Sampling for Nonsymmetric Determinantal Point Processes

2022-07-01 · Insu Han, Mike Gartrell, Elvis Dohmatob, Amin Karbasi

A determinantal point process (DPP) is an elegant model that assigns a probability to every subset of a collection of $n$ items. While conventionally a DPP is parameterized by a symmetric kernel matrix, removing this symmetry constraint, resulting in nonsymmetric DPPs (NDPPs), leads to significant improvements in modeling power and predictive performance. Recent work has studied an approximate Markov chain Monte Carlo (MCMC) sampling algorithm for NDPPs restricted to size-$k$ subsets (called $k$-NDPPs). However, the runtime of this approach is quadratic in $n$, making it infeasible for large-scale settings. In this work, we develop a scalable MCMC sampling algorithm for $k$-NDPPs with low-rank kernels, thus enabling runtime that is sublinear in $n$. Our method is based on a state-of-the-art NDPP rejection sampling algorithm, which we enhance with a novel approach for efficiently constructing the proposal distribution. Furthermore, we extend our scalable $k$-NDPP sampling algorithm to NDPPs without size constraints. Our resulting sampling method has polynomial time complexity in the rank of the kernel, while the existing approach has runtime that is exponential in the rank. With both a theoretical analysis and experiments on real-world datasets, we verify that our scalable approximate sampling algorithms are orders of magnitude faster than existing sampling approaches for $k$-NDPPs and NDPPs.

📄 PDF Abstract BibTeX arXiv:2207.00486

Code (1)

insuhan/ndpp-mcmc-sampling 공식 구현 pytorch

Tasks

Point Processes

Similar Papers 제목 키워드 기반

Scalable Sampling for Nonsymmetric Determinantal Point Processes

2022-01-20 · ICLR 2022 4 · Insu Han, Mike Gartrell, Jennifer Gillenwater, Elvis Dohmatob 외

A determinantal point process (DPP) on a collection of $M$ items is a model, parameterized by a symmetric kernel matrix, that assigns a probability to every subset of those items. Recent work shows that removing the kern…

Point Processes

Learning Nonsymmetric Determinantal Point Processes

2019-05-30 · NeurIPS 2019 12 · Mike Gartrell, Victor-Emmanuel Brunel, Elvis Dohmatob, Syrine Krichene

Determinantal point processes (DPPs) have attracted substantial attention as an elegant probabilistic model that captures the balance between quality and diversity within sets. DPPs are conventionally parameterized by a …

Information RetrievalPoint ProcessesRecommendation SystemsRetrieval

Scalable Learning and MAP Inference for Nonsymmetric Determinantal Point Processes

2020-06-17 · ICLR 2021 1 · Mike Gartrell, Insu Han, Elvis Dohmatob, Jennifer Gillenwater 외

Determinantal point processes (DPPs) have attracted significant attention in machine learning for their ability to model subsets drawn from a large item collection. Recent work shows that nonsymmetric DPP (NDPP) kernels …

Point Processes

Monte Carlo Markov Chain Algorithms for Sampling Strongly Rayleigh Distributions and Determinantal Point Processes

2016-02-16 · Nima Anari, Shayan Oveis Gharan, Alireza Rezaei

Strongly Rayleigh distributions are natural generalizations of product and determinantal probability distributions and satisfy strongest form of negative dependence properties. We show that the "natural" Monte Carlo Mark…

Open-Ended Question AnsweringPoint Processes

Online MAP Inference and Learning for Nonsymmetric Determinantal Point Processes

2021-11-29 · Aravind Reddy, Ryan A. Rossi, Zhao Song, Anup Rao 외

In this paper, we introduce the online and streaming MAP inference and learning problems for Non-symmetric Determinantal Point Processes (NDPPs) where data points arrive in an arbitrary order and the algorithms are const…

Point Processesvalid