paper-with-me

Papers

Efficient Bregman Range Search

2009-12-01 · NeurIPS 2009 12 · Lawrence Cayton

We develop an algorithm for efficient range search when the notion of dissimilarity is given by a Bregman divergence. The range search task is to return all points in a potentially large database that are within some specified distance of a query. It arises in many learning algorithms such as locally-weighted regression, kernel density estimation, neighborhood graph-based algorithms, and in tasks like outlier detection and information retrieval. In metric spaces, efficient range search-like algorithms based on spatial data structures have been deployed on a variety of statistical tasks. Here we describe the first algorithm for range search for an arbitrary Bregman divergence. This broad class of dissimilarity measures includes the relative entropy, Mahalanobis distance, Itakura-Saito divergence, and a variety of matrix divergences. Metric methods cannot be directly applied since Bregman divergences do not in general satisfy the triangle inequality. We derive geometric properties of Bregman divergences that yield an efficient algorithm for range search based on a recently proposed space decomposition for Bregman divergences.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Density EstimationInformation RetrievalOutlier DetectionRetrieval

Similar Papers 제목 키워드 기반

A scaled Bregman theorem with applications

2016-07-01 · NeurIPS 2016 12 · Richard Nock, Aditya Krishna Menon, Cheng Soon Ong

Bregman divergences play a central role in the design and analysis of a range of machine learning algorithms. This paper explores the use of Bregman divergences to establish reductions between such algorithms and their a…

BIG-bench Machine LearningClustering

Re-examination of Bregman functions and new properties of their divergences

2018-03-01 · Daniel Reem, Simeon Reich, Alvaro De Pierro

The Bregman divergence (Bregman distance, Bregman measure of distance) is a certain useful substitute for a distance, obtained from a well-chosen function (the "Bregman function"). Bregman functions and divergences have …

A Spectral Estimation Framework for Phase Retrieval via Bregman Divergence Minimization

2020-12-03 · Bariscan Yonel, Birsen Yazıcı

In this paper, we develop a novel framework to optimally design spectral estimators for phase retrieval given measurements realized from an arbitrary model. We begin by deconstructing spectral methods, and identify the f…

Retrieval

Neural Architecture Search via Bregman Iterations

2021-06-04 · Leon Bungert, Tim Roith, Daniel Tenbrinck, Martin Burger

We propose a novel strategy for Neural Architecture Search (NAS) based on Bregman iterations. Starting from a sparse neural network our gradient-based one-shot algorithm gradually adds relevant parameters in an inverse s…

DeblurringDenoisingNeural Architecture Search

Monte Carlo Information Geometry: The dually flat case

2018-03-20 · Frank Nielsen, Gaëtan Hadjeres

Exponential families and mixture families are parametric probability models that can be geometrically studied as smooth statistical manifolds with respect to any statistical divergence like the Kullback-Leibler (KL) dive…

Clustering