paper-with-me

Papers

Learning Deep Nearest Neighbor Representations Using Differentiable Boundary Trees

2017-02-28 · Daniel Zoran, Balaji Lakshminarayanan, Charles Blundell

Nearest neighbor (kNN) methods have been gaining popularity in recent years in light of advances in hardware and efficiency of algorithms. There is a plethora of methods to choose from today, each with their own advantages and disadvantages. One requirement shared between all kNN based methods is the need for a good representation and distance measure between samples. We introduce a new method called differentiable boundary tree which allows for learning deep kNN representations. We build on the recently proposed boundary tree algorithm which allows for efficient nearest neighbor classification, regression and retrieval. By modelling traversals in the tree as stochastic events, we are able to form a differentiable cost function which is associated with the tree's predictions. Using a deep neural network to transform the data and back-propagating through the tree allows us to learn good representations for kNN methods. We demonstrate that our method is able to learn suitable representations allowing for very efficient trees with a clearly interpretable structure.

📄 PDF Abstract BibTeX arXiv:1702.08833

Code (1)

thadikari/differentiable-boundary-trees tf

Tasks

Retrieval

Similar Papers 제목 키워드 기반

Efficient learning of neighbor representations for boundary trees and forests

2018-10-26 · Tharindu Adikari, Stark C. Draper

We introduce a semiparametric approach to neighbor-based classification. We build off the recently proposed Boundary Trees algorithm by Mathy et al.(2015) which enables fast neighbor-based classification, regression and …

ClassificationGeneral ClassificationRetrievalSemantic Similarity+1

SOAR: Improved Indexing for Approximate Nearest Neighbor Search

2024-03-31 · NeurIPS 2023 11 · Philip Sun, David Simcha, Dave Dopson, Ruiqi Guo 외

This paper introduces SOAR: Spilling with Orthogonality-Amplified Residuals, a novel data indexing technique for approximate nearest neighbor (ANN) search. SOAR extends upon previous approaches to ANN search, such as spi…

Explaining the Success of Nearest Neighbor Methods in Prediction

2025-02-21 · George H. Chen, Devavrat Shah

Many modern methods for prediction leverage nearest neighbor search to find past training examples most similar to a test example, an idea that dates back in text to at least the 11th century and has stood the test of ti…

PredictionregressionTime Series Forecasting

Which Space Partitioning Tree to Use for Search?

2013-12-01 · NeurIPS 2013 12 · Parikshit Ram, Alexander Gray

We consider the task of nearest-neighbor search with the class of binary-space-partitioning trees, which includes kd-trees, principal axis trees and random projection trees, and try to rigorously answer the question whic…

Quantization

Efficient Autotuning of Hyperparameters in Approximate Nearest Neighbor Search

2018-12-18 · Elias Jääsaari, Ville Hyvönen, Teemu Roos

Approximate nearest neighbor algorithms are used to speed up nearest neighbor search in a wide array of applications. However, current indexing methods feature several hyperparameters that need to be tuned to reach an ac…