paper-with-me

홈 › Papers

Efficient learning of neighbor representations for boundary trees and forests

2018-10-26 · Tharindu Adikari, Stark C. Draper

We introduce a semiparametric approach to neighbor-based classification. We build off the recently proposed Boundary Trees algorithm by Mathy et al.(2015) which enables fast neighbor-based classification, regression and retrieval in large datasets. While boundary trees use an Euclidean measure of similarity, the Differentiable Boundary Tree algorithm by Zoran et al.(2017) was introduced to learn low-dimensional representations of complex input data, on which semantic similarity can be calculated to train boundary trees. As is pointed out by its authors, the differentiable boundary tree approach contains a few limitations that prevents it from scaling to large datasets. In this paper, we introduce Differentiable Boundary Sets, an algorithm that overcomes the computational issues of the differentiable boundary tree scheme and also improves its classification accuracy and data representability. Our algorithm is efficiently implementable with existing tools and offers a significant reduction in training time. We test and compare the algorithms on the well known MNIST handwritten digits dataset and the newer Fashion-MNIST dataset by Xiao et al.(2017).

📄 PDF Abstract BibTeX arXiv:1810.11165

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral ClassificationRetrievalSemantic SimilaritySemantic Textual Similarity

Similar Papers 제목 키워드 기반

K-nearest Neighbor Search by Random Projection Forests

2018-12-31 · Donghui Yan, Yingjie Wang, Jin Wang, Honggang Wang 외

K-nearest neighbor (kNN) search has wide applications in many areas, including data mining, machine learning, statistics and many applied domains. Inspired by the success of ensemble methods and the flexibility of tree-b…

Learning Deep Nearest Neighbor Representations Using Differentiable Boundary Trees

2017-02-28 · Daniel Zoran, Balaji Lakshminarayanan, Charles Blundell

Nearest neighbor (kNN) methods have been gaining popularity in recent years in light of advances in hardware and efficiency of algorithms. There is a plethora of methods to choose from today, each with their own advantag…

Retrieval

When do random forests fail?

2018-12-01 · NeurIPS 2018 12 · Cheng Tang, Damien Garreau, Ulrike Von Luxburg

Random forests are learning algorithms that build large collections of random trees and make predictions by averaging the individual tree predictions. In this paper, we consider various tree constructions and examine how…

A Rigorous, Tractable Measure of Model Complexity

2026-05-20 · Oskar Allerbo, Thomas B. Schön arxiv

An accurate assessment of a model's complexity is crucial for topics such as interpretation, generalization, and model selection. However, most existing complexity measures either rely on heuristic assumptions or are com…

Brauer and partition diagram models for phylogenetic trees and forests

2021-11-30 · Andrew Francis, Peter D Jarvis

We introduce a correspondence between phylogenetic trees and Brauer diagrams, inspired by links between binary trees and matchings described by Diaconis and Holmes (1998). This correspondence gives rise to a range of sem…