paper-with-me

Papers

Hyperbolic Random Forests

2023-08-25 · Lars Doorenbos, Pablo Márquez-Neila, Raphael Sznitman, Pascal Mettes

Hyperbolic space is becoming a popular choice for representing data due to the hierarchical structure - whether implicit or explicit - of many real-world datasets. Along with it comes a need for algorithms capable of solving fundamental tasks, such as classification, in hyperbolic space. Recently, multiple papers have investigated hyperbolic alternatives to hyperplane-based classifiers, such as logistic regression and SVMs. While effective, these approaches struggle with more complex hierarchical data. We, therefore, propose to generalize the well-known random forests to hyperbolic space. We do this by redefining the notion of a split using horospheres. Since finding the globally optimal split is computationally intractable, we find candidate horospheres through a large-margin classifier. To make hyperbolic random forests work on multi-class data and imbalanced experiments, we furthermore outline a new method for combining classes based on their lowest common ancestor and a class-balanced version of the large-margin loss. Experiments on standard and new benchmarks show that our approach outperforms both conventional random forest algorithms and recent hyperbolic classifiers.

📄 PDF Abstract BibTeX arXiv:2308.13279

Code (1)

larsdoorenbos/hororf 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Even Faster Hyperbolic Random Forests: A Beltrami-Klein Wrapper Approach

2025-06-04 · Philippe Chlenski, Itsik Pe'er

Decision trees and models that use them as primitives are workhorses of machine learning in Euclidean spaces. Recent work has further extended these models to the Lorentz model of hyperbolic space by replacing axis-paral…

Mixed-Curvature Decision Trees and Random Forests

2024-06-07 · Philippe Chlenski, Quentin Chu, Itsik Pe'er

We extend decision tree and random forest algorithms to product space manifolds: Cartesian products of Euclidean, hyperspherical, and hyperbolic manifolds. Such spaces have extremely expressive geometries capable of repr…

Mixed-curvature decision trees and random forests

2024-10-03 · Philippe Chlenski, Quentin Chu, Raiyan R. Khan, Kaizhu Du 외

Decision trees (DTs) and their random forest (RF) extensions are workhorses of classification and regression in Euclidean spaces. However, algorithms for learning in non-Euclidean spaces are still limited. We extend DT a…

Link Predictionregression

ggRandomForests: Visually Exploring a Random Forest for Regression

2015-01-28 · John Ehrlinger

Random Forests [Breiman:2001] (RF) are a fully non-parametric statistical method requiring no distributional assumptions on covariate relation to the response. RF are a robust, nonlinear technique that optimizes predicti…

regression

Mondrian Forests: Efficient Online Random Forests

2014-06-10 · NeurIPS 2014 12 · Balaji Lakshminarayanan, Daniel M. Roy, Yee Whye Teh

Ensembles of randomized decision trees, usually referred to as random forests, are widely used for classification and regression tasks in machine learning and statistics. Random forests achieve competitive predictive per…