paper-with-me

Papers

A One-Class Classification Decision Tree Based on Kernel Density Estimation

2018-05-14 · Sarah Itani, Fabian Lecron, Philippe Fortemps

One-class Classification (OCC) is an area of machine learning which addresses prediction based on unbalanced datasets. Basically, OCC algorithms achieve training by means of a single class sample, with potentially some additional counter-examples. The current OCC models give satisfaction in terms of performance, but there is an increasing need for the development of interpretable models. In the present work, we propose a one-class model which addresses concerns of both performance and interpretability. Our hybrid OCC method relies on density estimation as part of a tree-based learning algorithm, called One-Class decision Tree (OC-Tree). Within a greedy and recursive approach, our proposal rests on kernel density estimation to split a data subset on the basis of one or several intervals of interest. Thus, the OC-Tree encloses data within hyper-rectangles of interest which can be described by a set of rules. Against state-of-the-art methods such as Cluster Support Vector Data Description (ClusterSVDD), One-Class Support Vector Machine (OCSVM) and isolation Forest (iForest), the OC-Tree performs favorably on a range of benchmark datasets. Furthermore, we propose a real medical application for which the OC-Tree has demonstrated its effectiveness, through the ability to tackle interpretable diagnosis aid based on unbalanced datasets.

📄 PDF Abstract BibTeX arXiv:1805.05021

Code (0)

등록된 구현이 없습니다.

Tasks

Density EstimationGeneral ClassificationOne-Class Classification

Similar Papers 제목 키워드 기반

Kernel Density Decision Trees

2021-09-29 · Jack Henry Good, Kyle Miller, Artur Dubrawski

We propose kernel density decision trees (KDDTs), a novel fuzzy decision tree (FDT) formalism based on kernel density estimation that achieves state-of-the-art prediction performance often matching or exceeding that of c…

Density Estimation

Kernel clustering: density biases and solutions

2017-05-16 · Dmitrii Marin, Meng Tang, Ismail Ben Ayed, Yuri Boykov

Kernel methods are popular in clustering due to their generality and discriminating power. However, we show that many kernel clustering criteria have density biases theoretically explaining some practically significant a…

Clustering

Conditional Density Estimation with Histogram Trees

2024-10-15 · Lincen Yang, Matthijs van Leeuwen

Conditional density estimation (CDE) goes beyond regression by modeling the full conditional distribution, providing a richer understanding of the data than just the conditional mean in regression. This makes CDE particu…

Density Estimationregression

Adaptive kernel-density approach for imbalanced binary classification

2025-10-05 · Kotaro J. Nishimura, Yuichi Sakumura, Kazushi Ikeda arxiv

Class imbalance is a common challenge in real-world binary classification tasks, often leading to predictions biased toward the majority class and reduced recognition of the minority class. This issue is particularly cri…

Binary ClassificationDensity EstimationAnomaly DetectionMedical Diagnosis

(Decision and regression) tree ensemble based kernels for regression and classification

2020-12-19 · Dai Feng, Richard Baumgartner

Tree based ensembles such as Breiman's random forest (RF) and Gradient Boosted Trees (GBT) can be interpreted as implicit kernel generators, where the ensuing proximity matrix represents the data-driven tree ensemble ker…

General Classificationregression