An Enhanced Projection Pursuit Tree Classifier with Visual Methods for Assessing Algorithmic Improvements

2026-02-24 · Natalia da Silva, Dianne Cook, Eun-Kyung Lee arxiv

This paper presents enhancements to the projection pursuit tree classifier and visual diagnostic methods for assessing their impact in high dimensions. The original algorithm uses linear combinations of variables in a tree structure where depth is constrained to be less than the number of classes -- a limitation that proves too rigid for complex classification problems. Our extensions improve performance in multi-class settings with unequal variance-covariance structures and nonlinear class separations by allowing more splits and more flexible class groupings in the projection pursuit computation. Proposing algorithmic improvements is straightforward; demonstrating their actual utility is not. We therefore develop two visual diagnostic approaches to verify that the enhancements perform as intended. Using high-dimensional visualization techniques, we examine model fits on benchmark datasets to assess whether the algorithm behaves as theorized. An interactive web application enables users to explore the behavior of both the original and enhanced classifiers under controlled scenarios. The enhancements are implemented in the R package PPtreeExt.

📄 PDF Abstract BibTeX arXiv:2602.21130

Code (0)

등록된 구현이 없습니다.

Interactive Graphics for Visually Diagnosing Forest Classifiers in R

2017-04-08 · Natalia da Silva, Dianne Cook, Eun-Kyung Lee

This paper describes structuring data and constructing plots to explore forest classification models interactively. A forest classifier is an example of an ensemble, produced by bagging multiple trees. The process of bag…

Dimensionality Reduction General Classification

A Projection Pursuit Forest Algorithm for Supervised Classification

2018-07-19 · Natalia da Silva, Dianne Cook, Eun-Kyung Lee

This paper presents a new ensemble learning method for classification problems called projection pursuit random forest (PPF). PPF uses the PPtree algorithm introduced in Lee et al. (2013). In PPF, trees are constructed b…

Classification Ensemble Learning General Classification

Informative Data Projections: A Framework and Two Examples

2015-11-27 · Tijl De Bie, Jefrey Lijffijt, Raul Santos-Rodriguez, Bo Kang

Methods for Projection Pursuit aim to facilitate the visual exploration of high-dimensional data by identifying interesting low-dimensional projections. A major challenge is the design of a suitable quality metric of pro…

Vocal Bursts Valence Prediction

Projection pursuit based on Gaussian mixtures and evolutionary algorithms

2019-12-27 · Luca Scrucca, Alessio Serafini

We propose a projection pursuit (PP) algorithm based on Gaussian mixture models (GMMs). The negentropy obtained from a multivariate density estimated by GMMs is adopted as the PP index to be maximised. For a fixed dimens…

Density Estimation Evolutionary Algorithms

Optimal Projections for Classification with Naive Bayes

2024-09-09 · David P. Hofmeyr, Francois Kamper, Michail M. Melonas

In the Naive Bayes classification model the class conditional densities are estimated as the products of their marginal densities along the cardinal basis directions. We study the problem of obtaining an alternative basi…

Classification Dimensionality Reduction