paper-with-me

Papers

Cluster-Based Random Forest Visualization and Interpretation

2025-07-30 · Max Sondag, Christofer Meinecke, Dennis Collaris, Tatiana von Landesberger, Stef van den Elzen arxiv

Random forests are a machine learning method used to automatically classify datasets and consist of a multitude of decision trees. While these random forests often have higher performance and generalize better than a single decision tree, they are also harder to interpret. This paper presents a visualization method and system to increase interpretability of random forests. We cluster similar trees which enables users to interpret how the model performs in general without needing to analyze each individual decision tree in detail, or interpret an oversimplified summary of the full forest. To meaningfully cluster the decision trees, we introduce a new distance metric that takes into account both the decision rules as well as the predictions of a pair of decision trees. We also propose two new visualization methods that visualize both clustered and individual decision trees: (1) The Feature Plot, which visualizes the topological position of features in the decision trees, and (2) the Rule Plot, which visualizes the decision rules of the decision trees. We demonstrate the efficacy of our approach through a case study on the "Glass" dataset, which is a relatively complex standard machine learning dataset, as well as a small user study.

📄 PDF Abstract BibTeX arXiv:2507.22665

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Naïve Bayes and Random Forest for Crop Yield Prediction

2024-04-23 · Abbas Maazallahi, Sreehari Thota, Naga Prasad Kondaboina, Vineetha Muktineni 외

This study analyzes crop yield prediction in India from 1997 to 2020, focusing on various crops and key environmental factors. It aims to predict agricultural yields by utilizing advanced machine learning techniques like…

ClusteringCrop Yield PredictionPrediction

Similarity Kernel and Clustering via Random Projection Forests

2019-08-28 · Donghui Yan, Songxiang Gu, Ying Xu, Zhiwei Qin

Similarity plays a fundamental role in many areas, including data mining, machine learning, statistics and various applied domains. Inspired by the success of ensemble methods and the flexibility of trees, we propose to …

ClusteringClustering Ensemble

Forest Floor Visualizations of Random Forests

2016-05-30 · Soeren H. Welling, Hanne H. F. Refsgaard, Per B. Brockhoff, Line H. Clemmensen

We propose a novel methodology, forest floor, to visualize and interpret random forest (RF) models. RF is a popular and useful tool for non-linear multi-variate classification and regression, which yields a good trade-of…

Geometry- and Accuracy-Preserving Random Forest Proximities

2022-01-29 · Jake S. Rhodes, Adele Cutler, Kevin R. Moon

Random forests are considered one of the best out-of-the-box classification and regression algorithms due to their high level of predictive performance with relatively little tuning. Pairwise proximities can be computed …

Data VisualizationImputationOutlier Detectionregression

Random Forest Autoencoders for Guided Representation Learning

2025-02-18 · Adrien Aumon, Shuang Ni, Myriam Lizotte, Guy Wolf 외

Extensive research has produced robust methods for unsupervised data visualization. Yet supervised visualization$\unicode{x2013}$where expert labels guide representations$\unicode{x2013}$remains underexplored, as most su…

Data VisualizationDimensionality ReductionRepresentation Learning