Visualizing Random Forest with Self-Organising Map
Random Forest (RF) is a powerful ensemble method for classification and regression tasks. It consists of decision trees set. Although, a single tree is well interpretable for human, the ensemble of trees is a black-box model. The popular technique to look inside the RF model is to visualize a RF proximity matrix obtained on data samples with Multidimensional Scaling (MDS) method. Herein, we present a novel method based on Self-Organising Maps (SOM) for revealing intrinsic relationships in data that lay inside the RF used for classification tasks. We propose an algorithm to learn the SOM with the proximity matrix obtained from the RF. The visualization of RF proximity matrix with MDS and SOM is compared. What is more, the SOM learned with the RF proximity matrix has better classification accuracy in comparison to SOM learned with Euclidean distance. Presented approach enables better understanding of the RF and additionally improves accuracy of the SOM.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Forest structure in epigenetic landscapes
Morphogenesis is the biological process that causes the emergence and changes of patterns (tissues and organs) in living organisms. It is a robust, self-organising mechanism, governed by Genetic Regulatory Networks (GRN)…
Bayesian mechanics of self-organising systems
Bayesian mechanics provides a framework that addresses dynamical systems that can be conceptualised as Bayesian inference. However, elucidating the requisite generative models is essential for empirical applications to r…
Bayesian InferenceAttention and Self-Attention in Random Forests
New models of random forests jointly using the attention and self-attention mechanisms are proposed for solving the regression problem. The models can be regarded as extensions of the attention-based random forest whose …
regressionA conditional, a fuzzy and a probabilistic interpretation of self-organising maps
In this paper we establish a link between fuzzy and preferential semantics for description logics and Self-Organising Maps, which have been proposed as possible candidates to explain the psychological mechanisms underlyi…
A self-organising eigenspace map for time series clustering
This paper presents a novel time series clustering method, the self-organising eigenspace map (SOEM), based on a generalisation of the well-known self-organising feature map (SOFM). The SOEM operates on the eigenspaces o…
ClusteringTime SeriesTime Series AnalysisTime Series Clustering+2