paper-with-me

홈 › Papers

Interpretation and Simplification of Deep Forest

2020-01-14 · Sangwon Kim, Mira Jeong, Byoung Chul Ko

This paper proposes a new method for interpreting and simplifying a black box model of a deep random forest (RF) using a proposed rule elimination. In deep RF, a large number of decision trees are connected to multiple layers, thereby making an analysis difficult. It has a high performance similar to that of a deep neural network (DNN), but achieves a better generalizability. Therefore, in this study, we consider quantifying the feature contributions and frequency of the fully trained deep RF in the form of a decision rule set. The feature contributions provide a basis for determining how features affect the decision process in a rule set. Model simplification is achieved by eliminating unnecessary rules by measuring the feature contributions. Consequently, the simplified model has fewer parameters and rules than before. Experiment results have shown that a feature contribution analysis allows a black box model to be decomposed for quantitatively interpreting a rule set. The proposed method was successfully applied to various deep RF models and benchmark datasets while maintaining a robust performance despite the elimination of a large number of rules.

📄 PDF Abstract BibTeX arXiv:2001.04721

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Narrowing the Gap: Random Forests In Theory and In Practice

2013-10-04 · Misha Denil, David Matheson, Nando de Freitas

Despite widespread interest and practical use, the theoretical properties of random forests are still not well understood. In this paper we contribute to this understanding in two ways. We present a new theoretically tra…

regression

Conclusive Local Interpretation Rules for Random Forests

2021-04-13 · Ioannis Mollas, Nick Bassiliades, Grigorios Tsoumakas

In critical situations involving discrimination, gender inequality, economic damage, and even the possibility of casualties, machine learning models must be able to provide clear interpretations for their decisions. Othe…

Binary ClassificationDecision MakingMulti-class Classification

A Quantum-Inspired Ensemble Method and Quantum-Inspired Forest Regressors

2017-11-22 · Zeke Xie, Issei Sato

We propose a Quantum-Inspired Subspace(QIS) Ensemble Method for generating feature ensembles based on feature selections. We assign each principal component a Fraction Transition Probability as its probability weight bas…

Diversityregression

Forest-Chat: Adapting Vision-Language Agents for Interactive Forest Change Analysis

2026-01-21 · James Brock, Ce Zhang, Nantheera Anantrasirichai arxiv

The increasing availability of high-resolution satellite imagery, together with advances in deep learning, creates new opportunities for forest monitoring workflows. Two central challenges in this domain are pixel-level …

Change DetectionObject Counting

Local Interpretability of Random Forests for Multi-Target Regression

2023-03-29 · Avraam Bardos, Nikolaos Mylonas, Ioannis Mollas, Grigorios Tsoumakas

Multi-target regression is useful in a plethora of applications. Although random forest models perform well in these tasks, they are often difficult to interpret. Interpretability is crucial in machine learning, especial…

Multi-target regressionregression