Explicating feature contribution using Random Forest proximity distances
In Random Forests, proximity distances are a metric representation of data into decision space. By observing how changes in input map to the movement of instances in this space we are able to determine the independent contribution of each feature to the decision-making process. For binary feature vectors, this process is fully specified. As these changes in input move particular instances nearer to the in-group or out-group, the independent contribution of each feature can be uncovered. Using this technique, we are able to calculate the contribution of each feature in determining how black-box decisions were made. This allows explication of the decision-making process, audit of the classifier, and post-hoc analysis of errors in classification.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingGeneral ClassificationSimilar Papers 제목 키워드 기반
RFX-Fuse: Breiman and Cutler's Unified ML Engine + Native Explainable Similarity
Breiman and Cutler's original Random Forest was designed as a unified ML engine -- not merely an ensemble predictor. Their implementation included classification, regression, unsupervised learning, proximity-based simila…
Outlier DetectionRFX: High-Performance Random Forests with GPU Acceleration and QLORA Compression
RFX (Random Forests X), where X stands for compression or quantization, presents a production-ready implementation of Breiman and Cutler's Random Forest classification methodology in Python. RFX v1.0 provides complete cl…
Learning Interpretable Characteristic Kernels via Decision Forests
Decision forests are widely used for classification and regression tasks. A lesser known property of tree-based methods is that one can construct a proximity matrix from the tree(s), and these proximity matrices are indu…
Feature ImportanceGeneral ClassificationInterpreting Deep Forest through Feature Contribution and MDI Feature Importance
Deep forest is a non-differentiable deep model which has achieved impressive empirical success across a wide variety of applications, especially on categorical/symbolic or mixed modeling tasks. Many of the application fi…
Explainable ModelsFeature ImportanceInterpreting random forest classification models using a feature contribution method
Model interpretation is one of the key aspects of the model evaluation process. The explanation of the relationship between model variables and outputs is relatively easy for statistical models, such as linear regression…
ClassificationGeneral Classification