paper-with-me

Papers

A Gradient-Based Split Criterion for Highly Accurate and Transparent Model Trees

2018-09-25 · Klaus Broelemann, Gjergji Kasneci

Machine learning algorithms aim at minimizing the number of false decisions and increasing the accuracy of predictions. However, the high predictive power of advanced algorithms comes at the costs of transparency. State-of-the-art methods, such as neural networks and ensemble methods, often result in highly complex models that offer little transparency. We propose shallow model trees as a way to combine simple and highly transparent predictive models for higher predictive power without losing the transparency of the original models. We present a novel split criterion for model trees that allows for significantly higher predictive power than state-of-the-art model trees while maintaining the same level of simplicity. This novel approach finds split points which allow the underlying simple models to make better predictions on the corresponding data. In addition, we introduce multiple mechanisms to increase the transparency of the resulting trees.

📄 PDF Abstract BibTeX arXiv:1809.09703

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Generalizing Few-Shot NAS with Gradient Matching

2022-03-29 · ICLR 2022 4 · Shoukang Hu, Ruochen Wang, Lanqing Hong, Zhenguo Li 외

Efficient performance estimation of architectures drawn from large search spaces is essential to Neural Architecture Search. One-Shot methods tackle this challenge by training one supernet to approximate the performance …

Neural Architecture Search

Splitting Steepest Descent for Growing Neural Architectures

2019-10-06 · NeurIPS 2019 12 · Qiang Liu, Lemeng Wu, Dilin Wang

We develop a progressive training approach for neural networks which adaptively grows the network structure by splitting existing neurons to multiple off-springs. By leveraging a functional steepest descent idea, we deri…

Quaternion MLP Neural Networks Based on the Maximum Correntropy Criterion

2023-09-11 · Gang Wang, Xinyu Tian, Zuxuan Zhang

We propose a gradient ascent algorithm for quaternion multilayer perceptron (MLP) networks based on the cost function of the maximum correntropy criterion (MCC). In the algorithm, we use the split quaternion activation f…

Wasserstein Random Forests and Applications in Heterogeneous Treatment Effects

2020-06-08 · Qiming Du, Gérard Biau, François Petit, Raphaël Porcher

We present new insights into causal inference in the context of Heterogeneous Treatment Effects by proposing natural variants of Random Forests to estimate the key conditional distributions. To achieve this, we recast Br…

Causal InferencePhilosophy

Multi forests: Variable importance for multi-class outcomes

2024-09-13 · Roman Hornung, Alexander Hapfelmeier

In prediction tasks with multi-class outcomes, identifying covariates specifically associated with one or more outcome classes can be important. Conventional variable importance measures (VIMs) from random forests (RFs),…