paper-with-me

홈 › Papers

Bayes Point Rule Set Learning

2022-04-11 · Fabio Aiolli, Luca Bergamin, Tommaso Carraro, Mirko Polato

Interpretability is having an increasingly important role in the design of machine learning algorithms. However, interpretable methods tend to be less accurate than their black-box counterparts. Among others, DNFs (Disjunctive Normal Forms) are arguably the most interpretable way to express a set of rules. In this paper, we propose an effective bottom-up extension of the popular FIND-S algorithm to learn DNF-type rulesets. The algorithm greedily finds a partition of the positive examples. The produced DNF is a set of conjunctive rules, each corresponding to the most specific rule consistent with a part of positive and all negative examples. We also propose two principled extensions of this method, approximating the Bayes Optimal Classifier by aggregating DNF decision rules. Finally, we provide a methodology to significantly improve the explainability of the learned rules while retaining their generalization capabilities. An extensive comparison with state-of-the-art symbolic and statistical methods on several benchmark data sets shows that our proposal provides an excellent balance between explainability and accuracy.

📄 PDF Abstract BibTeX arXiv:2204.05251

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Probability Theory without Bayes' Rule

2014-11-28 · Samuel G. Rodriques

Within the Kolmogorov theory of probability, Bayes' rule allows one to perform statistical inference by relating conditional probabilities to unconditional probabilities. As we show here, however, there is a continuous s…

Rule-based Evolutionary Bayesian Learning

2022-02-28 · Themistoklis Botsas, Lachlan R. Mason, Omar K. Matar, Indranil Pan

In our previous work, we introduced the rule-based Bayesian Regression, a methodology that leverages two concepts: (i) Bayesian inference, for the general framework and uncertainty quantification and (ii) rule-based syst…

Bayesian InferenceUncertainty Quantification

On Bayesian Exponentially Embedded Family for Model Order Selection

2017-03-30 · Zhenghan Zhu, Steven Kay

In this paper, we derive a Bayesian model order selection rule by using the exponentially embedded family method, termed Bayesian EEF. Unlike many other Bayesian model selection methods, the Bayesian EEF can use vague pr…

Model Selection

Bayesian Learning Approach to Model Predictive Control

2022-03-05 · Namhoon Cho, Seokwon Lee, Hyo-Sang Shin, Antonios Tsourdos

This study presents a Bayesian learning perspective towards model predictive control algorithms. High-level frameworks have been developed separately in the earlier studies on Bayesian learning and sampling-based model p…

modelModel Predictive Control

Convergence Analysis of Deterministic Kernel-Based Quadrature Rules in Misspecified Settings

2017-09-01 · Motonobu Kanagawa, Bharath K. Sriperumbudur, Kenji Fukumizu

This paper presents a convergence analysis of kernel-based quadrature rules in misspecified settings, focusing on deterministic quadrature in Sobolev spaces. In particular, we deal with misspecified settings where a test…