RRL: A Scalable Classifier for Interpretable Rule-Based Representation Learning

2021-01-01 · Zhuo Wang, Wei zhang, Ning Liu, Jianyong Wang

Rule-based models, e.g., decision trees, are widely used in scenarios demanding high model interpretability for their transparent inner structures and good model expressivity. However, rule-based models are hard to optimize, especially on large data sets, due to their discrete parameters and structures. Ensemble methods and fuzzy/soft rules are commonly used to tackle these issues, but they sacrifice the model interpretability. In this paper, we propose a new classifier, named Rule-based Representation Learner (RRL), that automatically learns interpretable non-fuzzy rules for data representation. To train the non-differentiable RRL effectively, we project it to a continuous space and propose a novel training method, called Gradient Grafting, that can directly optimize the discrete model using gradient descent. An improved design of logical activation functions is also devised to increase the scalability of RRL and enable it to discretize the continuous features end-to-end. Exhaustive experiments on 9 small and 4 large data sets show that RRL outperforms the competitive approaches, has low complexity close to the simple decision trees, and is rational for its main technical contributions.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Efficient Learning of Interpretable Classification Rules

2022-05-14 · Bishwamittra Ghosh, Dmitry Malioutov, Kuldeep S. Meel

Machine learning has become omnipresent with applications in various safety-critical domains such as medical, law, and transportation. In these domains, high-stake decisions provided by machine learning necessitate resea…

BIG-bench Machine Learning Classification Incremental Learning Interpretable Machine Learning

Learning Interpretable Rules for Scalable Data Representation and Classification

2023-10-22 · Zhuo Wang, Wei zhang, Ning Liu, Jianyong Wang

Classification

Scalable Rule-Based Representation Learning for Interpretable Classification

2021-09-30 · NeurIPS 2021 12 · Zhuo Wang, Wei zhang, Ning Liu, Jianyong Wang

Classification Representation Learning

Applying Interval Type-2 Fuzzy Rule Based Classifiers Through a Cluster-Based Class Representation

2016-07-21 · Javier Navarro, Christian Wagner, Uwe Aickelin

Fuzzy Rule-Based Classification Systems (FRBCSs) have the potential to provide so-called interpretable classifiers, i.e. classifiers which can be introspective, understood, validated and augmented by human experts by rel…

Classification Clustering General Classification

Interpretable Rule Discovery Through Bilevel Optimization of Split-Rules of Nonlinear Decision Trees for Classification Problems

2020-08-02 · Yashesh Dhebar, Kalyanmoy Deb

For supervised classification problems involving design, control, other practical purposes, users are not only interested in finding a highly accurate classifier, but they also demand that the obtained classifier be easi…

Bilevel Optimization