Learning Rules-First Classifiers
Complex classifiers may exhibit "embarassing" failures in cases where humans can easily provide a justified classification. Avoiding such failures is obviously of key importance. In this work, we focus on one such setting, where a label is perfectly predictable if the input contains certain features, or rules, and otherwise it is predictable by a linear classifier. We define a hypothesis class that captures this notion and determine its sample complexity. We also give evidence that efficient algorithms cannot achieve this sample complexity. We then derive a simple and efficient algorithm and show that its sample complexity is close to optimal, among efficient algorithms. Experiments on synthetic and sentiment analysis data demonstrate the efficacy of the method, both in terms of accuracy and interpretability.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationSentiment AnalysisSimilar Papers 제목 키워드 기반
Shared Task in Evaluating Accuracy: Leveraging Pre-Annotations in the Validation Process
We hereby present our submission to the Shared Task in Evaluating Accuracy at the INLG 2021 Conference. Our evaluation protocol relies on three main components; rules and text classifiers that pre-annotate the dataset, a…
RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers
The high performance of tree ensemble classifiers benefits from a large set of rules, which, in turn, makes the models hard to understand. To improve interpretability, existing methods extract a subset of rules for appro…
Computer-Assisted Creation of Boolean Search Rules for Text Classification in the Legal Domain
In this paper, we present a method of building strong, explainable classifiers in the form of Boolean search rules. We developed an interactive environment called CASE (Computer Assisted Semantic Exploration) which explo…
BIG-bench Machine Learningtext-classificationText ClassificationApplying Interval Type-2 Fuzzy Rule Based Classifiers Through a Cluster-Based Class Representation
Fuzzy Rule-Based Classification Systems (FRBCSs) have the potential to provide so-called interpretable classifiers, i.e. classifiers which can be introspective, understood, validated and augmented by human experts by rel…
ClassificationClusteringGeneral ClassificationComputing Optimal Decision Sets with SAT
As machine learning is increasingly used to help make decisions, there is a demand for these decisions to be explainable. Arguably, the most explainable machine learning models use decision rules. This paper focuses on d…
BIG-bench Machine Learning