paper-with-me

홈 › Papers

Training Classifiers with Natural Language Explanations

2018-05-10 · ACL 2018 7 · Braden Hancock, Paroma Varma, Stephanie Wang, Martin Bringmann, Percy Liang, Christopher Ré

Training accurate classifiers requires many labels, but each label provides only limited information (one bit for binary classification). In this work, we propose BabbleLabble, a framework for training classifiers in which an annotator provides a natural language explanation for each labeling decision. A semantic parser converts these explanations into programmatic labeling functions that generate noisy labels for an arbitrary amount of unlabeled data, which is used to train a classifier. On three relation extraction tasks, we find that users are able to train classifiers with comparable F1 scores from 5-100$\times$ faster by providing explanations instead of just labels. Furthermore, given the inherent imperfection of labeling functions, we find that a simple rule-based semantic parser suffices.

📄 PDF Abstract BibTeX arXiv:1805.03818

Code (2)

https://worksheets.codalab.org/worksheets/0x900e7e41deaa4ec5b2fe41dc50594548 공식 구현
MurtyShikhar/ExpBERT pytorch

Tasks

Binary ClassificationGeneral ClassificationRelation Extraction

Similar Papers 제목 키워드 기반

CLUES: A Benchmark for Learning Classifiers using Natural Language Explanations

2022-04-14 · ACL 2022 5 · Rakesh R Menon, Sayan Ghosh, Shashank Srivastava

Supervised learning has traditionally focused on inductive learning by observing labeled examples of a task. In contrast, humans have the ability to learn new concepts from language. Here, we explore training zero-shot c…

Inductive Learning

DISCERN: Decoding Systematic Errors in Natural Language for Text Classifiers

2024-10-29 · Rakesh R. Menon, Shashank Srivastava

Despite their high predictive accuracies, current machine learning systems often exhibit systematic biases stemming from annotation artifacts or insufficient support for certain classes in the dataset. Recent work propos…

Active Learningtext-classificationText Classification

Zero-shot Learning of Classifiers from Natural Language Quantification

2018-07-01 · ACL 2018 7 · Shashank Srivastava, Igor Labutov, Tom Mitchell

Humans can efficiently learn new concepts using language. We present a framework through which a set of explanations of a concept can be used to learn a classifier without access to any labeled examples. We use semantic …

Semantic ParsingZero-Shot Learning

Generating Token-Level Explanations for Natural Language Inference

2019-04-24 · NAACL 2019 6 · James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Arpit Mittal

The task of Natural Language Inference (NLI) is widely modeled as supervised sentence pair classification. While there has been a lot of work recently on generating explanations of the predictions of classifiers on a sin…

Multiple Instance LearningNatural Language InferenceSentenceSentence-Pair Classification

LLMs are One-Shot URL Classifiers and Explainers

2024-09-22 · Fariza Rashid, Nishavi Ranaweera, Ben Doyle, Suranga Seneviratne

Malicious URL classification represents a crucial aspect of cyber security. Although existing work comprises numerous machine learning and deep learning-based URL classification models, most suffer from generalisation an…

Domain AdaptationInformativenessOne-Shot Learning