PRBoost: Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning
Weakly-supervised learning (WSL) has shown promising results in addressing label scarcity on many NLP tasks, but manually designing a comprehensive, high-quality labeling rule set is tedious and difficult. We study interactive weakly-supervised learning -- the problem of iteratively and automatically discovering novel labeling rules from data to improve the WSL model. Our proposed model, named PRBoost, achieves this goal via iterative prompt-based rule discovery and model boosting. It uses boosting to identify large-error instances and then discovers candidate rules from them by prompting pre-trained LMs with rule templates. The candidate rules are judged by human experts, and the accepted rules are used to generate complementary weak labels and strengthen the current model. Experiments on four tasks show PRBoost outperforms state-of-the-art WSL baselines up to 7.1% and bridges the gaps with fully supervised models. Our Implementation is available at \url{https://github.com/rz-zhang/PRBoost}.
Code (1)
Tasks
Weakly-supervised LearningSimilar Papers 제목 키워드 기반
Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning
Weakly-supervised learning (WSL) has shown promising results in addressing label scarcity on many NLP tasks, but manually designing a comprehensive, high-quality labeling rule set is tedious and difficult. We study inter…
Weakly-supervised LearningAdaptive Multi-view Rule Discovery for Weakly-Supervised Compatible Products Prediction
On e-commerce platforms, predicting if two products are compatible with each other is an important functionality to achieve trustworthy product recommendation and search experience for consumers. However, accurately pred…
AttributeLanguage ModelingLanguage ModellingProduct RecommendationVisual Knowledge Discovery with General Line Coordinates
Understanding black-box Machine Learning methods on multidimensional data is a key challenge in Machine Learning. While many powerful Machine Learning methods already exist, these methods are often unexplainable or perfo…
Failing to Falsify: Evaluating and Mitigating Confirmation Bias in Language Models
Confirmation bias, the tendency to seek evidence that supports rather than challenges one's belief, hinders one's reasoning ability. We examine whether large language models (LLMs) exhibit confirmation bias by adapting t…
Integrating Domain Knowledge into Process Discovery Using Large Language Models
Process discovery aims to derive process models from event logs, providing insights into operational behavior and forming a foundation for conformance checking and process improvement. However, models derived solely from…
Prompt Engineering