Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification
A recent approach for few-shot text classification is to convert textual inputs to cloze questions that contain some form of task description, process them with a pretrained language model and map the predicted words to labels. Manually defining this mapping between words and labels requires both domain expertise and an understanding of the language model's abilities. To mitigate this issue, we devise an approach that automatically finds such a mapping given small amounts of training data. For a number of tasks, the mapping found by our approach performs almost as well as hand-crafted label-to-word mappings.
Code (2)
Tasks
Few-Shot Text ClassificationGeneral ClassificationLanguage ModelingLanguage Modellingtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Is ``hot pizza'' Positive or Negative? Mining Target-aware Sentiment Lexicons
Modelling a word{'}s polarity in different contexts is a key task in sentiment analysis. Previous works mainly focus on domain dependencies, and assume words{'} sentiments are invariant within a specific domain. In this …
Relation ExtractionSentiment AnalysisPrototypical Verbalizer for Prompt-based Few-shot Tuning
Prompt-based tuning for pre-trained language models (PLMs) has shown its effectiveness in few-shot learning. Typically, prompt-based tuning wraps the input text into a cloze question. To make predictions, the model maps …
Contrastive LearningEntity TypingFew-Shot LearningTopic ClassificationAutomatically Detecting the Position and Type of Psychiatric Evaluation Report Sections
Psychiatric evaluation reports represent a rich and still mostly-untapped source of information for developing systems for automatic diagnosis and treatment of mental health problems. These reports contain free-text stru…
PositionSemantic ParsingVocal Bursts Type PredictionPrototypical Verbalizer for Prompt-based Few-shot Tuning
Prompt-based tuning for pre-trained language models (PLMs) has shown its effectiveness in few-shot learning. Typically, prompt-based tuning wraps the input text into a cloze question. To make predictions, the model maps …
Contrastive LearningEntity TypingFew-Shot LearningTopic ClassificationEvolutionary Verbalizer Search for Prompt-based Few Shot Text Classification
Recent advances for few-shot text classification aim to wrap textual inputs with task-specific prompts to cloze questions. By processing them with a masked language model to predict the masked tokens and using a verbaliz…
Few-Shot Text ClassificationLanguage ModelingLanguage Modellingtext-classification+1