Unifying Token and Span Level Supervisions for Few-Shot Sequence Labeling
Few-shot sequence labeling aims to identify novel classes based on only a few labeled samples. Existing methods solve the data scarcity problem mainly by designing token-level or span-level labeling models based on metric learning. However, these methods are only trained at a single granularity (i.e., either token level or span level) and have some weaknesses of the corresponding granularity. In this paper, we first unify token and span level supervisions and propose a Consistent Dual Adaptive Prototypical (CDAP) network for few-shot sequence labeling. CDAP contains the token-level and span-level networks, jointly trained at different granularities. To align the outputs of two networks, we further propose a consistent loss to enable them to learn from each other. During the inference phase, we propose a consistent greedy inference algorithm that first adjusts the predicted probability and then greedily selects non-overlapping spans with maximum probability. Extensive experiments show that our model achieves new state-of-the-art results on three benchmark datasets.
Code (1)
Tasks
Metric LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling
Few-Shot Sequence Labeling (FSSL) is a canonical paradigm for the tagging models, e.g., named entity recognition and slot filling, to generalize on an emerging, resource-scarce domain. Recently, the metric-based meta-lea…
Few-shot NERMeta-Learningnamed-entity-recognitionNamed Entity Recognition+3Improving Cross-Lingual Token Representations by Adding a Pinch of SALT
Cross-lingual sentence encoders enable scalable transfer across hundreds of languages, powering applications such as translation mining and zero-shot learning in low-resource settings. Although trained for sentence-level…
Zero-Shot LearningVoiceCraft-X: Unifying Multilingual, Voice-Cloning Speech Synthesis and Speech Editing
We introduce VoiceCraft-X, an autoregressive neural codec language model which unifies multilingual speech editing and zero-shot Text-to-Speech (TTS) synthesis across 11 languages: English, Mandarin, Korean, Japanese, Sp…
Speech SynthesisSelf-Promoted Supervision for Few-Shot Transformer
The few-shot learning ability of vision transformers (ViTs) is rarely investigated though heavily desired. In this work, we empirically find that with the same few-shot learning frameworks, \eg~Meta-Baseline, replacing t…
Data AugmentationFew-Shot LearningInductive BiasHybrid Multi-stage Decoding for Few-shot NER with Entity-aware Contrastive Learning
Few-shot named entity recognition can identify new types of named entities based on a few labeled examples. Previous methods employing token-level or span-level metric learning suffer from the computational burden and a …
ClassificationContrastive Learningfew-shot-nerFew-shot NER+5