paper-with-me

Papers

Unifying Token and Span Level Supervisions for Few-Shot Sequence Labeling

2023-07-16 · Zifeng Cheng, Qingyu Zhou, Zhiwei Jiang, Xuemin Zhao, Yunbo Cao, Qing Gu

Few-shot sequence labeling aims to identify novel classes based on only a few labeled samples. Existing methods solve the data scarcity problem mainly by designing token-level or span-level labeling models based on metric learning. However, these methods are only trained at a single granularity (i.e., either token level or span level) and have some weaknesses of the corresponding granularity. In this paper, we first unify token and span level supervisions and propose a Consistent Dual Adaptive Prototypical (CDAP) network for few-shot sequence labeling. CDAP contains the token-level and span-level networks, jointly trained at different granularities. To align the outputs of two networks, we further propose a consistent loss to enable them to learn from each other. During the inference phase, we propose a consistent greedy inference algorithm that first adjusts the predicted probability and then greedily selects non-overlapping spans with maximum probability. Extensive experiments show that our model achieves new state-of-the-art results on three benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2307.07946

Code (1)

zifengcheng/cdap 공식 구현 pytorch

Tasks

Metric Learning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling

2021-09-27 · NAACL 2022 7 · Peiyi Wang, Runxin Xu, Tianyu Liu, Qingyu Zhou 외

Few-Shot Sequence Labeling (FSSL) is a canonical paradigm for the tagging models, e.g., named entity recognition and slot filling, to generalize on an emerging, resource-scarce domain. Recently, the metric-based meta-lea…

Few-shot NERMeta-Learningnamed-entity-recognitionNamed Entity Recognition+3

Improving Cross-Lingual Token Representations by Adding a Pinch of SALT

2026-09-09 · Guillem Ramírez arxiv

Cross-lingual sentence encoders enable scalable transfer across hundreds of languages, powering applications such as translation mining and zero-shot learning in low-resource settings. Although trained for sentence-level…

Zero-Shot Learning

VoiceCraft-X: Unifying Multilingual, Voice-Cloning Speech Synthesis and Speech Editing

2025-11-15 · Zhisheng Zheng, Puyuan Peng, Anuj Diwan, Cong Phuoc Huynh 외 arxiv

We introduce VoiceCraft-X, an autoregressive neural codec language model which unifies multilingual speech editing and zero-shot Text-to-Speech (TTS) synthesis across 11 languages: English, Mandarin, Korean, Japanese, Sp…

Speech Synthesis

Self-Promoted Supervision for Few-Shot Transformer

2022-03-14 · Bowen Dong, Pan Zhou, Shuicheng Yan, WangMeng Zuo

The few-shot learning ability of vision transformers (ViTs) is rarely investigated though heavily desired. In this work, we empirically find that with the same few-shot learning frameworks, \eg~Meta-Baseline, replacing t…

Data AugmentationFew-Shot LearningInductive Bias

Hybrid Multi-stage Decoding for Few-shot NER with Entity-aware Contrastive Learning

2024-04-10 · Peipei Liu, Gaosheng Wang, Ying Tong, Jian Liang 외

Few-shot named entity recognition can identify new types of named entities based on a few labeled examples. Previous methods employing token-level or span-level metric learning suffer from the computational burden and a …

ClassificationContrastive Learningfew-shot-nerFew-shot NER+5