paper-with-me

홈 › Papers

Improving Low-Resource Sequence Labeling with Knowledge Fusion and Contextual Label Explanations

2025-01-31 · Peichao Lai, Jiaxin Gan, Feiyang Ye, Yilei Wang, Bin Cui

Sequence labeling remains a significant challenge in low-resource, domain-specific scenarios, particularly for character-dense languages like Chinese. Existing methods primarily focus on enhancing model comprehension and improving data diversity to boost performance. However, these approaches still struggle with inadequate model applicability and semantic distribution biases in domain-specific contexts. To overcome these limitations, we propose a novel framework that combines an LLM-based knowledge enhancement workflow with a span-based Knowledge Fusion for Rich and Efficient Extraction (KnowFREE) model. Our workflow employs explanation prompts to generate precise contextual interpretations of target entities, effectively mitigating semantic biases and enriching the model's contextual understanding. The KnowFREE model further integrates extension label features, enabling efficient nested entity extraction without relying on external knowledge during inference. Experiments on multiple Chinese domain-specific sequence labeling datasets demonstrate that our approach achieves state-of-the-art performance, effectively addressing the challenges posed by low-resource settings.

📄 PDF Abstract BibTeX arXiv:2501.19093

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Low-Resource Sequence Labeling via Unsupervised Multilingual Contextualized Representations

2019-10-24 · IJCNLP 2019 11 · Zuyi Bao, Rui Huang, Chen Li, Kenny Q. Zhu

Previous work on cross-lingual sequence labeling tasks either requires parallel data or bridges the two languages through word-byword matching. Such requirements and assumptions are infeasible for most languages, especia…

Language ModelingLanguage ModellingNERPOS

Fine-grained Knowledge Fusion for Sequence Labeling Domain Adaptation

2019-09-10 · IJCNLP 2019 11 · Huiyun Yang, Shu-Jian Huang, Xin-yu Dai, Jia-Jun Chen

In sequence labeling, previous domain adaptation methods focus on the adaptation from the source domain to the entire target domain without considering the diversity of individual target domain samples, which may lead to…

DiversityDomain Adaptation

More Embeddings, Better Sequence Labelers?

2020-09-17 · Findings of the Association for Computational Linguistics 2020 · Xinyu Wang, Yong Jiang, Nguyen Bach, Tao Wang 외

Recent work proposes a family of contextual embeddings that significantly improves the accuracy of sequence labelers over non-contextual embeddings. However, there is no definite conclusion on whether we can build better…

ChunkingWord Embeddings

UDapter: Typology-based Language Adapters for Multilingual Dependency Parsing and Sequence Labeling

2022-09-01 · CL (ACL) 2022 9 · Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord

Recent advances in multilingual language modeling have brought the idea of a truly universal parser closer to reality. However, such models are still not immune to the “curse of multilinguality”: Cross-language interfere…

Dependency ParsingLanguage ModelingLanguage ModellingMorphological Tagging+3

Augmented Natural Language for Generative Sequence Labeling

2020-09-15 · EMNLP 2020 11 · Ben Athiwaratkun, Cicero Nogueira dos santos, Jason Krone, Bing Xiang

We propose a generative framework for joint sequence labeling and sentence-level classification. Our model performs multiple sequence labeling tasks at once using a single, shared natural language output space. Unlike pr…

intent-classificationIntent Classificationnamed-entity-recognitionNamed Entity Recognition+2