paper-with-me

홈 › Papers

KoGNER: A Novel Framework for Knowledge Graph Distillation on Biomedical Named Entity Recognition

2025-03-19 · Heming Zhang, Wenyu Li, Di Huang, Yinjie Tang, Yixin Chen, Philip Payne, Fuhai Li

Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP) that plays a crucial role in information extraction, question answering, and knowledge-based systems. Traditional deep learning-based NER models often struggle with domain-specific generalization and suffer from data sparsity issues. In this work, we introduce Knowledge Graph distilled for Named Entity Recognition (KoGNER), a novel approach that integrates Knowledge Graph (KG) distillation into NER models to enhance entity recognition performance. Our framework leverages structured knowledge representations from KGs to enrich contextual embeddings, thereby improving entity classification and reducing ambiguity in entity detection. KoGNER employs a two-step process: (1) Knowledge Distillation, where external knowledge sources are distilled into a lightweight representation for seamless integration with NER models, and (2) Entity-Aware Augmentation, which integrates contextual embeddings that have been enriched with knowledge graph information directly into GNN, thereby improving the model's ability to understand and represent entity relationships. Experimental results on benchmark datasets demonstrate that KoGNER achieves state-of-the-art performance, outperforming finetuned NER models and LLMs by a significant margin. These findings suggest that leveraging knowledge graphs as auxiliary information can significantly improve NER accuracy, making KoGNER a promising direction for future research in knowledge-aware NLP.

📄 PDF Abstract BibTeX arXiv:2503.15737

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge DistillationKnowledge Graphsnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERQuestion Answering

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Graph Relation Distillation for Efficient Biomedical Instance Segmentation

2024-01-12 · Xiaoyu Liu, Yueyi Zhang, Zhiwei Xiong, Wei Huang 외

Instance-aware embeddings predicted by deep neural networks have revolutionized biomedical instance segmentation, but its resource requirements are substantial. Knowledge distillation offers a solution by transferring di…

Instance SegmentationKnowledge DistillationRelationSemantic Segmentation

m-KAILIN: Knowledge-Driven Agentic Scientific Corpus Distillation Framework for Biomedical Large Language Models Training

2025-04-28 · Meng Xiao, Xunxin Cai, Qingqing Long, Chengrui Wang 외

Corpus distillation for biomedical large language models (LLMs) seeks to address the pressing challenge of insufficient quantity and quality in open-source annotated scientific corpora, which remains a bottleneck for eff…

Question Answering

BioLORD-2023: Semantic Textual Representations Fusing LLM and Clinical Knowledge Graph Insights

2023-11-27 · François Remy, Kris Demuynck, Thomas Demeester

In this study, we investigate the potential of Large Language Models to complement biomedical knowledge graphs in the training of semantic models for the biomedical and clinical domains. Drawing on the wealth of the UMLS…

Clinical KnowledgeContrastive LearningKnowledge GraphsRepresentation Learning

Domain Knowledge Transferring for Pre-trained Language Model via Calibrated Activation Boundary Distillation

2022-05-01 · ACL 2022 5 · Dongha Choi, HongSeok Choi, Hyunju Lee

Since the development and wide use of pretrained language models (PLMs), several approaches have been applied to boost their performance on downstream tasks in specific domains, such as biomedical or scientific domains. …

Knowledge DistillationLanguage ModelingLanguage Modelling

Distilling Large Language Models for Biomedical Knowledge Extraction: A Case Study on Adverse Drug Events

2023-07-12 · Yu Gu, Sheng Zhang, Naoto Usuyama, Yonas Woldesenbet 외

Large language models (LLMs), such as GPT-4, have demonstrated remarkable capabilities across a wide range of tasks, including health applications. In this paper, we study how LLMs can be used to scale biomedical knowled…

Self-Supervised Learning