paper-with-me

Papers

Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Survey

2025-02-15 · Zirui Song, Bin Yan, YuHan Liu, Miao Fang, Mingzhe Li, Rui Yan, Xiuying Chen

Large Language Models (LLMs) have demonstrated remarkable success in various tasks such as natural language understanding, text summarization, and machine translation. However, their general-purpose nature often limits their effectiveness in domain-specific applications that require specialized knowledge, such as healthcare, chemistry, or legal analysis. To address this, researchers have explored diverse methods to enhance LLMs by integrating domain-specific knowledge. In this survey, we provide a comprehensive overview of these methods, which we categorize into four key approaches: dynamic knowledge injection, static knowledge embedding, modular adapters, and prompt optimization. Each approach offers unique mechanisms to equip LLMs with domain expertise, balancing trade-offs between flexibility, scalability, and efficiency. We discuss how these methods enable LLMs to tackle specialized tasks, compare their advantages and disadvantages, evaluate domain-specific LLMs against general LLMs, and highlight the challenges and opportunities in this emerging field. For those interested in delving deeper into this area, we also summarize the commonly used datasets and benchmarks. To keep researchers updated on the latest studies, we maintain an open-source at: https://github.com/abilliyb/Knowledge_Injection_Survey_Papers, dedicated to documenting research in the field of specialized LLM.

📄 PDF Abstract BibTeX arXiv:2502.10708

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNatural Language UnderstandingText Summarization

Similar Papers 제목 키워드 기반

Injecting Domain Knowledge in Language Models for Task-Oriented Dialogue Systems

2022-12-15 · Denis Emelin, Daniele Bonadiman, Sawsan Alqahtani, Yi Zhang 외

Pre-trained language models (PLM) have advanced the state-of-the-art across NLP applications, but lack domain-specific knowledge that does not naturally occur in pre-training data. Previous studies augmented PLMs with sy…

Knowledge ProbingResponse GenerationTask-Oriented Dialogue Systems

Enhancing Chest X-ray Classification through Knowledge Injection in Cross-Modality Learning

2025-02-19 · Yang Yan, Bingqing Yue, Qiaxuan Li, Man Huang 외

The integration of artificial intelligence in medical imaging has shown tremendous potential, yet the relationship between pre-trained knowledge and performance in cross-modality learning remains unclear. This study inve…

Caption GenerationClassificationDiagnosticMedical Image Analysis+3

Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories

2023-06-08 · Shizhe Diao, Tianyang Xu, Ruijia Xu, Jiawei Wang 외

Pre-trained language models (PLMs) demonstrate excellent abilities to understand texts in the generic domain while struggling in a specific domain. Although continued pre-training on a large domain-specific corpus is eff…

Domain Adaptation

Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking

2021-05-30 · ACL 2021 5 · Fangyu Liu, Ivan Vulić, Anna Korhonen, Nigel Collier

Injecting external domain-specific knowledge (e.g., UMLS) into pretrained language models (LMs) advances their capability to handle specialised in-domain tasks such as biomedical entity linking (BEL). However, such abund…

Cross-Lingual TransferEntity Linking

Advantages of Domain Knowledge Injection for Legal Document Summarization: A Case Study on Summarizing Indian Court Judgments in English and Hindi

2026-02-07 · Debtanu Datta, Rajdeep Mukherjee, Adrijit Goswami, Saptarshi Ghosh arxiv

Summarizing Indian legal court judgments is a complex task not only due to the intricate language and unstructured nature of the legal texts, but also since a large section of the Indian population does not understand th…

Document Summarization