paper-with-me

홈 › Papers

Enhancing Large Language Models (LLMs) for Telecommunications using Knowledge Graphs and Retrieval-Augmented Generation

2025-03-31 · Dun Yuan, Hao Zhou, Di wu, Xue Liu, Hao Chen, Yan Xin, Jianzhong, Zhang

Large language models (LLMs) have made significant progress in general-purpose natural language processing tasks. However, LLMs are still facing challenges when applied to domain-specific areas like telecommunications, which demands specialized expertise and adaptability to evolving standards. This paper presents a novel framework that combines knowledge graph (KG) and retrieval-augmented generation (RAG) techniques to enhance LLM performance in the telecom domain. The framework leverages a KG to capture structured, domain-specific information about network protocols, standards, and other telecom-related entities, comprehensively representing their relationships. By integrating KG with RAG, LLMs can dynamically access and utilize the most relevant and up-to-date knowledge during response generation. This hybrid approach bridges the gap between structured knowledge representation and the generative capabilities of LLMs, significantly enhancing accuracy, adaptability, and domain-specific comprehension. Our results demonstrate the effectiveness of the KG-RAG framework in addressing complex technical queries with precision. The proposed KG-RAG model attained an accuracy of 88% for question answering tasks on a frequently used telecom-specific dataset, compared to 82% for the RAG-only and 48% for the LLM-only approaches.

📄 PDF Abstract BibTeX arXiv:2503.24245

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge GraphsQuestion AnsweringRAGResponse GenerationRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Residual Connection 설명 없음
WordPiece 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Linguistic Intelligence in Large Language Models for Telecommunications

2024-02-24 · Tasnim Ahmed, Nicola Piovesan, Antonio De Domenico, Salimur Choudhury

Large Language Models (LLMs) have emerged as a significant advancement in the field of Natural Language Processing (NLP), demonstrating remarkable capabilities in language generation and other language-centric tasks. Des…

Text Generation

Tele-LLMs: A Series of Specialized Large Language Models for Telecommunications

2024-09-09 · Ali Maatouk, Kenny Chirino Ampudia, Rex Ying, Leandros Tassiulas

The emergence of large language models (LLMs) has significantly impacted various fields, from natural language processing to sectors like medicine and finance. However, despite their rapid proliferation, the applications…

TeleEval-OS: Performance evaluations of large language models for operations scheduling

2025-05-06 · Yanyan Wang, Yingying Wang, Junli Liang, Yin Xu 외

The rapid advancement of large language models (LLMs) has significantly propelled progress in artificial intelligence, demonstrating substantial application potential across multiple specialized domains. Telecommunicatio…

Scheduling

Technical Language Processing for Telecommunications Specifications

2024-06-04 · Felipe A. Rodriguez Y.

Large Language Models (LLMs) are continuously being applied in a more diverse set of contexts. At their current state, however, even state-of-the-art LLMs such as Generative Pre-Trained Transformer 4 (GTP-4) have challen…

TeleQnA: A Benchmark Dataset to Assess Large Language Models Telecommunications Knowledge

2023-10-23 · Ali Maatouk, Fadhel Ayed, Nicola Piovesan, Antonio De Domenico 외

We introduce TeleQnA, the first benchmark dataset designed to evaluate the knowledge of Large Language Models (LLMs) in telecommunications. Comprising 10,000 questions and answers, this dataset draws from diverse sources…

ArticlesQuestion GenerationQuestion-Generation