paper-with-me

홈 › Papers

EpilepsyLLM: Domain-Specific Large Language Model Fine-tuned with Epilepsy Medical Knowledge

2024-01-11 · Xuyang Zhao, Qibin Zhao, Toshihisa Tanaka

With large training datasets and massive amounts of computing sources, large language models (LLMs) achieve remarkable performance in comprehensive and generative ability. Based on those powerful LLMs, the model fine-tuned with domain-specific datasets posseses more specialized knowledge and thus is more practical like medical LLMs. However, the existing fine-tuned medical LLMs are limited to general medical knowledge with English language. For disease-specific problems, the model's response is inaccurate and sometimes even completely irrelevant, especially when using a language other than English. In this work, we focus on the particular disease of Epilepsy with Japanese language and introduce a customized LLM termed as EpilepsyLLM. Our model is trained from the pre-trained LLM by fine-tuning technique using datasets from the epilepsy domain. The datasets contain knowledge of basic information about disease, common treatment methods and drugs, and important notes in life and work. The experimental results demonstrate that EpilepsyLLM can provide more reliable and specialized medical knowledge responses.

📄 PDF Abstract BibTeX arXiv:2401.05908

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

SLM Finetuning for Natural Language to Domain Specific Code Generation in Production

2026-04-10 · Renjini R. Nair, Damian K. Kowalczyk, Marco Gaudesi, Chhaya Methani arxiv

Many applications today use large language models for code generation; however, production systems have strict latency requirements that can be difficult to meet with large models. Small language models with a few billio…

Code Generation

Regex-augmented Domain Transfer Topic Classification based on a Pre-trained Language Model: An application in Financial Domain

2023-05-23 · Vanessa Liao, Syed Shariyar Murtaza, Yifan Nie, Jimmy Lin

A common way to use large pre-trained language models for downstream tasks is to fine tune them using additional layers. This may not work well if downstream domain is a specialized domain whereas the large language mode…

Language ModelingLanguage ModellingLarge Language Modeltext-classification+2

FineScope : Precision Pruning for Domain-Specialized Large Language Models Using SAE-Guided Self-Data Cultivation

2025-05-01 · Chaitali Bhattacharyya, Yeseong Kim

Training large language models (LLMs) from scratch requires significant computational resources, driving interest in developing smaller, domain-specific LLMs that maintain both efficiency and strong task performance. Med…

Fine-tuning Large Enterprise Language Models via Ontological Reasoning

2023-06-19 · Teodoro Baldazzi, Luigi Bellomarini, Stefano Ceri, Andrea Colombo 외

Large Language Models (LLMs) exploit fine-tuning as a technique to adapt to diverse goals, thanks to task-specific training data. Task specificity should go hand in hand with domain orientation, that is, the specializati…

Knowledge GraphsSpecificity

Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space

2024-02-26 · Gaurav Verma, MinJe Choi, Kartik Sharma, Jamelle Watson-Daniels 외

Multimodal large language models (MLLMs) like LLaVA and GPT-4(V) enable general-purpose conversations about images with the language modality. As off-the-shelf MLLMs may have limited capabilities on images from domains l…

Language ModelingLanguage ModellingLarge Language Model