paper-with-me

Papers

Benchmarking LLMs and SLMs for patient reported outcomes

2024-12-20 · Matteo Marengo, Jarod Lévy, Jean-Emmanuel Bibault

LLMs have transformed the execution of numerous tasks, including those in the medical domain. Among these, summarizing patient-reported outcomes (PROs) into concise natural language reports is of particular interest to clinicians, as it enables them to focus on critical patient concerns and spend more time in meaningful discussions. While existing work with LLMs like GPT-4 has shown impressive results, real breakthroughs could arise from leveraging SLMs as they offer the advantage of being deployable locally, ensuring patient data privacy and compliance with healthcare regulations. This study benchmarks several SLMs against LLMs for summarizing patient-reported Q\&A forms in the context of radiotherapy. Using various metrics, we evaluate their precision and reliability. The findings highlight both the promise and limitations of SLMs for high-stakes medical tasks, fostering more efficient and privacy-preserving AI-driven healthcare solutions.

📄 PDF Abstract BibTeX arXiv:2412.16291

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingPrivacy Preserving

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Adam 설명 없음
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Benchmarking LLMs for Predictive Applications in the Intensive Care Units

2025-12-23 · Chehak Malhotra, Mehak Gopal, Akshaya Devadiga, Pradeep Singh 외 arxiv

With the advent of LLMs, various tasks across the natural language processing domain have been transformed. However, their application in predictive tasks remains less researched. This study compares large language model…

AI-Powered Detection of Inappropriate Language in Medical School Curricula

2025-08-27 · Chiman Salavati, Shannon Song, Scott A. Hale, Roberto E. Montenegro 외 arxiv

The use of inappropriate language -- such as outdated, exclusionary, or non-patient-centered terms -- medical instructional materials can significantly influence clinical training, patient interactions, and health outcom…

SLMQuant:Benchmarking Small Language Model Quantization for Practical Deployment

2025-11-17 · Jiacheng Wang, Yejun Zeng, Jinyang Guo, Yuqing Ma 외 arxiv

Despite the growing interest in Small Language Models (SLMs) as resource-efficient alternatives to Large Language Models (LLMs), their deployment on edge devices remains challenging due to unresolved efficiency gaps in m…

Model Compression

Purifying Large Language Models by Ensembling a Small Language Model

2024-02-19 · Tianlin Li, Qian Liu, Tianyu Pang, Chao Du 외

The emerging success of large language models (LLMs) heavily relies on collecting abundant training data from external (untrusted) sources. Despite substantial efforts devoted to data cleaning and curation, well-construc…

Data PoisoningLanguage ModelingLanguage ModellingSmall Language Model

Energy-Aware Code Generation with LLMs: Benchmarking Small vs. Large Language Models for Sustainable AI Programming

2025-08-10 · Humza Ashraf, Syed Muhammad Danish, Aris Leivadeas, Yazan Otoum 외 arxiv

Large Language Models (LLMs) are widely used for code generation. However, commercial models like ChatGPT require significant computing power, which leads to high energy use and carbon emissions. This has raised concerns…

Code Generation