paper-with-me

Papers

Enhancing Summarization Performance through Transformer-Based Prompt Engineering in Automated Medical Reporting

2023-11-22 · Daphne van Zandvoort, Laura Wiersema, Tom Huibers, Sandra van Dulmen, Sjaak Brinkkemper

Customized medical prompts enable Large Language Models (LLM) to effectively address medical dialogue summarization. The process of medical reporting is often time-consuming for healthcare professionals. Implementing medical dialogue summarization techniques presents a viable solution to alleviate this time constraint by generating automated medical reports. The effectiveness of LLMs in this process is significantly influenced by the formulation of the prompt, which plays a crucial role in determining the quality and relevance of the generated reports. In this research, we used a combination of two distinct prompting strategies, known as shot prompting and pattern prompting to enhance the performance of automated medical reporting. The evaluation of the automated medical reports is carried out using the ROUGE score and a human evaluation with the help of an expert panel. The two-shot prompting approach in combination with scope and domain context outperforms other methods and achieves the highest score when compared to the human reference set by a general practitioner. However, the automated reports are approximately twice as long as the human references, due to the addition of both redundant and relevant statements that are added to the report.

📄 PDF Abstract BibTeX arXiv:2311.13274

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt Engineering

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

UMB@PerAnsSumm 2025: Enhancing Perspective-Aware Summarization with Prompt Optimization and Supervised Fine-Tuning

2025-03-14 · Kristin Qi, Youxiang Zhu, Xiaohui Liang

We present our approach to the PerAnsSumm Shared Task, which involves perspective span identification and perspective-aware summarization in community question-answering (CQA) threads. For span identification, we adopt e…

Community Question AnsweringEnsemble LearningQuestion Answering

Understanding Code Semantics: An Evaluation of Transformer Models in Summarization

2023-10-25 · Debanjan Mondal, Abhilasha Lodha, Ankita Sahoo, Beena Kumari

This paper delves into the intricacies of code summarization using advanced transformer-based language models. Through empirical studies, we evaluate the efficacy of code summarization by altering function and variable n…

Code Summarization

BIM-GPT: a Prompt-Based Virtual Assistant Framework for BIM Information Retrieval

2023-04-18 · Junwen Zheng, Martin Fischer

Efficient information retrieval (IR) from building information models (BIMs) poses significant challenges due to the necessity for deep BIM knowledge or extensive engineering efforts for automation. We introduce BIM-GPT,…

Information RetrievalRetrieval

Detecting Errors through Ensembling Prompts (DEEP): An End-to-End LLM Framework for Detecting Factual Errors

2024-06-18 · Alex Chandler, Devesh Surve, Hui Su

Accurate text summarization is one of the most common and important tasks performed by Large Language Models, where the costs of human review for an entire document may be high, but the costs of errors in summarization m…

HallucinationLanguage ModelingLanguage ModellingLarge Language Model+1

PromptSum: Parameter-Efficient Controllable Abstractive Summarization

2023-08-06 · Mathieu Ravaut, Hailin Chen, Ruochen Zhao, Chengwei Qin 외

Prompt tuning (PT), a parameter-efficient technique that only tunes the additional prompt embeddings while keeping the backbone pre-trained language model (PLM) frozen, has shown promising results in language understandi…

Abstractive Text SummarizationLanguage ModelingLanguage Modelling