PULSAR at MEDIQA-Sum 2023: Large Language Models Augmented by Synthetic Dialogue Convert Patient Dialogues to Medical Records
This paper describes PULSAR, our system submission at the ImageClef 2023 MediQA-Sum task on summarising patient-doctor dialogues into clinical records. The proposed framework relies on domain-specific pre-training, to produce a specialised language model which is trained on task-specific natural data augmented by synthetic data generated by a black-box LLM. We find limited evidence towards the efficacy of domain-specific pre-training and data augmentation, while scaling up the language model yields the best performance gains. Our approach was ranked second and third among 13 submissions on task B of the challenge. Our code is available at https://github.com/yuping-wu/PULSAR.
Code (1)
Tasks
Data AugmentationLanguage ModelingLanguage ModellingSimilar Papers 제목 키워드 기반
MediQAl: A French Medical Question Answering Dataset for Knowledge and Reasoning Evaluation
This work introduces MediQAl, a French medical question answering dataset designed to evaluate the capabilities of language models in factual medical recall and reasoning over real-world clinical scenarios. MediQAl conta…
Question AnsweringUW-BHI at MEDIQA 2019: An Analysis of Representation Methods for Medical Natural Language Inference
Recent advances in distributed language modeling have led to large performance increases on a variety of natural language processing (NLP) tasks. However, it is not well understood how these methods may be augmented by k…
Language ModelingLanguage ModellingNatural Language InferenceRetrieval-Augmented Generation Based Nurse Observation Extraction
Recent advancements in Large Language Models (LLMs) have played a significant role in reducing human workload across various domains, a trend that is increasingly extending into the medical field. In this paper, we propo…
Pulsar Candidate Identification with Artificial Intelligence Techniques
Discovering pulsars is a significant and meaningful research topic in the field of radio astronomy. With the advent of astronomical instruments such as he Five-hundred-meter Aperture Spherical Telescope (FAST) in China, …
AstronomyGenerative Adversarial NetworkIsolated pulsar population synthesis with simulation-based inference
We combine pulsar population synthesis with simulation-based inference (SBI) to constrain the magnetorotational properties of isolated Galactic radio pulsars. We first develop a framework to model neutron star birth prop…