paper-with-me

홈 › Papers

Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health Records

2024-05-04 · Gyubok Lee, Sunjun Kweon, Seongsu Bae, Edward Choi

Electronic Health Records (EHRs) are relational databases that store the entire medical histories of patients within hospitals. They record numerous aspects of patients' medical care, from hospital admission and diagnosis to treatment and discharge. While EHRs are vital sources of clinical data, exploring them beyond a predefined set of queries requires skills in query languages like SQL. To make information retrieval more accessible, one strategy is to build a question-answering system, possibly leveraging text-to-SQL models that can automatically translate natural language questions into corresponding SQL queries and use these queries to retrieve the answers. The EHRSQL 2024 shared task aims to advance and promote research in developing a question-answering system for EHRs using text-to-SQL modeling, capable of reliably providing requested answers to various healthcare professionals to improve their clinical work processes and satisfy their needs. Among more than 100 participants who applied to the shared task, eight teams were formed and completed the entire shared task requirement and demonstrated a wide range of methods to effectively solve this task. In this paper, we describe the task of reliable text-to-SQL modeling, the dataset, and the methods and results of the participants. We hope this shared task will spur further research and insights into developing reliable question-answering systems for EHRs.

📄 PDF Abstract BibTeX arXiv:2405.06673

Code (1)

glee4810/EHRSQL pytorch

Tasks

Information RetrievalQuestion AnsweringText to SQLText-To-SQL

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

PromptMind Team at EHRSQL-2024: Improving Reliability of SQL Generation using Ensemble LLMs

2024-05-14 · Satya K Gundabathula, Sriram R Kolar

This paper presents our approach to the EHRSQL-2024 shared task, which aims to develop a reliable Text-to-SQL system for electronic health records. We propose two approaches that leverage large language models (LLMs) for…

Text to SQLText-To-SQLWorld Knowledge

LG AI Research & KAIST at EHRSQL 2024: Self-Training Large Language Models with Pseudo-Labeled Unanswerable Questions for a Reliable Text-to-SQL System on EHRs

2024-05-18 · Yongrae Jo, Seongyun Lee, Minju Seo, Sung Ju Hwang 외

Text-to-SQL models are pivotal for making Electronic Health Records (EHRs) accessible to healthcare professionals without SQL knowledge. With the advancements in large language models, these systems have become more adep…

Decision MakingMisinformationText to SQLText-To-SQL

KU-DMIS at EHRSQL 2024:Generating SQL query via question templatization in EHR

2024-05-22 · Hajung Kim, Chanhwi Kim, Hoonick Lee, Kyochul Jang 외

Transforming natural language questions into SQL queries is crucial for precise data retrieval from electronic health record (EHR) databases. A significant challenge in this process is detecting and rejecting unanswerabl…

Language ModelingLanguage ModellingLarge Language ModelText to SQL+1

EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Records

2023-01-16 · NeurIPS 2022 Datasets and Benchmarks 2022 12 · Gyubok Lee, Hyeonji Hwang, Seongsu Bae, Yeonsu Kwon 외

We present a new text-to-SQL dataset for electronic health records (EHRs). The utterances were collected from 222 hospital staff members, including physicians, nurses, and insurance review and health records teams. To co…

RetrievalText to SQLText-To-SQL

Towards Unbiased Evaluation of Detecting Unanswerable Questions in EHRSQL

2024-04-29 · Yongjin Yang, Sihyeon Kim, Sangmook Kim, Gyubok Lee 외

Incorporating unanswerable questions into EHR QA systems is crucial for testing the trustworthiness of a system, as providing non-existent responses can mislead doctors in their diagnoses. The EHRSQL dataset stands out a…