paper-with-me

홈 › Papers

LG AI Research & KAIST at EHRSQL 2024: Self-Training Large Language Models with Pseudo-Labeled Unanswerable Questions for a Reliable Text-to-SQL System on EHRs

2024-05-18 · Yongrae Jo, Seongyun Lee, Minju Seo, Sung Ju Hwang, Moontae Lee

Text-to-SQL models are pivotal for making Electronic Health Records (EHRs) accessible to healthcare professionals without SQL knowledge. With the advancements in large language models, these systems have become more adept at translating complex questions into SQL queries. Nonetheless, the critical need for reliability in healthcare necessitates these models to accurately identify unanswerable questions or uncertain predictions, preventing misinformation. To address this problem, we present a self-training strategy using pseudo-labeled unanswerable questions to enhance the reliability of text-to-SQL models for EHRs. This approach includes a two-stage training process followed by a filtering method based on the token entropy and query execution. Our methodology's effectiveness is validated by our top performance in the EHRSQL 2024 shared task, showcasing the potential to improve healthcare decision-making through more reliable text-to-SQL systems.

📄 PDF Abstract BibTeX arXiv:2405.11162

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingMisinformationText to SQLText-To-SQL

Similar Papers 제목 키워드 기반

EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Records

2023-01-16 · NeurIPS 2022 Datasets and Benchmarks 2022 12 · Gyubok Lee, Hyeonji Hwang, Seongsu Bae, Yeonsu Kwon 외

We present a new text-to-SQL dataset for electronic health records (EHRs). The utterances were collected from 222 hospital staff members, including physicians, nurses, and insurance review and health records teams. To co…

RetrievalText to SQLText-To-SQL

PromptMind Team at EHRSQL-2024: Improving Reliability of SQL Generation using Ensemble LLMs

2024-05-14 · Satya K Gundabathula, Sriram R Kolar

This paper presents our approach to the EHRSQL-2024 shared task, which aims to develop a reliable Text-to-SQL system for electronic health records. We propose two approaches that leverage large language models (LLMs) for…

Text to SQLText-To-SQLWorld Knowledge

KU-DMIS at EHRSQL 2024:Generating SQL query via question templatization in EHR

2024-05-22 · Hajung Kim, Chanhwi Kim, Hoonick Lee, Kyochul Jang 외

Transforming natural language questions into SQL queries is crucial for precise data retrieval from electronic health record (EHR) databases. A significant challenge in this process is detecting and rejecting unanswerabl…

Language ModelingLanguage ModellingLarge Language ModelText to SQL+1

Towards Unbiased Evaluation of Detecting Unanswerable Questions in EHRSQL

2024-04-29 · Yongjin Yang, Sihyeon Kim, Sangmook Kim, Gyubok Lee 외

Incorporating unanswerable questions into EHR QA systems is crucial for testing the trustworthiness of a system, as providing non-existent responses can mislead doctors in their diagnoses. The EHRSQL dataset stands out a…

Multispectral Pedestrian Detection via Simultaneous Detection and Segmentation

2018-08-14 · Chengyang Li, Dan Song, Ruofeng Tong, Min Tang

Multispectral pedestrian detection has attracted increasing attention from the research community due to its crucial competence for many around-the-clock applications (e.g., video surveillance and autonomous driving), es…

Autonomous DrivingMultispectral Object DetectionPedestrian DetectionSemantic Segmentation