Database Normalization via Dual-LLM Self-Refinement
Database normalization is crucial to preserving data integrity. However, it is time-consuming and error-prone, as it is typically performed manually by data engineers. To this end, we present Miffie, a database normalization framework that leverages the capability of large language models. Miffie enables automated data normalization without human effort while preserving high accuracy. The core of Miffie is a dual-model self-refinement architecture that combines the best-performing models for normalized schema generation and verification, respectively. The generation module eliminates anomalies based on the feedback of the verification module until the output schema satisfies the requirement for normalization. We also carefully design task-specific zero-shot prompts to guide the models for achieving both high accuracy and cost efficiency. Experimental results show that Miffie can normalize complex database schemas while maintaining high accuracy.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Mitigating Cross-Database Differences for Learning Unified HRTF Representation
Individualized head-related transfer functions (HRTFs) are crucial for accurate sound positioning in virtual auditory displays. As the acoustic measurement of HRTFs is resource-intensive, predicting individualized HRTFs …
NLCA-Net v2 for Stereo Matching in ECCV'20 Robust Vision Challenge
Our goal in this ECCV'20 Robust Vision Challenge (RVC) is to develop a novel stereo matching system that is robust over multiple datasets instead of one specific dataset. Our developed NLCA-Net v2 used in this RVC is an …
Stereo MatchingReSIFT: Reliability-Weighted SIFT-based Image Quality Assessment
This paper presents a full-reference image quality estimator based on SIFT descriptor matching over reliability-weighted feature maps. Reliability assignment includes a smoothing operation, a transformation to perceptual…
Image Quality Assessmentpreon: Fast and accurate entity normalization for drug names and cancer types in precision oncology
Motivation In precision oncology (PO), clinicians aim to find the best treatment for any patient based on their molecular characterization. A major bottleneck is the manual annotation and evaluation of individual varian…
Data IntegrationMedical Concept NormalizationTerm ExtractionLLM-Based SQL Generation: Prompting, Self-Refinement, and Adaptive Weighted Majority Voting
Text-to-SQL has emerged as a prominent research area, particularly with the rapid advancement of large language models (LLMs). By enabling users to query databases through natural language rather than SQL, this technolog…