Towards Scalable Schema Mapping using Large Language Models
The growing need to integrate information from a large number of diverse sources poses significant scalability challenges for data integration systems. These systems often rely on manually written schema mappings, which are complex, source-specific, and costly to maintain as sources evolve. While recent advances suggest that large language models (LLMs) can assist in automating schema matching by leveraging both structural and natural language cues, key challenges remain. In this paper, we identify three core issues with using LLMs for schema mapping: (1) inconsistent outputs due to sensitivity to input phrasing and structure, which we propose methods to address through sampling and aggregation techniques; (2) the need for more expressive mappings (e.g., GLaV), which strain the limited context windows of LLMs; and (3) the computational cost of repeated LLM calls, which we propose to mitigate through strategies like data type prefiltering.
Code (0)
등록된 구현이 없습니다.
Tasks
Data IntegrationSimilar Papers 제목 키워드 기반
DBCopilot: Natural Language Querying over Massive Databases via Schema Routing
The development of Natural Language Interfaces to Databases (NLIDBs) has been greatly advanced by the advent of large language models (LLMs), which provide an intuitive way to translate natural language (NL) questions in…
NavigateQuestion GenerationQuestion-GenerationText-To-SQLCompound Schema Registry
Schema evolution is critical in managing database systems to ensure compatibility across different data versions. A schema registry typically addresses the challenges of schema evolution in real-time data streaming by ma…
Evaluating CxG Generalisation in LLMs via Construction-Based NLI Fine Tuning
We probe large language models' ability to learn deep form-meaning mappings as defined by construction grammars. We introduce the ConTest-NLI benchmark of 80k sentences covering eight English constructions from highly le…
ReMatch: Retrieval Enhanced Schema Matching with LLMs
Schema matching is a crucial task in data integration, involving the alignment of a source schema with a target schema to establish correspondence between their elements. This task is challenging due to textual and seman…
AttributeData IntegrationRetrievalSchema Generation for Large Knowledge Graphs Using Large Language Models
Schemas are vital for ensuring data quality in the Semantic Web and natural language processing. Traditionally, their creation demands substantial involvement from knowledge engineers and domain experts. Leveraging the i…
Knowledge Graphs