paper-with-me

홈 › Papers

Exploring the Compositional Generalization in Context Dependent Text-to-SQL Parsing

2023-05-29 · Aiwei Liu, Wei Liu, Xuming Hu, Shuang Li, Fukun Ma, Yawen Yang, Lijie Wen

In the context-dependent Text-to-SQL task, the generated SQL statements are refined iteratively based on the user input utterance from each interaction. The input text from each interaction can be viewed as component modifications to the previous SQL statements, which could be further extracted as the modification patterns. Since these modification patterns could also be combined with other SQL statements, the models are supposed to have the compositional generalization to these novel combinations. This work is the first exploration of compositional generalization in context-dependent Text-to-SQL scenarios. To facilitate related studies, we constructed two challenging benchmarks named \textsc{CoSQL-CG} and \textsc{SParC-CG} by recombining the modification patterns and existing SQL statements. The following experiments show that all current models struggle on our proposed benchmarks. Furthermore, we found that better aligning the previous SQL statements with the input utterance could give models better compositional generalization ability. Based on these observations, we propose a method named \texttt{p-align} to improve the compositional generalization of Text-to-SQL models. Further experiments validate the effectiveness of our method. Source code and data are available.

📄 PDF Abstract BibTeX arXiv:2306.04480

Code (0)

등록된 구현이 없습니다.

Tasks

SQL ParsingText to SQLText-To-SQL

Similar Papers 제목 키워드 기반

How Do In-Context Examples Affect Compositional Generalization?

2023-05-08 · Shengnan An, Zeqi Lin, Qiang Fu, Bei Chen 외

Compositional generalization--understanding unseen combinations of seen primitives--is an essential reasoning capability in human intelligence. The AI community mainly studies this capability by fine-tuning neural networ…

In-Context Learning

When can transformers compositionally generalize in-context?

2024-07-17 · Seijin Kobayashi, Simon Schug, Yassir Akram, Florian Redhardt 외

Many tasks can be composed from a few independent components. This gives rise to a combinatorial explosion of possible tasks, only some of which might be encountered during training. Under what circumstances can transfor…

The Coverage Principle: A Framework for Understanding Compositional Generalization

2025-05-26 · Hoyeon Chang, Jinho Park, Hanseul Cho, Sohee Yang 외

Large language models excel at pattern matching, yet often fall short in systematic compositional generalization. We propose the coverage principle: a data-centric framework showing that models relying primarily on patte…

EHR-SeqSQL : A Sequential Text-to-SQL Dataset For Interactively Exploring Electronic Health Records

2024-05-23 · Jaehee Ryu, Seonhee Cho, Gyubok Lee, Edward Choi

In this paper, we introduce EHR-SeqSQL, a novel sequential text-to-SQL dataset for Electronic Health Record (EHR) databases. EHR-SeqSQL is designed to address critical yet underexplored aspects in text-to-SQL parsing: in…

SQL ParsingText to SQLText-To-SQL

Independent Prototype Propagation for Zero-Shot Compositionality

2021-06-01 · NeurIPS 2021 12 · Frank Ruis, Gertjan Burghouts, Doina Bucur

Humans are good at compositional zero-shot reasoning; someone who has never seen a zebra before could nevertheless recognize one when we tell them it looks like a horse with black and white stripes. Machine learning syst…

AttributeCompositional Zero-Shot Learning