Embedding Individual Table Columns for Resilient SQL Chatbots
Most of the world's data is stored in relational databases. Accessing these requires specialized knowledge of the Structured Query Language (SQL), putting them out of the reach of many people. A recent research thread in Natural Language Processing (NLP) aims to alleviate this problem by automatically translating natural language questions into SQL queries. While the proposed solutions are a great start, they lack robustness and do not easily generalize: the methods require high quality descriptions of the database table columns, and the most widely used training dataset, WikiSQL, is heavily biased towards using those descriptions as part of the questions. In this work, we propose solutions to both problems: we entirely eliminate the need for column descriptions, by relying solely on their contents, and we augment the WikiSQL dataset by paraphrasing column names to reduce bias. We show that the accuracy of existing methods drops when trained on our augmented, column-agnostic dataset, and that our own method reaches state of the art accuracy, while relying on column contents only.
Code (0)
등록된 구현이 없습니다.
Tasks
Sql ChatbotsSimilar Papers 제목 키워드 기반
Pylon: Semantic Table Union Search in Data Lakes
The large size and fast growth of data repositories, such as data lakes, has spurred the need for data discovery to help analysts find related data. The problem has become challenging as (i) a user typically does not kno…
Contrastive LearningRepresentation LearningRetrievalGem: Gaussian Mixture Model Embeddings for Numerical Feature Distributions
Embeddings are now used to underpin a wide variety of data management tasks, including entity resolution, dataset search and semantic type detection. Such applications often involve datasets with numerical columns, but t…
AttributeEntity ResolutionSnoopy: Effective and Efficient Semantic Join Discovery via Proxy Columns
Semantic join discovery, which aims to find columns in a table repository with high semantic joinabilities to a query column, is crucial for dataset discovery. Existing methods can be divided into two categories: cell-le…
Contrastive LearningGraph MatchingTabEmb: Joint Semantic-Structure Embedding for Table Annotation
Table annotation is crucial for making web and enterprise tables usable in downstream NLP applications. Unlike textual data where learning semantically rich token or sentence embeddings often suffice, tables are structur…
CARTE: Pretraining and Transfer for Tabular Learning
Pretrained deep-learning models are the go-to solution for images or text. However, for tabular data the standard is still to train tree-based models. Indeed, transfer learning on tables hits the challenge of data integr…
Data IntegrationTransfer Learning