paper-with-me

홈 › Papers

Speech-to-SQL: Towards Speech-driven SQL Query Generation From Natural Language Question

2022-01-04 · Yuanfeng Song, Raymond Chi-Wing Wong, Xuefang Zhao, Di Jiang

Speech-based inputs have been gaining significant momentum with the popularity of smartphones and tablets in our daily lives, since voice is the most easiest and efficient way for human-computer interaction. This paper works towards designing more effective speech-based interfaces to query the structured data in relational databases. We first identify a new task named Speech-to-SQL, which aims to understand the information conveyed by human speech and directly translate it into structured query language (SQL) statements. A naive solution to this problem can work in a cascaded manner, that is, an automatic speech recognition (ASR) component followed by a text-to-SQL component. However, it requires a high-quality ASR system and also suffers from the error compounding problem between the two components, resulting in limited performance. To handle these challenges, we further propose a novel end-to-end neural architecture named SpeechSQLNet to directly translate human speech into SQL queries without an external ASR step. SpeechSQLNet has the advantage of making full use of the rich linguistic information presented in speech. To the best of our knowledge, this is the first attempt to directly synthesize SQL based on arbitrary natural language questions, rather than a natural language-based version of SQL or its variants with a limited SQL grammar. To validate the effectiveness of the proposed problem and model, we further construct a dataset named SpeechQL, by piggybacking the widely-used text-to-SQL datasets. Extensive experimental evaluations on this dataset show that SpeechSQLNet can directly synthesize high-quality SQL queries from human speech, outperforming various competitive counterparts as well as the cascaded methods in terms of exact match accuracies.

📄 PDF Abstract BibTeX arXiv:2201.01209

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech RecognitionText to SQLText-To-SQL

Similar Papers 제목 키워드 기반

UniFLG: Unified Facial Landmark Generator from Text or Speech

2023-02-28 · Kentaro Mitsui, Yukiya Hono, Kei Sawada

Talking face generation has been extensively investigated owing to its wide applicability. The two primary frameworks used for talking face generation comprise a text-driven framework, which generates synchronized speech…

DecoderFace GenerationSpeech SynthesisTalking Face Generation+2

QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation

2023-05-18 · CVPR 2023 1 · Sicheng Yang, Zhiyong Wu, Minglei Li, Zhensong Zhang 외

Speech-driven gesture generation is highly challenging due to the random jitters of human motion. In addition, there is an inherent asynchronous relationship between human speech and gestures. To tackle these challenges,…

Gesture GenerationQuantizationRhythm

Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video

2023-09-09 · ICCV 2023 1 · Xiuzhe Wu, Pengfei Hu, Yang Wu, Xiaoyang Lyu 외

Synthesizing realistic videos according to a given speech is still an open challenge. Previous works have been plagued by issues such as inaccurate lip shape generation and poor image quality. The key reason is that only…

Image Generation

FacePlex: Full-Duplex Joint Speech-Facial Motion Generation for Conversational Avatars

2026-06-29 · Habin Lim, Jae-Ho Lee, Hah Min Lew, Ji-Su Kang 외 arxiv

Natural face-to-face conversation requires real-time speech generation together with synchronized facial motion. Existing systems only partially address this problem: speech-only full-duplex models can generate speech in…

Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generation

2024-07-07 · Haorui He, Zengqiang Shang, Chaoren Wang, Xuyuan Li 외

Recent advancements in speech generation models have been significantly driven by the use of large-scale training data. However, producing highly spontaneous, human-like speech remains a challenge due to the scarcity of …

Text to Speech