SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering
Spoken Question Answering (SQA) is essential for machines to reply to user's question by finding the answer span within a given spoken passage. SQA has been previously achieved without ASR to avoid recognition errors and Out-of-Vocabulary (OOV) problems. However, the real-world problem of Open-domain SQA (openSQA), in which the machine needs to first retrieve passages that possibly contain the answer from a spoken archive in addition, was never considered. This paper proposes the first known end-to-end framework, Speech Dense Passage Retriever (SpeechDPR), for the retrieval component of the openSQA problem. SpeechDPR learns a sentence-level semantic representation by distilling knowledge from the cascading model of unsupervised ASR (UASR) and text dense retriever (TDR). No manually transcribed speech data is needed. Initial experiments showed performance comparable to the cascading model of UASR and TDR, and significantly better when UASR was poor, verifying this approach is more robust to speech recognition errors.
Code (0)
등록된 구현이 없습니다.
Tasks
Passage RetrievalQuestion AnsweringRetrievalSentencespeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
A Multimodal Dense Retrieval Approach for Speech-Based Open-Domain Question Answering
Speech-based open-domain question answering (QA over a large corpus of text passages with spoken questions) has emerged as an important task due to the increasing number of users interacting with QA systems via speech in…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Open-Domain Question AnsweringPassage Retrieval+4On the Impact of Speech Recognition Errors in Passage Retrieval for Spoken Question Answering
Interacting with a speech interface to query a Question Answering (QA) system is becoming increasingly popular. Typically, QA systems rely on passage retrieval to select candidate contexts and reading comprehension to ex…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationPassage Ranking+6Dense Passage Retrieval for Open-Domain Question Answering
Open-domain question answering relies on efficient passage retrieval to select candidate contexts, where traditional sparse vector space models, such as TF-IDF or BM25, are the de facto method. In this work, we show that…
Open-Domain Question AnsweringPassage RetrievalQuestion AnsweringRetrievalImproving Passage Retrieval with Zero-Shot Question Generation
We propose a simple and effective re-ranking method for improving passage retrieval in open question answering. The re-ranker re-scores retrieved passages with a zero-shot question generation model, which uses a pre-trai…
Language ModelingLanguage ModellingOpen-Domain Question AnsweringOpen-Ended Question Answering+6Dense Hierarchical Retrieval for Open-Domain Question Answering
Dense neural text retrieval has achieved promising results on open-domain Question Answering (QA), where latent representations of questions and passages are exploited for maximum inner product search in the retrieval pr…
Open-Domain Question AnsweringQuestion AnsweringRetrievalText Retrieval