Ambient Search: A Document Retrieval System for Speech Streams
We present Ambient Search, an open source system for displaying and retrieving relevant documents in real time for speech input. The system works ambiently, that is, it unobstructively listens to speech streams in the background, identifies keywords and keyphrases for query construction and continuously serves relevant documents from its index. Query terms are ranked with Word2Vec and TF-IDF and are continuously updated to allow for ongoing querying of a document collection. The retrieved documents, in our case Wikipedia articles, are visualized in real time in a browser interface. Our evaluation shows that Ambient Search compares favorably to another implicit information retrieval system on speech streams. Furthermore, we extrinsically evaluate multiword keyphrase generation, showing positive impact for manual transcriptions.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesInformation RetrievalKeyphrase GenerationRetrievalSpeech RecognitionSimilar Papers 제목 키워드 기반
Demonstrating Ambient Search: Implicit Document Retrieval for Speech Streams
In this demonstration paper we describe Ambient Search, a system that displays and retrieves documents in real time based on speech input. The system operates continuously in ambient mode, i.e. it generates speech transc…
Information RetrievalKeyword ExtractionRetrievalSpeech RecognitionAn Investigative Study of Multi-Modal Cross-Lingual Retrieval
We describe work from our investigations of the novel area of multi-modal cross-lingual retrieval (MMCLIR) under low-resource conditions. We study the challenges associated with MMCLIR relating to: (i) data conversion be…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Information RetrievalMachine Translation+5Corpora for Cross-Language Information Retrieval in Six Less-Resourced Languages
The Machine Translation for English Retrieval of Information in Any Language (MATERIAL) research program, sponsored by the Intelligence Advanced Research Projects Activity (IARPA), focuses on rapid development of end-to-…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Information RetrievalMachine Translation+4Keyword Augmented Retrieval: Novel framework for Information Retrieval integrated with speech interface
Retrieving answers in a quick and low cost manner without hallucinations from a combination of structured and unstructured data using Language models is a major hurdle. This is what prevents employment of Language models…
ChatbotInformation RetrievalLanguage ModellingLarge Language Model+1A neural document language modeling framework for spoken document retrieval
Recent developments in deep learning have led to a significant innovation in various classic and practical subjects, including speech recognition, computer vision, question answering, information retrieval and so on. In …
Information RetrievalLanguage ModelingLanguage ModellingQuestion Answering+3