FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevance
Frequently Asked Question (FAQ) retrieval is an important task where the objective is to retrieve an appropriate Question-Answer (QA) pair from a database based on a user's query. We propose a FAQ retrieval system that considers the similarity between a user's query and a question as well as the relevance between the query and an answer. Although a common approach to FAQ retrieval is to construct labeled data for training, it takes annotation costs. Therefore, we use a traditional unsupervised information retrieval system to calculate the similarity between the query and question. On the other hand, the relevance between the query and answer can be learned by using QA pairs in a FAQ database. The recently-proposed BERT model is used for the relevance calculation. Since the number of QA pairs in FAQ page is not enough to train a model, we cope with this issue by leveraging FAQ sets that are similar to the one in question. We evaluate our approach on two datasets. The first one is localgovFAQ, a dataset we construct in a Japanese administrative municipality domain. The second is StackExchange dataset, which is the public dataset in English. We demonstrate that our proposed method outperforms baseline methods on these datasets.
Code (1)
Tasks
Information RetrievalQuestion SimilarityRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Revisiting Semantic Representation and Tree Search for Similar Question Retrieval
This paper studies the performances of BERT combined with tree structure in short sentence ranking task. In retrieval-based question answering system, we retrieve the most similar question of the query question by rankin…
AllInformation RetrievalQuestion AnsweringRetrieval+3Information Retrieval and Extraction on COVID-19 Clinical Articles Using Graph Community Detection and Bio-BERT Embeddings
In this paper, we present an information retrieval system on a corpus of scientific articles related to COVID-19. We build a similarity network on the articles where similarity is determined via shared citations and biol…
ArticlesCommunity DetectionExtractive SummarizationInformation Retrieval+3ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
Recent progress in Natural Language Understanding (NLU) is driving fast-paced advances in Information Retrieval (IR), largely owed to fine-tuning deep language models (LMs) for document ranking. While remarkably effectiv…
Document RankingInformation RetrievalNatural Language UnderstandingRe-Ranking+1QEQR: An Exploration of Query Expansion Methods for Question Retrieval in CQA Services
CQA services are valuable sources of knowledge that can be used to find answers to users' information needs. In these services, question retrieval aims to help users with their information needs by finding similar questi…
Question SimilarityRetrievalWord SimilarityOn the Interpolation of Contextualized Term-based Ranking with BM25 for Query-by-Example Retrieval
Term-based ranking with pre-trained transformer-based language models has recently gained attention as they bring the contextualization power of transformer models into the highly efficient term-based retrieval. In this …
Retrieval