paper-with-me

홈 › Papers

FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevance

2019-05-08 · Wataru Sakata, Tomohide Shibata, Ribeka Tanaka, Sadao Kurohashi

Frequently Asked Question (FAQ) retrieval is an important task where the objective is to retrieve an appropriate Question-Answer (QA) pair from a database based on a user's query. We propose a FAQ retrieval system that considers the similarity between a user's query and a question as well as the relevance between the query and an answer. Although a common approach to FAQ retrieval is to construct labeled data for training, it takes annotation costs. Therefore, we use a traditional unsupervised information retrieval system to calculate the similarity between the query and question. On the other hand, the relevance between the query and answer can be learned by using QA pairs in a FAQ database. The recently-proposed BERT model is used for the relevance calculation. Since the number of QA pairs in FAQ page is not enough to train a model, we cope with this issue by leveraging FAQ sets that are similar to the one in question. We evaluate our approach on two datasets. The first one is localgovFAQ, a dataset we construct in a Japanese administrative municipality domain. The second is StackExchange dataset, which is the public dataset in English. We demonstrate that our proposed method outperforms baseline methods on these datasets.

📄 PDF Abstract BibTeX arXiv:1905.02851

Code (1)

ku-nlp/bert-based-faqir tf

Tasks

Information RetrievalQuestion SimilarityRetrieval

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Revisiting Semantic Representation and Tree Search for Similar Question Retrieval

2019-08-22 · Tong Guo, Huilin Gao

This paper studies the performances of BERT combined with tree structure in short sentence ranking task. In retrieval-based question answering system, we retrieve the most similar question of the query question by rankin…

AllInformation RetrievalQuestion AnsweringRetrieval+3

Information Retrieval and Extraction on COVID-19 Clinical Articles Using Graph Community Detection and Bio-BERT Embeddings

2020-07-01 · ACL 2020 7 · Debasmita Das, Yatin Katyal, Janu Verma, Shashank Dubey 외

In this paper, we present an information retrieval system on a corpus of scientific articles related to COVID-19. We build a similarity network on the articles where similarity is determined via shared citations and biol…

ArticlesCommunity DetectionExtractive SummarizationInformation Retrieval+3

ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT

2020-04-27 · Omar Khattab, Matei Zaharia

Recent progress in Natural Language Understanding (NLU) is driving fast-paced advances in Information Retrieval (IR), largely owed to fine-tuning deep language models (LMs) for document ranking. While remarkably effectiv…

Document RankingInformation RetrievalNatural Language UnderstandingRe-Ranking+1

QEQR: An Exploration of Query Expansion Methods for Question Retrieval in CQA Services

2024-11-23 · Yasin Ghafourian, Sajad Movahedi, Azadeh Shakery

CQA services are valuable sources of knowledge that can be used to find answers to users' information needs. In these services, question retrieval aims to help users with their information needs by finding similar questi…

Question SimilarityRetrievalWord Similarity

On the Interpolation of Contextualized Term-based Ranking with BM25 for Query-by-Example Retrieval

2022-10-11 · Amin Abolghasemi, Arian Askari, Suzan Verberne

Term-based ranking with pre-trained transformer-based language models has recently gained attention as they bring the contextualization power of transformer models into the highly efficient term-based retrieval. In this …

Retrieval