Generating Biomedical Question Answering Corpora from Q&A forums
Question Answering (QA) is a natural language processing task that aims at obtaining relevant answers to user questions. While some progress has been made in this area, biomedical questions are still a challenge to most QA approaches, due to the complexity of the domain and limited availability of training sets. We present a method to automatically extract question-article pairs from Q\&A web forums, which can be used for document retrieval, a crucial step of most QA systems. The proposed framework extracts from selected forums the questions and the respective answers that contain citations. This way, QA systems based on document retrieval can be developed and evaluated using the question-article pairs annotated by users of these forums. We generated the BiQA corpus by applying our framework to three forums, obtaining 7,453 questions and 14,239 question-article pairs. We evaluated how the number of articles associated with each question and the number of votes on each answer affects the performance of baseline document retrieval approaches. Also, we demonstrated that the articles given as answers are significantly similar to the questions and trained a state-of-the-art deep learning model that obtained similar performance to using a dataset manually annotated by experts. The proposed framework can be used to update the BiQA corpus from the same forums as new posts are made, and from other forums that support their answers with documents. The BiQA corpus and the framework used to generate it are available at \url{https://github.com/lasigeBioTM/BiQA}.
Code (1)
Tasks
ArticlesQuestion AnsweringRetrievalSimilar Papers 제목 키워드 기반
Pre-trained Language Model for Biomedical Question Answering
The recent success of question answering systems is largely attributed to pre-trained language models. However, as language models are mostly pre-trained on general domain corpora such as Wikipedia, they often have diffi…
Language ModelingLanguage ModellingmodelQuestion AnsweringA Biomedical Question Answering System in BioASQ 2017
Question answering, the identification of short accurate answers to users questions, is a longstanding challenge widely studied over the last decades in the open domain. However, it still requires further efforts in the …
Question AnsweringCQASUMM: Building References for Community Question Answering Summarization Corpora
Community Question Answering forums such as Quora, Stackoverflow are rich knowledge resources, often catering to information on topics overlooked by major search engines. Answers submitted to these forums are often elabo…
Community Question AnsweringDocument SummarizationMulti-Document SummarizationQuestion AnsweringPreferred Answer Selection in Stack Overflow: Better Text Representations ... and Metadata, Metadata, Metadata
Community question answering (cQA) forums provide a rich source of data for facilitating non-factoid question answering over many technical domains. Given this, there is considerable interest in answer retrieval from the…
Answer SelectionCommunity Question AnsweringInformation RetrievalQuestion Answering+1Combining LLMs and Knowledge Graphs to Reduce Hallucinations in Question Answering
Advancements in natural language processing have revolutionized the way we can interact with digital information systems, such as databases, making them more accessible. However, challenges persist, especially when accur…
HallucinationKnowledge GraphsMisinformationNatural Language Queries+2