Document retrieval and question answering in medical documents. A large-scale corpus challenge.
Whenever employed on large datasets, information retrieval works by isolating a subset of documents from the larger dataset and then proceeding with low-level processing of the text. This is usually carried out by means of adding index-terms to each document in the collection. In this paper we deal with automatic document classification and index-term detection applied on large-scale medical corpora. In our methodology we employ a linear classifier and we test our results on the BioASQ training corpora, which is a collection of 12 million MeSH-indexed medical abstracts. We cover both term-indexing, result retrieval and result ranking based on distributed word representations.
Code (0)
등록된 구현이 없습니다.
Tasks
Document ClassificationGeneral ClassificationInformation RetrievalQuestion AnsweringRetrievalSimilar Papers 제목 키워드 기반
Using Centroids of Word Embeddings and Word Mover's Distance for Biomedical Document Retrieval in Question Answering
We propose a document retrieval method for question answering that represents documents and questions as weighted centroids of word embeddings and reranks the retrieved documents with a relaxation of Word Mover's Distanc…
Question AnsweringRetrievalWord EmbeddingsTop K Relevant Passage Retrieval for Biomedical Question Answering
Question answering is a task that answers factoid questions using a large collection of documents. It aims to provide precise answers in response to the user's questions in natural language. Question answering relies on …
ArticlesPassage RetrievalQuestion AnsweringReading Comprehension+1Biomedical Question Answering via Weighted Neural Network Passage Retrieval
The amount of publicly available biomedical literature has been growing rapidly in recent years, yet question answering systems still struggle to exploit the full potential of this source of data. In a preliminary proces…
Passage RetrievalQuestion AnsweringRetrievalWord EmbeddingsImproving Health Question Answering with Reliable and Time-Aware Evidence Retrieval
In today's digital world, seeking answers to health questions on the Internet is a common practice. However, existing question answering (QA) systems often rely on using pre-selected and annotated evidence documents, thu…
ArticlesQuestion AnsweringRetrievalSentenceHybrid-IR: Dual-Path Hybrid Retrieval with Iterative Reasoning for Complex Medical Question Answering
Large language models (LLMs) have shown promising performance across a wide range of biomedical applications, including medical question answering (QA), yet they remain prone to hallucinations and outdated knowledge. Alt…
Question Answering