paper-with-me

Papers

Passage Segmentation of Documents for Extractive Question Answering

2025-01-17 · Zuhong Liu, Charles-Elie Simon, Fabien Caspani

Retrieval-Augmented Generation (RAG) has proven effective in open-domain question answering. However, the chunking process, which is essential to this pipeline, often receives insufficient attention relative to retrieval and synthesis components. This study emphasizes the critical role of chunking in improving the performance of both dense passage retrieval and the end-to-end RAG pipeline. We then introduce the Logits-Guided Multi-Granular Chunker (LGMGC), a novel framework that splits long documents into contextualized, self-contained chunks of varied granularity. Our experimental results, evaluated on two benchmark datasets, demonstrate that LGMGC not only improves the retrieval step but also outperforms existing chunking methods when integrated into a RAG pipeline.

📄 PDF Abstract BibTeX arXiv:2501.09940

Code (0)

등록된 구현이 없습니다.

Tasks

ChunkingExtractive Question-AnsweringOpen-Domain Question AnsweringPassage RetrievalQuestion AnsweringRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Adam 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

AutoEQA: Auto-Encoding Questions for Extractive Question Answering

2021-11-01 · Findings (EMNLP) 2021 11 · Stalin Varanasi, Saadullah Amin, Guenter Neumann

There has been a significant progress in the field of Extractive Question Answering (EQA) in the recent years. However, most of them are reliant on annotations of answer-spans in the corresponding passages. In this work,…

Extractive Question-AnsweringQuestion AnsweringQuestion GenerationQuestion-Generation

A Method of Passage-Based Document Retrieval in Question Answering System

2015-12-17 · Jong Man-Hung, Ri Chong-Han, Choe Hyok-Chol, Hwang Chol-Jun

We propose a method for using the scoring values of passages to effectively retrieve documents in a Question Answering system. For this, we suggest evaluation function that considers proximity between each question ter…

Question AnsweringRetrieval

Conversational Answer Generation and Factuality for Reading Comprehension Question-Answering

2021-03-11 · Stan Peshterliev, Barlas Oguz, Debojeet Chatterjee, Hakan Inan 외

Question answering (QA) is an important use case on voice assistants. A popular approach to QA is extractive reading comprehension (RC) which finds an answer span in a text passage. However, extractive answers are often …

Answer GenerationPassage RankingQuestion AnsweringReading Comprehension

Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question Answering

2020-10-16 · Wissam Siblini, Mohamed Challal, Charlotte Pasqual

Open Domain Question Answering (ODQA) on a large-scale corpus of documents (e.g. Wikipedia) is a key challenge in computer science. Although transformer-based language models such as Bert have shown on SQuAD the ability …

Information RetrievalManagementOpen-Domain Question AnsweringQuestion Answering+1

Attention-guided Generative Models for Extractive Question Answering

2021-10-12 · Peng Xu, Davis Liang, Zhiheng Huang, Bing Xiang

We propose a novel method for applying Transformer models to extractive question answering (QA) tasks. Recently, pretrained generative sequence-to-sequence (seq2seq) models have achieved great success in question answeri…

DecoderExtractive Question-AnsweringHallucinationOpen-Domain Question Answering+2