paper-with-me

홈 › Papers

QuOTE: Question-Oriented Text Embeddings

2025-02-16 · Andrew Neeser, Kaylen Latimer, Aadyant Khatri, Chris Latimer, Naren Ramakrishnan

We present QuOTE (Question-Oriented Text Embeddings), a novel enhancement to retrieval-augmented generation (RAG) systems, aimed at improving document representation for accurate and nuanced retrieval. Unlike traditional RAG pipelines, which rely on embedding raw text chunks, QuOTE augments chunks with hypothetical questions that the chunk can potentially answer, enriching the representation space. This better aligns document embeddings with user query semantics, and helps address issues such as ambiguity and context-dependent relevance. Through extensive experiments across diverse benchmarks, we demonstrate that QuOTE significantly enhances retrieval accuracy, including in multi-hop question-answering tasks. Our findings highlight the versatility of question generation as a fundamental indexing strategy, opening new avenues for integrating question generation into retrieval-based AI pipelines.

📄 PDF Abstract BibTeX arXiv:2502.10976

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-hop Question AnsweringQuestion AnsweringQuestion GenerationQuestion-GenerationRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Weight Decay 설명 없음
BART BART is a denoising autoencoder for pretraining sequence-to-sequence models. It is trained by (1) corrupting text…

Similar Papers 제목 키워드 기반

Political Stance in Danish

2019-09-01 · WS (NoDaLiDa) 2019 9 · Rasmus Lehmann, Leon Derczynski

The task of stance detection consists of classifying the opinion within a text towards some target. This paper seeks to generate a dataset of quotes from Danish politicians, label this dataset to allow the task of stance…

Stance DetectionWord Embeddings

SocialQuotes: Learning Contextual Roles of Social Media Quotes on the Web

2024-07-22 · John Palowitch, Hamidreza Alvari, Mehran Kazemi, Tanvir Amin 외

Web authors frequently embed social media to support and enrich their content, creating the potential to derive web-based, cross-platform social media representations that can enable more effective social media retrieval…

Language ModelingLanguage Modelling

RA-MTR: A Retrieval Augmented Multi-Task Reader based Approach for Inspirational Quote Extraction from Long Documents

2025-02-17 · Sayantan Adak, Animesh Mukherjee

Inspirational quotes from famous individuals are often used to convey thoughts in news articles, essays, and everyday conversations. In this paper, we propose a novel context-based quote extraction system that aims to ex…

ArticlesOpen-Domain Question AnsweringQuestion Answering

Improving Quotation Attribution with Fictional Character Embeddings

2024-06-17 · Gaspard Michel, Elena V. Epure, Romain Hennequin, Christophe Cerisara

Humans naturally attribute utterances of direct speech to their speaker in literary works. When attributing quotes, we process contextual information but also access mental representations of characters that we build and…

AttributeAuthorship Verification

FanfictionNLP: A Text Processing Pipeline for Fanfiction

2021-06-01 · NAACL (NUSE) 2021 6 · Michael Yoder, Sopan Khosla, Qinlan Shen, Aakanksha Naik 외

Fanfiction presents an opportunity as a data source for research in NLP, education, and social science. However, answering specific research questions with this data is difficult, since fanfiction contains more diverse w…