paper-with-me

Papers

Your Dense Retriever is Secretly an Expeditious Reasoner

2025-09-27 · Yichi Zhang, Jun Bai, Zhixin Cai, Shuhan Qin, Zhuofan Chen, Jinghua Guan, Wenge Rong arxiv

Dense retrievers enhance retrieval by encoding queries and documents into continuous vectors, but they often struggle with reasoning-intensive queries. Although Large Language Models (LLMs) can reformulate queries to capture complex reasoning, applying them universally incurs significant computational cost. In this work, we propose Adaptive Query Reasoning (AdaQR), a hybrid query rewriting framework. Within this framework, a Reasoner Router dynamically directs each query to either fast dense reasoning or deep LLM reasoning. The dense reasoning is achieved by the Dense Reasoner, which performs LLM-style reasoning directly in the embedding space, enabling a controllable trade-off between efficiency and accuracy. Experiments on large-scale retrieval benchmarks BRIGHT show that AdaQR reduces reasoning cost by 28% while preserving-or even improving-retrieval performance by 7%.

📄 PDF Abstract BibTeX arXiv:2510.21727

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AttentionRetriever: Attention Layers are Secretly Long Document Retrievers

2026-02-12 · David Jiahao Fu, Lam Thanh Do, Jiayu Li, Kevin Chen-Chuan Chang arxiv

Retrieval augmented generation (RAG) has been widely adopted to help Large Language Models (LLMs) to process tasks involving long documents. However, existing retrieval models are not designed for long document retrieval…

Your Data Manifold is Secretly a Reward Model: Shell-LCC for Text-to-Video Generation

2026-06-29 · Shihao Zhang, Yuguang Yan, Junzhe Zhang, Wei Zhao 외 arxiv

Recent text-to-video (T2V) diffusion models rely heavily on auxiliary reward signals (e.g., via reward models or DPO) to align generated content with human aesthetics and improve realism. These signals, however, incur su…

Text-to-Video Generation

Secret mixtures of experts inside your LLM

2025-12-20 · Enric Boix-Adsera arxiv

Despite being one of the earliest neural network layers, the Multilayer Perceptron (MLP) is arguably one of the least understood parts of the transformer architecture due to its dense computation and lack of easy visuali…

S$^3$HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering

2023-05-19 · Fangyu Lei, Xiang Li, Yifan Wei, Shizhu He 외

Answering multi-hop questions over hybrid factual knowledge from the given text and table (TextTableQA) is a challenging task. Existing models mainly adopt a retriever-reader framework, which have several deficiencies, s…

Question AnsweringReading Comprehension

Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One?

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Despite their recent popularity and well known advantages, dense retrievers still lag behind sparse methods such as BM25 in their ability to reliably match salient phrases and rare entities in the query. It has been argu…

Open-Domain Question AnsweringPassage RetrievalQuestion AnsweringRetrieval