paper-with-me

Papers

DocQAC: Adaptive Trie-Guided Decoding for Effective In-Document Query Auto-Completion

2026-04-20 · Rahul Mehta, Kavin R, Indrajit Pal, Tushar Abhishek, Pawan Goyal, Manish Gupta arxiv

Query auto-completion (QAC) has been widely studied in the context of web search, yet remains underexplored for in-document search, which we term DocQAC. DocQAC aims to enhance search productivity within long documents by helping users craft faster, more precise queries, even for complex or hard-to-spell terms. While global historical queries are available to both WebQAC and DocQAC, DocQAC uniquely accesses document-specific context, including the current document's content and its specific history of user query interactions. To address this setting, we propose a novel adaptive trie-guided decoding framework that uses user query prefixes to softly steer language models toward high-quality completions. Our approach introduces an adaptive penalty mechanism with tunable hyperparameters, enabling a principled trade-off between model confidence and trie-based guidance. To efficiently incorporate document context, we explore retrieval-augmented generation (RAG) and lightweight contextual document signals such as titles, keyphrases, and summaries. When applied to encoder-decoder models like T5 and BART, our trie-guided framework outperforms strong baselines and even surpasses much larger instruction-tuned models such as LLaMA-3 and Phi-3 on seen queries across both seen and unseen documents. This demonstrates its practicality for real-world DocQAC deployments, where efficiency and scalability are critical. We evaluate our method on a newly introduced DocQAC benchmark derived from ORCAS, enriched with query-document pairs. We make both the DocQAC dataset (https://bit.ly/3IGEkbH) and code (https://github.com/rahcode7/DocQAC) publicly available.

📄 PDF Abstract BibTeX arXiv:2604.18257

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When, What, and How: Rethinking Retrieval-Enhanced Speculative Decoding

2025-11-03 · Min Fang, Zhihui Fu, Qibin Zhao, Jun Wang arxiv

Speculative decoding (SD) has emerged as an effective technique to accelerate large language model (LLM) inference without compromising output quality. However, the achievable speedup largely depends on the effectiveness…

Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment

2026-05-14 · Fan Yin, Chuhang Zheng, Peiliang Gong, Donghai Guan 외 arxiv

EEG-based visual decoding aims to establish a mapping between neural signals and visual semantics. However, it remains constrained by the dual challenges of severe information granularity mismatch and the low signal-to-n…

Image Retrieval

Lost in Decoding? Reproducing and Stress-Testing the Look-Ahead Prior in Generative Retrieval

2026-04-25 · Kidist Amde Mekonnen, Yongkang Li, Yubao Tang, Simon Lupart 외 arxiv

Generative retrieval (GR) ranks documents by autoregressively generating document identifiers. Because many GR methods rely on trie-constrained beam search, they are vulnerable to early pruning of relevant prefixes under…

Adaptive Contrastive Search: Uncertainty-Guided Decoding for Open-Ended Text Generation

2024-07-26 · Esteban Garces Arias, Julian Rodemann, Meimingwei Li, Christian Heumann 외

Decoding from the output distributions of large language models to produce high-quality text is a complex challenge in language modeling. Various approaches, such as beam search, sampling with temperature, $k-$sampling, …

DiversityLanguage ModelingLanguage ModellingText Generation

GRAD: Graph-Retrieved Adaptive Decoding for Hallucination Mitigation

2025-11-05 · Manh Nguyen, Sunil Gupta, Dai Do, Hung Le arxiv

Hallucination mitigation remains a persistent challenge for large language models (LLMs), even as model scales grow. Existing approaches often rely on external knowledge sources, such as structured databases or knowledge…

Knowledge Graphs