paper-with-me

Papers

Denoising Table-Text Retrieval for Open-Domain Question Answering

2024-03-26 · Deokhyung Kang, Baikjin Jung, Yunsu Kim, Gary Geunbae Lee

In table-text open-domain question answering, a retriever system retrieves relevant evidence from tables and text to answer questions. Previous studies in table-text open-domain question answering have two common challenges: firstly, their retrievers can be affected by false-positive labels in training datasets; secondly, they may struggle to provide appropriate evidence for questions that require reasoning across the table. To address these issues, we propose Denoised Table-Text Retriever (DoTTeR). Our approach involves utilizing a denoised training dataset with fewer false positive labels by discarding instances with lower question-relevance scores measured through a false positive detection model. Subsequently, we integrate table-level ranking information into the retriever to assist in finding evidence for questions that demand reasoning across the table. To encode this ranking information, we fine-tune a rank-aware column encoder to identify minimum and maximum values within a column. Experimental results demonstrate that DoTTeR significantly outperforms strong baselines on both retrieval recall and downstream QA tasks. Our code is available at https://github.com/deokhk/DoTTeR.

📄 PDF Abstract BibTeX arXiv:2403.17611

Code (1)

deokhk/dotter 공식 구현 pytorch

Tasks

DenoisingOpen-Domain Question AnsweringQuestion AnsweringRetrievalText Retrieval

Similar Papers 제목 키워드 기반

MURRE: Multi-Hop Table Retrieval with Removal for Open-Domain Text-to-SQL

2024-02-16 · Xuanliang Zhang, Dingzirui Wang, Longxu Dou, Qingfu Zhu 외

The open-domain text-to-SQL task aims to retrieve question-relevant tables from massive databases and generate SQL. However, the performance of current methods is constrained by single-hop retrieval, and existing multi-h…

Open-Domain Question AnsweringQuestion AnsweringRetrievalTable Retrieval+2

Enhancing Open-Domain Table Question Answering via Syntax- and Structure-aware Dense Retrieval

2023-09-19 · Nengzheng Jin, Dongfang Li, Junying Chen, Joanna Siebert 외

Open-domain table question answering aims to provide answers to a question by retrieving and extracting information from a large collection of tables. Existing studies of open-domain table QA either directly adopt text r…

Question AnsweringRetrievalTable RetrievalText Retrieval+2

Open Domain Question Answering over Tables via Dense Retrieval

2021-03-22 · NAACL 2021 4 · Jonathan Herzig, Thomas Müller, Syrine Krichene, Julian Martin Eisenschlos

Recent advances in open-domain QA have led to strong models based on dense retrieval, but only focused on retrieving textual passages. In this work, we tackle open-domain QA over tables for the first time, and show that …

Natural QuestionsOpen-Domain Question AnsweringQuestion AnsweringRetrieval

Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA

2022-10-11 · JunJie Huang, Wanjun Zhong, Qian Liu, Ming Gong 외

Retrieving evidences from tabular and textual resources is essential for open-domain question answering (OpenQA), which provides more comprehensive information. However, training an effective dense table-text retriever i…

Open-Domain Question AnsweringQuestion AnsweringRepresentation LearningRetrieval+1

LLM-Oriented Information Retrieval: A Denoising-First Perspective

2026-05-01 · Lu Dai, Liang Sun, Fanpu Cao, Ziyang Rao 외 arxiv

Modern information retrieval (IR) is no longer consumed primarily by humans but increasingly by large language models (LLMs) via retrieval-augmented generation (RAG) and agentic search. Unlike human users, LLMs are const…

Information Retrieval