Interpretable LLM-based Table Question Answering
Interpretability for Table Question Answering (Table QA) is critical, particularly in high-stakes industries like finance or healthcare. Although recent approaches using Large Language Models (LLMs) have significantly improved Table QA performance, their explanations for how the answers are generated are ambiguous. To fill this gap, we introduce Plan-of-SQLs ( or POS), an interpretable, effective, and efficient approach to Table QA that answers an input query solely with SQL executions. Through qualitative and quantitative evaluations with human and LLM judges, we show that POS is most preferred among explanation methods, helps human users understand model decision boundaries, and facilitates model success and error identification. Furthermore, when evaluated in standard benchmarks (TabFact, WikiTQ, and FetaQA), POS achieves competitive or superior accuracy compared to existing methods, while maintaining greater efficiency by requiring significantly fewer LLM calls and database queries.
Code (0)
등록된 구현이 없습니다.
Tasks
POSQuestion AnsweringSimilar Papers 제목 키워드 기반
Interpretable AMR-Based Question Decomposition for Multi-hop Question Answering
Effective multi-hop question answering (QA) requires reasoning over multiple scattered paragraphs and providing explanations for answers. Most existing approaches cannot provide an interpretable reasoning process to illu…
Abstract Meaning RepresentationAMR-to-Text GenerationMulti-hop Question AnsweringQuestion Answering+1An Interpretable Reasoning Network for Multi-Relation Question Answering
Multi-relation Question Answering is a challenging task, due to the requirement of elaborated analysis on questions and reasoning over multiple fact triples in knowledge base. In this paper, we present a novel model call…
Question AnsweringRelationIdentifying and Answering Questions with False Assumptions: An Interpretable Approach
People often ask questions with false assumptions, a type of question that does not have regular answers. Answering such questions requires first identifying the false assumptions. Large Language Models (LLMs) often gene…
Fact VerificationInterpretable Visual Question Answering by Reasoning on Dependency Trees
Collaborative reasoning for understanding image-question pairs is a very critical but underexplored topic in interpretable visual question answering systems. Although very recent studies have attempted to use explicit co…
Question AnsweringvalidVisual Question AnsweringVisual Question Answering (VQA)Intrinsic Subgraph Generation for Interpretable Graph based Visual Question Answering
The large success of deep learning based methods in Visual Question Answering (VQA) has concurrently increased the demand for explainable methods. Most methods in Explainable Artificial Intelligence (XAI) focus on genera…
Decision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Question Answering+2