Robust Few-shot Transfer Learning for Knowledge Base Question Answering with Unanswerable Questions

2024-06-20 · Riya Sawhney, Indrajit Bhattacharya, Mausam

Real-world KBQA applications require models that are (1) robust -- e.g., can differentiate between answerable and unanswerable questions, and (2) low-resource -- do not require large training data. Towards this goal, we propose the novel task of few-shot transfer for KBQA with unanswerable questions. We present FUn-FuSIC that extends the state-of-the-art (SoTA) few-shot transfer model for answerable-only KBQA to handle unanswerability. It iteratively prompts an LLM to generate logical forms for the question by providing feedback using a diverse suite of syntactic, semantic and execution guided checks, and adapts self-consistency to assess confidence of the LLM to decide answerability. Experiments over newly constructed datasets show that FUn-FuSIC outperforms suitable adaptations of the SoTA model for KBQA with unanswerability, and the SoTA model for answerable-only few-shot-transfer KBQA.

📄 PDF Abstract BibTeX arXiv:2406.14313

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Base Question Answering Question Answering Transfer Learning

Encoding Explanatory Knowledge for Zero-shot Science Question Answering

2021-05-12 · IWCS (ACL) 2021 6 · Zili Zhou, Marco Valentino, Donal Landers, Andre Freitas

This paper describes N-XKT (Neural encoding based on eXplanatory Knowledge Transfer), a novel method for the automatic transfer of explanatory knowledge through neural encoding mechanisms. We demonstrate that N-XKT is ab…

Question Answering Science Question Answering Transfer Learning Zero-shot Generalization

Improving Zero-Shot Cross-lingual Transfer for Multilingual Question Answering over Knowledge Graph

2021-06-01 · NAACL 2021 4 · Yucheng Zhou, Xiubo Geng, Tao Shen, Wenqiang Zhang 외

Multilingual question answering over knowledge graph (KGQA) aims to derive answers from a knowledge graph (KG) for questions in multiple languages. To be widely applicable, we focus on its zero-shot transfer setting. Tha…

Bilingual Lexicon Induction Cross-Lingual Transfer Question Answering Zero-Shot Cross-Lingual Transfer

Few-shot Transfer Learning for Knowledge Base Question Answering: Fusing Supervised Models with In-Context Learning

2023-11-15 · Mayur Patidar, Riya Sawhney, Avinash Singh, Biswajit Chatterjee 외

Existing Knowledge Base Question Answering (KBQA) architectures are hungry for annotated data, which make them costly and time-consuming to deploy. We introduce the problem of few-shot transfer learning for KBQA, where t…

In-Context Learning Knowledge Base Question Answering Question Answering Retrieval+1

Zero-Shot Dialogue State Tracking via Cross-Task Transfer

2021-09-10 · EMNLP 2021 11 · Zhaojiang Lin, Bing Liu, Andrea Madotto, Seungwhan Moon 외

Zero-shot transfer learning for dialogue state tracking (DST) enables us to handle a variety of task-oriented dialogue domains without the expense of collecting in-domain data. In this work, we propose to transfer the \t…

Dialogue State Tracking Question Answering Transfer Learning

Momentum Contrastive Pre-training for Question Answering

2022-12-12 · Minda Hu, Muzhi Li, Yasheng Wang, Irwin King

Existing pre-training methods for extractive Question Answering (QA) generate cloze-like queries different from natural questions in syntax structure, which could overfit pre-trained models to simple keyword matching. In…

Benchmarking Contrastive Learning Extractive Question-Answering Natural Questions+1