paper-with-me

홈 › Papers

Understanding Unnatural Questions Improves Reasoning over Text

2020-10-19 · COLING 2020 8 · Xiao-Yu Guo, Yuan-Fang Li, Gholamreza Haffari

Complex question answering (CQA) over raw text is a challenging task. A prominent approach to this task is based on the programmer-interpreter framework, where the programmer maps the question into a sequence of reasoning actions which is then executed on the raw text by the interpreter. Learning an effective CQA model requires large amounts of human-annotated data,consisting of the ground-truth sequence of reasoning actions, which is time-consuming and expensive to collect at scale. In this paper, we address the challenge of learning a high-quality programmer (parser) by projecting natural human-generated questions into unnatural machine-generated questions which are more convenient to parse. We firstly generate synthetic (question,action sequence) pairs by a data generator, and train a semantic parser that associates synthetic questions with their corresponding action sequences. To capture the diversity when applied tonatural questions, we learn a projection model to map natural questions into their most similar unnatural questions for which the parser can work well. Without any natural training data, our projection model provides high-quality action sequences for the CQA task. Experimental results show that the QA model trained exclusively with synthetic data generated by our method outperforms its state-of-the-art counterpart trained on human-labeled data.

📄 PDF Abstract BibTeX arXiv:2010.09366

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityNatural QuestionsQuestion Answering

Similar Papers 제목 키워드 기반

CLIP-UP: CLIP-Based Unanswerable Problem Detection for Visual Question Answering

2025-01-02 · Ben Vardi, Oron Nir, Ariel Shamir

Recent Vision-Language Models (VLMs) have demonstrated remarkable capabilities in visual understanding and reasoning, and in particular on multiple-choice Visual Question Answering (VQA). Still, these models can make dis…

Multiple-choiceQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Reinforcement Learning vs. Distillation: Understanding Accuracy and Capability in LLM Reasoning

2025-05-20 · Minwu Kim, Anubhav Shrestha, Safal Shrestha, Aadim Nepal 외

Recent studies have shown that reinforcement learning with verifiable rewards (RLVR) enhances overall accuracy but fails to improve capability, while distillation can improve both. In this paper, we investigate the mecha…

Chain-of-Thought Reasoning In The Wild Is Not Always Faithful

2025-03-11 · Iván Arcuschin, Jett Janiak, Robert Krzyzanowski, Senthooran Rajamanoharan 외

Chain-of-Thought (CoT) reasoning has significantly advanced state-of-the-art AI capabilities. However, recent studies have shown that CoT reasoning is not always faithful, i.e. CoT reasoning does not always reflect how m…

SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency

2020-10-20 · NAACL 2021 4 · Sameer Dharur, Purva Tendulkar, Dhruv Batra, Devi Parikh 외

Recent research in Visual Question Answering (VQA) has revealed state-of-the-art models to be inconsistent in their understanding of the world -- they answer seemingly difficult questions requiring reasoning correctly bu…

Question AnsweringVisual GroundingVisual Question AnsweringVisual Question Answering (VQA)

Imagining Grounded Conceptual Representations from Perceptual Information in Situated Guessing Games

2020-11-05 · COLING 2020 8 · Alessandro Suglia, Antonio Vergari, Ioannis Konstas, Yonatan Bisk 외

In visual guessing games, a Guesser has to identify a target object in a scene by asking questions to an Oracle. An effective strategy for the players is to learn conceptual representations of objects that are both discr…

Object