paper-with-me

Papers

GraDA: Graph Generative Data Augmentation for Commonsense Reasoning

2022-10-01 · COLING 2022 10 · Adyasha Maharana, Mohit Bansal

Recent advances in commonsense reasoning have been fueled by the availability of large-scale human annotated datasets. Manual annotation of such datasets, many of which are based on existing knowledge bases, is expensive and not scalable. Moreover, it is challenging to build augmentation data for commonsense reasoning because the synthetic questions need to adhere to real-world scenarios. Hence, we present GraDA, a graph-generative data augmentation framework to synthesize factual data samples from knowledge graphs for commonsense reasoning datasets. First, we train a graph-to-text model for conditional generation of questions from graph entities and relations. Then, we train a generator with GAN loss to generate distractors for synthetic questions. Our approach improves performance for SocialIQA, CODAH, HellaSwag and CommonsenseQA, and works well for generative tasks like ProtoQA. We show improvement in robustness to semantic adversaries after training with GraDA and provide human evaluation of the quality of synthetic datasets in terms of factuality and answerability. Our work provides evidence and encourages future research into graph-based generative data augmentation.

📄 PDF Abstract BibTeX

Code (1)

adymaharana/grada 공식 구현 pytorch

Tasks

Data AugmentationHellaSwagKnowledge Graphs

Similar Papers 제목 키워드 기반

Automatic Knowledge Augmentation for Generative Commonsense Reasoning

2021-10-30 · Jaehyung Seo, Chanjun Park, Sugyeong Eo, Hyeonseok Moon 외

Generative commonsense reasoning is the capability of a language model to generate a sentence with a given concept-set that is based on commonsense knowledge. However, generative language models still struggle to provide…

Language ModelingLanguage ModellingSentence

Generative Data Augmentation for Commonsense Reasoning

2020-04-24 · Findings of the Association for Computational Linguistics 2020 · Yiben Yang, Chaitanya Malaviya, Jared Fernandez, Swabha Swayamdipta 외

Recent advances in commonsense reasoning depend on large-scale human-annotated training data to achieve peak performance. However, manual curation of training examples is expensive and has been shown to introduce annotat…

Common Sense ReasoningCoreference ResolutionData AugmentationOut-of-Distribution Generalization+3

Improving Commonsense Bias Classification by Mitigating the Influence of Demographic Terms

2024-06-11 · Jinkyu Lee, Jihie Kim

Understanding commonsense knowledge is crucial in the field of Natural Language Processing (NLP). However, the presence of demographic terms in commonsense knowledge poses a potential risk of compromising the performance…

Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles

2022-11-29 · CVPR 2023 1 · Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu 외

This paper focuses on analyzing and improving the commonsense ability of recent popular vision-language (VL) models. Despite the great success, we observe that existing VL-models still lack commonsense knowledge/reasonin…

Data AugmentationDiagnosticRetrieval

Learning from Missing Relations: Contrastive Learning with Commonsense Knowledge Graphs for Commonsense Inference

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Commonsense inference poses a unique challenge to reason and generate the physical, social, and causal conditions of a given event. Existing approaches to commonsense inference utilize commonsense transformers, which are…

Contrastive LearningDiversityKnowledge Graphs