Unsupervised Deep Structured Semantic Models for Commonsense Reasoning
Commonsense reasoning is fundamental to natural language understanding. While traditional methods rely heavily on human-crafted features and knowledge bases, we explore learning commonsense knowledge from a large amount of raw text via unsupervised learning. We propose two neural network models based on the Deep Structured Semantic Models (DSSM) framework to tackle two classic commonsense reasoning tasks, Winograd Schema challenges (WSC) and Pronoun Disambiguation (PDP). Evaluation shows that the proposed models effectively capture contextual information in the sentence and co-reference information between pronouns and nouns, and achieve significant improvement over previous state-of-the-art approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningCoreference ResolutionNatural Language UnderstandingSentenceSimilar Papers 제목 키워드 기반
Improving Unsupervised Commonsense Reasoning Using Knowledge-Enabled Natural Language Inference
Recent methods based on pre-trained language models have shown strong supervised performance on commonsense reasoning. However, they rely on expensive data annotation and time-consuming training. Thus, we focus on unsupe…
Natural Language InferenceTransfer LearningWinowhyVisual Commonsense Driven Knowledge Refinements for Scene Graph Generation
Learning-driven Scene Graph Generation (SGG) models excel on frequent relation types but degrade sharply under annotation sparsity, failing to capture reliable visual commonsense knowledge. We propose a model-agnostic, s…
Visual Commonsense ReasoningScene Graph GenerationExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoning
Recent commonsense-reasoning tasks are typically discriminative in nature, where a model answers a multiple-choice question for a certain context. Discriminative tasks are limiting because they fail to adequately evaluat…
Graph GenerationMultiple-choiceText GenerationKagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning
Commonsense reasoning aims to empower machines with the human ability to make presumptions about ordinary situations in our daily life. In this paper, we propose a textual inference framework for answering commonsense qu…
Common Sense ReasoningKnowledge Base Question AnsweringKnowledge GraphsNatural Language InferenceTeaching Pretrained Models with Commonsense Reasoning: A Preliminary KB-Based Approach
Recently, pretrained language models (e.g., BERT) have achieved great success on many downstream natural language understanding tasks and exhibit a certain level of commonsense reasoning ability. However, their performan…
Few-Shot LearningLogical ReasoningMultiple-choiceNatural Language Understanding