Ordinal Common-sense Inference
Humans have the capacity to draw common-sense inferences from natural language: various things that are likely but not certain to hold based on established discourse, and are rarely stated explicitly. We propose an evaluation of automated common-sense inference based on an extension of recognizing textual entailment: predicting ordinal human responses on the subjective likelihood of an inference holding in a given context. We describe a framework for extracting common-sense knowledge from corpora, which is then used to construct a dataset for this ordinal entailment task. We train a neural sequence-to-sequence model on this dataset, which we use to score and generate possible inferences. Further, we annotate subsets of previously established datasets via our ordinal annotation protocol in order to then analyze the distinctions between these and what we have constructed.
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningNatural Language InferenceSimilar Papers 제목 키워드 기반
Teach CLIP to Develop a Number Sense for Ordinal Regression
Ordinal regression is a fundamental problem within the field of computer vision, with customised well-trained models on specific tasks. While pre-trained vision-language models (VLMs) have exhibited impressive performanc…
regressionText MatchingA Latent Causal Inference Framework for Ordinal Variables
Ordinal variables, such as on the Likert scale, are common in applied research. Yet, existing methods for causal inference tend to target nominal or continuous data. When applied to ordinal data, this fails to account fo…
Causal InferenceCIKQA: Learning Commonsense Inference with a Unified Knowledge-in-the-loop QA Paradigm
Recently, the community has achieved substantial progress on many commonsense reasoning benchmarks. However, it is still unclear what is learned from the training process: the knowledge, inference capability, or both? We…
Question AnsweringTask 2Learning from Missing Relations: Contrastive Learning with Commonsense Knowledge Graphs for Commonsense Inference
Commonsense inference poses a unique challenge to reason and generate the physical, social, and causal conditions of a given event. Existing approaches to commonsense inference utilize commonsense transformers, which are…
Contrastive LearningDiversityKnowledge GraphsLearning from Missing Relations: Contrastive Learning with Commonsense Knowledge Graphs for Commonsense Inference
Commonsense inference poses a unique challenge to reason and generate the physical, social, and causal conditions of a given event. Existing approaches to commonsense inference utilize commonsense transformers, which are…
Contrastive LearningDiversityKnowledge Graphs