A Knowledge Hunting Framework for Common Sense Reasoning
We introduce an automatic system that achieves state-of-the-art results on the Winograd Schema Challenge (WSC), a common sense reasoning task that requires diverse, complex forms of inference and knowledge. Our method uses a knowledge hunting module to gather text from the web, which serves as evidence for candidate problem resolutions. Given an input problem, our system generates relevant queries to send to a search engine, then extracts and classifies knowledge from the returned results and weighs them to make a resolution. Our approach improves F1 performance on the full WSC by 0.21 over the previous best and represents the first system to exceed 0.5 F1. We further demonstrate that the approach is competitive on the Choice of Plausible Alternatives (COPA) task, which suggests that it is generally applicable.
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningCoreference ResolutionSimilar Papers 제목 키워드 기반
Combining Knowledge Hunting and Neural Language Models to Solve the Winograd Schema Challenge
Winograd Schema Challenge (WSC) is a pronoun resolution task which seems to require reasoning with commonsense knowledge. The needed knowledge is not present in the given text. Automatic extraction of the needed knowledg…
Language ModelingLanguage ModellingA Generalized Knowledge Hunting Framework for the Winograd Schema Challenge
We introduce an automatic system that performs well on two common-sense reasoning tasks, the Winograd Schema Challenge (WSC) and the Choice of Plausible Alternatives (COPA). Problem instances from these tasks require div…
Common Sense ReasoningCoreference ResolutionInformation RetrievalOn the Security Risks of Knowledge Graph Reasoning
Knowledge graph reasoning (KGR) -- answering complex logical queries over large knowledge graphs -- represents an important artificial intelligence task, entailing a range of applications (e.g., cyber threat hunting). Ho…
Knowledge GraphsTowards Question Format Independent Numerical Reasoning: A Set of Prerequisite Tasks
Numerical reasoning is often important to accurately understand the world. Recently, several format-specific datasets have been proposed, such as numerical reasoning in the settings of Natural Language Inference (NLI), R…
Natural Language InferenceQuestion AnsweringReading ComprehensionMulti-hop Commonsense Knowledge Injection Framework for Zero-Shot Commonsense Question Answering
Commonsense question answering (QA) research requires machines to answer questions based on commonsense knowledge. However, this research requires expensive labor costs to annotate data as the basis of research, and mode…
Contrastive LearningKnowledge GraphsQuestion Answering