Automatic Evaluation of Commonsense Knowledge for Refining Japanese ConceptNet
In this paper we present two methods for automatic common sense knowledge evaluation for Japanese entries in ConceptNet ontology. Our proposed methods utilize text-mining approach: one with relation clue words and WordNet synonyms, and one without. Both methods were tested with a blog corpus. The system based on our proposed methods reached relatively high precision score for three relations (MadeOf, UsedFor, AtLocation), which is comparable with previous research using commercial search engines and simpler input. We analyze errors and discuss problems of common sense evaluation, both manual and automatic and propose ideas for further improvements.
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningSimilar Papers 제목 키워드 기반
PHALM: Building a Knowledge Graph from Scratch by Prompting Humans and a Language Model
Despite the remarkable progress in natural language understanding with pretrained Transformers, neural language models often do not handle commonsense knowledge well. Toward commonsense-aware models, there have been atte…
Language ModelingLanguage ModellingLarge Language ModelNatural Language UnderstandingCross-lingual Knowledge Projection Using Machine Translation and Target-side Knowledge Base Completion
Considerable effort has been devoted to building commonsense knowledge bases. However, they are not available in many languages because the construction of KBs is expensive. To bridge the gap between languages, this pape…
Knowledge Base CompletionMachine TranslationTranslationReconstructing Implicit Knowledge with Language Models
In this work we propose an approach for generating statements that explicate implicit knowledge connecting sentences in text. We make use of pre-trained language models which we refine by fine-tuning them on specifically…
SentenceImproving Commonsense Contingent Reasoning by Pseudo-data and Its Application to the Related Tasks
Contingent reasoning is one of the essential abilities in natural language understanding, and many language resources annotated with contingent relations have been constructed. However, despite the recent advances in dee…
Natural Language UnderstandingRelationTransfer LearningAdvanced Semantics for Commonsense Knowledge Extraction
Commonsense knowledge (CSK) about concepts and their properties is useful for AI applications such as robust chatbots. Prior works like ConceptNet, TupleKB and others compiled large CSK collections, but are restricted in…
Commonsense Knowledge Base Construction