paper-with-me

홈 › Papers

Alleviating the Knowledge-Language Inconsistency: A Study for Deep Commonsense Knowledge

2021-05-28 · Yi Zhang, Lei LI, Yunfang Wu, Qi Su, Xu sun

Knowledge facts are typically represented by relational triples, while we observe that some commonsense facts are represented by the triples whose forms are inconsistent with the expression of language. This inconsistency puts forward a challenge for pre-trained language models to deal with these commonsense knowledge facts. In this paper, we term such knowledge as deep commonsense knowledge and conduct extensive exploratory experiments on it. We show that deep commonsense knowledge occupies a significant part of commonsense knowledge while conventional methods fail to capture it effectively. We further propose a novel method to mine the deep commonsense knowledge distributed in sentences, alleviating the reliance of conventional methods on the triple representation form of knowledge. Experiments demonstrate that the proposal significantly improves the performance in mining deep commonsense knowledge.

📄 PDF Abstract BibTeX arXiv:2105.13607

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Visual Riddles: a Commonsense and World Knowledge Challenge for Large Vision and Language Models

2024-07-28 · Nitzan Bitton-Guetta, Aviv Slobodkin, Aviya Maimon, Eliya Habba 외

Imagine observing someone scratching their arm; to understand why, additional context would be necessary. However, spotting a mosquito nearby would immediately offer a likely explanation for the person's discomfort, ther…

World Knowledge

What Really is Commonsense Knowledge?

2024-11-06 · Quyet V. Do, Junze Li, Tung-Duong Vuong, Zhaowei Wang 외

Commonsense datasets have been well developed in Natural Language Processing, mainly through crowdsource human annotation. However, there are debates on the genuineness of commonsense reasoning benchmarks. In specific, a…

SCoRE: Benchmarking Long-Chain Reasoning in Commonsense Scenarios

2025-03-08 · Weidong Zhan, Yue Wang, Nan Hu, Liming Xiao 외

Currently, long-chain reasoning remains a key challenge for large language models (LLMs) because natural texts lack sufficient explicit reasoning data. However, existing benchmarks suffer from limitations such as narrow …

BenchmarkingDiagnosticLogical ReasoningMultiple-choice

Relational Reasoning using Prior Knowledge for Visual Captioning

2019-06-04 · Jingyi Hou, Xinxiao Wu, Yayun Qi, Wentian Zhao 외

Exploiting relationships among objects has achieved remarkable progress in interpreting images or videos by natural language. Most existing methods resort to first detecting objects and their relationships, and then gene…

Image Captioningobject-detectionObject DetectionRelational Reasoning+2

Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

2021-10-14 · NAACL 2022 7 · Peter West, Chandra Bhagavatula, Jack Hessel, Jena D. Hwang 외

The common practice for training commonsense models has gone from-human-to-corpus-to-machine: humans author commonsense knowledge graphs in order to train commonsense models. In this work, we investigate an alternative, …

Knowledge DistillationKnowledge GraphsLanguage ModelingLanguage Modelling+1