paper-with-me

Papers

CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning

2023-05-08 · Weiqi Wang, Tianqing Fang, Baixuan Xu, Chun Yi Louis Bo, Yangqiu Song, Lei Chen

Commonsense reasoning, aiming at endowing machines with a human-like ability to make situational presumptions, is extremely challenging to generalize. For someone who barely knows about "meditation," while is knowledgeable about "singing," he can still infer that "meditation makes people relaxed" from the existing knowledge that "singing makes people relaxed" by first conceptualizing "singing" as a "relaxing event" and then instantiating that event to "meditation." This process, known as conceptual induction and deduction, is fundamental to commonsense reasoning while lacking both labeled data and methodologies to enhance commonsense modeling. To fill such a research gap, we propose CAT (Contextualized ConceptuAlization and InsTantiation), a semi-supervised learning framework that integrates event conceptualization and instantiation to conceptualize commonsense knowledge bases at scale. Extensive experiments show that our framework achieves state-of-the-art performances on two conceptualization tasks, and the acquired abstract commonsense knowledge can significantly improve commonsense inference modeling. Our code, data, and fine-tuned models are publicly available at https://github.com/HKUST-KnowComp/CAT.

📄 PDF Abstract BibTeX arXiv:2305.04808

Code (2)

hkust-knowcomp/cat 공식 구현 pytorch
hkust-knowcomp/car pytorch

Similar Papers 제목 키워드 기반

CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning

2024-01-14 · Weiqi Wang, Tianqing Fang, Chunyang Li, Haochen Shi 외

The sequential process of conceptualization and instantiation is essential to generalizable commonsense reasoning as it allows the application of existing knowledge to unfamiliar scenarios. However, existing works tend t…

Diversity

Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization

2022-06-03 · Mutian He, Tianqing Fang, Weiqi Wang, Yangqiu Song

Conceptualization, or viewing entities and situations as instances of abstract concepts in mind and making inferences based on that, is a vital component in human intelligence for commonsense reasoning. Despite recent pr…

Knowledge Graphs

ConceptEdit: Conceptualization-Augmented Knowledge Editing in Large Language Models for Commonsense Reasoning

2024-12-16 · Liyu Zhang, Weiqi Wang, Tianqing Fang, Yangqiu Song

Knowledge Editing (KE) aims to adjust a Large Language Model's (LLM) internal representations and parameters to correct inaccuracies and improve output consistency without incurring the computational expense of re-traini…

knowledge editingQuestion Answering

COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspective

2023-05-09 · Zhaowei Wang, Quyet V. Do, Hongming Zhang, Jiayao Zhang 외

Detecting commonsense causal relations (causation) between events has long been an essential yet challenging task. Given that events are complicated, an event may have different causes under various contexts. Thus, explo…

Causal InferenceCoLACommonsense Causal Reasoning

Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models

2021-09-10 · EMNLP 2021 11 · Tassilo Klein, Moin Nabi

Can we get existing language models and refine them for zero-shot commonsense reasoning? This paper presents an initial study exploring the feasibility of zero-shot commonsense reasoning for the Winograd Schema Challenge…

Language ModelingLanguage ModellingSelf-Supervised Learning