paper-with-me

Papers

ATAP: Automatic Template-Augmented Commonsense Knowledge Graph Completion via Pre-Trained Language Models

2024-11-01 · Conference 2024 11 · Fu Zhang, Yifan Ding, Jingwei Cheng

The mission of commonsense knowledge graph completion (CKGC) is to infer missing facts from known commonsense knowledge. CKGC methods can be roughly divided into two categories: triple-based methods and text-based methods. Due to the imbalanced distribution of entities and limited structural information, triple-based methods struggle with long-tail entities. Text-based methods alleviate this issue, but require extensive training and fine-tuning of language models, which reduces efficiency. To alleviate these problems, we propose ATAP, the first CKGC framework that utilizes automatically generated continuous prompt templates combined with pre-trained language models (PLMs). Moreover, ATAP uses a carefully designed new prompt template training strategy, guiding PLMs to generate optimal prompt templates for CKGC tasks. Combining the rich knowledge of PLMs with the template automatic augmentation strategy, ATAP effectively mitigates the long-tail problem and enhances CKGC performance. Results on benchmark datasets show that ATAP achieves state-of-the-art performance overall.

📄 PDF Abstract BibTeX

Code (1)

MindSpore-scientific-2/code-7/tree/main/ATAP mindspore

Tasks

Knowledge Graph Completion

Similar Papers 제목 키워드 기반

COMET: Commonsense Transformers for Automatic Knowledge Graph Construction

2019-06-12 · ACL 2019 7 · Antoine Bosselut, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya 외

We present the first comprehensive study on automatic knowledge base construction for two prevalent commonsense knowledge graphs: ATOMIC (Sap et al., 2019) and ConceptNet (Speer et al., 2017). Contrary to many convention…

graph constructionKnowledge Base ConstructionKnowledge Graphs

Knowledge-Augmented Language Models for Cause-Effect Relation Classification

2021-12-16 · CSRR (ACL) 2022 5 · Pedram Hosseini, David A. Broniatowski, Mona Diab

Previous studies have shown the efficacy of knowledge augmentation methods in pretrained language models. However, these methods behave differently across domains and downstream tasks. In this work, we investigate the au…

Cause-Effect Relation ClassificationClassificationCommonsense Causal ReasoningLanguage Modelling+2

Augmenting End-to-End Dialog Systems with Commonsense Knowledge

2017-09-16 · Tom Young, Erik Cambria, Iti Chaturvedi, Minlie Huang 외

Building dialog agents that can converse naturally with humans is a challenging yet intriguing problem of artificial intelligence. In open-domain human-computer conversation, where the conversational agent is expected to…

Retrieval

Ape210K: A Large-Scale and Template-Rich Dataset of Math Word Problems

2020-09-24 · Wei Zhao, Mingyue Shang, Yang Liu, Liang Wang 외

Automatic math word problem solving has attracted growing attention in recent years. The evaluation datasets used by previous works have serious limitations in terms of scale and diversity. In this paper, we release a ne…

DiversityMathMath Word Problem SolvingNatural Language Understanding

Designing Templates for Eliciting Commonsense Knowledge from Pretrained Sequence-to-Sequence Models

2020-12-01 · COLING 2020 8 · Jheng-Hong Yang, Sheng-Chieh Lin, Rodrigo Nogueira, Ming-Feng Tsai 외

While internalized {``}implicit knowledge{''} in pretrained transformers has led to fruitful progress in many natural language understanding tasks, how to most effectively elicit such knowledge remains an open question. …

Multiple-choiceNatural Language UnderstandingOpen-Ended Question AnsweringQuestion Answering