paper-with-me

Papers

Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs

2023-10-18 · Zhiwei Hu, Víctor Gutiérrez-Basulto, Zhiliang Xiang, Ru Li, Jeff Z. Pan

Knowledge graph entity typing (KGET) aims at inferring plausible types of entities in knowledge graphs. Existing approaches to KGET focus on how to better encode the knowledge provided by the neighbors and types of an entity into its representation. However, they ignore the semantic knowledge provided by the way in which types can be clustered together. In this paper, we propose a novel method called Multi-view Contrastive Learning for knowledge graph Entity Typing (MCLET), which effectively encodes the coarse-grained knowledge provided by clusters into entity and type embeddings. MCLET is composed of three modules: i) Multi-view Generation and Encoder module, which encodes structured information from entity-type, entity-cluster and cluster-type views; ii) Cross-view Contrastive Learning module, which encourages different views to collaboratively improve view-specific representations of entities and types; iii) Entity Typing Prediction module, which integrates multi-head attention and a Mixture-of-Experts strategy to infer missing entity types. Extensive experiments show the strong performance of MCLET compared to the state-of-the-art

📄 PDF Abstract BibTeX arXiv:2310.12008

Code (1)

zhiweihu1103/et-mclet 공식 구현 pytorch

Tasks

Contrastive LearningEntity TypingKnowledge GraphsMixture-of-Experts

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Focus 설명 없음
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Multi-Multi-View Learning: Multilingual and Multi-Representation Entity Typing

2018-10-24 · EMNLP 2018 10 · Yadollah Yaghoobzadeh, Hinrich Schütze

Knowledge bases (KBs) are paramount in NLP. We employ multiview learning for increasing accuracy and coverage of entity type information in KBs. We rely on two metaviews: language and representation. For language, we con…

Entity TypingMultiview LearningMULTI-VIEW LEARNING

Cross-Lingual Contrastive Learning for Fine-Grained Entity Typing for Low-Resource Languages

2022-05-01 · ACL 2022 5 · Xu Han, Yuqi Luo, Weize Chen, Zhiyuan Liu 외

Fine-grained entity typing (FGET) aims to classify named entity mentions into fine-grained entity types, which is meaningful for entity-related NLP tasks. For FGET, a key challenge is the low-resource problem — the compl…

Contrastive LearningEntity TypingMachine Translation

Type-enriched Hierarchical Contrastive Strategy for Fine-Grained Entity Typing

2022-08-22 · COLING 2022 10 · Xinyu Zuo, Haijin Liang, Ning Jing, Shuang Zeng 외

Fine-grained entity typing (FET) aims to deduce specific semantic types of the entity mentions in text. Modern methods for FET mainly focus on learning what a certain type looks like. And few works directly model the typ…

Entity TypingVocal Bursts Type Prediction

COTET: Cross-view Optimal Transport for Knowledge Graph Entity Typing

2024-05-22 · Zhiwei Hu, Víctor Gutiérrez-Basulto, Zhiliang Xiang, Ru Li 외

Knowledge graph entity typing (KGET) aims to infer missing entity type instances in knowledge graphs. Previous research has predominantly centered around leveraging contextual information associated with entities, which …

Entity TypingKnowledge Graphs

Generative Entity Typing with Curriculum Learning

2022-10-06 · Siyu Yuan, Deqing Yang, Jiaqing Liang, Zhixu Li 외

Entity typing aims to assign types to the entity mentions in given texts. The traditional classification-based entity typing paradigm has two unignorable drawbacks: 1) it fails to assign an entity to the types beyond the…

Entity TypingLanguage Modelling