Cross-lingual Entity Alignment with Incidental Supervision
Much research effort has been put to multilingual knowledge graph (KG) embedding methods to address the entity alignment task, which seeks to match entities in different languagespecific KGs that refer to the same real-world object. Such methods are often hindered by the insufficiency of seed alignment provided between KGs. Therefore, we propose an incidentally supervised model, JEANS , which jointly represents multilingual KGs and text corpora in a shared embedding scheme, and seeks to improve entity alignment with incidental supervision signals from text. JEANS first deploys an entity grounding process to combine each KG with the monolingual text corpus. Then, two learning processes are conducted: (i) an embedding learning process to encode the KG and text of each language in one embedding space, and (ii) a selflearning based alignment learning process to iteratively induce the matching of entities and that of lexemes between embeddings. Experiments on benchmark datasets show that JEANS leads to promising improvement on entity alignment with incidental supervision, and significantly outperforms state-of-the-art methods that solely rely on internal information of KGs.
Code (1)
Tasks
Entity AlignmentKnowledge GraphsSimilar Papers 제목 키워드 기반
Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study
Multilingual BERT (mBERT) has shown reasonable capability for zero-shot cross-lingual transfer when fine-tuned on downstream tasks. Since mBERT is not pre-trained with explicit cross-lingual supervision, transfer perform…
Cross-Lingual Transferslot-fillingSlot FillingZero-Shot Cross-Lingual TransferForeseeing the Benefits of Incidental Supervision
Real-world applications often require improved models by leveraging a range of cheap incidental supervision signals. These could include partial labels, noisy labels, knowledge-based constraints, and cross-domain or cros…
InformativenessLearning Theorynamed-entity-recognitionNamed Entity Recognition+3PABI: A Unified PAC-Bayesian Informativeness Measure for Incidental Supervision Signals
Real-world applications often require making use of {\em a range of incidental supervision signals}. However, we currently lack a principled way to measure the benefit an incidental training dataset can bring, and the co…
Informativenessnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2EASE: Entity-Aware Contrastive Learning of Sentence Embedding
We present EASE, a novel method for learning sentence embeddings via contrastive learning between sentences and their related entities. The advantage of using entity supervision is twofold: (1) entities have been shown t…
ClusteringContrastive LearningSemantic Textual SimilaritySentence+6EASE: Entity-Aware Contrastive Learning of Sentence Embedding
We present EASE, a novel method for learning sentence embeddings via contrastive learning between sentences and their related entities.The advantage of using entity supervision is twofold: (1) entities have been shown to…
ClusteringContrastive LearningSemantic Textual SimilaritySentence+6