paper-with-me

홈 › Papers

The Analysis about Building Cross-lingual Sememe Knowledge Base Based on Deep Clustering Network

2022-08-10 · Xiaoran Li, Toshiaki Takano

A sememe is defined as the minimum semantic unit of human languages. Sememe knowledge bases (KBs), which contain words annotated with sememes, have been successfully applied to many NLP tasks, and we believe that by learning the smallest unit of meaning, computers can more easily understand human language. However, Existing sememe KBs are built on only manual annotation, human annotations have personal understanding biases, and the meaning of vocabulary will be constantly updated and changed with the times, and artificial methods are not always practical. To address the issue, we propose an unsupervised method based on a deep clustering network (DCN) to build a sememe KB, and you can use any language to build a KB through this method. We first learn the distributed representation of multilingual words, use MUSE to align them in a single vector space, learn the multi-layer meaning of each word through the self-attention mechanism, and use a DNC to cluster sememe features. Finally, we completed the prediction using only the 10-dimensional sememe space in English. We found that the low-dimensional space can still retain the main feature of the sememes.

📄 PDF Abstract BibTeX arXiv:2208.05462

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Clustering

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Towards Building a Multilingual Sememe Knowledge Base: Predicting Sememes for BabelNet Synsets

2019-12-04 · Fanchao Qi, Liang Chang, Maosong Sun, Sicong Ouyang 외

A sememe is defined as the minimum semantic unit of human languages. Sememe knowledge bases (KBs), which contain words annotated with sememes, have been successfully applied to many NLP tasks. However, existing sememe KB…

Sememe Prediction for BabelNet Synsets using Multilingual and Multimodal Information

2022-03-14 · Findings (ACL) 2022 5 · Fanchao Qi, Chuancheng Lv, Zhiyuan Liu, Xiaojun Meng 외

In linguistics, a sememe is defined as the minimum semantic unit of languages. Sememe knowledge bases (KBs), which are built by manually annotating words with sememes, have been successfully applied to various NLP tasks.…

Cross-lingual Lexical Sememe Prediction

2018-10-01 · EMNLP 2018 10 · Fanchao Qi, Yankai Lin, Maosong Sun, Hao Zhu 외

Sememes are defined as the minimum semantic units of human languages. As important knowledge sources, sememe-based linguistic knowledge bases have been widely used in many NLP tasks. However, most languages still do not …

Learning Word EmbeddingsMultilingual Word EmbeddingsPredictionWord Embeddings

Going “Deeper”: Structured Sememe Prediction via Transformer with Tree Attention

2022-05-01 · Findings (ACL) 2022 5 · Yining Ye, Fanchao Qi, Zhiyuan Liu, Maosong Sun

Sememe knowledge bases (SKBs), which annotate words with the smallest semantic units (i.e., sememes), have proven beneficial to many NLP tasks. Building an SKB is very time-consuming and labor-intensive. Therefore, some …

Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge

2023-02-21 · Fan Chen, Yan Huang, Xinfang Zhang, Kang Luo 외

Semantic consistency recognition aims to detect and judge whether the semantics of two text sentences are consistent with each other. However, the existing methods usually encounter the challenges of synonyms, polysemy a…

Paraphrase IdentificationSentenceText Matching