paper-with-me

Papers

Modeling Semantic Compositionality with Sememe Knowledge

2019-07-10 · ACL 2019 7 · Fanchao Qi, Jun-Jie Huang, Chenghao Yang, Zhiyuan Liu, Xiao Chen, Qun Liu, Maosong Sun

Semantic compositionality (SC) refers to the phenomenon that the meaning of a complex linguistic unit can be composed of the meanings of its constituents. Most related works focus on using complicated compositionality functions to model SC while few works consider external knowledge in models. In this paper, we verify the effectiveness of sememes, the minimum semantic units of human languages, in modeling SC by a confirmatory experiment. Furthermore, we make the first attempt to incorporate sememe knowledge into SC models, and employ the sememeincorporated models in learning representations of multiword expressions, a typical task of SC. In experiments, we implement our models by incorporating knowledge from a famous sememe knowledge base HowNet and perform both intrinsic and extrinsic evaluations. Experimental results show that our models achieve significant performance boost as compared to the baseline methods without considering sememe knowledge. We further conduct quantitative analysis and case studies to demonstrate the effectiveness of applying sememe knowledge in modeling SC. All the code and data of this paper can be obtained on https://github.com/thunlp/Sememe-SC.

📄 PDF Abstract BibTeX arXiv:1907.04744

Code (1)

thunlp/Sememe-SC 공식 구현 tf

Tasks

multi-word expression embeddingmulti-word expression sememe prediction

Similar Papers 제목 키워드 기반

Enhancing Transformer with Sememe Knowledge

2020-07-01 · WS 2020 7 · Yuhui Zhang, Chenghao Yang, Zhengping Zhou, Zhiyuan Liu

While large-scale pretraining has achieved great success in many NLP tasks, it has not been fully studied whether external linguistic knowledge can improve data-driven models. In this work, we introduce sememe knowledge …

Language ModelingLanguage Modelling

Improved Word Representation Learning with Sememes

2017-07-01 · ACL 2017 7 · Yilin Niu, Ruobing Xie, Zhiyuan Liu, Maosong Sun

Sememes are minimum semantic units of word meanings, and the meaning of each word sense is typically composed by several sememes. Since sememes are not explicit for each word, people manually annotate word sememes and fo…

Common Sense ReasoningLanguage ModelingLanguage ModellingMachine Translation+6

SememeASR: Boosting Performance of End-to-End Speech Recognition against Domain and Long-Tailed Data Shift with Sememe Semantic Knowledge

2023-09-04 · Jiaxu Zhu, Changhe Song, Zhiyong Wu, Helen Meng

Recently, excellent progress has been made in speech recognition. However, pure data-driven approaches have struggled to solve the problem in domain-mismatch and long-tailed data. Considering that knowledge-driven approa…

Domain Generalizationspeech-recognitionSpeech Recognition

Cross-lingual Lexical Sememe Prediction

2018-10-01 · EMNLP 2018 10 · Fanchao Qi, Yankai Lin, Maosong Sun, Hao Zhu 외

Sememes are defined as the minimum semantic units of human languages. As important knowledge sources, sememe-based linguistic knowledge bases have been widely used in many NLP tasks. However, most languages still do not …

Learning Word EmbeddingsMultilingual Word EmbeddingsPredictionWord Embeddings

Language Modeling with Sparse Product of Sememe Experts

2018-10-29 · EMNLP 2018 10 · Yihong Gu, Jun Yan, Hao Zhu, Zhiyuan Liu 외

Most language modeling methods rely on large-scale data to statistically learn the sequential patterns of words. In this paper, we argue that words are atomic language units but not necessarily atomic semantic units. Ins…

Language ModelingLanguage Modelling