Implanting Rational Knowledge into Distributed Representation at Morpheme Level

2018-11-26 · Zi Lin, Yang Liu

Previously, researchers paid no attention to the creation of unambiguous morpheme embeddings independent from the corpus, while such information plays an important role in expressing the exact meanings of words for parataxis languages like Chinese. In this paper, after constructing the Chinese lexical and semantic ontology based on word-formation, we propose a novel approach to implanting the structured rational knowledge into distributed representation at morpheme level, naturally avoiding heavy disambiguation in the corpus. We design a template to create the instances as pseudo-sentences merely from the pieces of knowledge of morphemes built in the lexicon. To exploit hierarchical information and tackle the data sparseness problem, the instance proliferation technique is applied based on similarity to expand the collection of pseudo-sentences. The distributed representation for morphemes can then be trained on these pseudo-sentences using word2vec. For evaluation, we validate the paradigmatic and syntagmatic relations of morpheme embeddings, and apply the obtained embeddings to word similarity measurement, achieving significant improvements over the classical models by more than 5 Spearman scores or 8 percentage points, which shows very promising prospects for adoption of the new source of knowledge.

📄 PDF Abstract BibTeX arXiv:1811.10188

Code (0)

등록된 구현이 없습니다.

Tasks

Word Similarity

Believe It or Not: How Deeply do LLMs Believe Implanted Facts?

2025-10-20 · Stewart Slocum, Julian Minder, Clément Dumas, Henry Sleight 외 arxiv

Knowledge editing techniques promise to implant new factual knowledge into large language models (LLMs). But do LLMs really believe these facts? We develop a framework to measure belief depth and use it to evaluate the s…

knowledge editing

World Model Implanting for Test-time Adaptation of Embodied Agents

2025-09-04 · Minjong Yoo, Jinwoo Jang, Sihyung Yoon, Honguk Woo arxiv

In embodied AI, a persistent challenge is enabling agents to robustly adapt to novel domains without requiring extensive data collection or retraining. To address this, we present a world model implanting framework (WorM…

Test-time Adaptation

Dense Classification and Implanting for Few-Shot Learning

2019-03-12 · CVPR 2019 6 · Yann Lifchitz, Yannis Avrithis, Sylvaine Picard, Andrei Bursuc

Training deep neural networks from few examples is a highly challenging and key problem for many computer vision tasks. In this context, we are targeting knowledge transfer from a set with abundant data to other sets wit…

Classification Few-Shot Learning General Classification Transfer Learning

Group Sparse CNNs for Question Classification with Answer Sets

2017-10-07 · ACL 2017 7 · Mingbo Ma, Liang Huang, Bing Xiang, Bo-Wen Zhou

Question classification is an important task with wide applications. However, traditional techniques treat questions as general sentences, ignoring the corresponding answer data. In order to consider answer information i…

Classification General Classification

Incremental Few-Shot Learning via Implanting and Compressing

2022-03-19 · Yiting Li, Haiyue Zhu, Xijia Feng, Zilong Cheng 외

This work focuses on tackling the challenging but realistic visual task of Incremental Few-Shot Learning (IFSL), which requires a model to continually learn novel classes from only a few examples while not forgetting the…

Few-Shot Learning image-classification Image Classification object-detection+1