Explaining Word Embeddings via Disentangled Representation
Disentangled representations have attracted increasing attention recently. However, how to transfer the desired properties of disentanglement to word representations is unclear. In this work, we propose to transform typical dense word vectors into disentangled embeddings featuring improved interpretability via encoding polysemous semantics separately. We also found the modular structure of our disentangled word embeddings helps generate more efficient and effective features for natural language processing tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
DisentanglementWord EmbeddingsSimilar Papers 제목 키워드 기반
Disentangled and Self-Explainable Node Representation Learning
Node representations, or embeddings, are low-dimensional vectors that capture node properties, typically learned through unsupervised structural similarity objectives or supervised tasks. While recent efforts have focuse…
DisentanglementRepresentation LearningBreaking Down Word Semantics from Pre-trained Language Models through Layer-wise Dimension Selection
Contextual word embeddings obtained from pre-trained language model (PLM) have proven effective for various natural language processing tasks at the word level. However, interpreting the hidden aspects within embeddings,…
Binary ClassificationLanguage ModelingLanguage ModellingRepresentation Learning+1What Does This Word Mean? Explaining Contextualized Embeddings with Natural Language Definition
Contextualized word embeddings have boosted many NLP tasks compared with traditional static word embeddings. However, the word with a specific sense may have different contextualized embeddings due to its various context…
Word EmbeddingsThe performance evaluation of Multi-representation in the Deep Learning models for Relation Extraction Task
Single implementing, concatenating, adding or replacing of the representations has yielded significant improvements on many NLP tasks. Mainly in Relation Extraction where static, contextualized and others representations…
RelationRelation ExtractionWord EmbeddingsCoLiDR: Concept Learning using Aggregated Disentangled Representations
Interpretability of Deep Neural Networks using concept-based models offers a promising way to explain model behavior through human-understandable concepts. A parallel line of research focuses on disentangling the data di…
Representation Learning