paper-with-me

홈 › Papers

Consistent Alignment of Word Embedding Models

2017-02-24 · Cem Safak Sahin, Rajmonda S. Caceres, Brandon Oselio, William M. Campbell

Word embedding models offer continuous vector representations that can capture rich contextual semantics based on their word co-occurrence patterns. While these word vectors can provide very effective features used in many NLP tasks such as clustering similar words and inferring learning relationships, many challenges and open research questions remain. In this paper, we propose a solution that aligns variations of the same model (or different models) in a joint low-dimensional latent space leveraging carefully generated synthetic data points. This generative process is inspired by the observation that a variety of linguistic relationships is captured by simple linear operations in embedded space. We demonstrate that our approach can lead to substantial improvements in recovering embeddings of local neighborhoods.

📄 PDF Abstract BibTeX arXiv:1702.07680

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

Locality Preserving Loss: Neighbors that Live together, Align together

2020-04-07 · EACL (AdaptNLP) 2021 4 · Ashwinkumar Ganesan, Francis Ferraro, Tim Oates

We present a locality preserving loss (LPL) that improves the alignment between vector space embeddings while separating uncorrelated representations. Given two pretrained embedding manifolds, LPL optimizes a model to pr…

Natural Language InferenceSentence EmbeddingsSTStext similarity+1

Multi-lingual Common Semantic Space Construction via Cluster-consistent Word Embedding

2018-04-21 · EMNLP 2018 10 · Lifu Huang, Kyunghyun Cho, Boliang Zhang, Heng Ji 외

We construct a multilingual common semantic space based on distributional semantics, where words from multiple languages are projected into a shared space to enable knowledge and resource transfer across languages. Beyon…

ClusteringWord Alignment

Are Girls Neko or Shōjo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization

2019-06-04 · Mozhi Zhang, Keyulu Xu, Ken-ichi Kawarabayashi, Stefanie Jegelka 외

Cross-lingual word embeddings (CLWE) underlie many multilingual natural language processing systems, often through orthogonal transformations of pre-trained monolingual embeddings. However, orthogonal mapping only works …

Cross-Lingual Word EmbeddingsTranslationWord EmbeddingsWord Translation

Cross-Lingual Word Alignment for ASEAN Languages with Contrastive Learning

2024-07-06 · Jingshen Zhang, Xinying Qiu, Teng Shen, Wenyu Wang 외

Cross-lingual word alignment plays a crucial role in various natural language processing tasks, particularly for low-resource languages. Recent study proposes a BiLSTM-based encoder-decoder model that outperforms pre-tra…

Contrastive LearningDecoderWord AlignmentWord Embeddings

Are Girls Neko or Sh\=ojo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization

2019-07-01 · ACL 2019 7 · Mozhi Zhang, Keyulu Xu, Ken-ichi Kawarabayashi, Stefanie Jegelka 외

Cross-lingual word embeddings (CLWE) underlie many multilingual natural language processing systems, often through orthogonal transformations of pre-trained monolingual embeddings. However, orthogonal mapping only works …

Cross-Lingual Word EmbeddingsTranslationWord EmbeddingsWord Translation