Scalable Cross-Lingual Transfer of Neural Sentence Embeddings
We develop and investigate several cross-lingual alignment approaches for neural sentence embedding models, such as the supervised inference classifier, InferSent, and sequential encoder-decoder models. We evaluate three alignment frameworks applied to these models: joint modeling, representation transfer learning, and sentence mapping, using parallel text to guide the alignment. Our results support representation transfer as a scalable approach for modular cross-lingual alignment of neural sentence embeddings, where we observe better performance compared to joint models in intrinsic and extrinsic evaluations, particularly with smaller sets of parallel data.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual TransferDecoderSentenceSentence EmbeddingSentence-EmbeddingSentence EmbeddingsTransfer LearningSimilar Papers 제목 키워드 기반
Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts. Our system uses a single BiLSTM encode…
Cross-Lingual Bitext MiningCross-Lingual Document ClassificationCross-Lingual Natural Language InferenceCross-Lingual Transfer+8Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representation
We introduce a new method to improve existing multilingual sentence embeddings with Abstract Meaning Representation (AMR). Compared with the original textual input, AMR is a structured semantic representation that presen…
Abstract Meaning RepresentationSemantic SimilaritySemantic Textual SimilaritySentence+1Lingua Custodi's participation at the WMT 2025 Terminology shared task
While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning BERT based cross-lingual sentence embeddings have yet to be explored. We system…
Semantic SimilarityTransfer LearningText RetrievalLeveraging Multi-lingual Positive Instances in Contrastive Learning to Improve Sentence Embedding
Learning multi-lingual sentence embeddings is a fundamental task in natural language processing. Recent trends in learning both mono-lingual and multi-lingual sentence embeddings are mainly based on contrastive learning …
Contrastive LearningCross-Lingual TransferRetrievalSemantic Similarity+5Language-agnostic BERT Sentence Embedding
While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings have…
Language ModelingLanguage ModellingMasked Language ModelingMultilingual NLP+11