Linear Transformations for Cross-lingual Semantic Textual Similarity
Cross-lingual semantic textual similarity systems estimate the degree of the meaning similarity between two sentences, each in a different language. State-of-the-art algorithms usually employ machine translation and combine vast amount of features, making the approach strongly supervised, resource rich, and difficult to use for poorly-resourced languages. In this paper, we study linear transformations, which project monolingual semantic spaces into a shared space using bilingual dictionaries. We propose a novel transformation, which builds on the best ideas from prior works. We experiment with unsupervised techniques for sentence similarity based only on semantic spaces and we show they can be significantly improved by the word weighting. Our transformation outperforms other methods and together with word weighting leads to very promising results on several datasets in different languages.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual Semantic Textual SimilarityMachine TranslationSemantic Textual SimilaritySentenceSentence SimilarityTranslationSimilar Papers 제목 키워드 기반
Cross-lingual Word Analogies using Linear Transformations between Semantic Spaces
We generalize the word analogy task across languages, to provide a new intrinsic evaluation method for cross-lingual semantic spaces. We experiment with six languages within different language families, including English…
A Common Semantic Space for Monolingual and Cross-Lingual Meta-Embeddings
This paper presents a new technique for creating monolingual and cross-lingual meta-embeddings. Our method integrates multiple word embeddings created from complementary techniques, textual sources, knowledge bases and l…
Cross-Lingual TransferPOSPOS TaggingSemantic Textual Similarity+3Linear Transformations for Cross-lingual Sentiment Analysis
This paper deals with cross-lingual sentiment analysis in Czech, English and French languages. We perform zero-shot cross-lingual classification using five linear transformations combined with LSTM and CNN based classifi…
ClassificationSentiment AnalysisMapping Semantic & Syntactic Relationships with Geometric Rotation
Understanding how language and embedding models encode semantic relationships is fundamental to model interpretability. While early word embeddings exhibited intuitive vector arithmetic (''king'' - ''man'' + ''woman'' = …
Discovering Lexical Gaps Using Embeddings from Multilingual LLMs
Lexical gaps are words that do not exist in certain languages. They pose challenges for building multilingual lexical resources, for machine translation, and for cross-lingual transfer. Existing lexical gap detection rel…
Cross-Lingual TransferSemantic SimilarityMachine Translation