paper-with-me

홈 › Papers

Assessing the Role of Lexical Semantics in Cross-lingual Transfer through Controlled Manipulations

2024-08-14 · Roy Ilani, Taelin Karidi, Omri Abend

While cross-linguistic model transfer is effective in many settings, there is still limited understanding of the conditions under which it works. In this paper, we focus on assessing the role of lexical semantics in cross-lingual transfer, as we compare its impact to that of other language properties. Examining each language property individually, we systematically analyze how differences between English and a target language influence the capacity to align the language with an English pretrained representation space. We do so by artificially manipulating the English sentences in ways that mimic specific characteristics of the target language, and reporting the effect of each manipulation on the quality of alignment with the representation space. We show that while properties such as the script or word order only have a limited impact on alignment quality, the degree of lexical matching between the two languages, which we define using a measure of translation entropy, greatly affects it.

📄 PDF Abstract BibTeX arXiv:2408.07599

Code (1)

roy54x/Lexical_semantics_in_cross-lingual_transfer 공식 구현 pytorch

Tasks

Cross-Lingual Transfer

Methods 이 논문이 사용한 방법론

Focus 설명 없음
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

The Typology of Polysemy: A Multilingual Distributional Framework

2020-06-02 · Ella Rabinovich, Yang Xu, Suzanne Stevenson

Lexical semantic typology has identified important cross-linguistic generalizations about the variation and commonalities in polysemy patterns---how languages package up meanings into words. Recent computational research…

Beyond lexical semantics: notes on pragmatic frames

2020-05-01 · LREC 2020 5 · Oliver Czulo, Alex Ziem, er, Tiago Timponi Torrent

Framenets as an incarnation of frame semantics have been set up to deal with lexicographic issues (cf. Fillmore and Baker 2010, among others). They are thus concerned with lexical units (LUs) and the conceptual structure…

TAG

Graph Methods for Multilingual FrameNets

2017-08-01 · WS 2017 8 · Collin F. Baker, Michael Ellsworth

This paper introduces a new, graph-based view of the data of the FrameNet project, which we hope will make it easier to understand the mixture of semantic and syntactic information contained in FrameNet annotation. We sh…

Semantic Role LabelingSentence

Tokenization Impacts Multilingual Language Modeling: Assessing Vocabulary Allocation and Overlap Across Languages

2023-05-26 · Tomasz Limisiewicz, Jiří Balhar, David Mareček

Multilingual language models have recently gained attention as a promising solution for representing multiple languages in a single model. In this paper, we propose new criteria to evaluate the quality of lexical represe…

Language ModelingLanguage ModellingNERPOS+2

Proceedings of the LexSem+Logics Workshop 2016

2016-08-14 · Steven Neale, Valeria de Paiva, Arantxa Otegi, Alexandre Rademaker

Lexical semantics continues to play an important role in driving research directions in NLP, with the recognition and understanding of context becoming increasingly important in delivering successful outcomes in NLP task…

Entity DisambiguationOpen Information ExtractionPart-Of-Speech TaggingSemantic Similarity+1