paper-with-me

홈 › Papers

Cross-lingual Semantic Specialization via Lexical Relation Induction

2019-11-01 · IJCNLP 2019 11 · Edoardo Maria Ponti, Ivan Vuli{\'c}, Goran Glava{\v{s}}, Roi Reichart, Anna Korhonen

Semantic specialization integrates structured linguistic knowledge from external resources (such as lexical relations in WordNet) into pretrained distributional vectors in the form of constraints. However, this technique cannot be leveraged in many languages, because their structured external resources are typically incomplete or non-existent. To bridge this gap, we propose a novel method that transfers specialization from a resource-rich source language (English) to virtually any target language. Our specialization transfer comprises two crucial steps: 1) Inducing noisy constraints in the target language through automatic word translation; and 2) Filtering the noisy constraints via a state-of-the-art relation prediction model trained on the source language constraints. This allows us to specialize any set of distributional vectors in the target language with the refined constraints. We prove the effectiveness of our method through intrinsic word similarity evaluation in 8 languages, and with 3 downstream tasks in 5 languages: lexical simplification, dialog state tracking, and semantic textual similarity. The gains over the previous state-of-art specialization methods are substantial and consistent across languages. Our results also suggest that the transfer method is effective even for lexically distant source-target language pairs. Finally, as a by-product, our method produces lists of WordNet-style lexical relations in resource-poor languages.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

dialog state trackingLexical SimplificationRelationRelation PredictionSemantic Textual SimilarityWord SimilarityWord Translation

Similar Papers 제목 키워드 기반

Specializing Distributional Vectors of All Words for Lexical Entailment

2019-08-01 · WS 2019 8 · Aishwarya Kamath, Jonas Pfeiffer, Edoardo Maria Ponti, Goran Glava{\v{s}} 외

Semantic specialization methods fine-tune distributional word vectors using lexical knowledge from external resources (e.g. WordNet) to accentuate a particular relation between words. However, such post-processing method…

AllCross-Lingual TransferLexical EntailmentRelation+2

Adversarial Propagation and Zero-Shot Cross-Lingual Transfer of Word Vector Specialization

2018-09-11 · EMNLP 2018 10 · Edoardo Maria Ponti, Ivan Vulić, Goran Glavaš, Nikola Mrkšić 외

Semantic specialization is the process of fine-tuning pre-trained distributional word vectors using external lexical knowledge (e.g., WordNet) to accentuate a particular semantic relation in the specialized vector space.…

Cross-Lingual Transferdialog state trackingLexical SimplificationWord Similarity+1

Massively Multilingual Lexical Specialization of Multilingual Transformers

2022-08-01 · Tommaso Green, Simone Paolo Ponzetto, Goran Glavaš

While pretrained language models (PLMs) primarily serve as general-purpose text encoders that can be fine-tuned for a wide variety of downstream tasks, recent work has shown that they can also be rewired to produce high-…

Bilingual Lexicon InductionRetrievalSentenceSentence Retrieval+3

Generalized Tuning of Distributional Word Vectors for Monolingual and Cross-Lingual Lexical Entailment

2019-07-01 · ACL 2019 7 · Goran Glava{\v{s}}, Ivan Vuli{\'c}

Lexical entailment (LE; also known as hyponymy-hypernymy or is-a relation) is a core asymmetric lexical relation that supports tasks like taxonomy induction and text generation. In this work, we propose a simple and effe…

Lexical EntailmentRelationText Generation

Explicit Retrofitting of Distributional Word Vectors

2018-07-01 · ACL 2018 7 · Goran Glava{\v{s}}, Ivan Vuli{\'c}

Semantic specialization of distributional word vectors, referred to as retrofitting, is a process of fine-tuning word vectors using external lexical knowledge in order to better embed some semantic relation. Existing ret…

dialog state trackingLexical SimplificationSemantic Textual SimilarityText Simplification+1