paper-with-me

홈 › Papers

Revisiting Machine Translation for Cross-lingual Classification

2023-05-23 · Mikel Artetxe, Vedanuj Goswami, Shruti Bhosale, Angela Fan, Luke Zettlemoyer

Machine Translation (MT) has been widely used for cross-lingual classification, either by translating the test set into English and running inference with a monolingual model (translate-test), or translating the training set into the target languages and finetuning a multilingual model (translate-train). However, most research in the area focuses on the multilingual models rather than the MT component. We show that, by using a stronger MT system and mitigating the mismatch between training on original text and running inference on machine translated text, translate-test can do substantially better than previously assumed. The optimal approach, however, is highly task dependent, as we identify various sources of cross-lingual transfer gap that affect different tasks and approaches differently. Our work calls into question the dominance of multilingual models for cross-lingual classification, and prompts to pay more attention to MT-based baselines.

📄 PDF Abstract BibTeX arXiv:2305.14240

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationCross-Lingual TransferMachine TranslationTranslation

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classification

2023-06-08 · Inigo Jauregi Unanue, Gholamreza Haffari, Massimo Piccardi

Cross-lingual text classification leverages text classifiers trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning (zero/few-shots cross-lingual transfer). N…

ClassificationCross-Lingual TransferLanguage Modellingtext-classification+2

Just Use XML: Revisiting Joint Translation and Label Projection

2026-03-12 · Thennal DK, Chris Biemann, Hans Ole Hatzel arxiv

Label projection is an effective technique for cross-lingual transfer, extending span-annotated datasets from a high-resource language to low-resource ones. Most approaches perform label projection as a separate step aft…

Cross-Lingual TransferMachine Translation

XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders

2020-12-31 · Shuming Ma, Jian Yang, Haoyang Huang, Zewen Chi 외

Multilingual machine translation enables a single model to translate between different languages. Most existing multilingual machine translation systems adopt a randomly initialized Transformer backbone. In this work, in…

Language ModelingLanguage ModellingMachine TranslationTranslation+1

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation

2019-09-01 · Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan 외

The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a single model. Its improved translation perf…

Cross-Lingual TransferMachine TranslationNMTTransfer Learning+1

Using Machine Translation to Augment Multilingual Classification

2024-05-09 · Adam King

An all-too-present bottleneck for text classification model development is the need to annotate training data and this need is multiplied for multilingual classifiers. Fortunately, contemporary machine translation models…

ClassificationImage CaptioningMachine Translationtext-classification+2