Tradutor: Building a Variety Specific Translation Model
Language models have become foundational to many widely used systems. However, these seemingly advantageous models are double-edged swords. While they excel in tasks related to resource-rich languages like English, they often lose the fine nuances of language forms, dialects, and varieties that are inherent to languages spoken in multiple regions of the world. Languages like European Portuguese are neglected in favor of their more popular counterpart, Brazilian Portuguese, leading to suboptimal performance in various linguistic tasks. To address this gap, we introduce the first open-source translation model specifically tailored for European Portuguese, along with a novel dataset specifically designed for this task. Results from automatic evaluations on two benchmark datasets demonstrate that our best model surpasses existing open-source translation systems for Portuguese and approaches the performance of industry-leading closed-source systems for European Portuguese. By making our dataset, models, and code publicly available, we aim to support and encourage further research, fostering advancements in the representation of underrepresented language varieties.
Code (0)
등록된 구현이 없습니다.
Tasks
modelTranslationSimilar Papers 제목 키워드 기반
The MITLL-AFRL IWSLT 2016 Systems
This report summarizes the MITLL-AFRL MT and ASR systems and the experiments run during the 2016 IWSLT evaluation campaign. Building on lessons learned from previous years’ results, we refine our ASR systems and examine …
Machine TranslationTranslationBuilding Machine Translation System for Software Product Descriptions Using Domain-specific Sub-corpora Extraction
Building Machine Translation systems for a specific domain requires a sufficiently large and good quality parallel corpus in that domain. However, this is a bit challenging task due to the lack of parallel data in many d…
Machine TranslationSentenceSentence EmbeddingSentence-Embedding+1Towards Universality in Multilingual Text Rewriting
In this work, we take the first steps towards building a universal rewriter: a model capable of rewriting text in any language to exhibit a wide variety of attributes, including styles and languages, while preserving as …
TranslationTranslating Between Morphologically Rich Languages: An Arabic-to-Turkish Machine Translation System
This paper introduces the work on building a machine translation system for Arabic-to-Turkish in the news domain. Our work includes collecting parallel datasets in several ways for a new and low-resourced language pair, …
Machine TranslationTranslationAn Empirical Study of Generation Order for Machine Translation
In this work, we present an empirical study of generation order for machine translation. Building on recent advances in insertion-based modeling, we first introduce a soft order-reward framework that enables us to train …
Machine TranslationTranslation