paper-with-me

홈 › Papers

Advanced Language Model-based Translator for English-Vietnamese Translation

2024-05-27 · 2024 2024 5 · Hoai Nam Nguyen, Thanh Trong Nguyen, Quoc Bao Nguyen, Vu Anh Tran

We introduce a transformative approach to English-Vietnamese translation, leveraging the cutting edge capabilities of the Gemma-7B-IT (Gemma Team et al. 2024) model. Enhanced by the Advanced Language Model-based Translator (ALMA) (Xu et al. 2023) methodology, our system significantly advances beyond the conventional Transformer models in handling complex linguistic contexts. This research details our robust training framework, experimental validations, and the rigorous evaluation processes that establish a new state-of-the-art for Vietnamese translation tasks. Our results emphatically surpass those of well-known systems such as VinAI Translate (Nguyen et al. 2022) and Google Translate (Google 2024b), demonstrating an improvement of over 12 BLEU scores against the previously top-performing systems. These achievements highlight the superior flexibility and contextual understanding capabilities of Large Language Models (LLMs) (Zhao et al. 2023) integrated within our ALMA framework, which excel in adapting to varied translation nuances and complexities. Capitalizing on these remarkable advancements, we have also introduced a user-centric translation product, available at https://www.doctranslate.io (Doctranslate 2023). This tool embodies our commitment to merging technological innovation with practical utility, offering users a seamless and high-quality translation experience.

📄 PDF Abstract BibTeX

Code (1)

doctranslate-io/viet-translation-llm 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingMachine TranslationTranslation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

MTet: Multi-domain Translation for English and Vietnamese

2022-10-11 · Chinh Ngo, Trieu H. Trinh, Long Phan, Hieu Tran 외

We introduce MTet, the largest publicly available parallel corpus for English-Vietnamese translation. MTet consists of 4.2M high-quality training sentence pairs and a multi-domain test set refined by the Vietnamese resea…

Machine TranslationSentenceTranslation

Machine Translation between Vietnamese and English: an Empirical Study

2018-10-30 · Hong-Hai Phan-Vu, Viet-Trung Tran, Van-Nam Nguyen, Hoang-Vu Dang 외

Machine translation is shifting to an end-to-end approach based on deep neural networks. The state of the art achieves impressive results for popular language pairs such as English - French or English - Chinese. However …

Machine TranslationTranslation

DivEMT: Neural Machine Translation Post-Editing Effort Across Typologically Diverse Languages

2022-05-24 · Gabriele Sarti, Arianna Bisazza, Ana Guerberof Arenas, Antonio Toral

We introduce DivEMT, the first publicly available post-editing study of Neural Machine Translation (NMT) over a typologically diverse set of target languages. Using a strictly controlled setup, 18 professional translator…

Machine TranslationNMTTranslation

PhoMT: A High-Quality and Large-Scale Benchmark Dataset for Vietnamese-English Machine Translation

2021-10-23 · EMNLP 2021 11 · Long Doan, Linh The Nguyen, Nguyen Luong Tran, Thai Hoang 외

We introduce a high-quality and large-scale Vietnamese-English parallel dataset of 3.02M sentence pairs, which is 2.9M pairs larger than the benchmark Vietnamese-English machine translation corpus IWSLT15. We conduct exp…

DenoisingMachine TranslationSentenceTranslation

A High-Quality and Large-Scale Dataset for English-Vietnamese Speech Translation

2022-08-08 · Linh The Nguyen, Nguyen Luong Tran, Long Doan, Manh Luong 외

In this paper, we introduce a high-quality and large-scale benchmark dataset for English-Vietnamese speech translation with 508 audio hours, consisting of 331K triplets of (sentence-lengthed audio, English source transcr…

SentenceTranslation