paper-with-me

홈 › Papers

Korean-English Machine Translation with Multiple Tokenization Strategy

2021-05-29 · Dojun Park, Youngjin Jang, Harksoo Kim

This work was conducted to find out how tokenization methods affect the training results of machine translation models. In this work, alphabet tokenization, morpheme tokenization, and BPE tokenization were applied to Korean as the source language and English as the target language respectively, and the comparison experiment was conducted by repeating 50,000 epochs of each 9 models using the Transformer neural network. As a result of measuring the BLEU scores of the experimental models, the model that applied BPE tokenization to Korean and morpheme tokenization to English recorded 35.73, showing the best performance.

📄 PDF Abstract BibTeX arXiv:2105.14274

Code (1)

DojunPark/Machine_Translation

Tasks

Machine TranslationTranslation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Zero-shot North Korean to English Neural Machine Translation by Character Tokenization and Phoneme Decomposition

2020-07-01 · ACL 2020 6 · Hwichan Kim, Tosho Hirasawa, Mamoru Komachi

The primary limitation of North Korean to English translation is the lack of a parallel corpus; therefore, high translation accuracy cannot be achieved. To address this problem, we propose a zero-shot approach using Sout…

Machine TranslationTranslation

Should we find another model?: Improving Neural Machine Translation Performance with ONE-Piece Tokenization Method without Model Modification

2021-06-01 · NAACL 2021 4 · Chanjun Park, Sugyeong Eo, Hyeonseok Moon, Heuiseok Lim

Most of the recent Natural Language Processing(NLP) studies are based on the Pretrain-Finetuning Approach (PFA), but in small and medium-sized enterprises or companies with insufficient hardware there are many limitation…

Machine TranslationmodelTranslation

An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks

2020-10-06 · Asian Chapter of the Association for Computational Linguistics 2020 · Kyubyong Park, Joohong Lee, Seongbo Jang, Dawoon Jung

Typically, tokenization is the very first step in most text processing works. As a token serves as an atomic unit that embeds the contextual information of text, how to define a token plays a decisive role in the perform…

Machine TranslationNatural Language UnderstandingSegmentationTranslation

The Improvement of Negative Sentences Translation in English-to-Korean Machine Translation

2015-12-26 · Chung-Hyok Jang, Kwang-Hyok Kim

This paper describes the algorithm for translating English negative sentences into Korean in English-Korean Machine Translation (EKMT). The proposed algorithm is based on the comparative study of English and Korean negat…

Machine TranslationSentenceTranslation

Translating Hanja Historical Documents to Contemporary Korean and English

2022-05-20 · Juhee Son, Jiho Jin, Haneul Yoo, JinYeong Bak 외

The Annals of Joseon Dynasty (AJD) contain the daily records of the Kings of Joseon, the 500-year kingdom preceding the modern nation of Korea. The Annals were originally written in an archaic Korean writing system, `Han…

Machine TranslationTranslation