Learning How to Translate North Korean through South Korean
South and North Korea both use the Korean language. However, Korean NLP research has focused on South Korean only, and existing NLP systems of the Korean language, such as neural machine translation (NMT) models, cannot properly handle North Korean inputs. Training a model using North Korean data is the most straightforward approach to solving this problem, but there is insufficient data to train NMT models. In this study, we create data for North Korean NMT models using a comparable corpus. First, we manually create evaluation data for automatic alignment and machine translation. Then, we investigate automatic alignment methods suitable for North Korean. Finally, we verify that a model trained by North Korean bilingual data without human annotation can significantly boost North Korean translation accuracy compared to existing South Korean models in zero-shot settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Zero-shot North Korean to English Neural Machine Translation by Character Tokenization and Phoneme Decomposition
The primary limitation of North Korean to English translation is the lack of a parallel corpus; therefore, high translation accuracy cannot be achieved. To address this problem, we propose a zero-shot approach using Sout…
Machine TranslationTranslationWhy North Korean Refugees are Reluctant to Compete: The Roles of Cognitive Ability
The study compares the competitiveness of three Korean groups raised in different institutional environments: South Korea, North Korea, and China. Laboratory experiments reveal that North Korean refugees are less likely …
Developing Language Resources and NLP Tools for the North Korean Language
Since the division of Korea, the two Korean languages have diverged significantly over the last 70 years. However, due to the lack of linguistic source of the North Korean language, there is no DPRK-based language model.…
Language ModelingLanguage ModellingMasked Language ModelingSentiment AnalysisMotivations and locational factors of FDI in CIS countries: Empirical evidence from South Korean FDI in Kazakhstan, Russia, and Uzbekistan
Considering the growing significance of Eurasian economic ties because of South Korea s New Northern Policy and Russia s New Eastern Policy, this study investigates the motivations and locational factors of South Korean …
Implicit Bias against a Capitalistic Society Predicts Market Earnings
This paper investigates whether ideological indoctrination by living in a communist regime relates to low economic performance in a market economy. We recruit North Korean refugees and measure their implicit bias against…