Restoring and Mining the Records of the Joseon Dynasty via Neural Language Modeling and Machine Translation
Understanding voluminous historical records provides clues on the past in various aspects, such as social and political issues and even natural science facts. However, it is generally difficult to fully utilize the historical records, since most of the documents are not written in a modern language and part of the contents are damaged over time. As a result, restoring the damaged or unrecognizable parts as well as translating the records into modern languages are crucial tasks. In response, we present a multi-task learning approach to restore and translate historical documents based on a self-attention mechanism, specifically utilizing two Korean historical records, ones of the most voluminous historical records in the world. Experimental results show that our approach significantly improves the accuracy of the translation task than baselines without multi-task learning. In addition, we present an in-depth exploratory analysis on our translated results via topic modeling, uncovering several significant historical events.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingMachine TranslationMulti-Task LearningTranslationSimilar Papers 제목 키워드 기반
Five Centuries of Monarchy in Korea: Mining the Text of the Annals of the Joseon Dynasty
Translating Hanja Historical Documents to Contemporary Korean and English
The Annals of Joseon Dynasty (AJD) contain the daily records of the Kings of Joseon, the 500-year kingdom preceding the modern nation of Korea. The Annals were originally written in an archaic Korean writing system, `Han…
Machine TranslationTranslationHUE: Pretrained Model and Dataset for Understanding Hanja Documents of Ancient Korea
Historical records in Korea before the 20th century were primarily written in Hanja, an extinct language based on Chinese characters and not understood by modern Korean or Chinese speakers. Historians with expertise in t…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Retrieval+1Conversational Decision-Making Model for Predicting the King's Decision in the Annals of the Joseon Dynasty
Styles of leaders when they make decisions in groups vary, and the different styles affect the performance of the group. To understand the key words and speakers associated with decisions, we initially formalize the prob…
Decision MakingEnhancement of text recognition for hanja handwritten documents of Ancient Korea
We implemented a high-performance optical character recognition model for classical handwritten documents using data augmentation with highly variable cropping within the document region. Optical character recognition in…
Data Augmentationobject-detectionObject DetectionOptical Character Recognition+1