IDENTIC Corpus: Morphologically Enriched Indonesian-English Parallel Corpus
This paper describes the creation process of an Indonesian-English parallel corpus (IDENTIC). The corpus contains 45,000 sentences collected from different sources in different genres. Several manual text preprocessing tasks, such as alignment and spelling correction, are applied to the corpus to assure its quality. We also apply language specific text processing such as tokenization on both sides and clitic normalization on the Indonesian side. The corpus is available in two different formats: plain', stored in text format and morphologically enriched', stored in CoNLL format. Some parts of the corpus are publicly available at the IDENTIC homepage.
Code (0)
등록된 구현이 없습니다.
Tasks
Spelling CorrectionSimilar Papers 제목 키워드 기반
IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languages
Significant progress has been made on Indonesian NLP. Nevertheless, exploration of the code-mixing phenomenon in Indonesian is limited, despite many languages being frequently mixed with Indonesian in daily conversation.…
DiversityDomain-Specific Language Model Post-Training for Indonesian Financial NLP
BERT and IndoBERT have achieved impressive performance in several NLP tasks. There has been several investigation on its adaption in specialized domains especially for English language. We focus on financial domain and I…
Language ModelingLanguage ModellingSentiment AnalysisTopic ClassificationA Simple Yet Effective Corpus Construction Framework for Indonesian Grammatical Error Correction
Currently, the majority of research in grammatical error correction (GEC) is concentrated on universal languages, such as English and Chinese. Many low-resource languages lack accessible evaluation corpora. How to effici…
Grammatical Error CorrectionMICE: A Crosslinguistic Emotion Corpus in Malay, Indonesian, Chinese and English
MICE is a corpus of emotion words in four languages which is currently working progress. There are two sections to this study, Part I: Emotion word corpus and Part II: Emotion word survey. In Part 1, the method of how th…
SurveyThe MARCELL Legislative Corpus
This article presents the current outcomes of the MARCELL CEF Telecom project aiming to collect and deeply annotate a large comparable corpus of legal documents. The MARCELL corpus includes 7 monolingual sub-corpora (Bul…
Sentence