Morphology-aware Word-Segmentation in Dialectal Arabic Adaptation of Neural Machine Translation
Parallel corpora available for building machine translation (MT) models for dialectal Arabic (DA) are rather limited. The scarcity of resources has prompted the use of Modern Standard Arabic (MSA) abundant resources to complement the limited dialectal resource. However, dialectal clitics often differ between MSA and DA. This paper compares morphology-aware DA word segmentation to other word segmentation approaches like Byte Pair Encoding (BPE) and Sub-word Regularization (SR). A set of experiments conducted on Egyptian Arabic (EA), Levantine Arabic (LA), and Gulf Arabic (GA) show that a sufficiently accurate morphology-aware segmentation used in conjunction with BPE outperforms the other word segmentation approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationSegmentationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Morphotactic Modeling in an Open-source Multi-dialectal Arabic Morphological Analyzer and Generator
Arabic is a morphologically rich and complex language, with numerous dialectal variants. Previous efforts on Arabic morphology modeling focused on specific variants and specific domains using a range of techniques with d…
Interpreting Arabic Transformer Models
Arabic is a Semitic language which is widely spoken with many dialects. Given the success of pre-trained language models, many transformer models trained on Arabic and its dialects have surfaced. While these models have …
Morphological TaggingPOSPOS TaggingConventional Orthography for Dialectal Arabic
Dialectal Arabic (DA) refers to the day-to-day vernaculars spoken in the Arab world. DA lives side-by-side with the official language, Modern Standard Arabic (MSA). DA differs from MSA on all levels of linguistic represe…
Speech RecognitionUnsupervised Word Segmentation Improves Dialectal Arabic to English Machine Translation
DALILA: The Dialectal Arabic Linguistic Learning Assistant
Dialectal Arabic (DA) poses serious challenges for Natural Language Processing (NLP). The number and sophistication of tools and datasets in DA are very limited in comparison to Modern Standard Arabic (MSA) and other lan…