Error Analysis and the Role of Morphology
We evaluate two common conjectures in error analysis of NLP models: (i) Morphology is predictive of errors; and (ii) the importance of morphology increases with the morphological complexity of a language. We show across four different tasks and up to 57 languages that of these conjectures, somewhat surprisingly, only (i) is true. Using morphological features does improve error prediction across tasks; however, this effect is less pronounced with morphologically complex languages. We speculate this is because morphology is more discriminative in morphologically simple languages. Across all four tasks, case and gender are the morphological features most predictive of error.
Code (1)
Similar Papers 제목 키워드 기반
Character-Level Models versus Morphology in Semantic Role Labeling
Character-level models have become a popular approach specially for their accessibility and ability to handle unseen data. However, little is known on their ability to reveal the underlying morphological structure of a w…
Semantic Role LabelingThe Lazy Encoder: A Fine-Grained Analysis of the Role of Morphology in Neural Machine Translation
Neural sequence-to-sequence models have proven very effective for machine translation, but at the expense of model interpretability. To shed more light into the role played by linguistic structure in the process of neura…
Machine TranslationNMTTranslationWord EmbeddingsWord Semantic Similarity for Morphologically Rich Languages
In this work, we investigate the role of morphology on the performance of semantic similarity for morphologically rich languages, such as German and Greek. The challenge in processing languages with richer morphology tha…
Semantic SimilaritySemantic Textual SimilarityShortest Length Total Orders Do Not Minimize Irregularity in Vector-Valued Mathematical Morphology
Mathematical morphology is a theory concerned with non-linear operators for image processing and analysis. The underlying framework for mathematical morphology is a partially ordered set with well-defined supremum and in…
Towards Finite-State Morphology of Kurdish
Morphological analysis is the study of the formation and structure of words. It plays a crucial role in various tasks in Natural Language Processing (NLP) and Computational Linguistics (CL) such as machine translation an…
Information RetrievalMachine TranslationMorphological AnalysisRetrieval+2