A Structured Variational Autoencoder for Contextual Morphological Inflection
Statistical morphological inflectors are typically trained on fully supervised, type-level data. One remaining open research question is the following: How can we effectively exploit raw, token-level data to improve their performance? To this end, we introduce a novel generative latent-variable model for the semi-supervised learning of inflection generation. To enable posterior inference over the latent variables, we derive an efficient variational inference procedure based on the wake-sleep algorithm. We experiment on 23 languages, using the Universal Dependencies corpora in a simulated low-resource setting, and find improvements of over 10% absolute accuracy in some cases.
Code (2)
Tasks
Morphological InflectionVariational InferenceSimilar Papers 제목 키워드 기반
The SIGMORPHON 2019 Shared Task: Morphological Analysis in Context and Cross-Lingual Transfer for Inflection
The SIGMORPHON 2019 shared task on cross-lingual transfer and contextual analysis in morphology examined transfer learning of inflection between 100 language pairs, as well as contextual lemmatization and morphosyntactic…
Cross-Lingual TransferLemmatizationMorphological AnalysisMorphological Inflection+1Remote Elicitation of Inflectional Paradigms to Seed Morphological Analysis in Low-Resource Languages
Structured, complete inflectional paradigm data exists for very few of the world{'}s languages, but is crucial to training morphological analysis tools. We present methods inspired by linguistic fieldwork for gathering i…
Morphological AnalysisMorphological Inflection Generation with Multi-space Variational Encoder-Decoders
Well-Defined Morphology is Sentence-Level Morphology
Morphological tasks have gained decent popularity within the NLP community in the recent years, with large multi-lingual datasets providing morphological analysis of words, either in or out of context. However, the lack …
Morphological AnalysisMorphological InflectionSentenceOn the Complexity and Typology of Inflectional Morphological Systems
We quantify the linguistic complexity of different languages' morphological systems. We verify that there is an empirical trade-off between paradigm size and irregularity: a language's inflectional paradigms may be eithe…