paper-with-me

홈 › Papers

Linguistically inspired morphological inflection with a sequence to sequence model

2020-09-04 · Eleni Metheniti, Guenter Neumann, Josef van Genabith

Inflection is an essential part of every human language's morphology, yet little effort has been made to unify linguistic theory and computational methods in recent years. Methods of string manipulation are used to infer inflectional changes; our research question is whether a neural network would be capable of learning inflectional morphemes for inflection production in a similar way to a human in early stages of language acquisition. We are using an inflectional corpus (Metheniti and Neumann, 2020) and a single layer seq2seq model to test this hypothesis, in which the inflectional affixes are learned and predicted as a block and the word stem is modelled as a character sequence to account for infixation. Our character-morpheme-based model creates inflection by predicting the stem character-to-character and the inflectional affixes as character blocks. We conducted three experiments on creating an inflected form of a word given the lemma and a set of input and target features, comparing our architecture to a mainstream character-based model with the same hyperparameters, training and test sets. Overall for 17 languages, we noticed small improvements on inflecting known lemmas (+0.68%) but steadily better performance of our model in predicting inflected forms of unknown words (+3.7%) and small improvements on predicting in a low-resource scenario (+1.09%)

📄 PDF Abstract BibTeX arXiv:2009.02073

Code (0)

등록된 구현이 없습니다.

Tasks

Language AcquisitionLEMMAMorphological Inflection

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

Improving Sequence to Sequence Learning for Morphological Inflection Generation: The BIU-MIT Systems for the SIGMORPHON 2016 Shared Task for Morphological Reinflection

2016-08-01 · WS 2016 8 · Roee Aharoni, Yoav Goldberg, Yonatan Belinkov
Feature EngineeringMachine TranslationMorphological Inflection

DeLex, a freely-avaible, large-scale and linguistically grounded morphological lexicon for German

2014-05-01 · LREC 2014 5 · Beno{\^\i}t Sagot

We introduce DeLex, a freely-avaible, large-scale and linguistically grounded morphological lexicon for German developed within the Alexina framework. We extracted lexical information from the German wiktionary and devel…

Morphological AnalysisMorphological Inflection

Morphological Inflection Generation Using Character Sequence to Sequence Learning

2015-12-18 · NAACL 2016 6 · Manaal Faruqui, Yulia Tsvetkov, Graham Neubig, Chris Dyer

Morphological inflection generation is the task of generating the inflected form of a given lemma corresponding to a particular linguistic transformation. We model the problem of inflection generation as a character sequ…

DecoderLEMMAMorphological Inflection

SU-RUG at the CoNLL-SIGMORPHON 2017 shared task: Morphological Inflection with Attentional Sequence-to-Sequence Models

2017-06-12 · CONLL 2017 8 · Robert Östling, Johannes Bjerva

This paper describes the Stockholm University/University of Groningen (SU-RUG) system for the SIGMORPHON 2017 shared task on morphological inflection. Our system is based on an attentional sequence-to-sequence neural net…

LemmatizationMorphological AnalysisMorphological Inflection

Gender-Aware Reinflection using Linguistically Enhanced Neural Models

2020-12-01 · GeBNLP (COLING) 2020 12 · Bashar Alhafni, Nizar Habash, Houda Bouamor

In this paper, we present an approach for sentence-level gender reinflection using linguistically enhanced sequence-to-sequence models. Our system takes an Arabic sentence and a given target gender as input and generates…

DecoderGrammatical Error CorrectionSentence