paper-with-me

홈 › Papers

Multi Task Deep Morphological Analyzer: Context Aware Joint Morphological Tagging and Lemma Prediction

2018-11-21 · Saurav Jha, Akhilesh Sudhakar, Anil Kumar Singh

The ambiguities introduced by the recombination of morphemes constructing several possible inflections for a word makes the prediction of syntactic traits in Morphologically Rich Languages (MRLs) a notoriously complicated task. We propose the Multi Task Deep Morphological analyzer (MT-DMA), a character-level neural morphological analyzer based on multitask learning of word-level tag markers for Hindi and Urdu. MT-DMA predicts a set of six morphological tags for words of Indo-Aryan languages: Parts-of-speech (POS), Gender (G), Number (N), Person (P), Case (C), Tense-Aspect-Modality (TAM) marker as well as the Lemma (L) by jointly learning all these in one trainable framework. We show the effectiveness of training of such deep neural networks by the simultaneous optimization of multiple loss functions and sharing of initial parameters for context-aware morphological analysis. Exploiting character-level features in phonological space optimized for each tag using multi-objective genetic algorithm, our model establishes a new state-of-the-art accuracy score upon all seven of the tasks for both the languages. MT-DMA is publicly accessible: code, models and data are available at https://github.com/Saurav0074/morph_analyzer.

📄 PDF Abstract BibTeX arXiv:1811.08619

Code (1)

Saurav0074/morph_analyzer 공식 구현

Tasks

Dependency ParsingLEMMAMachine TranslationMorphological AnalysisMorphological TaggingPOSTAG

Similar Papers 제목 키워드 기반

An Unsupervised Method for Weighting Finite-state Morphological Analyzers

2020-05-01 · LREC 2020 5 · Amr Keleg, Francis Tyers, Nick Howell, Tommi Pirinen

Morphological analysis is one of the tasks that have been studied for years. Different techniques have been used to develop models for performing morphological analysis. Models based on finite state transducers have prov…

Morphological Analysis

CKMorph: A Comprehensive Morphological Analyzer for Central Kurdish

2021-09-17 · Morteza Naserzade, Aso Mahmudi, Hadi Veisi, Hawre Hosseini 외

A morphological analyzer, which is a significant component of many natural language processing applications especially for morphologically rich languages, divides an input word into all its composing morphemes and identi…

An Open, Extendible, and Fast Turkish Morphological Analyzer

2019-09-01 · RANLP 2019 9 · Olcay Taner Y{\i}ld{\i}z, Beg{\"u}m Avar, G{\"o}khan Ercan

In this paper, we present a two-level morphological analyzer for Turkish. The morphological analyzer consists of five main components: finite state transducer, rule engine for suffixation, lexicon, trie data structure, a…

Morphological Analysis

Morphological Analysis and Disambiguation for Gulf Arabic: The Interplay between Resources and Methods

2020-05-01 · LREC 2020 5 · Salam Khalifa, Nasser Zalmout, Nizar Habash

In this paper we present the first full morphological analysis and disambiguation system for Gulf Arabic. We use an existing state-of-the-art morphological disambiguation system to investigate the effects of different da…

Morphological AnalysisMorphological DisambiguationMorphological Tagging

Rapid Development of Morphological Analyzers for Typologically Diverse Languages

2016-05-01 · LREC 2016 5 · Seth Kulick, Ann Bies

The Low Resource Language research conducted under DARPA{'}s Broad Operational Language Translation (BOLT) program required the rapid creation of text corpora of typologically diverse languages (Turkish, Hausa, and Uzbek…

Translation