Tokenizing, POS Tagging, Lemmatizing and Parsing UD 2.0 with UDPipe

2017-08-01 · CONLL 2017 8 · Milan Straka, Jana Strakov{\'a}

Many natural language processing tasks, including the most advanced ones, routinely start by several basic processing steps {--} tokenization and segmentation, most likely also POS tagging and lemmatization, and commonly parsing as well. A multilingual pipeline performing these steps can be trained using the Universal Dependencies project, which contains annotations of the described tasks for 50 languages in the latest release UD 2.0. We present an update to UDPipe, a simple-to-use pipeline processing CoNLL-U version 2.0 files, which performs these tasks for multiple languages without requiring additional external data. We provide models for all 50 languages of UD 2.0, and furthermore, the pipeline can be trained easily using data in CoNLL-U format. UDPipe is a standalone application in C++, with bindings available for Python, Java, C{\#} and Perl. In the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, UDPipe was the eight best system, while achieving low running times and moderately sized models.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dependency ParsingLemmatizationPOSPOS Tagging

A Transition-based System for Universal Dependency Parsing

2017-08-01 · CONLL 2017 8 · Hao Wang, Hai Zhao, Zhisong Zhang

This paper describes the system for our participation in the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. In this work, we design a system based on UDPipe1 for universal dependenc…

Dependency Parsing Transfer Learning Transition-Based Dependency Parsing

UDPipe 2.0 Prototype at CoNLL 2018 UD Shared Task

2018-10-01 · CONLL 2018 10 · Milan Straka

UDPipe is a trainable pipeline which performs sentence segmentation, tokenization, POS tagging, lemmatization and dependency parsing. We present a prototype for UDPipe 2.0 and evaluate it in the CoNLL 2018 UD Shared Task…

Dependency Parsing Lemmatization POS POS Tagging+3

UDPipe: Trainable Pipeline for Processing CoNLL-U Files Performing Tokenization, Morphological Analysis, POS Tagging and Parsing

2016-05-01 · LREC 2016 5 · Milan Straka, Jan Haji{\v{c}}, Jana Strakov{\'a}

Automatic natural language processing of large texts often presents recurring challenges in multiple languages: even for most advanced tasks, the texts are first processed by basic processing steps {--} from tokenization…

Dependency Parsing Lemmatization Morphological Analysis Part-Of-Speech Tagging+2

ÚFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared Task

2019-10-24 · Milan Straka, Jana Straková

We present a system description of our contribution to the CoNLL 2019 shared task, Cross-Framework Meaning Representation Parsing (MRP 2019). The proposed architecture is our first attempt towards a semantic parsing exte…

Dependency Parsing Graph Neural Network Lemmatization POS+2

\'UFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared Task

2019-11-01 · CONLL 2019 11 · Milan Straka, Jana Strakov{\'a}

We present a system description of our contribution to the CoNLL 2019 shared task, CrossFramework Meaning Representation Parsing (MRP 2019). The proposed architecture is our first attempt towards a semantic parsing exten…

Dependency Parsing Lemmatization POS POS Tagging+1