paper-with-me

홈 › Papers

Stanza: A Python Natural Language Processing Toolkit for Many Human Languages

2020-03-16 · ACL 2020 6 · Peng Qi, Yuhao Zhang, Yuhui Zhang, Jason Bolton, Christopher D. Manning

We introduce Stanza, an open-source Python natural language processing toolkit supporting 66 human languages. Compared to existing widely used toolkits, Stanza features a language-agnostic fully neural pipeline for text analysis, including tokenization, multi-word token expansion, lemmatization, part-of-speech and morphological feature tagging, dependency parsing, and named entity recognition. We have trained Stanza on a total of 112 datasets, including the Universal Dependencies treebanks and other multilingual corpora, and show that the same neural architecture generalizes well and achieves competitive performance on all languages tested. Additionally, Stanza includes a native Python interface to the widely used Java Stanford CoreNLP software, which further extends its functionality to cover other tasks such as coreference resolution and relation extraction. Source code, documentation, and pretrained models for 66 languages are available at https://stanfordnlp.github.io/stanza.

📄 PDF Abstract BibTeX arXiv:2003.07082

Code (5)

stanfordnlp/stanza 공식 구현 pytorch
astrazeneca/kazu jax
rasoolims/stanza pytorch
sktwtrg/stanza_ja_test pytorch
textflint/textflint

Tasks

Coreference ResolutionDependency ParsingLemmatizationNamed Entity RecognitionNamed Entity Recognition (NER)Relation Extraction

Similar Papers 제목 키워드 기반

Biomedical and Clinical English Model Packages in the Stanza Python NLP Library

2020-07-29 · Yuhao Zhang, Yuhui Zhang, Peng Qi, Christopher D. Manning 외

We introduce biomedical and clinical English model packages for the Stanza Python NLP library. These packages offer accurate syntactic analysis and named entity recognition capabilities for biomedical and clinical text, …

GPUNamed Entity RecognitionNamed Entity Recognition (NER)

Benchmarking Pre-trained Language Models for Multilingual NER: TraSpaS at the BSNLP2021 Shared Task

2021-04-01 · EACL (BSNLP) 2021 4 · Marek Suppa, Ondrej Jariabka

In this paper we describe TraSpaS, a submission to the third shared task on named entity recognition hosted as part of the Balto-Slavic Natural Language Processing (BSNLP) Workshop. In it we evaluate various pre-trained …

BenchmarkingLanguage ModelingLanguage Modellingnamed-entity-recognition+4

CLASSLA-Stanza: The Next Step for Linguistic Processing of South Slavic Languages

2023-08-08 · Luka Terčon, Nikola Ljubešić

We present CLASSLA-Stanza, a pipeline for automatic linguistic annotation of the South Slavic languages, which is based on the Stanza natural language processing pipeline. We describe the main improvements in CLASSLA-Sta…

LaoNLP: Lao language Natural Language Processing

2022-07-22 · Zenodo 2022 7 · Wannaphong Phatthiyaphaibun

LaoNLP, the Lao language Natural Language Processing Toolkit, is an open-source tool for doing natural language processing pipelines with the Lao language in Python programming language.

CAMeL Tools: An Open Source Python Toolkit for Arabic Natural Language Processing

2020-05-01 · LREC 2020 5 · Ossama Obeid, Nasser Zalmout, Salam Khalifa, Dima Taji 외

We present CAMeL Tools, a collection of open-source tools for Arabic natural language processing in Python. CAMeL Tools currently provides utilities for pre-processing, morphological modeling, Dialect Identification, Nam…

Arabic Sentiment AnalysisArabic Text DiacritizationDialect IdentificationMorphological Analysis+5