Papers Lexical Normalization

NCSU-SAS-Ning: Candidate Generation and Feature Engineering for Supervised Lexical Normalization

USZEGED: Correction Type-sensitive Normalization of English Tweets Using Efficiently Indexed n-gram Statistics

Shared Tasks of the 2015 Workshop on Noisy User-generated Text: Twitter Lexical Normalization and Named Entity Recognition

NCSU\_SAS\_SAM: Deep Encoding and Reconstruction for Normalization of Noisy Text

Accurate Word Segmentation and POS Tagging for Japanese Microblogs: Corpus Annotation and Joint Modeling with Lexical Normalization

A Large Corpus of Product Reviews in Portuguese: Tackling Out-Of-Vocabulary Words

Web 2.0 has allowed a never imagined communication boom. With the widespread use of computational and mobile devices, anyone, in practically any language, may post comments in the web. As such, formal language is not nec…

TweetNorm\_es: an annotated corpus for Spanish microtext normalization

In this paper we introduce TweetNorm{\_}es, an annotated corpus of tweets in Spanish language, which we make publicly available under the terms of the CC-BY license. This corpus is intended for development and testing of…

Towards Shared Datasets for Normalization Research

In this paper we present a Dutch and English dataset that can serve as a gold standard for evaluating text normalization approaches. With the combination of text messages, message board posts and tweets, these datasets r…

A Log-Linear Model for Unsupervised Text Normalization