USZEGED: Correction Type-sensitive Normalization of English Tweets Using Efficiently Indexed n-gram Statistics
Code (0)
등록된 구현이 없습니다.
Tasks
Lexical NormalizationSimilar Papers 제목 키워드 기반
Visual Cues and Error Correction for Translation Robustness
Neural Machine Translation models are sensitive to noise in the input texts, such as misspelled words and ungrammatical constructions. Existing robustness techniques generally fail when faced with unseen types of noise a…
Machine TranslationTranslationMoNoise: Modeling Noise Using a Modular Normalization System
We propose MoNoise: a normalization model focused on generalizability and efficiency, it aims at being easily reusable and adaptable. Normalization is the task of translating texts from a non- canonical domain to a more …
Lexical NormalizationSpelling CorrectionWord EmbeddingsUnsupervised Context-Sensitive Spelling Correction of English and Dutch Clinical Free-Text with Word and Character N-Gram Embeddings
We present an unsupervised context-sensitive spelling correction method for clinical free-text that uses word and character n-gram embeddings. Our method generates misspelling replacement candidates and ranks them accord…
Spelling CorrectionTNT: Text Normalization based Pre-training of Transformers for Content Moderation
In this work, we present a new language pre-training model TNT (Text Normalization based pre-training of Transformers) for content moderation. Inspired by the masking strategy and text normalization, TNT is developed to …
Text NormalizationIDENTIC Corpus: Morphologically Enriched Indonesian-English Parallel Corpus
This paper describes the creation process of an Indonesian-English parallel corpus (IDENTIC). The corpus contains 45,000 sentences collected from different sources in different genres. Several manual text preprocessing t…
Spelling Correction