Lexical Normalization
1개 벤치마크 · 논문 49편 · 이 태스크의 논문 보기 →
Benchmarks
LexNorm
Most implemented
MoNoise: Modeling Noise Using a Modular Normalization System
ViSoLex: An Open-Source Repository for Vietnamese Social Media Lexical Normalization
ViLexNorm: A Lexical Normalization Corpus for Vietnamese Social Media Text
Automatic Textual Normalization for Hate Speech Detection
Increasing Robustness for Cross-domain Dialogue Act Classification on Social Media Data
MultiLexNorm: A Shared Task on Multilingual Lexical Normalization
Papers
ViGoEmotions: A Benchmark Dataset For Fine-grained Emotion Detection on Vietnamese Texts
Emotion classification plays a significant role in emotion prediction and harmful content detection. Recent advancements in NLP, particularly through large language models (LLMs), have greatly improved outcomes in this f…
Emotion ClassificationLexical NormalizationMultiLexNorm++: A Unified Benchmark and a Generative Model for Lexical Normalization for Asian Languages
Social media data has been of interest to Natural Language Processing (NLP) practitioners for over a decade, because of its richness in information, but also challenges for automatic processing. Since language use is mor…
Lexical NormalizationViSoLex: An Open-Source Repository for Vietnamese Social Media Lexical Normalization
ViSoLex is an open-source system designed to address the unique challenges of lexical normalization for Vietnamese social media text. The platform provides two core services: Non-Standard Word (NSW) Lookup and Lexical No…
Lexical NormalizationWeakly-supervised LearningA Weakly Supervised Data Labeling Framework for Machine Lexical Normalization in Vietnamese Social Media
This study introduces an innovative automatic labeling framework to address the challenges of lexical normalization in social media texts for low-resource languages like Vietnamese. Social media data is rich and diverse,…
Lexical NormalizationViLexNorm: A Lexical Normalization Corpus for Vietnamese Social Media Text
Lexical normalization, a fundamental task in Natural Language Processing (NLP), involves the transformation of words into their canonical forms. This process has been proven to benefit various downstream NLP tasks greatl…
Lexical NormalizationVietnamese Lexical NormalizationVietnamese Social Media Text ProcessingAutomatic Textual Normalization for Hate Speech Detection
Social media data is a valuable resource for research, yet it contains a wide range of non-standard words (NSW). These irregularities hinder the effective operation of NLP tools. Current state-of-the-art methods for the …
Hate Speech DetectionLexical NormalizationVietnamese Hate Speech Detection