Exploiting Unlabeled Data for Neural Grammatical Error Detection
Identifying and correcting grammatical errors in the text written by non-native writers has received increasing attention in recent years. Although a number of annotated corpora have been established to facilitate data-driven grammatical error detection and correction approaches, they are still limited in terms of quantity and coverage because human annotation is labor-intensive, time-consuming, and expensive. In this work, we propose to utilize unlabeled data to train neural network based grammatical error detection models. The basic idea is to cast error detection as a binary classification problem and derive positive and negative training examples from unlabeled data. We introduce an attention-based neural network to capture long-distance dependencies that influence the word being detected. Experiments show that the proposed approach significantly outperforms SVMs and convolutional networks with fixed-size context window.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationGeneral ClassificationGrammatical Error DetectionSimilar Papers 제목 키워드 기반
Multi-Head Multi-Layer Attention to Deep Language Representations for Grammatical Error Detection
It is known that a deep neural network model pre-trained with large-scale data greatly improves the accuracy of various tasks, especially when there are resource constraints. However, the information needed to solve a gi…
Grammatical Error DetectionSentenceExploiting N-Best Hypotheses to Improve an SMT Approach to Grammatical Error Correction
Grammatical error correction (GEC) is the task of detecting and correcting grammatical errors in texts written by second language learners. The statistical machine translation (SMT) approach to GEC, in which sentences wr…
Grammatical Error CorrectionMachine TranslationTranslationN-gram Model for Chinese Grammatical Error Diagnosis
Detection and correction of Chinese grammatical errors have been two of major challenges for Chinese automatic grammatical error diagnosis.This paper presents an N-gram model for automatic detection and correction of Chi…
Language ModelingLanguage ModellingmodelGrammatical Error Detection Using Error- and Grammaticality-Specific Word Embeddings
In this study, we improve grammatical error detection by learning word embeddings that consider grammaticality and error patterns. Most existing algorithms for learning word embeddings usually model only the syntactic co…
Grammatical Error DetectionLearning Word EmbeddingsWord EmbeddingsChinese Grammatical Error Detection Based on BERT Model
Automatic grammatical error correction is of great value in assisting second language writing. In 2020, the shared task for Chinese grammatical error diagnosis(CGED) was held in NLP-TEA. As the LDU team, we participated …
Binary ClassificationGrammatical Error CorrectionGrammatical Error Detectionmodel+1