Context is Key: Grammatical Error Detection with Contextual Word Representations
Grammatical error detection (GED) in non-native writing requires systems to identify a wide range of errors in text written by language learners. Error detection as a purely supervised task can be challenging, as GED datasets are limited in size and the label distributions are highly imbalanced. Contextualized word representations offer a possible solution, as they can efficiently capture compositional information in language and can be optimized on large amounts of unsupervised data. In this paper, we perform a systematic comparison of ELMo, BERT and Flair embeddings (Peters et al., 2017; Devlin et al., 2018; Akbik et al., 2018) on a range of public GED datasets, and propose an approach to effectively integrate such representations in current methods, achieving a new state of the art on GED. We further analyze the strengths and weaknesses of different contextual embeddings for the task at hand, and present detailed analyses of their impact on different types of errors.
Code (1)
Tasks
Grammatical Error DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Grammatical Error Detection Using Error- and Grammaticality-Specific Word Embeddings
In this study, we improve grammatical error detection by learning word embeddings that consider grammaticality and error patterns. Most existing algorithms for learning word embeddings usually model only the syntactic co…
Grammatical Error DetectionLearning Word EmbeddingsWord EmbeddingsChinese Grammatical Errors Diagnosis System Based on BERT at NLPTEA-2020 CGED Shared Task
In the process of learning Chinese, second language learners may have various grammatical errors due to the negative transfer of native language. This paper describes our submission to the NLPTEA 2020 shared task on CGED…
Grammatical Error DetectionGrammatical error detection in transcriptions of spoken English
We describe the collection of transcription corrections and grammatical error annotations for the CrowdED Corpus of spoken English monologues on business topics. The corpus recordings were crowdsourced from native speake…
Grammatical Error CorrectionGrammatical Error DetectionCombining GCN and Transformer for Chinese Grammatical Error Detection
This paper describes our system at NLPTEA-2020 Task: Chinese Grammatical Error Diagnosis (CGED). The goal of CGED is to diagnose four types of grammatical errors: word selection (S), redundant words (R), missing words (M…
Grammatical Error DetectionGraph Neural NetworkNeural Network Translation Models for Grammatical Error Correction
Phrase-based statistical machine translation (SMT) systems have previously been used for the task of grammatical error correction (GEC) to achieve state-of-the-art accuracy. The superiority of SMT systems comes from thei…
Grammatical Error CorrectionMachine TranslationSentenceTranslation