A Simple and Robust Approach to Detecting Subject-Verb Agreement Errors
While rule-based detection of subject-verb agreement (SVA) errors is sensitive to syntactic parsing errors and irregularities and exceptions to the main rules, neural sequential labelers have a tendency to overfit their training data. We observe that rule-based error generation is less sensitive to syntactic parsing errors and irregularities than error detection and explore a simple, yet efficient approach to getting the best of both worlds: We train neural sequential labelers on the combination of large volumes of silver standard data, obtained through rule-based error generation, and gold standard data. We show that our simple protocol leads to more robust detection of SVA errors on both in-domain and out-of-domain data, as well as in the context of other errors and long-distance dependencies; and across four standard benchmarks, the induced model on average achieves a new state of the art.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Light Rule-based Approach to English Subject-Verb Agreement Errors on the Third Person Singular Forms
Influence Paths for Characterizing Subject-Verb Number Agreement in LSTM Language Models
LSTM-based recurrent neural networks are the state-of-the-art for many natural language processing (NLP) tasks. Despite their performance, it is unclear whether, or how, LSTMs learn structural features of natural languag…
DiagnosticLanguage ModellingSubject Verb Agreement Error Patterns in Meaningless Sentences: Humans vs. BERT
Both humans and neural language models are able to perform subject-verb number agreement (SVA). In principle, semantics shouldn't interfere with this task, which only requires syntactic knowledge. In this work we test wh…
Probing for targeted syntactic knowledge through grammatical error detection
Targeted studies testing knowledge of subject-verb agreement (SVA) indicate that pre-trained language models encode syntactic information. We assert that if models robustly encode subject-verb agreement, they should be a…
DiagnosticGrammatical Error DetectionAre Transformers a Modern Version of ELIZA? Observations on French Object Verb Agreement
Many recent works have demonstrated that unsupervised sentence representations of neural networks encode syntactic information by observing that neural language models are able to predict the agreement between a verb and…
Sentence