paper-with-me

홈 › Papers

A Simple and Robust Approach to Detecting Subject-Verb Agreement Errors

2019-06-01 · NAACL 2019 6 · Simon Flachs, Oph{\'e}lie Lacroix, Marek Rei, Helen Yannakoudakis, Anders S{\o}gaard

While rule-based detection of subject-verb agreement (SVA) errors is sensitive to syntactic parsing errors and irregularities and exceptions to the main rules, neural sequential labelers have a tendency to overfit their training data. We observe that rule-based error generation is less sensitive to syntactic parsing errors and irregularities than error detection and explore a simple, yet efficient approach to getting the best of both worlds: We train neural sequential labelers on the combination of large volumes of silver standard data, obtained through rule-based error generation, and gold standard data. We show that our simple protocol leads to more robust detection of SVA errors on both in-domain and out-of-domain data, as well as in the context of other errors and long-distance dependencies; and across four standard benchmarks, the induced model on average achieves a new state of the art.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Light Rule-based Approach to English Subject-Verb Agreement Errors on the Third Person Singular Forms

2015-10-01 · PACLIC 2015 10 · Yuzhu Wang, Hai Zhao
Grammatical Error Detection

Influence Paths for Characterizing Subject-Verb Number Agreement in LSTM Language Models

2020-05-03 · ACL 2020 6 · Kaiji Lu, Piotr Mardziel, Klas Leino, Matt Fedrikson 외

LSTM-based recurrent neural networks are the state-of-the-art for many natural language processing (NLP) tasks. Despite their performance, it is unclear whether, or how, LSTMs learn structural features of natural languag…

DiagnosticLanguage Modelling

Subject Verb Agreement Error Patterns in Meaningless Sentences: Humans vs. BERT

2022-09-21 · COLING 2022 10 · Karim Lasri, Olga Seminck, Alessandro Lenci, Thierry Poibeau

Both humans and neural language models are able to perform subject-verb number agreement (SVA). In principle, semantics shouldn't interfere with this task, which only requires syntactic knowledge. In this work we test wh…

Probing for targeted syntactic knowledge through grammatical error detection

2022-10-28 · Christopher Davis, Christopher Bryant, Andrew Caines, Marek Rei 외

Targeted studies testing knowledge of subject-verb agreement (SVA) indicate that pre-trained language models encode syntactic information. We assert that if models robustly encode subject-verb agreement, they should be a…

DiagnosticGrammatical Error Detection

Are Transformers a Modern Version of ELIZA? Observations on French Object Verb Agreement

2021-09-21 · EMNLP 2021 11 · Bingzhi Li, Guillaume Wisniewski, Benoit Crabbé

Many recent works have demonstrated that unsupervised sentence representations of neural networks encode syntactic information by observing that neural language models are able to predict the agreement between a verb and…

Sentence